-- Logs begin at Tue 2022-10-18 12:30:12 UTC, end at Tue 2022-10-18 15:16:31 UTC. -- Oct 18 13:02:51.753219 n-d-858383-13 systemd[1]: Starting Devstack devstack@keystone.service... Oct 18 13:02:51.761894 n-d-858383-13 devstack@keystone.service[82151]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 13:02:51 2022] *** Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: nodename: n-d-858383-13 Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: machine: x86_64 Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: clock source: unix Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: pcre jit disabled Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: detected number of CPU cores: 4 Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: current working directory: / Oct 18 13:02:51.763893 n-d-858383-13 devstack@keystone.service[82151]: detected binary path: /usr/bin/uwsgi-core Oct 18 13:02:51.764429 n-d-858383-13 devstack@keystone.service[82151]: your processes number limit is 47680 Oct 18 13:02:51.764429 n-d-858383-13 devstack@keystone.service[82151]: your memory page size is 4096 bytes Oct 18 13:02:51.764429 n-d-858383-13 devstack@keystone.service[82151]: detected max file descriptor number: 2048 Oct 18 13:02:51.764429 n-d-858383-13 devstack@keystone.service[82151]: lock engine: pthread robust mutexes Oct 18 13:02:51.764429 n-d-858383-13 devstack@keystone.service[82151]: thunder lock: enabled Oct 18 13:02:51.764429 n-d-858383-13 devstack@keystone.service[82151]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 18 13:02:51.764429 n-d-858383-13 devstack@keystone.service[82151]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 13:02:51.803687 n-d-858383-13 devstack@keystone.service[82151]: Python main interpreter initialized at 0x5611ff8bd9c0 Oct 18 13:02:51.803687 n-d-858383-13 devstack@keystone.service[82151]: python threads support enabled Oct 18 13:02:51.803687 n-d-858383-13 devstack@keystone.service[82151]: your server socket listen backlog is limited to 100 connections Oct 18 13:02:51.803687 n-d-858383-13 devstack@keystone.service[82151]: your mercy for graceful operations on workers is 90 seconds Oct 18 13:02:51.804009 n-d-858383-13 devstack@keystone.service[82151]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 13:02:51.804107 n-d-858383-13 devstack@keystone.service[82151]: *** Operational MODE: preforking *** Oct 18 13:02:51.804373 n-d-858383-13 devstack@keystone.service[82151]: *** uWSGI is running in multiple interpreter mode *** Oct 18 13:02:51.804373 n-d-858383-13 devstack@keystone.service[82151]: spawned uWSGI master process (pid: 82151) Oct 18 13:02:51.804563 n-d-858383-13 systemd[1]: Started Devstack devstack@keystone.service. Oct 18 13:02:51.806100 n-d-858383-13 devstack@keystone.service[82151]: spawned uWSGI worker 1 (pid: 82160, cores: 1) Oct 18 13:02:51.806100 n-d-858383-13 devstack@keystone.service[82151]: spawned uWSGI worker 2 (pid: 82161, cores: 1) Oct 18 13:02:51.806100 n-d-858383-13 devstack@keystone.service[82151]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 13:02:56.152974 n-d-858383-13 devstack@keystone.service[82161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:02:56.152974 n-d-858383-13 devstack@keystone.service[82161]: from cryptography.utils import int_from_bytes Oct 18 13:02:56.154294 n-d-858383-13 devstack@keystone.service[82161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:02:56.154294 n-d-858383-13 devstack@keystone.service[82161]: from cryptography.utils import int_from_bytes Oct 18 13:02:56.157502 n-d-858383-13 devstack@keystone.service[82160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:02:56.157502 n-d-858383-13 devstack@keystone.service[82160]: from cryptography.utils import int_from_bytes Oct 18 13:02:56.157974 n-d-858383-13 devstack@keystone.service[82160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:02:56.157974 n-d-858383-13 devstack@keystone.service[82160]: from cryptography.utils import int_from_bytes Oct 18 13:02:56.217142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:02:56.217351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:02:56.217524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] command line args: [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:02:56.217799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:02:56.217980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ================================================================================ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:02:56.218240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:02:56.218337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] admin_token = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.218600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:02:56.218684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_dir = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.218843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.218961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] command line args: [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:02:56.219041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] config_source = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.219200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] debug = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.219402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.219704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:02:56.219811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.219906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ================================================================================ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:02:56.220011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] admin_token = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] config_dir = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] config_source = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] debug = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.220953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_config_append = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_dir = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.221913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_config_append = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_dir = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.222948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.223980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.224984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.225066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.225233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.225467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.225544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.225657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] publish_errors = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.225780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.225899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.226937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] standard_threads = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] publish_errors = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.227952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_journal = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_json = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_stderr = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] use_syslog = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] standard_threads = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.228967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.229078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.229188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.229298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.229413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.229413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_journal = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.229635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.229746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_json = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.229862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.229973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_stderr = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.229973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] use_syslog = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.230213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.230326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:02:56.230442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.230552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.230662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.230771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.230959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.231909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.232909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.233977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.234965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.235076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.235212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.235333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.235493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.235612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.235732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.235954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.236067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.236205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.236385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.236500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.236686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.236804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.236915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.237128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.237247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.237439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.237563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.237680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.237837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.237948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.238885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.239920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.240986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.241098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.241322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.241448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.241561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.241780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.241902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.242015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.242262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.242387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.242501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.242720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.242842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.242956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.243166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.243283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.243394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.243625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.243749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.243881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.244086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.244212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.244326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.244545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.244659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.244772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.245004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.245120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.245270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.245507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.245628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.245746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.245866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.246890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.247978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.248113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.248282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.248454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.248628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.248803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.248946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.249127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.249292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.249458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.249623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.249761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.249928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.250213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.250388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.250529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.250703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.250870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.251035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.251181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.251348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.251521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.251694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.251862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.252038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.252215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.252392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.252557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.252699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.252910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.253901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.254981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.255921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.external = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.256944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.password = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] auth.token = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.257958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.258981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.259907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.external = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.260953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.password = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] auth.token = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.261975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.262203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.262316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.262316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.262538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.263966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.264989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.265980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.266705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.267797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.268797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.269840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.270076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.270195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.270308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.270453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.270649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.270778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.270893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.271909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.272999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.273911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.274967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.275900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.276964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.277998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.278172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.278867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.278990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.279915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.280940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.281968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.282996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.283912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.284842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.285930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.286008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.286226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.286406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.286484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.286697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.286860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.286936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.287177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.287254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.287466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.287543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.287714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.287791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.287948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.288933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.289978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.290169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.290395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.290473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.290648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.290843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.290920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.291116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.291298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.291375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.291593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.291758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.291834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.292068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.292211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.292485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.292670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.292747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.292958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.293153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.293231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.293437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.293632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.293709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.293926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.294213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.294294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.294463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.294698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.294774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.294927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.295978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.296951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.297911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.298927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.299886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.300870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.301851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.302982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.303966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.304923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.305950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:02:56.306038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.306280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.306516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.306773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.307032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.307283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.307523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.307766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.307999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.308237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.308477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.308728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.308967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.309226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.309492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.309737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.310160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.310600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.311028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.311477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.311741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.311986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.312241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.312531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.312770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.313019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.313293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.313560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.313805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.314073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.314329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.314766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.315204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.315658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.316113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.316566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.317022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.317483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.317960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.318462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.318943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.319402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.319755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.319996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.320246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.320489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:02:56.320664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:02:56.336070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.336300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.336527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.345608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.350343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.350577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.350803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.359195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.374237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.374465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.380917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.381150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.429974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.433342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.481206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.481464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.489776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.490013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.637357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.637666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.638370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.638593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.638795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.638880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.639010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.639090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.639243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.639464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.639680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.639895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.661567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.661792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.662968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.663102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.663315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.663528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.673920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.674258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.686891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.687939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.688018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.688153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82161) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.688231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.688368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 13:02:56.705226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.705428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 13:02:56.705766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.705902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.705997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 13:02:56.706144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 13:02:56.706255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.706488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.706566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.706689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 13:02:56.706780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.706966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.707052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.707230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.707493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.707806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.716541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.716816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.717087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.717373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.717497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.717780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.718070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.718358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.727644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.727759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.727845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.727845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.728055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.728331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.728612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.728691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.728875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.728943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.729144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.729211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.729415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.729491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.729684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.729752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.729953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.730021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.730242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.730321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.730540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.730815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.731091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.731402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.753469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.754992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.755275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.760010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.760296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.760579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.761832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.763940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.764226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.767637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.767916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.768790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.769151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.769778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.773642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.773938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.774247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.774530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.774801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.775073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.775344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.775611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.782188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.782656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.786757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.787052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.787338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.787620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.789713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.790009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.790328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.790615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.791014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.791292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.795146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.798353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.798647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.802813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.805870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.806236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.806521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.809055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.809352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.810189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.810476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.810750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.810936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.811025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.814035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.814355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.818705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.821826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.825107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.825955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.826270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.826671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.826958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.827148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.827244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.827437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.827703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.827970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.834740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.836247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.837740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.838021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.840784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.841068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.841349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.841641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.842212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.843092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.843379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.843646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.843908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.851015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.852672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.853434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.853721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.854005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.854233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.854317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.854511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.854674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.854954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.855242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.857216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.857504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.857785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.858093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.858371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.869650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.869940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.870316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.870602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.870682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.870886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.871165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.871443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.874090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.876946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.878514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.879969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.880252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.880650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.887076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.887518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.889114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.891133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.892010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.892403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.892689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.892968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.894030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.895488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.896970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.897258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.897553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.900764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.901053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.901332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.904193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.905662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.908289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82161) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.908574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.908690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.908854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.908935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.909128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.909211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.909400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.909484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.909669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.909949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.910249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.910517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.910798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.911084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.911343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.911605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.911871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82161) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.917379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.917673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.917957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.925436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 13:02:56.925725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.926008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.926312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.926587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.926864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.927139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.927420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.927700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.927971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.928260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.928523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.928796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.929070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 13:02:56.946847 n-d-858383-13 devstack@keystone.service[82161]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5611ff8bd9c0 pid: 82161 (default app) Oct 18 13:02:56.950021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904bf5f-b222-4aff-9324-39a7fce79c01 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:02:56.950352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904bf5f-b222-4aff-9324-39a7fce79c01 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:02:56.950624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904bf5f-b222-4aff-9324-39a7fce79c01 None None] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:02:56.954721 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Tue Oct 18 13:02:56 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:02:56.963511 n-d-858383-13 devstack@keystone.service[82160]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5611ff8bd9c0 pid: 82160 (default app) Oct 18 13:03:04.399503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b89bb-b8a1-4680-a15d-0749dc7ffea4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:04.400057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b89bb-b8a1-4680-a15d-0749dc7ffea4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:04.400057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b89bb-b8a1-4680-a15d-0749dc7ffea4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:04.401353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:03:04.409192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:04.409644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:04.409796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:04.481080 n-d-858383-13 devstack@keystone.service[82160]: INFO dbcounter [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] Registered counter for database keystone Oct 18 13:03:04.501361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG oslo_db.sqlalchemy.engines [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:03:04.507721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writer thread running {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:03:04.687378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG passlib.handlers.bcrypt [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82160) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 13:03:04.687711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG passlib.handlers.bcrypt [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82160) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 13:03:04.744802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:04.746438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:04.879783 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 13:03:05.346930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b89bb-b8a1-4680-a15d-0749dc7ffea4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:05.415773 n-d-858383-13 devstack@keystone.service[82161]: INFO dbcounter [None req-0e6b89bb-b8a1-4680-a15d-0749dc7ffea4 None None] Registered counter for database keystone Oct 18 13:03:05.436745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG oslo_db.sqlalchemy.engines [None req-0e6b89bb-b8a1-4680-a15d-0749dc7ffea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:03:05.442949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writer thread running {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:03:05.563740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b89bb-b8a1-4680-a15d-0749dc7ffea4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:05.568049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385c1a9-9143-43d5-9561-95cee970182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:05.568679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c1a9-9143-43d5-9561-95cee970182a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:05.568963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c1a9-9143-43d5-9561-95cee970182a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:05.569240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385c1a9-9143-43d5-9561-95cee970182a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:05.577879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385c1a9-9143-43d5-9561-95cee970182a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:05.630209 n-d-858383-13 devstack@keystone.service[82161]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4385c1a9-9143-43d5-9561-95cee970182a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 13:03:05.630558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385c1a9-9143-43d5-9561-95cee970182a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:05.640273 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Oct 18 13:03:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:03:05.646221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:05.660862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202135d-e92b-4d30-bf7f-03765fba48b6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:05.665274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f050a40-c3bc-4d2b-afbd-ea83546dd0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:05.666441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050a40-c3bc-4d2b-afbd-ea83546dd0ff admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:05.666731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050a40-c3bc-4d2b-afbd-ea83546dd0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:05.667009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050a40-c3bc-4d2b-afbd-ea83546dd0ff admin admin] PATH_INFO: `/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:05.668484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f050a40-c3bc-4d2b-afbd-ea83546dd0ff admin admin] RBAC: Authorizing `identity:get_project(project_id=5197f824fa2b4aa1886cdd12c796a5bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:05.722581 n-d-858383-13 devstack@keystone.service[82160]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f050a40-c3bc-4d2b-afbd-ea83546dd0ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 13:03:05.722933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f050a40-c3bc-4d2b-afbd-ea83546dd0ff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:05.727714 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2/5] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Oct 18 13:03:05 2022] GET /identity/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:07.831162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ab6b1-a507-453c-8bfb-f7ac31058f0b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:07.831646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ab6b1-a507-453c-8bfb-f7ac31058f0b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:07.831646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ab6b1-a507-453c-8bfb-f7ac31058f0b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:07.835640 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4/6] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:07.840939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b065562-e428-422b-bb53-e932b9016167 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:07.841298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b065562-e428-422b-bb53-e932b9016167 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:07.841496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b065562-e428-422b-bb53-e932b9016167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:07.861689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b065562-e428-422b-bb53-e932b9016167 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:07.863248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b065562-e428-422b-bb53-e932b9016167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:07.870991 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 13:03:08.140800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ab6b1-a507-453c-8bfb-f7ac31058f0b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:08.152651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ab6b1-a507-453c-8bfb-f7ac31058f0b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:08.156815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cdee8-d0ff-428e-8494-12c713e57329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:08.157406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cdee8-d0ff-428e-8494-12c713e57329 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:08.157686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cdee8-d0ff-428e-8494-12c713e57329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:08.157959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cdee8-d0ff-428e-8494-12c713e57329 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:08.165399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cdee8-d0ff-428e-8494-12c713e57329 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:08.167182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cdee8-d0ff-428e-8494-12c713e57329 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:08.176190 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Oct 18 13:03:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:03:08.181269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b065562-e428-422b-bb53-e932b9016167 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:08.190861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b065562-e428-422b-bb53-e932b9016167 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:08.195182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65072a-9bf1-4e8c-b15a-d43e6de4fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:08.195812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65072a-9bf1-4e8c-b15a-d43e6de4fd49 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:08.196094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65072a-9bf1-4e8c-b15a-d43e6de4fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:08.196371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65072a-9bf1-4e8c-b15a-d43e6de4fd49 admin admin] PATH_INFO: `/v3/users/046cf75832784d19837da245ab0a0009` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:08.197677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65072a-9bf1-4e8c-b15a-d43e6de4fd49 admin admin] RBAC: Authorizing `identity:get_user(user_id=046cf75832784d19837da245ab0a0009)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:08.199541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65072a-9bf1-4e8c-b15a-d43e6de4fd49 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:08.201041 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4/9] 10.222.0.27 () {56 vars in 1198 bytes} [Tue Oct 18 13:03:08 2022] GET /identity/v3/users/046cf75832784d19837da245ab0a0009 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:10.374780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b6577-e93d-43e0-84d7-33b4b3a33278 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:10.375296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b6577-e93d-43e0-84d7-33b4b3a33278 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:10.375375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b6577-e93d-43e0-84d7-33b4b3a33278 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:10.376648 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:03:10.381776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195fbc2-6c81-4c11-ad09-ff929cd3657e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:10.382222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195fbc2-6c81-4c11-ad09-ff929cd3657e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:10.382369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195fbc2-6c81-4c11-ad09-ff929cd3657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:10.400225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1195fbc2-6c81-4c11-ad09-ff929cd3657e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:10.401399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1195fbc2-6c81-4c11-ad09-ff929cd3657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:10.443805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679cd1e-cc18-427e-ac36-7958c43c88fe None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:10.444098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679cd1e-cc18-427e-ac36-7958c43c88fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:10.445187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679cd1e-cc18-427e-ac36-7958c43c88fe None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:10.446574 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 7/11] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:03:10.452213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:10.452501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:10.453454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:10.482474 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 5/12] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:10.496033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG passlib.handlers.bcrypt [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82161) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 13:03:10.496430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG passlib.handlers.bcrypt [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82161) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 13:03:10.545627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:10.547227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:10.645519 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:10.748565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195fbc2-6c81-4c11-ad09-ff929cd3657e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:10.771346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:10.862633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195fbc2-6c81-4c11-ad09-ff929cd3657e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:10.895776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:10.896350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:10.896628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:10.896898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:10.908447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:10.916819 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:10.917645 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:10.919366 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 6/14] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:10.924296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:10.927893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:11.008106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:11.024301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1a183-a0f2-4e83-85c1-a632b7ecd773 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:11.025425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a74f-ad06-452c-8933-b45106b35172 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:11.026613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:11.061040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:11.061393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:11.061648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:11.061936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:11.062237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:11.062325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:11.062564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:11.062837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:11.062917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:11.063695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:11.064002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:11.064295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:11.065413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:11.077684 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 9/15] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:11.083192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:11.103611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.sql.core [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 13:03:11.103611 n-d-858383-13 devstack@keystone.service[82160]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:03:11.103611 n-d-858383-13 devstack@keystone.service[82160]: [parameters: {'id': 'a189253ea47241a2880a5c282c89c9c8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 13:03:11.103611 n-d-858383-13 devstack@keystone.service[82160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:03:11.121323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 13:03:11.122270 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:03:11.123148 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:03:11.123961 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:03:11.124772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:03:11.125486 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [parameters: {'id': 'a189253ea47241a2880a5c282c89c9c8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 13:03:11.126323 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:11.127007 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.127791 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 7/16] 10.222.0.27 () {60 vars in 1137 bytes} [Tue Oct 18 13:03:10 2022] POST /identity/v3/domains => generated 190 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:11.128631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:11.190034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df70c-0406-42f1-b7e7-2e78378fed21 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:11.224597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:11.225446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:11.225722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:11.225994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] PATH_INFO: `/v3/users/046cf75832784d19837da245ab0a0009` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:11.227499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] RBAC: Authorizing `identity:get_user(user_id=046cf75832784d19837da245ab0a0009)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:11.229065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:11.229383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb790ce-0098-4529-8b2a-acebb1ada8eb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:11.230861 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 10/17] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:11 2022] GET /identity/v3/users/046cf75832784d19837da245ab0a0009 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:11.236085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:11.264385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:11.265030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:11.265312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:11.265597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:11.273331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:11.277802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:11.280008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:11.287726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:03:11.298538 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:11.299449 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:03:11.300286 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:03:11.300286 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:03:11.300286 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:11.304633 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 8/18] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:11.306156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:11.356732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df245-8c0a-4259-856d-1935bb57026a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:11.398654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:11.399396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:11.399583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:11.399861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:11.401007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:11.402506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:11.404684 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 11/19] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:11.410577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:11.416859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752b067-0cff-4c53-a99f-4fefdabb84f9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:11.452432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c907817-6e82-4e9f-9527-947fefbd4d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:11.453189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907817-6e82-4e9f-9527-947fefbd4d98 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:11.453278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907817-6e82-4e9f-9527-947fefbd4d98 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:11.453502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907817-6e82-4e9f-9527-947fefbd4d98 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:11.454185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c907817-6e82-4e9f-9527-947fefbd4d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:11.454494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c907817-6e82-4e9f-9527-947fefbd4d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:11.455899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c907817-6e82-4e9f-9527-947fefbd4d98 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:11.478092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 9/20] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:11.522534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5db97-d214-4b59-98e2-8ac806de381a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:11.524220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:11.565645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f323f-9155-45f7-9bff-18e0ed66fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:11.566689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f323f-9155-45f7-9bff-18e0ed66fc38 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:11.566975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f323f-9155-45f7-9bff-18e0ed66fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:11.567258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f323f-9155-45f7-9bff-18e0ed66fc38 None admin] PATH_INFO: `/v3/domains/default/users/046cf75832784d19837da245ab0a0009/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:11.569457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f323f-9155-45f7-9bff-18e0ed66fc38 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=046cf75832784d19837da245ab0a0009, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:11.570979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f323f-9155-45f7-9bff-18e0ed66fc38 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:11.723592 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 12/21] 10.222.0.27 () {58 vars in 1361 bytes} [Tue Oct 18 13:03:11 2022] PUT /identity/v3/domains/default/users/046cf75832784d19837da245ab0a0009/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:14.060813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa4fd2-555a-42c5-acc1-8b19653000b9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.061376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa4fd2-555a-42c5-acc1-8b19653000b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.061376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa4fd2-555a-42c5-acc1-8b19653000b9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.063050 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 10/22] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:14.069090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8590-0265-4fdd-b6d4-e38069f6c3e1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.069603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8590-0265-4fdd-b6d4-e38069f6c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.069681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf8590-0265-4fdd-b6d4-e38069f6c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.089870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2bcf8590-0265-4fdd-b6d4-e38069f6c3e1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:14.091460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bcf8590-0265-4fdd-b6d4-e38069f6c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:14.161150 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 13/23] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:14.485415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df3f31-4914-4ab2-a3be-e9d213b151e3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.485693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df3f31-4914-4ab2-a3be-e9d213b151e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.486240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df3f31-4914-4ab2-a3be-e9d213b151e3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.488040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 11/24] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:14.493395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe3bf2-20ec-4944-b5f8-f95a531c4e85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.493908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe3bf2-20ec-4944-b5f8-f95a531c4e85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.494417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe3bf2-20ec-4944-b5f8-f95a531c4e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.513357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3dbe3bf2-20ec-4944-b5f8-f95a531c4e85 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:14.514884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3dbe3bf2-20ec-4944-b5f8-f95a531c4e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:14.567473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df3f31-4914-4ab2-a3be-e9d213b151e3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:14.585450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:14.590140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c409671-23ec-42ee-bd8d-147c8007c306 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.590140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c409671-23ec-42ee-bd8d-147c8007c306 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.590140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c409671-23ec-42ee-bd8d-147c8007c306 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.592653 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 15/26] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:14.600394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1d73-8cf0-4eb8-8724-deead3ca2228 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.600394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1d73-8cf0-4eb8-8724-deead3ca2228 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.600394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e1d73-8cf0-4eb8-8724-deead3ca2228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.637885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a92e1d73-8cf0-4eb8-8724-deead3ca2228 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:14.646089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a92e1d73-8cf0-4eb8-8724-deead3ca2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:14.693432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:14.726477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:14.775692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df3f31-4914-4ab2-a3be-e9d213b151e3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:14.811289 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 16/27] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:14.812324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28c46-8926-46f5-97ed-546658f81965 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.812611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28c46-8926-46f5-97ed-546658f81965 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.813022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28c46-8926-46f5-97ed-546658f81965 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.814290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 17/28] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:14.820017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f168-4f1b-487e-a9b5-389a35ec8ab5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.820306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f168-4f1b-487e-a9b5-389a35ec8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.820584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978f168-4f1b-487e-a9b5-389a35ec8ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.845270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:14.846117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:14.846408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:14.846683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:14.847425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:14.849144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:14.851055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b978f168-4f1b-487e-a9b5-389a35ec8ab5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:14.852248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b978f168-4f1b-487e-a9b5-389a35ec8ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:14.955197 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 18/29] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:14.964361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f168-4f1b-487e-a9b5-389a35ec8ab5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.110004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:15.122048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978f168-4f1b-487e-a9b5-389a35ec8ab5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:15.151305 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 12/30] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Oct 18 13:03:14 2022] POST /identity/v3/roles => generated 219 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:15.153001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.168009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:15.168789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.169141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.169487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.171437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:15.173091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:15.286546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 19/31] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Oct 18 13:03:14 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:03:15.354386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd45e-565c-4528-bc84-8dbc923f0cbb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:15.357141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.378119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:15.405587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:15.407689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.407689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.407689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.428640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:15.433760 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:15.435440 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:15.436210 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:15.443557 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 13/32] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:15.457961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.535317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbb59-3631-4ad7-8027-14978b6018be None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:15.597049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e61e8f-218f-4ef3-b677-dbc71aa5e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:15.597706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e61e8f-218f-4ef3-b677-dbc71aa5e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.598021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e61e8f-218f-4ef3-b677-dbc71aa5e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.599169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e61e8f-218f-4ef3-b677-dbc71aa5e9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.623321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e61e8f-218f-4ef3-b677-dbc71aa5e9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:15.624815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e61e8f-218f-4ef3-b677-dbc71aa5e9a4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:15.626853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:15.644588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b45cf5-06b7-463f-845c-b90e64027ce1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-89e61e8f-218f-4ef3-b677-dbc71aa5e9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:03:15.650860 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:15.651754 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:03:15.652540 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:03:15.652540 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:03:15.652540 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:15.652540 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 20/33] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:15.656393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006609-12db-44f5-8f31-d2a350a1ec8f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.656687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006609-12db-44f5-8f31-d2a350a1ec8f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.657155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006609-12db-44f5-8f31-d2a350a1ec8f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.658316 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 21/34] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:15.659989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006609-12db-44f5-8f31-d2a350a1ec8f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.681469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c4a38-f102-4bf2-a4b1-b24f66953d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:15.682123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4a38-f102-4bf2-a4b1-b24f66953d99 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.682411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4a38-f102-4bf2-a4b1-b24f66953d99 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.682687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4a38-f102-4bf2-a4b1-b24f66953d99 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.683660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4a38-f102-4bf2-a4b1-b24f66953d99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:15.683660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4a38-f102-4bf2-a4b1-b24f66953d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:15.685814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4a38-f102-4bf2-a4b1-b24f66953d99 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:15.699808 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 14/35] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:15.700926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0588-c2d0-47bf-b4f9-1d50dcf23488 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.701215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0588-c2d0-47bf-b4f9-1d50dcf23488 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.701487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0588-c2d0-47bf-b4f9-1d50dcf23488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.720593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1dcc0588-c2d0-47bf-b4f9-1d50dcf23488 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:15.722236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1dcc0588-c2d0-47bf-b4f9-1d50dcf23488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:15.758262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:15.778954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006609-12db-44f5-8f31-d2a350a1ec8f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:15.798087 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 15/36] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:15.798087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0588-c2d0-47bf-b4f9-1d50dcf23488 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.831103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:15.831726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.832012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.832291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.833364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:15.833673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:15.835462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:15.858454 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 22/37] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:15.864683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.899026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0588-c2d0-47bf-b4f9-1d50dcf23488 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:15.922595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:15.936090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:15.937132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:15.937821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:15.938341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] PATH_INFO: `/v3/users/046cf75832784d19837da245ab0a0009` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:15.939912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] RBAC: Authorizing `identity:get_user(user_id=046cf75832784d19837da245ab0a0009)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:15.941751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:15.943875 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 16/38] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:15 2022] GET /identity/v3/users/046cf75832784d19837da245ab0a0009 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:15.956212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:15.977258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd30807-de26-495a-b693-f4e50d5907b2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:16.008076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:16.021403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:16.022768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.023201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.023914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.024725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:16.027053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:16.072931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea79a0-d589-46e7-9179-02ee226d6bca None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:16.107918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c364d-f436-45ee-b176-6fad50e10e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:16.108622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c364d-f436-45ee-b176-6fad50e10e24 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.108901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c364d-f436-45ee-b176-6fad50e10e24 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.109174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c364d-f436-45ee-b176-6fad50e10e24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.110310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c364d-f436-45ee-b176-6fad50e10e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:16.111764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c364d-f436-45ee-b176-6fad50e10e24 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:16.113295 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 17/39] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:16.114444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489ece-529b-4452-b925-d6889de7decf None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.114727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489ece-529b-4452-b925-d6889de7decf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.115000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489ece-529b-4452-b925-d6889de7decf None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.116168 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 18/40] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:16.116851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23489ece-529b-4452-b925-d6889de7decf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:16.144802 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 23/41] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:03:15 2022] POST /identity/v3/projects => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:03:16.145643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:16.229774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23489ece-529b-4452-b925-d6889de7decf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:16.238423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:16.268720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156122be-efe9-4439-a42c-cdf5e55c3957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:16.269757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156122be-efe9-4439-a42c-cdf5e55c3957 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.270304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156122be-efe9-4439-a42c-cdf5e55c3957 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.270768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156122be-efe9-4439-a42c-cdf5e55c3957 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.272386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156122be-efe9-4439-a42c-cdf5e55c3957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:16.273600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ab27-29a4-49b2-9eef-5488cb0c7ac0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:16.273881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156122be-efe9-4439-a42c-cdf5e55c3957 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:16.275754 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 19/42] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:16.282096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5fbd5-fb8b-4d92-96cf-c90cb17e2021 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.282394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5fbd5-fb8b-4d92-96cf-c90cb17e2021 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.282675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5fbd5-fb8b-4d92-96cf-c90cb17e2021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.283848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:16.301875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-beb5fbd5-fb8b-4d92-96cf-c90cb17e2021 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:16.303151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-beb5fbd5-fb8b-4d92-96cf-c90cb17e2021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:16.314281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:16.316084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.317014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.317301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.318203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.domain.id=default, user.id=046cf75832784d19837da245ab0a0009) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:16.318523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:16.320013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:16.338081 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 24/43] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Oct 18 13:03:16 2022] GET /identity/v3/role_assignments?user.id=046cf75832784d19837da245ab0a0009&scope.domain.id=default&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 530 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:16.338081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:16.386080 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 20/44] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:16.468904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4882a0-036a-4d94-a2c0-e1808bb0fd61 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:16.506135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2102f1-60cb-431f-9659-ff874a0d3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:16.506683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2102f1-60cb-431f-9659-ff874a0d3b81 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.506964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2102f1-60cb-431f-9659-ff874a0d3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.507246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2102f1-60cb-431f-9659-ff874a0d3b81 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.507900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2102f1-60cb-431f-9659-ff874a0d3b81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:16.509348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2102f1-60cb-431f-9659-ff874a0d3b81 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:16.602518 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 25/45] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:03:16 2022] POST /identity/v3/projects => generated 312 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:16.659253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5fbd5-fb8b-4d92-96cf-c90cb17e2021 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:16.865144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5fbd5-fb8b-4d92-96cf-c90cb17e2021 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:16.867439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:16.907501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d0d89-e249-4745-8f8e-bd7806bc5831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:16.908123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d0d89-e249-4745-8f8e-bd7806bc5831 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:16.908453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d0d89-e249-4745-8f8e-bd7806bc5831 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:16.908749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d0d89-e249-4745-8f8e-bd7806bc5831 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:16.909703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d0d89-e249-4745-8f8e-bd7806bc5831 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:16.911512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d0d89-e249-4745-8f8e-bd7806bc5831 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:16.960900 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 21/46] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Oct 18 13:03:16 2022] POST /identity/v3/roles => generated 223 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:18.772723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a62b-996b-4437-a5d5-2211c98ddad2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:18.773210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a62b-996b-4437-a5d5-2211c98ddad2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:18.773210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a62b-996b-4437-a5d5-2211c98ddad2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:18.774594 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 26/47] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:18.779817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d2a8-2dd6-4ca5-b623-68d2ba48080f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:18.780211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d2a8-2dd6-4ca5-b623-68d2ba48080f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:18.780369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d2a8-2dd6-4ca5-b623-68d2ba48080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:18.798504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9d69d2a8-2dd6-4ca5-b623-68d2ba48080f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:18.799674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d69d2a8-2dd6-4ca5-b623-68d2ba48080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:18.863392 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 22/48] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:19.132651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473a62b-996b-4437-a5d5-2211c98ddad2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:19.157153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:19.232283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473a62b-996b-4437-a5d5-2211c98ddad2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:19.264853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c6478-db5e-451b-b045-8c7216d98ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:19.265471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c6478-db5e-451b-b045-8c7216d98ca3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:19.265756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c6478-db5e-451b-b045-8c7216d98ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:19.266034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c6478-db5e-451b-b045-8c7216d98ca3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:19.267180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c6478-db5e-451b-b045-8c7216d98ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:19.268624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c6478-db5e-451b-b045-8c7216d98ca3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:19.270203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 27/49] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:19.275889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69d2a8-2dd6-4ca5-b623-68d2ba48080f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:19.366373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:19.372721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69d2a8-2dd6-4ca5-b623-68d2ba48080f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:19.406740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097581a6-c0fe-4ddc-8384-b6e7754065ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:19.407290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097581a6-c0fe-4ddc-8384-b6e7754065ee None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:19.407577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097581a6-c0fe-4ddc-8384-b6e7754065ee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:19.407857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097581a6-c0fe-4ddc-8384-b6e7754065ee None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:19.408515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097581a6-c0fe-4ddc-8384-b6e7754065ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:19.409971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097581a6-c0fe-4ddc-8384-b6e7754065ee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:19.464202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 23/50] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Oct 18 13:03:19 2022] POST /identity/v3/projects => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:03:21.578369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7918-363d-4dcf-855e-42b99447060f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:21.578874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7918-363d-4dcf-855e-42b99447060f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:21.578955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7918-363d-4dcf-855e-42b99447060f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:21.580252 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 28/51] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:21.585588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3162-d52b-4682-b8ea-2ab94fd8845b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:21.586002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3162-d52b-4682-b8ea-2ab94fd8845b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:21.586185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3162-d52b-4682-b8ea-2ab94fd8845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:21.604523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e49f3162-d52b-4682-b8ea-2ab94fd8845b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:21.605714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e49f3162-d52b-4682-b8ea-2ab94fd8845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:21.670460 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 24/52] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:21.940545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7918-363d-4dcf-855e-42b99447060f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:22.029588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:22.039505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7918-363d-4dcf-855e-42b99447060f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:22.072214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fafc05-e402-45fe-af27-9db08dc25045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:22.072835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafc05-e402-45fe-af27-9db08dc25045 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:22.073113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafc05-e402-45fe-af27-9db08dc25045 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:22.073383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fafc05-e402-45fe-af27-9db08dc25045 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:22.074505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fafc05-e402-45fe-af27-9db08dc25045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:22.075940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fafc05-e402-45fe-af27-9db08dc25045 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:22.078021 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 29/53] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:22.083528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3162-d52b-4682-b8ea-2ab94fd8845b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:22.156375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:22.177623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3162-d52b-4682-b8ea-2ab94fd8845b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:22.211198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676ae94-d658-45e3-bdc6-1f845266182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:22.211732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ae94-d658-45e3-bdc6-1f845266182a None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:22.212015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ae94-d658-45e3-bdc6-1f845266182a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:22.212295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676ae94-d658-45e3-bdc6-1f845266182a None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:22.212942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676ae94-d658-45e3-bdc6-1f845266182a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:22.214444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676ae94-d658-45e3-bdc6-1f845266182a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:22.291244 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 25/54] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:03:22 2022] POST /identity/v3/users => generated 275 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:25.567743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40d9a-7be7-48a2-96a1-07df5b6a6e46 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:25.568270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40d9a-7be7-48a2-96a1-07df5b6a6e46 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:25.568270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40d9a-7be7-48a2-96a1-07df5b6a6e46 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:25.569816 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 30/55] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:25.575227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6705a-6313-4ec9-8a60-105336f70dcf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:25.576028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6705a-6313-4ec9-8a60-105336f70dcf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:25.576999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6705a-6313-4ec9-8a60-105336f70dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:25.595646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544967-cbf0-4f90-9c27-a09fe519a2ff None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:25.596200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544967-cbf0-4f90-9c27-a09fe519a2ff None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:25.596671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5544967-cbf0-4f90-9c27-a09fe519a2ff None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:25.598445 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 31/56] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:25.599599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ea6705a-6313-4ec9-8a60-105336f70dcf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:25.600450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ea6705a-6313-4ec9-8a60-105336f70dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:25.607602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc7c0-1155-4e21-ae23-d9317d4cebf6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:25.608065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc7c0-1155-4e21-ae23-d9317d4cebf6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:25.608417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc7c0-1155-4e21-ae23-d9317d4cebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:25.640154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab0fc7c0-1155-4e21-ae23-d9317d4cebf6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:25.642534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab0fc7c0-1155-4e21-ae23-d9317d4cebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:25.729033 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 26/57] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:25.761208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 32/58] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:25.861551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4d3d5-4bb7-44a6-913f-99f1ee221ce5 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:25.862143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4d3d5-4bb7-44a6-913f-99f1ee221ce5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:25.862661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4d3d5-4bb7-44a6-913f-99f1ee221ce5 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:25.864467 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 27/59] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:25.869414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabfa68-968e-46f0-9a27-1d29ca3c9ecb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:25.869956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabfa68-968e-46f0-9a27-1d29ca3c9ecb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:25.870467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabfa68-968e-46f0-9a27-1d29ca3c9ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:25.898278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7dabfa68-968e-46f0-9a27-1d29ca3c9ecb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:25.899857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7dabfa68-968e-46f0-9a27-1d29ca3c9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:26.085716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 33/60] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:26.088114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4d3d5-4bb7-44a6-913f-99f1ee221ce5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.122911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcd631-6d24-4d7c-b0ad-b000babd5d5b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.124075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcd631-6d24-4d7c-b0ad-b000babd5d5b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.124551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcd631-6d24-4d7c-b0ad-b000babd5d5b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.126397 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 34/61] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:26.134381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa0274-359e-450d-8788-638125f70e63 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.134894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa0274-359e-450d-8788-638125f70e63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.135386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa0274-359e-450d-8788-638125f70e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.170693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.171528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-63aa0274-359e-450d-8788-638125f70e63 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:26.172904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63aa0274-359e-450d-8788-638125f70e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:26.187252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.215004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4d3d5-4bb7-44a6-913f-99f1ee221ce5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.254557 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 35/62] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 18 13:03:26.255722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa0274-359e-450d-8788-638125f70e63 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.265964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.269448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.269957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.272061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.292792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:26.301546 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:26.302426 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:26.303162 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:26.306116 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 28/63] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:26.315207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.404397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa0274-359e-450d-8788-638125f70e63 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.424614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8e19-908c-4cd9-9726-912c9450c013 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.440244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4dcd4-5aa4-454c-ac00-d94aee238ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.440880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4dcd4-5aa4-454c-ac00-d94aee238ffe None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.441162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4dcd4-5aa4-454c-ac00-d94aee238ffe None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.441440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4dcd4-5aa4-454c-ac00-d94aee238ffe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.453994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.455384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4dcd4-5aa4-454c-ac00-d94aee238ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9fd4dcd4-5aa4-454c-ac00-d94aee238ffe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:26.461770 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:26.462686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:26.463436 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 36/64] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:26.467172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0dee7-0bec-41f0-bb66-ba2a6eeafbe3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.467172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0dee7-0bec-41f0-bb66-ba2a6eeafbe3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.467172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0dee7-0bec-41f0-bb66-ba2a6eeafbe3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.467172 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 37/65] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:26.469715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0dee7-0bec-41f0-bb66-ba2a6eeafbe3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.475703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.476338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.476625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.476907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.477648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:26.477964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:26.479466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:26.483120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.492845 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 29/66] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:26.492845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.583270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0dee7-0bec-41f0-bb66-ba2a6eeafbe3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.587664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3bec3-4c01-4307-8a54-c0c5cf34f8b5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.617215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.617906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.618226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.618506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.622371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b23f8-7aef-4293-8bc9-1ecc15ec94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.623011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b23f8-7aef-4293-8bc9-1ecc15ec94a6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.623298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b23f8-7aef-4293-8bc9-1ecc15ec94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.623578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b23f8-7aef-4293-8bc9-1ecc15ec94a6 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.624249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b23f8-7aef-4293-8bc9-1ecc15ec94a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:26.624560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b23f8-7aef-4293-8bc9-1ecc15ec94a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:26.625951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b23f8-7aef-4293-8bc9-1ecc15ec94a6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:26.628792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:26.633579 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:26.634594 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:26.635559 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:26.636255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 30/67] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:26.636331 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 38/68] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:26.636413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f962b8-bcdc-4f75-a809-60df3bd885d9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.636413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f962b8-bcdc-4f75-a809-60df3bd885d9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.636413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f962b8-bcdc-4f75-a809-60df3bd885d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.636619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.657940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-19f962b8-bcdc-4f75-a809-60df3bd885d9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:26.659097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-19f962b8-bcdc-4f75-a809-60df3bd885d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:26.699691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.706453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.725109 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 31/69] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:26.725745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f962b8-bcdc-4f75-a809-60df3bd885d9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.742382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae0ab-852e-4779-be08-3f33ce624bd3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.778884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.780019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.780303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.780580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] PATH_INFO: `/v3/users/effd4496ae734b3eaec9441f0ab77050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.796215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] RBAC: Authorizing `identity:get_user(user_id=effd4496ae734b3eaec9441f0ab77050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:26.797671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:26.799348 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 39/70] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/users/effd4496ae734b3eaec9441f0ab77050 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:26.800126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.835771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f962b8-bcdc-4f75-a809-60df3bd885d9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.872161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.873099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.873603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.874036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.884429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:26.889777 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:26.890832 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:26.891585 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 32/71] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:26.892204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:26.911375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370838ca-c93b-4932-b585-5d06c620e473 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:26.930426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.940369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:26.956037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:26.957152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:26.957425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:26.957750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] PATH_INFO: `/v3/users/046cf75832784d19837da245ab0a0009` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:26.959213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] RBAC: Authorizing `identity:get_user(user_id=046cf75832784d19837da245ab0a0009)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:26.960689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:26.962328 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 40/72] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/users/046cf75832784d19837da245ab0a0009 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:26.967968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.011782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a3458-816e-4820-bfd9-7ae895896e91 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.047199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.047821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.048112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.048708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.049387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:27.049702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.051130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.058868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 33/73] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:27.059659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.072673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f294d36-fcaf-4c75-aae9-17c728882344 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.106608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.107456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.107771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.108079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.109210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.110689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.112312 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 41/74] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:26 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:27.113066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.157212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:27.160973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03819bcc-933a-4475-bd4a-ff76b45aa8f7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.172223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:27.193154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.193771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.194077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.194365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.195035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:27.195347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.196727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.205858 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 34/75] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:27.206574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.209965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5359d-575e-4e55-86ca-01ac3420c841 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.244185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.244823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.245109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.245390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.246898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.248506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.250153 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 42/76] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:27 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:27.250919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.305835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e871-c26d-478e-9c78-da2597200b27 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.338523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.339155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.339434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.339709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.340816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.342856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.344561 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 35/77] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:27.345138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.351881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8f5c-214e-4c3f-adc9-cd68785362aa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.372480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:27.379844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:27.385169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.385793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.386097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.386377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] PATH_INFO: `/v3/users/effd4496ae734b3eaec9441f0ab77050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.387519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] RBAC: Authorizing `identity:get_user(user_id=effd4496ae734b3eaec9441f0ab77050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.389009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.390622 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 43/78] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:27 2022] GET /identity/v3/users/effd4496ae734b3eaec9441f0ab77050 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:27.391375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.443691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008cde3-83e9-494d-b586-034422cbb0f3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.479270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.479935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.480214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.480490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/effd4496ae734b3eaec9441f0ab77050/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.482984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=3053b3aba2bb4c728ebaafe4553b0ef2, user_id=effd4496ae734b3eaec9441f0ab77050, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.484446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.490636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d23fe-fc3a-4e69-a8b7-b6357f700a34 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.522582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.523211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.523497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.523776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] PATH_INFO: `/v3/users/effd4496ae734b3eaec9441f0ab77050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.524908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] RBAC: Authorizing `identity:get_user(user_id=effd4496ae734b3eaec9441f0ab77050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.526383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.527953 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 44/79] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:27 2022] GET /identity/v3/users/effd4496ae734b3eaec9441f0ab77050 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:27.528690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.554493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 36/80] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:27 2022] PUT /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/effd4496ae734b3eaec9441f0ab77050/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:27.555299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.604496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:27.648620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881a9b-312b-4c71-ad34-5e3cda520151 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.659256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:27.671990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bba47f-f204-4dae-a853-9c292d805d94 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.688420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.689282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.689566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.689840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/046cf75832784d19837da245ab0a0009/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.692067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] RBAC: Authorizing `identity:create_grant(project_id=3053b3aba2bb4c728ebaafe4553b0ef2, user_id=046cf75832784d19837da245ab0a0009, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.693651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.710044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:27.710625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:27.710911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:27.711198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:27.711850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:27.713337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:27.812015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 45/81] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:27 2022] PUT /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/046cf75832784d19837da245ab0a0009/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:27.813029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.838288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 37/82] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:03:27 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:27.839485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:27.960577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8bce-f8e3-4c5b-817b-c96808c6e778 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:27.987257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c37cb-9924-4a90-8aa2-08a5b8a1ecf8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:28.009019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:28.026649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:28.028201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:28.029950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:28.030642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:28.033608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:28.038505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:28.040719 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 46/83] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:27 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:28.048060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:28.070202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:28.070891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:28.071177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:28.071458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] PATH_INFO: `/v3/projects/f9f27665a53a45aeba2138f152181fbc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:28.073567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f27665a53a45aeba2138f152181fbc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:28.075223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:28.079856 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 38/84] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:27 2022] GET /identity/v3/projects/f9f27665a53a45aeba2138f152181fbc => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:28.088556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:28.109314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:28.195752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab2ea8-e0c5-4521-934f-6df902aea6f9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:28.225690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd1a7e-28df-4428-a89c-fb2f66f5f783 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:28.236965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06fb67-0e9c-4a50-ad19-1cee480bea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:28.237646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06fb67-0e9c-4a50-ad19-1cee480bea6c None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:28.237936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06fb67-0e9c-4a50-ad19-1cee480bea6c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:28.238249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06fb67-0e9c-4a50-ad19-1cee480bea6c None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/effd4496ae734b3eaec9441f0ab77050/roles/8ff4721e72e84ea6a7943c7a0b88a5f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:28.240695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06fb67-0e9c-4a50-ad19-1cee480bea6c None admin] RBAC: Authorizing `identity:create_grant(project_id=3053b3aba2bb4c728ebaafe4553b0ef2, user_id=effd4496ae734b3eaec9441f0ab77050, role_id=8ff4721e72e84ea6a7943c7a0b88a5f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:28.242184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06fb67-0e9c-4a50-ad19-1cee480bea6c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:28.275179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59a2e1-c9d1-4a01-bcb5-a74476b92598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:28.275861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a2e1-c9d1-4a01-bcb5-a74476b92598 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:28.276149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a2e1-c9d1-4a01-bcb5-a74476b92598 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:28.276427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a2e1-c9d1-4a01-bcb5-a74476b92598 None admin] PATH_INFO: `/v3/projects/f9f27665a53a45aeba2138f152181fbc/users/effd4496ae734b3eaec9441f0ab77050/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:28.280701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59a2e1-c9d1-4a01-bcb5-a74476b92598 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9f27665a53a45aeba2138f152181fbc, user_id=effd4496ae734b3eaec9441f0ab77050, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:28.286855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59a2e1-c9d1-4a01-bcb5-a74476b92598 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:28.361917 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 47/85] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:28 2022] PUT /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/effd4496ae734b3eaec9441f0ab77050/roles/8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:28.373050 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 39/86] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:28 2022] PUT /identity/v3/projects/f9f27665a53a45aeba2138f152181fbc/users/effd4496ae734b3eaec9441f0ab77050/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:29.966865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df969-5557-4def-aa28-1358deb6ef5e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:29.967404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df969-5557-4def-aa28-1358deb6ef5e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:29.967404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df969-5557-4def-aa28-1358deb6ef5e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:29.968925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 48/87] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:29.974566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cc5b7-1bb9-4e28-906d-127a439b7af9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:29.974958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cc5b7-1bb9-4e28-906d-127a439b7af9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:29.975173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cc5b7-1bb9-4e28-906d-127a439b7af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:29.995483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b6cc5b7-1bb9-4e28-906d-127a439b7af9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:29.996774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b6cc5b7-1bb9-4e28-906d-127a439b7af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:30.086653 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 40/88] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:30.618395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80df969-5557-4def-aa28-1358deb6ef5e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:30.696614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:30.763403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80df969-5557-4def-aa28-1358deb6ef5e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:30.805664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa423b-a0c6-412d-9100-11d222bfa45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:30.806336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa423b-a0c6-412d-9100-11d222bfa45b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:30.806623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa423b-a0c6-412d-9100-11d222bfa45b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:30.806901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa423b-a0c6-412d-9100-11d222bfa45b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:30.824848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa423b-a0c6-412d-9100-11d222bfa45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-47aa423b-a0c6-412d-9100-11d222bfa45b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:30.830765 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:30.831615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:30.833494 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 49/89] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:30.837995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cc5b7-1bb9-4e28-906d-127a439b7af9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:30.840156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:30.962909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8783-ca3d-4356-9630-932d600b83a4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:30.963239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8783-ca3d-4356-9630-932d600b83a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:30.963474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8783-ca3d-4356-9630-932d600b83a4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:30.965072 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 50/90] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:30.970600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96123fc-6f46-470c-af58-bc454f667188 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:30.971129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96123fc-6f46-470c-af58-bc454f667188 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:30.971129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96123fc-6f46-470c-af58-bc454f667188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.021398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b96123fc-6f46-470c-af58-bc454f667188 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:31.022548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b96123fc-6f46-470c-af58-bc454f667188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:31.029412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cc5b7-1bb9-4e28-906d-127a439b7af9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:31.117341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:31.117973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.118385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.118671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.119416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:31.119688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:31.121156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:31.142452 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 41/91] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:31.145555 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 51/92] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:31.151242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:31.194241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e25fa-1687-488d-adde-58cf162bb384 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.196432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e25fa-1687-488d-adde-58cf162bb384 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.196432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e25fa-1687-488d-adde-58cf162bb384 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.197319 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 52/93] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:31.204777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7ed0-c792-487e-8b1b-74bf8cee5989 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.205186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7ed0-c792-487e-8b1b-74bf8cee5989 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.205560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7ed0-c792-487e-8b1b-74bf8cee5989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.228171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-143d7ed0-c792-487e-8b1b-74bf8cee5989 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:31.229432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-143d7ed0-c792-487e-8b1b-74bf8cee5989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:31.276347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:31.300965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:31.305787 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 53/94] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:31.368220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb384ab-9e5d-468b-a37b-fca5699adc4d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.368603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb384ab-9e5d-468b-a37b-fca5699adc4d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.368951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb384ab-9e5d-468b-a37b-fca5699adc4d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.370403 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 54/95] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:03:31.376445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa07d-adc8-4e50-8654-aded2a9a45d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.376581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb87e3-5cf5-4ea9-b784-db55ec33a613 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:31.376863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa07d-adc8-4e50-8654-aded2a9a45d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.377204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa07d-adc8-4e50-8654-aded2a9a45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.411915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c29fa07d-adc8-4e50-8654-aded2a9a45d6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:31.413152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c29fa07d-adc8-4e50-8654-aded2a9a45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:31.474912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:31.475576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.475861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.476141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] PATH_INFO: `/v3/users/effd4496ae734b3eaec9441f0ab77050` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.478211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] RBAC: Authorizing `identity:get_user(user_id=effd4496ae734b3eaec9441f0ab77050)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:31.479802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:31.481411 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 42/96] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:31 2022] GET /identity/v3/users/effd4496ae734b3eaec9441f0ab77050 => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:31.487594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:31.522110 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 55/97] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:31.554480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa07d-adc8-4e50-8654-aded2a9a45d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:31.733847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa114-419c-4f4d-b05d-ab4dd10346ac None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:31.780952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:31.786965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:31.787947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.788256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa07d-adc8-4e50-8654-aded2a9a45d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:31.797008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.797008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.797186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:31.867669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:31.868242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:31.868914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:31.869194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:31.869467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:31.870714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:31.884540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:31.890458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:31.891492 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:31.892253 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 56/98] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:31.897704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:31.994088 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 43/99] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:31.994939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.022607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3f780-bb60-48f7-98f6-fb7f7a45e567 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.024374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.056694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.057360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.057647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.057933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.068002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:32.073297 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:32.074165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:32.074911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 57/100] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:03:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:32.075518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.094113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83307b3f-74b2-4ca1-a4b8-dc9e1eaacf8c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.101732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.128126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301309b4-2826-423b-9f7c-6a91ce1f97ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.128701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301309b4-2826-423b-9f7c-6a91ce1f97ed None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.128989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301309b4-2826-423b-9f7c-6a91ce1f97ed None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.129269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301309b4-2826-423b-9f7c-6a91ce1f97ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.130429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301309b4-2826-423b-9f7c-6a91ce1f97ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.131884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301309b4-2826-423b-9f7c-6a91ce1f97ed None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.133448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 44/101] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.134744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1687b-01b8-486e-b035-2d9fdf4ffb57 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.135019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1687b-01b8-486e-b035-2d9fdf4ffb57 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.135305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1687b-01b8-486e-b035-2d9fdf4ffb57 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.140881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 45/102] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:32.140881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d5a2d-ab0c-4875-a911-3b19fa12c513 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.140881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d5a2d-ab0c-4875-a911-3b19fa12c513 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.140881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d5a2d-ab0c-4875-a911-3b19fa12c513 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.140881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 46/103] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:32.140881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d5a2d-ab0c-4875-a911-3b19fa12c513 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.184151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a7793-bf62-4a88-8042-a1de0754e274 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.218900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.219516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.219833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.220086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.220757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:32.221068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.222492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.230782 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 58/104] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.234781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.237793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.241429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d5a2d-ab0c-4875-a911-3b19fa12c513 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.274303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.274930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.278147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.278147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.278147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.278147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.280212 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 47/105] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.280962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.319225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.334432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6642f-97c4-46cc-83f9-c85426c03ce8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.368234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1671c1a-4fa2-49a8-bffe-1ad41dec3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.368846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671c1a-4fa2-49a8-bffe-1ad41dec3128 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.369136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671c1a-4fa2-49a8-bffe-1ad41dec3128 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.369414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671c1a-4fa2-49a8-bffe-1ad41dec3128 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.370111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1671c1a-4fa2-49a8-bffe-1ad41dec3128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:32.370423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1671c1a-4fa2-49a8-bffe-1ad41dec3128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.371801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1671c1a-4fa2-49a8-bffe-1ad41dec3128 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.378446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab29c5b-f5ce-4fe7-8b51-2b25e7c89327 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.379912 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 59/106] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.381050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0be6e-a144-442d-877c-e72607a094be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.381338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0be6e-a144-442d-877c-e72607a094be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.381613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0be6e-a144-442d-877c-e72607a094be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.399036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c8a0be6e-a144-442d-877c-e72607a094be None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:32.400207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c8a0be6e-a144-442d-877c-e72607a094be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:32.413717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.414367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.414655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.414938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.415589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.417027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.465639 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 60/107] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:32.467472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626c92b-925e-4b15-81b9-fe6b375016a0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.467769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626c92b-925e-4b15-81b9-fe6b375016a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.468036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626c92b-925e-4b15-81b9-fe6b375016a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.485411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d626c92b-925e-4b15-81b9-fe6b375016a0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:32.486626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d626c92b-925e-4b15-81b9-fe6b375016a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:32.517528 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 48/108] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:03:32 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:32.518427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.544657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.585054 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 61/109] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:32.586509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626c92b-925e-4b15-81b9-fe6b375016a0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.601810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.639148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bda01-22b6-4402-b575-17325c116a2a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.688149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.689035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.689712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.690215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] PATH_INFO: `/v3/users/a1be43c364e14ade8404346168c4f866` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.706224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a1be43c364e14ade8404346168c4f866)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.708345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.710561 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 49/110] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/users/a1be43c364e14ade8404346168c4f866 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.712242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.745536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626c92b-925e-4b15-81b9-fe6b375016a0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.790434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.791228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.791676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.791976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.792823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] RBAC: Adding query filter params (role.id=a2471da680c44d5ea10d4af71215fd3d, scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2, user.id=effd4496ae734b3eaec9441f0ab77050) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:32.793245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.796295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.803483 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 62/111] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/role_assignments?user.id=effd4496ae734b3eaec9441f0ab77050&scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2&role.id=a2471da680c44d5ea10d4af71215fd3d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.803875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.829673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.858852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff37d-1466-46aa-bac2-900febb387b2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.909008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:32.912474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.913214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.913502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.913833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] PATH_INFO: `/v3/users/046cf75832784d19837da245ab0a0009` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.917082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] RBAC: Authorizing `identity:get_user(user_id=046cf75832784d19837da245ab0a0009)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.918718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.921084 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 50/112] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/users/046cf75832784d19837da245ab0a0009 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.924242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:32.947717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a34b1-c635-4e88-ab9a-cbcd395cc3f6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:32.986175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:32.986844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:32.987131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:32.987412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:32.988623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:32.990181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:32.996747 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 63/113] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:32.997750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.064676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd7f88-5acb-43d4-bb58-2d05a5b4bede None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.109997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.110759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.111038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.111207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.126314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:33.132110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:33.132970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:33.133700 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 51/114] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:33.134353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.141603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffac2f2-a4a4-465e-8ce8-d12f104b324a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.143228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:33.178335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.178897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.179184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.179456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.188868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:33.191791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:33.197161 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:33.197990 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:33.198761 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 64/115] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:03:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:33.200037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.248670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf7b8a-0955-4364-9038-0ad5ab9e31b8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.285787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.286488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.286786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.287113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.306927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f985f16-790e-4165-b652-0ffb9d1ac54a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.344984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.345702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.346039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.346543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/a1be43c364e14ade8404346168c4f866/roles/9092ce23c0424a5e803d0a837c6d23ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.348822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3053b3aba2bb4c728ebaafe4553b0ef2, user_id=a1be43c364e14ade8404346168c4f866, role_id=9092ce23c0424a5e803d0a837c6d23ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:33.350722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:33.363325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:33.364854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:33.372529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:33.429189 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 65/116] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:33 2022] PUT /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/users/a1be43c364e14ade8404346168c4f866/roles/9092ce23c0424a5e803d0a837c6d23ec => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:33.439203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.485490 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 52/117] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:33.486439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.526659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:33.586256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12fa6-72ac-484b-9845-3892a5b2d8a1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.623079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5821b2-35f1-4f58-83cb-641d286cfa49 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.632465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:33.641824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.642737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.643017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.643295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.643979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:33.644289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:33.645695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:33.655238 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 66/118] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:33.660595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.665743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.666610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.667076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.667550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.668417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:33.668974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:33.670916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:33.679827 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 53/119] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:33.681006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.776876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fe25c-1aea-4fa4-8506-fcad4c6ab5b7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.794838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0e760-7e4b-4272-b5ce-1af50b43529e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.807814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:33.819564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.820339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.820688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.821028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.822258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:33.823981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:33.825526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 67/120] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:33.827154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.842765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.844060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.844763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.845250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] PATH_INFO: `/v3/users/effd4496ae734b3eaec9441f0ab77050` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.847061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] RBAC: Authorizing `identity:get_user(user_id=effd4496ae734b3eaec9441f0ab77050)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:33.848749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:33.852083 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 54/121] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/users/effd4496ae734b3eaec9441f0ab77050 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:33.853025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:33.901636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:33.952306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af46f-3b01-46a2-95f5-763397aee25f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.970639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fdd0e-e389-4c87-93ce-88c48139228a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:33.989707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:33.990677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:33.991169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:33.991626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] PATH_INFO: `/v3/users/effd4496ae734b3eaec9441f0ab77050` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:33.992965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] RBAC: Authorizing `identity:get_user(user_id=effd4496ae734b3eaec9441f0ab77050)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:33.994629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:33.996705 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 68/122] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/users/effd4496ae734b3eaec9441f0ab77050 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:33.997647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:34.015342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:34.016299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.016650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.016994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.018186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2, user.id=046cf75832784d19837da245ab0a0009) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:34.018573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:34.020928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:34.030097 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 55/123] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/role_assignments?user.id=046cf75832784d19837da245ab0a0009&scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:34.032259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:34.109623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:34.212488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b6ebc-7765-416e-ae98-eab237191537 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:34.229809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abcdf9-23fb-46e8-b44f-0268d7f719bb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:34.234991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:34.282710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:34.283331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.283612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.283905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.287767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:34.288382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.288662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.288936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.373822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:34.376831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:34.381876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:34.383918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:34.454572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:34.511080 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 69/124] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:34.514409 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 56/125] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:34.514919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:34.521341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:34.522663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:34.630609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c598f-19dd-4461-bfa8-4c36ee80ebd6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:34.651419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c998ee0-6824-4ea0-be02-d22329217060 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:34.673810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:34.674468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.674808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.675085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.677279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:34.678748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:34.685979 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 70/126] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:34 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:34.687343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:34.700320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:34.701568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.702033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.702783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] PATH_INFO: `/v3/projects/f9f27665a53a45aeba2138f152181fbc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.704910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=f9f27665a53a45aeba2138f152181fbc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:34.706888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:34.709048 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 57/127] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:34 2022] GET /identity/v3/projects/f9f27665a53a45aeba2138f152181fbc => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:34.716390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:34.717493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:34.798772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:34.812875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33d734-35a3-445f-a408-77872e288811 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:34.842466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98833ee9-4bd0-40c6-ab77-01c4b9592ae9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:34.853370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452664ac-bc83-48b3-8260-2152cd13ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:34.854008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452664ac-bc83-48b3-8260-2152cd13ee85 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.854349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452664ac-bc83-48b3-8260-2152cd13ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.855271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452664ac-bc83-48b3-8260-2152cd13ee85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.856071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452664ac-bc83-48b3-8260-2152cd13ee85 None admin] RBAC: Adding query filter params (role.id=8ff4721e72e84ea6a7943c7a0b88a5f4, scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2, user.id=effd4496ae734b3eaec9441f0ab77050) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:34.856384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452664ac-bc83-48b3-8260-2152cd13ee85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:34.858888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452664ac-bc83-48b3-8260-2152cd13ee85 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:34.869159 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 71/128] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:34 2022] GET /identity/v3/role_assignments?user.id=effd4496ae734b3eaec9441f0ab77050&scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2&role.id=8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:34.895970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aa0f6-3b76-4d9f-9d4c-5e580e312a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:34.896609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa0f6-3b76-4d9f-9d4c-5e580e312a61 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.896896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa0f6-3b76-4d9f-9d4c-5e580e312a61 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.897180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa0f6-3b76-4d9f-9d4c-5e580e312a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.898013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa0f6-3b76-4d9f-9d4c-5e580e312a61 None admin] RBAC: Adding query filter params (role.id=a2471da680c44d5ea10d4af71215fd3d, scope.project.id=f9f27665a53a45aeba2138f152181fbc, user.id=effd4496ae734b3eaec9441f0ab77050) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:34.898371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa0f6-3b76-4d9f-9d4c-5e580e312a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:34.899910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa0f6-3b76-4d9f-9d4c-5e580e312a61 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:34.907729 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 58/129] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:34 2022] GET /identity/v3/role_assignments?user.id=effd4496ae734b3eaec9441f0ab77050&scope.project.id=f9f27665a53a45aeba2138f152181fbc&role.id=a2471da680c44d5ea10d4af71215fd3d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:34.972589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464b4c-6e0c-450b-a158-8793d4a1ab11 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.972950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464b4c-6e0c-450b-a158-8793d4a1ab11 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.973150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464b4c-6e0c-450b-a158-8793d4a1ab11 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:34.974907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 72/130] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:34.980957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aa908-a517-4848-9399-be3afa23e29c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:34.981253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aa908-a517-4848-9399-be3afa23e29c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:34.981535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aa908-a517-4848-9399-be3afa23e29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:35.002620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-297aa908-a517-4848-9399-be3afa23e29c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:35.003888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-297aa908-a517-4848-9399-be3afa23e29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:35.093204 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 59/131] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:35.361357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464b4c-6e0c-450b-a158-8793d4a1ab11 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:35.449741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:35.460578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464b4c-6e0c-450b-a158-8793d4a1ab11 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:35.494549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fac677-852d-4f3e-87e5-8fd1c7333d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:35.495188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fac677-852d-4f3e-87e5-8fd1c7333d57 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:35.495476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fac677-852d-4f3e-87e5-8fd1c7333d57 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:35.495758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fac677-852d-4f3e-87e5-8fd1c7333d57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:35.496865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fac677-852d-4f3e-87e5-8fd1c7333d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:35.498848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fac677-852d-4f3e-87e5-8fd1c7333d57 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:35.500425 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 73/132] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:35.505908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aa908-a517-4848-9399-be3afa23e29c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:35.566648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:35.607621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aa908-a517-4848-9399-be3afa23e29c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:35.640677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:35.641280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:35.641559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:35.641831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:35.642522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:35.644036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:35.675532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639bb06-02b3-4d08-a9ce-4e7479850676 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:35.675825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639bb06-02b3-4d08-a9ce-4e7479850676 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:35.676111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639bb06-02b3-4d08-a9ce-4e7479850676 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:35.677484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 74/133] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:03:35.682446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606221-b9d4-4c65-b27b-e06281a97e99 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:35.682735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606221-b9d4-4c65-b27b-e06281a97e99 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:35.683015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54606221-b9d4-4c65-b27b-e06281a97e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:35.702203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54606221-b9d4-4c65-b27b-e06281a97e99 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:35.703454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54606221-b9d4-4c65-b27b-e06281a97e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:35.732045 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 60/134] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:03:35 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:35.778777 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 75/135] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:36.041791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:36.150249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea54a1-36bc-437e-ad21-60f54bb58104 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:36.167812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:36.186423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:36.187137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:36.187452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:36.187686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:36.199190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:36.204095 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:36.205126 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:36.206027 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 61/136] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:36.214368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54606221-b9d4-4c65-b27b-e06281a97e99 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:36.309692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:36.323036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54606221-b9d4-4c65-b27b-e06281a97e99 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:36.360789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:36.361635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:36.362530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:36.362941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:36.363748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:36.364204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:36.365708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:36.375011 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 76/137] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:36.386594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:36.500677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b106207-8d4e-4b7f-8eb6-77fa9b262b62 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:36.535446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:36.536861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:36.537338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:36.537802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] PATH_INFO: `/v3/users/a1be43c364e14ade8404346168c4f866` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:36.539205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] RBAC: Authorizing `identity:get_user(user_id=a1be43c364e14ade8404346168c4f866)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:36.540878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:36.542676 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 62/138] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:36 2022] GET /identity/v3/users/a1be43c364e14ade8404346168c4f866 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:36.551196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:36.657864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4fab-bb0f-421d-a629-6cb9558620b2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:36.693322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:36.694357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:36.694837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:36.695321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:36.718625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:36.768800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:36.770746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:36.886066 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 77/139] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:36.887545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:36.935407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:36.990622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f6be-6dc8-45f1-a206-db2d15f65d78 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:37.031006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e3100-4033-4367-af99-3d99e1e07331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:37.031989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3100-4033-4367-af99-3d99e1e07331 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:37.032478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3100-4033-4367-af99-3d99e1e07331 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:37.032941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e3100-4033-4367-af99-3d99e1e07331 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:37.034336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e3100-4033-4367-af99-3d99e1e07331 None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:37.036001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e3100-4033-4367-af99-3d99e1e07331 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:37.037812 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 63/140] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:36 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:37.046084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:37.100901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:37.152091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3c4da-8115-4711-aba0-d2c53425dc99 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:37.187365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769c71-f84b-4bff-a425-30d5c80abd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:37.187904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769c71-f84b-4bff-a425-30d5c80abd39 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:37.188194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769c71-f84b-4bff-a425-30d5c80abd39 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:37.188453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769c71-f84b-4bff-a425-30d5c80abd39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:37.189183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76769c71-f84b-4bff-a425-30d5c80abd39 None admin] RBAC: Adding query filter params (role.id=9092ce23c0424a5e803d0a837c6d23ec, scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2, user.id=a1be43c364e14ade8404346168c4f866) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:37.189494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76769c71-f84b-4bff-a425-30d5c80abd39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:37.191013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76769c71-f84b-4bff-a425-30d5c80abd39 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:37.201646 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 78/141] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:37 2022] GET /identity/v3/role_assignments?user.id=a1be43c364e14ade8404346168c4f866&scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2&role.id=9092ce23c0424a5e803d0a837c6d23ec => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:37.995955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb5bd5-f32f-42e2-9e36-7c30ab455e7d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:37.996488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb5bd5-f32f-42e2-9e36-7c30ab455e7d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:37.996488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb5bd5-f32f-42e2-9e36-7c30ab455e7d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:37.998001 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 64/142] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:38.002896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d7cf-61bc-47d2-916b-ebb40a43ff68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.003296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d7cf-61bc-47d2-916b-ebb40a43ff68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.003496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d7cf-61bc-47d2-916b-ebb40a43ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.021787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1df0d7cf-61bc-47d2-916b-ebb40a43ff68 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:38.023047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1df0d7cf-61bc-47d2-916b-ebb40a43ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:38.096659 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 79/143] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:38.142700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ef7fc-dfa7-452a-aa23-bf49260b0fc7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.142986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ef7fc-dfa7-452a-aa23-bf49260b0fc7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.143427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ef7fc-dfa7-452a-aa23-bf49260b0fc7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.144898 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 65/144] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:38.150123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445587e1-dad6-49ac-9f52-c0af3f22a18a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.150559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445587e1-dad6-49ac-9f52-c0af3f22a18a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.150969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445587e1-dad6-49ac-9f52-c0af3f22a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.169406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-445587e1-dad6-49ac-9f52-c0af3f22a18a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:38.170802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-445587e1-dad6-49ac-9f52-c0af3f22a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:38.213034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:38.243537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 80/145] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:38.311971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca30895-f1f0-4284-8d9c-b5be2c7bae62 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.312183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca30895-f1f0-4284-8d9c-b5be2c7bae62 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.312695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca30895-f1f0-4284-8d9c-b5be2c7bae62 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.314112 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 66/146] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:38.319304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340040-0765-45a7-848b-d5b19decc8fe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.319601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340040-0765-45a7-848b-d5b19decc8fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.319880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0340040-0765-45a7-848b-d5b19decc8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.338411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0340040-0765-45a7-848b-d5b19decc8fe None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:38.339601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0340040-0765-45a7-848b-d5b19decc8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:38.368908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca30895-f1f0-4284-8d9c-b5be2c7bae62 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.407496 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 81/147] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:38.477302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca30895-f1f0-4284-8d9c-b5be2c7bae62 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:38.491309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:38.510765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:38.511403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.511912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.512025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.512914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0340040-0765-45a7-848b-d5b19decc8fe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.525411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:38.530254 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:38.531264 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:38.532093 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 67/148] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:03:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:38.536993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.617925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0340040-0765-45a7-848b-d5b19decc8fe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:38.621193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:38.646482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383931a2-75b1-4261-b13a-a582f28edfd5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:38.659017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:38.659557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.659832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.660097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.670147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:38.674887 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:38.675763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 82/149] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:03:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:38.677185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.682712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:38.683324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.683607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.683886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.684558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:38.684863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:38.686800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:38.695553 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 68/150] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:38.696608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.731281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:38.780594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b08ff6-c469-4443-86cd-8929420f33c0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:38.793411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4929a4-c472-4a44-a6c9-c70f4c72eb4f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:38.812927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:38.813552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.813828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.814124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.815225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:38.816656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:38.818233 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 83/151] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:38.818987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.831965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:38.832580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.832863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.833140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.833811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:38.834142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:38.835522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:38.843661 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 69/152] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:03:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:38.844495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.850301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:38.918997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2501025-ed8c-4fba-b497-4bcfac4bad6f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:38.940081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:38.944254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caff90-c217-4620-aba0-7e6148cb9040 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:38.951854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:38.952477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.952754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.953022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] PATH_INFO: `/v3/users/7f099a88e2364b318d12e9309f7556ef` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.965948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] RBAC: Authorizing `identity:get_user(user_id=7f099a88e2364b318d12e9309f7556ef)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:38.967540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:38.969179 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 84/153] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:38 2022] GET /identity/v3/users/7f099a88e2364b318d12e9309f7556ef => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:38.970094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:38.977449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:38.978284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:38.978742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:38.979347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:38.980004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:38.981466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:39.057859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:39.071214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd355f-4a9e-4330-91a3-68fa6e7e8e45 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:39.093081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 70/154] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:03:38 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:39.097842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:39.110863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:39.111797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:39.113563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:39.113563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] PATH_INFO: `/v3/users/7f099a88e2364b318d12e9309f7556ef` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:39.113819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] RBAC: Authorizing `identity:get_user(user_id=7f099a88e2364b318d12e9309f7556ef)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:39.115358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:39.117074 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 85/155] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:38 2022] GET /identity/v3/users/7f099a88e2364b318d12e9309f7556ef => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:39.122587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:39.211651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124d948-b49d-440f-9fca-2afd2c0c84bd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:39.237558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c79fa8-a280-458f-abbd-cdaf142f15d6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:39.249293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:39.249953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:39.250263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:39.250541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:39.251848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:39.253347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:39.259782 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 71/156] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:39 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:39.260885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:39.287494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:39.288047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:39.288328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:39.289317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:39.290660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:39.291220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:39.292144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:39.293813 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 86/157] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:39 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:39.300207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:39.333778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:39.378647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010628de-a1ff-48f4-b665-55c9a2378535 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:39.427806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fe2d7-a99f-4671-a93c-dc14069019e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:39.428489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe2d7-a99f-4671-a93c-dc14069019e8 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:39.428772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe2d7-a99f-4671-a93c-dc14069019e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:39.429053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe2d7-a99f-4671-a93c-dc14069019e8 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/7f099a88e2364b318d12e9309f7556ef/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:39.432066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fe2d7-a99f-4671-a93c-dc14069019e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e, user_id=7f099a88e2364b318d12e9309f7556ef, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:39.433538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fe2d7-a99f-4671-a93c-dc14069019e8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:39.434933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53039c61-59b3-46aa-a900-9b11422d00af None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:39.475252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf1dc9-e707-4f68-b036-5db2de18dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:39.475931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1dc9-e707-4f68-b036-5db2de18dcaf None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:39.476277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1dc9-e707-4f68-b036-5db2de18dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:39.476619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf1dc9-e707-4f68-b036-5db2de18dcaf None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/7f099a88e2364b318d12e9309f7556ef/roles/8ff4721e72e84ea6a7943c7a0b88a5f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:39.478870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf1dc9-e707-4f68-b036-5db2de18dcaf None admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e, user_id=7f099a88e2364b318d12e9309f7556ef, role_id=8ff4721e72e84ea6a7943c7a0b88a5f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:39.480412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf1dc9-e707-4f68-b036-5db2de18dcaf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:39.498989 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 72/158] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:39 2022] PUT /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/7f099a88e2364b318d12e9309f7556ef/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:39.568506 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 87/159] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:39 2022] PUT /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/7f099a88e2364b318d12e9309f7556ef/roles/8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:41.379154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e5ed-3623-499e-9a21-202f22616e5b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.379687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e5ed-3623-499e-9a21-202f22616e5b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.379961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e5ed-3623-499e-9a21-202f22616e5b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.381466 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 73/160] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:41.387506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0139-9c1e-41c1-9a7b-5e84cce2b932 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.389008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0139-9c1e-41c1-9a7b-5e84cce2b932 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.389483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c0139-9c1e-41c1-9a7b-5e84cce2b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.410661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-216c0139-9c1e-41c1-9a7b-5e84cce2b932 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:41.411867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-216c0139-9c1e-41c1-9a7b-5e84cce2b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:41.482606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 88/161] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:41.489724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19898b-4cf9-4a57-8a4a-cc18bc7aaf8b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.490010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19898b-4cf9-4a57-8a4a-cc18bc7aaf8b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.490318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19898b-4cf9-4a57-8a4a-cc18bc7aaf8b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.491759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 74/162] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:41.496992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea9a0a-aa65-4bb6-983a-1fb209d872f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.497509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea9a0a-aa65-4bb6-983a-1fb209d872f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.498524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea9a0a-aa65-4bb6-983a-1fb209d872f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.517013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3cea9a0a-aa65-4bb6-983a-1fb209d872f5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:41.518507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3cea9a0a-aa65-4bb6-983a-1fb209d872f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:41.530012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:41.594754 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 89/163] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:41.652439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1b26-44d9-424d-b332-82f5170dd6bf None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.652720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1b26-44d9-424d-b332-82f5170dd6bf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.652901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1b26-44d9-424d-b332-82f5170dd6bf None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.654380 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 75/164] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:41.660495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7df60-1030-4fd9-b3af-31f4dc711e34 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.660796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7df60-1030-4fd9-b3af-31f4dc711e34 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.661057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7df60-1030-4fd9-b3af-31f4dc711e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.680157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77f7df60-1030-4fd9-b3af-31f4dc711e34 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:41.681340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77f7df60-1030-4fd9-b3af-31f4dc711e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:41.751103 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 90/165] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:41.761082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9056af-5ff5-4ff2-b8bd-3d94dd057e43 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.761369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9056af-5ff5-4ff2-b8bd-3d94dd057e43 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.761644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9056af-5ff5-4ff2-b8bd-3d94dd057e43 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.763009 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 76/166] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:41.767023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7df60-1030-4fd9-b3af-31f4dc711e34 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:41.768339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123979-868e-4127-91ea-b0e5648fdc34 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.768692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123979-868e-4127-91ea-b0e5648fdc34 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.769041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123979-868e-4127-91ea-b0e5648fdc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.788374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b123979-868e-4127-91ea-b0e5648fdc34 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:41.789710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b123979-868e-4127-91ea-b0e5648fdc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:41.861694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 77/167] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:41.869374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:41.870175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123979-868e-4127-91ea-b0e5648fdc34 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:41.887097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:41.897001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7df60-1030-4fd9-b3af-31f4dc711e34 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:41.942445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:41.943012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:41.943291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:41.943562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:41.956948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:41.962960 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:41.963893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:41.964880 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 91/168] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:41.969824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:41.982549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123979-868e-4127-91ea-b0e5648fdc34 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.017115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.018075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.018551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.019011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.020388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.022038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.028359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 78/169] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:42.029816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.078349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a950-dc88-4676-8405-5e691627cd7e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.114558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.115451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.116001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.116210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.116479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.117141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:42.117440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.118841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.121390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.128658 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 92/170] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:42.129420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.138761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243e56c-dacc-4199-9837-389a2268fb31 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.174278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.174891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.175166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.175438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.176076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.177503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.230587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0763d4c-d3db-46e1-8882-813f2e2ca9f9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.263421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.264040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.264309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.264580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.274199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:42.280064 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:42.281079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:42.281889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 93/171] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:42.282883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.331503 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 79/172] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:03:42 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:03:42.339488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.349049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.400050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ade0a-1143-4bb0-b7d0-b809d701b782 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.440138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.441098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.441547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.441989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] PATH_INFO: `/v3/users/b8963a0a0ec445f6b291b84546b991b3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.442168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9dcf9-5182-48bd-b65f-28c54f4447fe None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.458282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] RBAC: Authorizing `identity:get_user(user_id=b8963a0a0ec445f6b291b84546b991b3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.460337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.462498 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 94/173] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/users/b8963a0a0ec445f6b291b84546b991b3 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:42.468739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.487972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.488557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.488823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.489099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.492570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.501880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:42.506994 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:42.507826 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:42.508810 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 80/174] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:42.510897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.579803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724260c3-5fae-4822-bc69-48a455dba396 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.597365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.619893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.621175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.621854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.622397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.624325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:42.624823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.626769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.631038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0370-c961-4ff6-bac9-5a7968c551b5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.639344 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 95/175] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:42.640406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.677362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.678413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.678843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.679126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.681385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.682930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.684786 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 81/176] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:42.686214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.763419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.768531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff44bb-b6dd-4d88-94b5-c1541e4d37c6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.802808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37b366-4387-4504-9632-90a4b294c4f7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.804654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.805396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.805752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.806825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.806825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:42.807209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.808744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.818512 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 96/177] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:42.819143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.841418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.842354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.842801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.843241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] PATH_INFO: `/v3/users/7f099a88e2364b318d12e9309f7556ef` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.844555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] RBAC: Authorizing `identity:get_user(user_id=7f099a88e2364b318d12e9309f7556ef)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.846206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.847929 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 82/178] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/users/7f099a88e2364b318d12e9309f7556ef => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:42.849045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:42.869969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.946449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922146-6bd7-48f2-96ef-a58726701404 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.963187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daaeb6-1e5a-4b02-86b4-6d657cabe004 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:42.989882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:42.990884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:42.991429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:42.991705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/b8963a0a0ec445f6b291b84546b991b3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:42.994241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e, user_id=b8963a0a0ec445f6b291b84546b991b3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:42.994447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:42.995930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:42.999578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:43.000591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:43.000937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:43.001301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] PATH_INFO: `/v3/users/7f099a88e2364b318d12e9309f7556ef` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:43.002541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] RBAC: Authorizing `identity:get_user(user_id=7f099a88e2364b318d12e9309f7556ef)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:43.004058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:43.005895 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 83/179] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:42 2022] GET /identity/v3/users/7f099a88e2364b318d12e9309f7556ef => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:43.010093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:43.080743 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 97/180] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:42 2022] PUT /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/b8963a0a0ec445f6b291b84546b991b3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:43.081297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:43.189073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2d592-de66-4759-b415-d854a7db82ea None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:43.222330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:43.227083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea86e-7c2f-4e43-b707-dc9b2c56b476 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:43.271953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:43.273086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:43.273371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:43.273644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:43.279888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:43.280785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:43.281319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:43.281809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:43.353463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:43.355184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:43.360893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:43.363644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:43.365230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:43.475486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:43.480033 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 98/181] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:43.485836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:43.486797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 84/182] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:43.495040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:43.690514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:43.693185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f78d1-6a96-414c-a60f-638b5d1e8853 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:43.707533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac3270-c5e5-451f-9169-964d1899a987 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:43.760983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:43.761635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:43.761919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:43.762224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:43.764169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:43.765713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:43.767388 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 99/183] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:43 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:43.769422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:43.770120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:43.770409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:43.770684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:43.772001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:43.773555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:43.774476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:43.785053 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 85/184] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:43 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:43.790325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:43.898437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:43.946654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca8e6b-f365-452e-ba17-c8878672681b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:43.968368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7c67b-be33-4981-b68a-9b7ec80bd660 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:44.021009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf3c86-feb0-4acc-908e-b92ce225bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:44.021617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf3c86-feb0-4acc-908e-b92ce225bf2e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:44.021894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf3c86-feb0-4acc-908e-b92ce225bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:44.022211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf3c86-feb0-4acc-908e-b92ce225bf2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:44.022938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf3c86-feb0-4acc-908e-b92ce225bf2e None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e, user.id=7f099a88e2364b318d12e9309f7556ef) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:44.023248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf3c86-feb0-4acc-908e-b92ce225bf2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:44.024688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf3c86-feb0-4acc-908e-b92ce225bf2e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:44.026076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b2ed-5824-45cb-adb9-aca147dd9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:44.026932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b2ed-5824-45cb-adb9-aca147dd9b38 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:44.027403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b2ed-5824-45cb-adb9-aca147dd9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:44.027875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b2ed-5824-45cb-adb9-aca147dd9b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:44.028904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b2ed-5824-45cb-adb9-aca147dd9b38 None admin] RBAC: Adding query filter params (role.id=8ff4721e72e84ea6a7943c7a0b88a5f4, scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e, user.id=7f099a88e2364b318d12e9309f7556ef) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:44.029420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b2ed-5824-45cb-adb9-aca147dd9b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:44.031085 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 86/185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:43 2022] GET /identity/v3/role_assignments?user.id=7f099a88e2364b318d12e9309f7556ef&scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:44.031556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b2ed-5824-45cb-adb9-aca147dd9b38 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:44.045571 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 100/186] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:43 2022] GET /identity/v3/role_assignments?user.id=7f099a88e2364b318d12e9309f7556ef&scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e&role.id=8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:44.686809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6a0a2-592c-4f81-8ee9-04929565935f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:44.687314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6a0a2-592c-4f81-8ee9-04929565935f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:44.687432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6a0a2-592c-4f81-8ee9-04929565935f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:44.688726 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 87/187] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:44.693703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1ad2-1f66-4bb1-b4a6-3e3bdd6a77ab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:44.694113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1ad2-1f66-4bb1-b4a6-3e3bdd6a77ab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:44.694280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1ad2-1f66-4bb1-b4a6-3e3bdd6a77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:44.712111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-693f1ad2-1f66-4bb1-b4a6-3e3bdd6a77ab None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:44.713225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-693f1ad2-1f66-4bb1-b4a6-3e3bdd6a77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:44.780125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 101/188] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:44.922775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09c0ac-b1ff-46a2-852f-bfd3c32ab1ac None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:44.923122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09c0ac-b1ff-46a2-852f-bfd3c32ab1ac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:44.923340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09c0ac-b1ff-46a2-852f-bfd3c32ab1ac None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:44.924845 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 88/189] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:44.929854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391c7b-a97a-421e-b17a-d6193ea8f56d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:44.930187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391c7b-a97a-421e-b17a-d6193ea8f56d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:44.930467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391c7b-a97a-421e-b17a-d6193ea8f56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:44.948403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c6391c7b-a97a-421e-b17a-d6193ea8f56d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:44.949578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6391c7b-a97a-421e-b17a-d6193ea8f56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:45.006019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:45.017234 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 102/190] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:45.046437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09c0ac-b1ff-46a2-852f-bfd3c32ab1ac None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:45.077991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:45.189802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09c0ac-b1ff-46a2-852f-bfd3c32ab1ac None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:45.223863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:45.224792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.225070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.225337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.235685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:45.241234 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:45.242151 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:45.242965 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 89/191] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:45.250080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6391c7b-a97a-421e-b17a-d6193ea8f56d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:45.290390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:45.350372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6391c7b-a97a-421e-b17a-d6193ea8f56d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:45.384004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:45.384600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.384874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.385627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.385739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:45.385816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:45.386103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:45.387480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:45.395586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae352bb-280c-4001-ae50-6ffdd5c039f4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:45.396827 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 103/192] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:45.402197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:45.431022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:45.431660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.431944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.432219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.433335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:45.434819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:45.436931 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 90/193] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:45.442247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:45.463347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:45.516516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab3d7-98db-4367-9bcb-a40fae77ac4e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:45.549362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f9aa8-f6de-453c-9246-2f953a746d29 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:45.551849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:45.552485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.552764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.553034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] PATH_INFO: `/v3/users/dac5d756a8ee4ad498dbc70231956e0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.567620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] RBAC: Authorizing `identity:get_user(user_id=dac5d756a8ee4ad498dbc70231956e0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:45.569120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:45.571311 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 104/194] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:45 2022] GET /identity/v3/users/dac5d756a8ee4ad498dbc70231956e0b => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:45.576788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:45.588173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768b350-4ac5-40f7-955c-1a33e2deefe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:45.588801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b350-4ac5-40f7-955c-1a33e2deefe5 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.589058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b350-4ac5-40f7-955c-1a33e2deefe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.589329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b350-4ac5-40f7-955c-1a33e2deefe5 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.589975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768b350-4ac5-40f7-955c-1a33e2deefe5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:45.591462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768b350-4ac5-40f7-955c-1a33e2deefe5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:45.672754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26fe6-0356-4499-95b1-90095a98f636 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:45.685833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:45.691615 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 91/195] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:03:45 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:03:45.692770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4591e2-0006-41a6-bed1-744a3ad1a222 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.700825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4591e2-0006-41a6-bed1-744a3ad1a222 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.700825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4591e2-0006-41a6-bed1-744a3ad1a222 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.700825 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 92/196] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:45.700825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3f3e-5205-4567-a8df-56edd065beaf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.700825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3f3e-5205-4567-a8df-56edd065beaf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.701917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3f3e-5205-4567-a8df-56edd065beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.713119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:45.713799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.714097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.714376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.715606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:45.717162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:45.719151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 105/197] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:45 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:45.721207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a63a3f3e-5205-4567-a8df-56edd065beaf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:45.722491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a63a3f3e-5205-4567-a8df-56edd065beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:45.725407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:45.736944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:45.803580 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 93/198] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:45.841431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b31a5-971c-4e74-abc6-78d5fcad0a3e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:45.878922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:45.879590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:45.879872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:45.880147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/dac5d756a8ee4ad498dbc70231956e0b/roles/9092ce23c0424a5e803d0a837c6d23ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:45.882165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e, user_id=dac5d756a8ee4ad498dbc70231956e0b, role_id=9092ce23c0424a5e803d0a837c6d23ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:45.883602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:45.943936 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 106/199] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:03:45 2022] PUT /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/users/dac5d756a8ee4ad498dbc70231956e0b/roles/9092ce23c0424a5e803d0a837c6d23ec => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:46.071573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3f3e-5205-4567-a8df-56edd065beaf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:46.184302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3f3e-5205-4567-a8df-56edd065beaf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:46.220859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:46.221499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:46.221778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:46.222072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:46.233637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:46.238570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:46.239432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:46.240599 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 94/200] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:46.245575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:46.293383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:46.355595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1cf47-9e60-40dd-80e7-4c4911c86a01 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:46.391553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:46.392482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:46.392946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:46.393403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:46.394267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:46.394817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:46.396350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:46.405880 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 107/201] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:46.411863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:46.422640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:46.517733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55ecf-761c-458e-9d78-4b61a7ba2506 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:46.553358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:46.554002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:46.554311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:46.554586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] PATH_INFO: `/v3/users/b8963a0a0ec445f6b291b84546b991b3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:46.555740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] RBAC: Authorizing `identity:get_user(user_id=b8963a0a0ec445f6b291b84546b991b3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:46.557296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:46.558944 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 95/202] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:46 2022] GET /identity/v3/users/b8963a0a0ec445f6b291b84546b991b3 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:46.564536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:46.669871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116206f-c89e-4697-9db3-970a4af1b3db None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:46.671362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:46.708803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:46.709782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:46.710269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:46.710713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:46.786218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:46.788391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:46.886795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 108/203] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:03:46.898102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:46.979319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:47.004523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2378d-102d-4ca7-9e22-a0ad8b0b2b41 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:47.039012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0a03a-4186-4e2e-9046-e3a79c8a99f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:47.039917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a03a-4186-4e2e-9046-e3a79c8a99f3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:47.040344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a03a-4186-4e2e-9046-e3a79c8a99f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:47.040952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0a03a-4186-4e2e-9046-e3a79c8a99f3 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:47.042298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0a03a-4186-4e2e-9046-e3a79c8a99f3 None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:47.044033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0a03a-4186-4e2e-9046-e3a79c8a99f3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:47.046288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 96/204] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:46 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:47.052282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:47.061121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:47.166884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ff1ab-1c74-41ff-8a77-15a4c149586e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:47.202528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55e636-525f-4a98-b826-e3eafa4af814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:47.203135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e636-525f-4a98-b826-e3eafa4af814 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:47.203413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e636-525f-4a98-b826-e3eafa4af814 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:47.203679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e636-525f-4a98-b826-e3eafa4af814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:47.204399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e636-525f-4a98-b826-e3eafa4af814 None admin] RBAC: Adding query filter params (role.id=a2471da680c44d5ea10d4af71215fd3d, scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e, user.id=b8963a0a0ec445f6b291b84546b991b3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:47.204699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e636-525f-4a98-b826-e3eafa4af814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:47.206238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e636-525f-4a98-b826-e3eafa4af814 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:47.212411 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 109/205] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:47 2022] GET /identity/v3/role_assignments?user.id=b8963a0a0ec445f6b291b84546b991b3&scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e&role.id=a2471da680c44d5ea10d4af71215fd3d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:47.980738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9df66-145a-4fe6-9f2e-21dbc23f5169 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:47.981294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9df66-145a-4fe6-9f2e-21dbc23f5169 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:47.981294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9df66-145a-4fe6-9f2e-21dbc23f5169 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:47.982858 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 97/206] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:47.989031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86437b4e-4988-4a79-addd-a1245735d32d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:47.989549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86437b4e-4988-4a79-addd-a1245735d32d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:47.989549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86437b4e-4988-4a79-addd-a1245735d32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.007797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86437b4e-4988-4a79-addd-a1245735d32d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:48.008966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86437b4e-4988-4a79-addd-a1245735d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:48.066292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:48.073761 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 110/207] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:48.088763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff979824-5225-492e-9144-3794f0f134f3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.089050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff979824-5225-492e-9144-3794f0f134f3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.091045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff979824-5225-492e-9144-3794f0f134f3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.091045 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 98/208] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:48.096454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5f7c-5a1e-4d3e-9fb1-b59b668514fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.096752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5f7c-5a1e-4d3e-9fb1-b59b668514fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.097029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5f7c-5a1e-4d3e-9fb1-b59b668514fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.115693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4cae5f7c-5a1e-4d3e-9fb1-b59b668514fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:48.117330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cae5f7c-5a1e-4d3e-9fb1-b59b668514fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:48.188333 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 111/209] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:48.252396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806de4c-1003-4184-9eb6-a59afa4aca63 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.252685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806de4c-1003-4184-9eb6-a59afa4aca63 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.252878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806de4c-1003-4184-9eb6-a59afa4aca63 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.254378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 99/210] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:48.259449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63901e1-4aa4-402c-bb91-5322ecd017c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.259736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63901e1-4aa4-402c-bb91-5322ecd017c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.260011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63901e1-4aa4-402c-bb91-5322ecd017c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.278599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b63901e1-4aa4-402c-bb91-5322ecd017c6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:48.279798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b63901e1-4aa4-402c-bb91-5322ecd017c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:48.338012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806de4c-1003-4184-9eb6-a59afa4aca63 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.347647 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 112/211] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:48.443163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806de4c-1003-4184-9eb6-a59afa4aca63 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:48.459028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63901e1-4aa4-402c-bb91-5322ecd017c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.487804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:48.488433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.488713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.488984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.499903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:48.504763 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:48.505894 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:48.506822 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 100/212] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:48.511943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.515763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:48.522380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:48.569306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63901e1-4aa4-402c-bb91-5322ecd017c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:48.605493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:48.606162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.606445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.606720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.607868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:48.609316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:48.610930 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 113/213] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:48.613756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6657295-c800-4a98-ae1f-e95d4d135733 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:48.615453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.650325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:48.650930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.651207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.651479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.652135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:48.652436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:48.653846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:48.661771 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 101/214] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:48.662467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.718362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b234fc-337d-41b7-bc3b-063b6ac3c7de None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:48.721822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:48.741467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:48.752370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:48.752998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.753276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.753545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.760522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478946-7254-4460-a5db-b61a904a1d08 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:48.763387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:48.768230 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:48.769099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:48.769866 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 114/215] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:48.770837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.795492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:48.796090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.796365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.796640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.797282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:48.798760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:48.868996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8c3a3-f84a-4266-80b8-69556e6ca2f2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:48.891771 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 102/216] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:03:48 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:48.892626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.905731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:48.909156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:48.909156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:48.909156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] PATH_INFO: `/v3/users/519b19b772734dedb2020d0b68caab19` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:48.923334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=519b19b772734dedb2020d0b68caab19)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:48.924845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:48.926643 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 115/217] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:48 2022] GET /identity/v3/users/519b19b772734dedb2020d0b68caab19 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:48.932783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:48.983279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:49.031831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d69fb-e01a-4224-a991-3b8325db63ba None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:49.045767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9267f-2473-4f78-b36c-158883a28dc2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:49.054377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:49.071658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:49.072278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:49.072557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:49.072835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:49.073508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] RBAC: Adding query filter params (name=reader) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:49.073815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:49.075338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:49.084729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:49.085343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:49.085464 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 103/218] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:49.085699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:49.085972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:49.086953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] RBAC: Adding query filter params (role.id=a2471da680c44d5ea10d4af71215fd3d, user.id=519b19b772734dedb2020d0b68caab19, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:49.095547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:49.095547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:49.095741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:49.095826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 116/219] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Oct 18 13:03:48 2022] GET /identity/v3/role_assignments?user.id=519b19b772734dedb2020d0b68caab19&scope.system=all&role.id=a2471da680c44d5ea10d4af71215fd3d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:49.217676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1c48-2912-4336-b85f-49d3d3327ecb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:49.260138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:49.261079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:49.261365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:49.261643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] PATH_INFO: `/v3/users/dac5d756a8ee4ad498dbc70231956e0b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:49.262889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] RBAC: Authorizing `identity:get_user(user_id=dac5d756a8ee4ad498dbc70231956e0b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:49.264417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:49.266445 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 104/220] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:49 2022] GET /identity/v3/users/dac5d756a8ee4ad498dbc70231956e0b => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:49.271677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:49.380739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ffc7-1898-4e2c-bde2-855bbb09c640 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:49.402558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:49.417052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:49.425647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:49.425647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:49.425647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:49.491085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:49.492555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:49.595893 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 117/221] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 13:03:49.601543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:49.652499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:49.706385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0f33f-69be-47c2-a11c-c9bf6fc68881 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:49.741259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2a0e5-469c-44e1-b88d-b6076d59e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:49.741897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2a0e5-469c-44e1-b88d-b6076d59e468 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:49.742213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2a0e5-469c-44e1-b88d-b6076d59e468 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:49.742492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2a0e5-469c-44e1-b88d-b6076d59e468 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:49.743628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2a0e5-469c-44e1-b88d-b6076d59e468 None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:49.745143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2a0e5-469c-44e1-b88d-b6076d59e468 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:49.746978 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 105/222] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:03:49 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:49.753407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:49.762217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:49.861590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21f8ed-483a-4744-ae51-34e0c19a15f7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:49.897817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9570f-d602-4312-b348-31aa5380c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:49.898829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9570f-d602-4312-b348-31aa5380c72f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:49.899311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9570f-d602-4312-b348-31aa5380c72f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:49.899778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9570f-d602-4312-b348-31aa5380c72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:49.900718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9570f-d602-4312-b348-31aa5380c72f None admin] RBAC: Adding query filter params (role.id=9092ce23c0424a5e803d0a837c6d23ec, scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e, user.id=dac5d756a8ee4ad498dbc70231956e0b) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:49.901219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9570f-d602-4312-b348-31aa5380c72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:49.902975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9570f-d602-4312-b348-31aa5380c72f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:49.909587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 118/223] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:03:49 2022] GET /identity/v3/role_assignments?user.id=dac5d756a8ee4ad498dbc70231956e0b&scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e&role.id=9092ce23c0424a5e803d0a837c6d23ec => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:51.282595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd525-d78e-4387-8ca1-eadcadf5cc59 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.283139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd525-d78e-4387-8ca1-eadcadf5cc59 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.283139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd525-d78e-4387-8ca1-eadcadf5cc59 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.284496 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 106/224] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:51.289570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dbffd-3028-448f-9913-99c2b4946fc3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.289963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dbffd-3028-448f-9913-99c2b4946fc3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.290153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dbffd-3028-448f-9913-99c2b4946fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.293001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b41f4-ae5e-43d3-8c0e-a7003942bd68 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.293334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b41f4-ae5e-43d3-8c0e-a7003942bd68 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.293568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b41f4-ae5e-43d3-8c0e-a7003942bd68 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.295524 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 107/225] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:03:51.301777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61c65-2811-4a1b-bd04-0a8a43e96776 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.302314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61c65-2811-4a1b-bd04-0a8a43e96776 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.302792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61c65-2811-4a1b-bd04-0a8a43e96776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.309254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-335dbffd-3028-448f-9913-99c2b4946fc3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:51.310499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-335dbffd-3028-448f-9913-99c2b4946fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:51.320420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bbc61c65-2811-4a1b-bd04-0a8a43e96776 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:51.321573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bbc61c65-2811-4a1b-bd04-0a8a43e96776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:51.372450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:51.377467 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 119/226] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:51.378563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e8492-a7e7-4570-a6e7-c1a201949c9a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.383911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e8492-a7e7-4570-a6e7-c1a201949c9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.383911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e8492-a7e7-4570-a6e7-c1a201949c9a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.383911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 120/227] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:51.385570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b48-e05e-44d5-b246-610f41da6713 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.385849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b48-e05e-44d5-b246-610f41da6713 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.386145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b48-e05e-44d5-b246-610f41da6713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.388417 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 108/228] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:51.403628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-114b2b48-e05e-44d5-b246-610f41da6713 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:51.405321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-114b2b48-e05e-44d5-b246-610f41da6713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:51.475909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 121/229] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:51.641639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61c65-2811-4a1b-bd04-0a8a43e96776 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:51.656688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b2b48-e05e-44d5-b246-610f41da6713 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:51.693529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:51.745678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61c65-2811-4a1b-bd04-0a8a43e96776 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:51.759974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b2b48-e05e-44d5-b246-610f41da6713 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:51.779782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:51.780422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.780706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.780976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.788953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:51.790748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:51.794695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:51.795459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:51.801569 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:51.802516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:51.803277 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:51.803847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.803847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.803962 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 109/230] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:51.804023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:51.804098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:51.804163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:51.804163 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 122/231] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:51.804163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:51.898253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308746c-29ab-4a3c-91ed-c6d3b7f41bbf None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:51.901920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdcd41-b792-4834-99e4-2279adb8ef6a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:51.907383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:51.932137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:51.932774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.933326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.933665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.934729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:51.935387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:51.935612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:51.935885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:51.936550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:51.936852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:51.938252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:51.943840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:51.946370 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 123/232] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:51.946920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:51.949028 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:51.949867 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:51.951890 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 110/233] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:51.952783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:52.008630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:52.048678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d7cd-9c52-4c78-bee1-a4ea09a02978 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:52.050252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550f62b-4603-44e4-9209-53d722672adb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:52.081488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:52.082109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:52.082392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:52.082661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:52.083277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:52.083683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:52.084312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:52.084593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:52.084708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:52.084864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] PATH_INFO: `/v3/users/8d372a62ea3248bc8835446008c6f26f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:52.097687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] RBAC: Authorizing `identity:get_user(user_id=8d372a62ea3248bc8835446008c6f26f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:52.099438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:52.105857 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 111/234] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:51 2022] GET /identity/v3/users/8d372a62ea3248bc8835446008c6f26f => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:52.105857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:52.127483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:52.154699 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 124/235] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Oct 18 13:03:51 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:52.155009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:52.207136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcf0d0-62fa-4ea1-bf1f-77e489f9f320 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:52.245679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:52.246326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:52.246603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:52.246874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:52.248086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:52.248388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:52.249796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:52.258988 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 112/236] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:52.265161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:52.362694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fbc9f-ebc9-40e7-93f9-d5c51ed4e785 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:52.476601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:52.491777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:52.492393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:52.492677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:52.492955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:52.493702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] RBAC: Adding query filter params (role.id=9092ce23c0424a5e803d0a837c6d23ec, user.id=8d372a62ea3248bc8835446008c6f26f, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:52.494014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:52.495492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:52.501349 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 125/237] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Oct 18 13:03:52 2022] GET /identity/v3/role_assignments?user.id=8d372a62ea3248bc8835446008c6f26f&scope.system=all&role.id=9092ce23c0424a5e803d0a837c6d23ec => generated 226 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:52.526857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:52.541091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f5ef3-eec1-49ea-9c9d-075173e3a609 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:52.579399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a2f87-6f5e-4e42-8535-121b9326d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:52.580064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a2f87-6f5e-4e42-8535-121b9326d4ad None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:52.580347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a2f87-6f5e-4e42-8535-121b9326d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:52.580623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a2f87-6f5e-4e42-8535-121b9326d4ad None admin] PATH_INFO: `/v3/users/519b19b772734dedb2020d0b68caab19` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:52.581832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a2f87-6f5e-4e42-8535-121b9326d4ad None admin] RBAC: Authorizing `identity:get_user(user_id=519b19b772734dedb2020d0b68caab19)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:52.583469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a2f87-6f5e-4e42-8535-121b9326d4ad None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:52.585188 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 113/238] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:52 2022] GET /identity/v3/users/519b19b772734dedb2020d0b68caab19 => generated 293 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:52.591027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:52.698525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfccb99-62f0-44f6-aed0-7903ff8c6cfd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:52.732325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779e86d-a949-4f97-bf1f-b90bbbf35a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:52.732925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779e86d-a949-4f97-bf1f-b90bbbf35a96 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:52.733208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779e86d-a949-4f97-bf1f-b90bbbf35a96 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:52.733481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779e86d-a949-4f97-bf1f-b90bbbf35a96 None admin] PATH_INFO: `/v3/system/users/519b19b772734dedb2020d0b68caab19/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:52.734941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779e86d-a949-4f97-bf1f-b90bbbf35a96 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=519b19b772734dedb2020d0b68caab19, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:52.736310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779e86d-a949-4f97-bf1f-b90bbbf35a96 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:52.818625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 126/239] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Oct 18 13:03:52 2022] PUT /identity/v3/system/users/519b19b772734dedb2020d0b68caab19/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:54.313520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a1725-bf94-4b59-abb7-ac888e2f672c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.314092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a1725-bf94-4b59-abb7-ac888e2f672c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.314092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a1725-bf94-4b59-abb7-ac888e2f672c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.315579 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 114/240] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:54.320655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b0d5-7f7c-4b5b-8289-c429db47a55b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.321066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b0d5-7f7c-4b5b-8289-c429db47a55b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.321225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b0d5-7f7c-4b5b-8289-c429db47a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.339950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9b2b0d5-7f7c-4b5b-8289-c429db47a55b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:54.341676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9b2b0d5-7f7c-4b5b-8289-c429db47a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:54.387255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:54.410989 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 127/241] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:03:54.651756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14603-a744-4647-b240-a3537374aa1c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.652153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14603-a744-4647-b240-a3537374aa1c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.652376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14603-a744-4647-b240-a3537374aa1c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.654297 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 115/242] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:54.659612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee19e-e838-4053-a91c-d0829ec9fd37 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.659902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee19e-e838-4053-a91c-d0829ec9fd37 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.660182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee19e-e838-4053-a91c-d0829ec9fd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.678350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d6ee19e-e838-4053-a91c-d0829ec9fd37 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:54.679520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d6ee19e-e838-4053-a91c-d0829ec9fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:54.681084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14603-a744-4647-b240-a3537374aa1c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:54.754370 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 128/243] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:54.782823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14603-a744-4647-b240-a3537374aa1c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:54.815666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef074c-8b2f-4690-86cf-a85bfc0a1105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:54.816333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef074c-8b2f-4690-86cf-a85bfc0a1105 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.816616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef074c-8b2f-4690-86cf-a85bfc0a1105 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.816892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef074c-8b2f-4690-86cf-a85bfc0a1105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.818097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef074c-8b2f-4690-86cf-a85bfc0a1105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:54.819600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef074c-8b2f-4690-86cf-a85bfc0a1105 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:54.821547 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 116/244] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:54.827623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee19e-e838-4053-a91c-d0829ec9fd37 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:54.930909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee19e-e838-4053-a91c-d0829ec9fd37 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:54.934034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdd102-35e0-4d3a-90c9-14280db66f3a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.934346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdd102-35e0-4d3a-90c9-14280db66f3a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.934621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdd102-35e0-4d3a-90c9-14280db66f3a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.936150 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 117/245] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:54.940767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66cfc1-075c-4c25-8376-7b760f02d3e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.941538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66cfc1-075c-4c25-8376-7b760f02d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.941643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:54.941717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66cfc1-075c-4c25-8376-7b760f02d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.960742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6e66cfc1-075c-4c25-8376-7b760f02d3e4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:54.961924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e66cfc1-075c-4c25-8376-7b760f02d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:54.968609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:54.968609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:54.968609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:54.968843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:54.969275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:54.970759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:54.980376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:55.029323 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 118/246] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:55.030239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66cfc1-075c-4c25-8376-7b760f02d3e4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:55.056756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 129/247] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Oct 18 13:03:54 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:03:55.137438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66cfc1-075c-4c25-8376-7b760f02d3e4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:55.173372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:55.174027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:55.174331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:55.174606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:55.186861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:55.191711 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:55.197802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:55.198721 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 119/248] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:55.199345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:55.306468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:55.312305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd325e1-88c1-45dd-aac1-b8b84c19f38d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:55.326500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:55.351862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:55.352489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:55.352770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:55.353044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:55.353721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:55.354026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:55.355429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:55.364869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 130/249] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:55.370792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:55.404400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:55.427420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd8b4d-1369-4e65-a7e9-319fe4dfdab8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:55.492539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:55.493281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:55.493559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:55.493929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:55.499981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff0c4-10f8-491b-b8e4-0bfa8f335929 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:55.506861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:55.512197 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:55.513109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:55.513884 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 120/250] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:03:55.519989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:55.551391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:55.552365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:55.552658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:55.552934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] PATH_INFO: `/v3/users/8d372a62ea3248bc8835446008c6f26f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:55.554894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] RBAC: Authorizing `identity:get_user(user_id=8d372a62ea3248bc8835446008c6f26f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:55.556351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:55.558121 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 131/251] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:55 2022] GET /identity/v3/users/8d372a62ea3248bc8835446008c6f26f => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:55.564207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:55.621016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:55.653463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6f51c-2ed9-4f6b-9b39-7e34fd40d35d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:55.687254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:55.690191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c3f8-cd16-42bc-a4b4-6d655504b857 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:55.695323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:55.695937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:55.696214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:55.696485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:55.697218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:55.697527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:55.698953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:55.713589 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 121/252] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:55.714954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:55.731593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:55.732932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:55.733218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:55.733495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] PATH_INFO: `/v3/system/users/8d372a62ea3248bc8835446008c6f26f/roles/9092ce23c0424a5e803d0a837c6d23ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:55.735031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8d372a62ea3248bc8835446008c6f26f, role_id=9092ce23c0424a5e803d0a837c6d23ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:55.736427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:55.813190 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 132/253] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Oct 18 13:03:55 2022] PUT /identity/v3/system/users/8d372a62ea3248bc8835446008c6f26f/roles/9092ce23c0424a5e803d0a837c6d23ec => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:03:55.847046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfac470-00ec-4d28-b36d-43080d0bfd9a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:55.893833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98491a1f-1f4a-4eb8-bd20-60f238caa7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:55.894834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491a1f-1f4a-4eb8-bd20-60f238caa7f6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:55.895258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491a1f-1f4a-4eb8-bd20-60f238caa7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:55.895703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491a1f-1f4a-4eb8-bd20-60f238caa7f6 None admin] PATH_INFO: `/v3/users/519b19b772734dedb2020d0b68caab19` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:55.897201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98491a1f-1f4a-4eb8-bd20-60f238caa7f6 None admin] RBAC: Authorizing `identity:get_user(user_id=519b19b772734dedb2020d0b68caab19)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:55.898896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98491a1f-1f4a-4eb8-bd20-60f238caa7f6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:55.900748 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 122/254] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:03:55 2022] GET /identity/v3/users/519b19b772734dedb2020d0b68caab19 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:55.907588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:56.037337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba824a-cb0b-4bf8-9602-45770705ac4f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:56.078344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39440be-230e-4863-b714-3ad407deddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:56.079221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440be-230e-4863-b714-3ad407deddc9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:56.079648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440be-230e-4863-b714-3ad407deddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:56.080062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39440be-230e-4863-b714-3ad407deddc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:56.080983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39440be-230e-4863-b714-3ad407deddc9 None admin] RBAC: Adding query filter params (role.id=a2471da680c44d5ea10d4af71215fd3d, user.id=519b19b772734dedb2020d0b68caab19, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:56.081434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39440be-230e-4863-b714-3ad407deddc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:56.088423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39440be-230e-4863-b714-3ad407deddc9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:56.102823 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 133/255] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Oct 18 13:03:55 2022] GET /identity/v3/role_assignments?user.id=519b19b772734dedb2020d0b68caab19&scope.system=all&role.id=a2471da680c44d5ea10d4af71215fd3d => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:57.601605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd8890-033c-4987-9eac-5f2ba568574c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:57.602128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd8890-033c-4987-9eac-5f2ba568574c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:57.602205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd8890-033c-4987-9eac-5f2ba568574c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:57.603532 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 123/256] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:57.619851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3741d52-5625-401e-9d0a-3db788919fd9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:57.620365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3741d52-5625-401e-9d0a-3db788919fd9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:57.620441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3741d52-5625-401e-9d0a-3db788919fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:57.651042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e3741d52-5625-401e-9d0a-3db788919fd9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:57.652245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3741d52-5625-401e-9d0a-3db788919fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:57.677875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:57.727846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 134/257] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 18 13:03:58.263752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd8890-033c-4987-9eac-5f2ba568574c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:58.271998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:58.282666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd8890-033c-4987-9eac-5f2ba568574c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:58.287163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:58.287804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.288073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.288347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.304347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:58.309432 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:58.310882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:58.311672 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:58.315628 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 124/258] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Oct 18 13:03:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:58.321037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3741d52-5625-401e-9d0a-3db788919fd9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:58.335137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3741d52-5625-401e-9d0a-3db788919fd9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:58.343520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:58.344142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.344424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.344706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.345387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:58.345693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:58.347489 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:03:58.347489 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:03:58.347489 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:03:58.348402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:58.361593 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 135/259] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:03:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:58.367250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:58.377298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad734e-b9c5-4013-838c-c57e8d36389a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:58.392606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:58.393260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.393534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.393801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.406813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:58.408623 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:03:58.408623 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:03:58.408623 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:03:58.409855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:58.412527 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 125/260] 10.222.0.27 () {56 vars in 1201 bytes} [Tue Oct 18 13:03:58 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:58.416980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:58.435475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a809a5-84d6-4561-b865-38ec25cff2df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:58.446151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7970e8a-bf07-4b72-a183-a65e2ee74a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:58.446798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970e8a-bf07-4b72-a183-a65e2ee74a71 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.452463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970e8a-bf07-4b72-a183-a65e2ee74a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.452463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970e8a-bf07-4b72-a183-a65e2ee74a71 admin admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.452463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7970e8a-bf07-4b72-a183-a65e2ee74a71 admin admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:58.452463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7970e8a-bf07-4b72-a183-a65e2ee74a71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:58.453632 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 136/261] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Oct 18 13:03:58 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:58.459260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:58.472314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ffb5-1f83-442d-8e9e-d4a2377657c3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:58.483151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630d0a-e478-4aae-80c5-e3f1666dae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:58.483824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630d0a-e478-4aae-80c5-e3f1666dae4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.484102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630d0a-e478-4aae-80c5-e3f1666dae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.484376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630d0a-e478-4aae-80c5-e3f1666dae4b admin admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.491323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630d0a-e478-4aae-80c5-e3f1666dae4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3053b3aba2bb4c728ebaafe4553b0ef2, group_id=4ab0c7dbe840409498a6a9c175cbaa15, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:58.492362 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-e1630d0a-e478-4aae-80c5-e3f1666dae4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:03:58.492362 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:03:58.492362 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:03:58.494338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630d0a-e478-4aae-80c5-e3f1666dae4b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:58.590375 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 126/262] 10.222.0.27 () {58 vars in 1463 bytes} [Tue Oct 18 13:03:58 2022] PUT /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:58.750563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b158035-f474-4ff6-aa7b-3b977b9fa6f4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.751223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b158035-f474-4ff6-aa7b-3b977b9fa6f4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.751223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b158035-f474-4ff6-aa7b-3b977b9fa6f4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.752624 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 137/263] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:58.758362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01154d-8eb5-49dd-b442-74a3d268b2e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.759267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01154d-8eb5-49dd-b442-74a3d268b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.759763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01154d-8eb5-49dd-b442-74a3d268b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.786882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b5fb-8580-48bf-90c7-5472b522581f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.787574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b5fb-8580-48bf-90c7-5472b522581f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.788053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8b5fb-8580-48bf-90c7-5472b522581f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.789668 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 138/264] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:03:58.792693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ca01154d-8eb5-49dd-b442-74a3d268b2e3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:58.795588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c243c8-ab0b-4350-86d4-9ee1485f7c1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.796162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c243c8-ab0b-4350-86d4-9ee1485f7c1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.796636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c243c8-ab0b-4350-86d4-9ee1485f7c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.803662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca01154d-8eb5-49dd-b442-74a3d268b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:58.830001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0c243c8-ab0b-4350-86d4-9ee1485f7c1e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:58.833488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0c243c8-ab0b-4350-86d4-9ee1485f7c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:58.896130 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 127/265] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 13:03:58.898313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ce5a9-e0f1-4820-84fa-070b485ab1ba None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.898934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ce5a9-e0f1-4820-84fa-070b485ab1ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.899393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ce5a9-e0f1-4820-84fa-070b485ab1ba None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.901009 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 128/266] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:58.906422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54769a4-0de8-47ea-9afe-e4678b75d8f5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:58.906930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54769a4-0de8-47ea-9afe-e4678b75d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:58.907383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54769a4-0de8-47ea-9afe-e4678b75d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:58.936503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e54769a4-0de8-47ea-9afe-e4678b75d8f5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:58.938203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e54769a4-0de8-47ea-9afe-e4678b75d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:58.938341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 139/267] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:03:58.949605 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 129/268] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 18 13:03:59.255911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c243c8-ab0b-4350-86d4-9ee1485f7c1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.266884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c243c8-ab0b-4350-86d4-9ee1485f7c1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.272394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.276749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.277546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.278349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.294731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:59.300020 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:59.300911 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:03:59.301755 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:59.304371 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 140/269] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:59.310817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54769a4-0de8-47ea-9afe-e4678b75d8f5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.322406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54769a4-0de8-47ea-9afe-e4678b75d8f5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.327519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.328378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.328857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.329328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.330277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:59.330785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.332012 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:03:59.332012 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:03:59.332012 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:03:59.333395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.342779 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 130/270] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:59.348604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.362324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d18b9-0e40-43b8-8cf9-029b03622817 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.367553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.368613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.369098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.369566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.371101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.373100 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:03:59.373100 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:03:59.373100 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:03:59.374840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.376881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 141/271] 10.222.0.27 () {56 vars in 1201 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:59.382816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.394160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601851c-57dc-4e82-8fad-8c01c99ebaee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.399141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.400020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.400541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.401051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.402445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.404878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.406881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 131/272] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:59.415243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.421944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.429174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31add42-223c-470e-9cfb-698f494dd25e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.438897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.439863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.440409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.440895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.447043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e, group_id=4ab0c7dbe840409498a6a9c175cbaa15, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.454581 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:03:59.454581 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:03:59.454581 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:03:59.459329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.537023 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 142/273] 10.222.0.27 () {58 vars in 1463 bytes} [Tue Oct 18 13:03:59 2022] PUT /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:03:59.537023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.610337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:59.617503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e33dc-35aa-41b0-a3da-1e7f6a12a730 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.668872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aa7fb-015e-49ce-be29-6bfea998f99f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.677337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93cf7d-76fe-4a02-b55c-05110cac4018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.678848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93cf7d-76fe-4a02-b55c-05110cac4018 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.679784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.680330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93cf7d-76fe-4a02-b55c-05110cac4018 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.681185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.681677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93cf7d-76fe-4a02-b55c-05110cac4018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.682754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.683235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.689637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:03:59.708207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:59.711928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93cf7d-76fe-4a02-b55c-05110cac4018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:59.719695 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:59.720669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:03:59.721429 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3f93cf7d-76fe-4a02-b55c-05110cac4018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:03:59.722613 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:03:59.723377 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:03:59.725456 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 132/274] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:59.732307 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 143/275] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:03:59.732490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3029298-a582-42b2-8423-6c9f900048ef None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.732490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3029298-a582-42b2-8423-6c9f900048ef None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.732490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3029298-a582-42b2-8423-6c9f900048ef None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.732490 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 133/276] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:03:59.733011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.738080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bd48e-2527-4314-a7b4-8c696bca57e2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.738080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bd48e-2527-4314-a7b4-8c696bca57e2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.738080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bd48e-2527-4314-a7b4-8c696bca57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.749453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e591c-3273-4b13-80c8-e41e4018242b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.761866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.765990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.766307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.766642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.767366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:03:59.767678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.770823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.782183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9c6bd48e-2527-4314-a7b4-8c696bca57e2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:03:59.783463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c6bd48e-2527-4314-a7b4-8c696bca57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:03:59.789944 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 144/277] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:59.791157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.803968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 134/278] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:03:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 13:03:59.805188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bd48e-2527-4314-a7b4-8c696bca57e2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.816059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bd48e-2527-4314-a7b4-8c696bca57e2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.821052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.821938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.822430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.822995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.824332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.827741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.829896 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 135/279] 10.222.0.27 () {56 vars in 1201 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:03:59.839239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.858146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905dbeb-b663-4276-b4c5-620c25a54165 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.869710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.870881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.872978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.873756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.875968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.879552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.881563 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 136/280] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:03:59.888585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:03:59.904409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576721-ddff-41e7-8704-39a664241392 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:03:59.911527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:03:59.912468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:03:59.912941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:03:59.913424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/8ff4721e72e84ea6a7943c7a0b88a5f4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:03:59.915871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3053b3aba2bb4c728ebaafe4553b0ef2, group_id=4ab0c7dbe840409498a6a9c175cbaa15, role_id=8ff4721e72e84ea6a7943c7a0b88a5f4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:03:59.920059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:03:59.967231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a242c7-c61b-4a26-adae-76acbaec4913 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.012467 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 137/281] 10.222.0.27 () {58 vars in 1463 bytes} [Tue Oct 18 13:03:59 2022] PUT /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:00.023159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.024251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.024768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.025289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.026176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:00.026666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:00.028357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:00.042034 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 145/282] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:03:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:00.046501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:00.174952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354669-5e1a-4bcf-8d80-659cabd93374 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.210349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:00.216189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.216847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.217126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.217399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] PATH_INFO: `/v3/users/8d372a62ea3248bc8835446008c6f26f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.218736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] RBAC: Authorizing `identity:get_user(user_id=8d372a62ea3248bc8835446008c6f26f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:00.227334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:00.227334 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 138/283] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:04:00 2022] GET /identity/v3/users/8d372a62ea3248bc8835446008c6f26f => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:00.228537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:00.288506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:00.350961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c9ce3-0853-4ab4-988c-41fb552c0664 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.365615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:00.427679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.428301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.428579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.428849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.429582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] RBAC: Adding query filter params (role.id=9092ce23c0424a5e803d0a837c6d23ec, user.id=8d372a62ea3248bc8835446008c6f26f, scope.system=all) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:00.429886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:00.433571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:00.458177 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 146/284] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Oct 18 13:04:00 2022] GET /identity/v3/role_assignments?user.id=8d372a62ea3248bc8835446008c6f26f&scope.system=all&role.id=9092ce23c0424a5e803d0a837c6d23ec => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:00.482547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5c70-34d4-4493-b244-b603d90d4bae None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.487485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.488495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.488995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.489480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.501747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:00.508791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:00.509795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:00.510689 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:00.513569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 139/285] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Oct 18 13:04:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:00.519242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:00.547230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f97ed-f5df-4d69-b59b-745e9fe9484b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.556482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.557122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.557397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.557673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.558390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:00.558697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:00.560487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:00.576706 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 147/286] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Oct 18 13:04:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:00.582518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:00.596308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ab441-68a9-42ae-b07e-58996145b791 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.606442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.608003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.608495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.608977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.614826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:00.617126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:00.619423 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 140/287] 10.222.0.27 () {56 vars in 1201 bytes} [Tue Oct 18 13:04:00 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:00.624779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:00.635089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae9875-ecf7-407c-a87a-960b6722a49c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.645990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fc0da-e187-4b71-9d59-1c2a8729cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.646667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fc0da-e187-4b71-9d59-1c2a8729cb96 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.646941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fc0da-e187-4b71-9d59-1c2a8729cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.647209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fc0da-e187-4b71-9d59-1c2a8729cb96 admin admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.650732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fc0da-e187-4b71-9d59-1c2a8729cb96 admin admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:00.652798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fc0da-e187-4b71-9d59-1c2a8729cb96 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:00.655390 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 148/288] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Oct 18 13:04:00 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:00.660798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:00.675839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a49275-5d46-4cf4-80b8-4f5125debe9a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:00.685539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce4cce-07b1-43cd-9e7d-d6e58b83ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:00.686597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce4cce-07b1-43cd-9e7d-d6e58b83ef6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.687108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce4cce-07b1-43cd-9e7d-d6e58b83ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.687581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce4cce-07b1-43cd-9e7d-d6e58b83ef6c admin admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/8ff4721e72e84ea6a7943c7a0b88a5f4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.696057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce4cce-07b1-43cd-9e7d-d6e58b83ef6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e, group_id=4ab0c7dbe840409498a6a9c175cbaa15, role_id=8ff4721e72e84ea6a7943c7a0b88a5f4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:00.699160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce4cce-07b1-43cd-9e7d-d6e58b83ef6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:00.792274 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 141/289] 10.222.0.27 () {58 vars in 1463 bytes} [Tue Oct 18 13:04:00 2022] PUT /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e/groups/4ab0c7dbe840409498a6a9c175cbaa15/roles/8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:00.872891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850a0d-ea02-463f-880f-fe2148458a52 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.873421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850a0d-ea02-463f-880f-fe2148458a52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.873421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa850a0d-ea02-463f-880f-fe2148458a52 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.875012 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 149/290] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:00.889302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac399-2f37-47f4-9a33-df89f9dffb41 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:00.889958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac399-2f37-47f4-9a33-df89f9dffb41 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:00.890482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac399-2f37-47f4-9a33-df89f9dffb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:00.917146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b51ac399-2f37-47f4-9a33-df89f9dffb41 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:00.918841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b51ac399-2f37-47f4-9a33-df89f9dffb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:00.997008 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 142/291] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 13:04:01.353412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850a0d-ea02-463f-880f-fe2148458a52 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:01.368012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa850a0d-ea02-463f-880f-fe2148458a52 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:01.372926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:01.373544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:01.373818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:01.374161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:01.387626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:01.393045 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:01.393941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:01.394766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 150/292] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:01.400201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac399-2f37-47f4-9a33-df89f9dffb41 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:01.412528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac399-2f37-47f4-9a33-df89f9dffb41 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:01.417908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:01.418565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:01.418845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:01.419648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:01.420325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:01.420628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:01.422256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:01.436340 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 143/293] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Oct 18 13:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:01.442222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:01.454759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f7989-b4bc-4e17-bfc1-5e4fbce8934f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:01.459321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:01.459965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:01.460244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:01.460512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] PATH_INFO: `/v3/groups/d4621667c350455c81a1535a4343afcc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:01.474082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] RBAC: Authorizing `identity:get_group(group_id=d4621667c350455c81a1535a4343afcc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:01.474082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:01.474082 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 151/294] 10.222.0.27 () {56 vars in 1201 bytes} [Tue Oct 18 13:04:01 2022] GET /identity/v3/groups/d4621667c350455c81a1535a4343afcc => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:01.479866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:01.491686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df067c-fd9e-4b92-9bc7-5fe78969871f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:01.496367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc37b07-2afc-4d28-9a34-e65f1b83af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:01.497001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc37b07-2afc-4d28-9a34-e65f1b83af11 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:01.497834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc37b07-2afc-4d28-9a34-e65f1b83af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:01.498146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc37b07-2afc-4d28-9a34-e65f1b83af11 admin admin] PATH_INFO: `/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:01.499281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc37b07-2afc-4d28-9a34-e65f1b83af11 admin admin] RBAC: Authorizing `identity:get_project(project_id=5197f824fa2b4aa1886cdd12c796a5bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:01.501151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc37b07-2afc-4d28-9a34-e65f1b83af11 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:01.503060 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 144/295] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Oct 18 13:04:01 2022] GET /identity/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:01.508607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:01.519237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fc764-73df-4e95-aad5-222ae4580ca7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:01.523744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850cb65-025f-4edc-bf37-09148ae4b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:01.524451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850cb65-025f-4edc-bf37-09148ae4b5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:01.524728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850cb65-025f-4edc-bf37-09148ae4b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:01.525050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850cb65-025f-4edc-bf37-09148ae4b5f4 admin admin] PATH_INFO: `/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc/groups/d4621667c350455c81a1535a4343afcc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:01.527036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850cb65-025f-4edc-bf37-09148ae4b5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5197f824fa2b4aa1886cdd12c796a5bc, group_id=d4621667c350455c81a1535a4343afcc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:01.529766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850cb65-025f-4edc-bf37-09148ae4b5f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:01.602253 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 152/296] 10.222.0.27 () {58 vars in 1463 bytes} [Tue Oct 18 13:04:01 2022] PUT /identity/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc/groups/d4621667c350455c81a1535a4343afcc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:01.717663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8a1f-7e33-42f2-b481-ec899f8459ee None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:01.718021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8a1f-7e33-42f2-b481-ec899f8459ee None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:01.718256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f8a1f-7e33-42f2-b481-ec899f8459ee None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:01.719595 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 145/297] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:01.725459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8d38-ed3b-4bd1-a5d9-b693a98e82f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:01.725733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8d38-ed3b-4bd1-a5d9-b693a98e82f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:01.726010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8d38-ed3b-4bd1-a5d9-b693a98e82f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:01.754640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0ce8d38-ed3b-4bd1-a5d9-b693a98e82f5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:01.755925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0ce8d38-ed3b-4bd1-a5d9-b693a98e82f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:01.829062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:01.844518 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 153/298] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:02.153312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8a1f-7e33-42f2-b481-ec899f8459ee None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:02.231780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:02.293005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f8a1f-7e33-42f2-b481-ec899f8459ee None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:02.336290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:02.336982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:02.337262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:02.337588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:02.351791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:02.357229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:02.358141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:02.358924 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 146/299] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:02.364584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8d38-ed3b-4bd1-a5d9-b693a98e82f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:02.486073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8d38-ed3b-4bd1-a5d9-b693a98e82f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:02.526559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e4b0-c345-4486-aa15-74e6e679f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:02.527407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e4b0-c345-4486-aa15-74e6e679f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:02.527848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e4b0-c345-4486-aa15-74e6e679f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:02.528264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e4b0-c345-4486-aa15-74e6e679f8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:02.529103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e4b0-c345-4486-aa15-74e6e679f8f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:02.529549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e4b0-c345-4486-aa15-74e6e679f8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:02.531075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4e4b0-c345-4486-aa15-74e6e679f8f6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:02.540087 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 154/300] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:02.545591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:02.678819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd964ba-e385-4dbb-8b00-f6276812cfe5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:02.711871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:02.721525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:02.722170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:02.722452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:02.722723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:02.809373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:02.811441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:02.884489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6eb3f-6b5c-470e-a9a1-15b2ccc6c3bd None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:02.885127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6eb3f-6b5c-470e-a9a1-15b2ccc6c3bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:02.885597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6eb3f-6b5c-470e-a9a1-15b2ccc6c3bd None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:02.889118 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 155/301] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:02.893551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e39d52-eff7-4b62-9953-9e7b6e23a046 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:02.894110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e39d52-eff7-4b62-9953-9e7b6e23a046 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:02.894603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e39d52-eff7-4b62-9953-9e7b6e23a046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:02.913555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-33e39d52-eff7-4b62-9953-9e7b6e23a046 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:02.915085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33e39d52-eff7-4b62-9953-9e7b6e23a046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:02.921278 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 147/302] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:04:02.928586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:02.969393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:02.987099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:03.004108 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 156/303] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:04:03.064252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83a61c-e136-4c71-bd60-3d92888c93dc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:03.108607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac6e32-ea47-458b-a945-88fd83922bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:03.109585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac6e32-ea47-458b-a945-88fd83922bf3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:03.110178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac6e32-ea47-458b-a945-88fd83922bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:03.110627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac6e32-ea47-458b-a945-88fd83922bf3 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:03.111943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac6e32-ea47-458b-a945-88fd83922bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:03.113630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac6e32-ea47-458b-a945-88fd83922bf3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:03.117739 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 148/304] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:04:02 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:03.121164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e39d52-eff7-4b62-9953-9e7b6e23a046 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:03.147292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd63c4-b9f6-4fd8-a41e-863e8e0a7639 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:03.147850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd63c4-b9f6-4fd8-a41e-863e8e0a7639 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:03.148315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd63c4-b9f6-4fd8-a41e-863e8e0a7639 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:03.149807 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 149/305] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:03.155118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cf32e-a6b4-4295-ae5f-6279aa05731e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:03.156032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cf32e-a6b4-4295-ae5f-6279aa05731e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:03.156476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cf32e-a6b4-4295-ae5f-6279aa05731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:03.185548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c6cf32e-a6b4-4295-ae5f-6279aa05731e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:03.187383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c6cf32e-a6b4-4295-ae5f-6279aa05731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:03.279158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e39d52-eff7-4b62-9953-9e7b6e23a046 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:03.324743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:03.325418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:03.325698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:03.325971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:03.327725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:03.329170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:03.331004 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 157/306] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Oct 18 13:04:03 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:03.341867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:03.345804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 150/307] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:04:03.396680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:03.453480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f910da7-fdb9-4abd-a1fe-f022e0159efa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:03.503421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cf32e-a6b4-4295-ae5f-6279aa05731e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:03.508069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:03.508942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:03.509458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:03.509918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:03.510867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] RBAC: Adding query filter params (group.id=4ab0c7dbe840409498a6a9c175cbaa15, role.id=a2471da680c44d5ea10d4af71215fd3d, scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:03.511377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:03.513040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:03.523015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 158/308] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Oct 18 13:04:03 2022] GET /identity/v3/role_assignments?group.id=4ab0c7dbe840409498a6a9c175cbaa15&scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2&role.id=a2471da680c44d5ea10d4af71215fd3d => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:03.534535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:03.638693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cf32e-a6b4-4295-ae5f-6279aa05731e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:03.684498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:03.685576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:03.686097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:03.686568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:03.707130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:03.712481 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:03.713401 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:03.714214 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:03.717310 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 151/309] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:03.723481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:03.804213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:03.934450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:03.938488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71770192-ccf1-48dd-83a6-987ea2aa25c3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:03.955953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fabbf-7535-4897-8881-75ce10b128cd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:03.968481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:04.006300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.007332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.007614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.007890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.010439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.011070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.011340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.011604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.015093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:04.015093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:04.017483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:04.027539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:04.033276 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:04.034415 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 13:04:04.035202 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:04.035782 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 159/310] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:04.037036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.038327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 152/311] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:04.046042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.150429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e049ec0-cda3-47b8-b89e-e9c5e6bb86d0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:04.153928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa636be2-dc53-4831-b325-af84aed2d4ea None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:04.189741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.190556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.190845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.198147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.198255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199653-1f68-48c6-89fc-a3f80baddb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.198255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199653-1f68-48c6-89fc-a3f80baddb9f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.198255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199653-1f68-48c6-89fc-a3f80baddb9f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.198255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199653-1f68-48c6-89fc-a3f80baddb9f None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.198846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199653-1f68-48c6-89fc-a3f80baddb9f None admin] RBAC: Adding query filter params (name=member) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:04.198846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199653-1f68-48c6-89fc-a3f80baddb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:04.198846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14199653-1f68-48c6-89fc-a3f80baddb9f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:04.199458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:04.208147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 153/312] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:04.209168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0166c-e49b-4fdb-a9cf-3212d2d7c331 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.209451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0166c-e49b-4fdb-a9cf-3212d2d7c331 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.209723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0166c-e49b-4fdb-a9cf-3212d2d7c331 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.211448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 154/313] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:04.217378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202bbc-6af2-412b-a3d4-0f49b80455bd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.217740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202bbc-6af2-412b-a3d4-0f49b80455bd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.218113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202bbc-6af2-412b-a3d4-0f49b80455bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.237867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ae202bbc-6af2-412b-a3d4-0f49b80455bd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:04.239961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae202bbc-6af2-412b-a3d4-0f49b80455bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:04.240483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:04.279194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:04.280638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:04.344824 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 155/314] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:04.350517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202bbc-6af2-412b-a3d4-0f49b80455bd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.430227 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 160/315] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 13:04:04.434431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.482023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202bbc-6af2-412b-a3d4-0f49b80455bd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:04.509479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:04.518638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.520511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.520511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.520511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.530266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:04.563755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca2cc5-6bdf-4841-b061-14ce85e2e2ed None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:04.598369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:04.600111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:04.611824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.613171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.613631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.614259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] PATH_INFO: `/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.615716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] RBAC: Authorizing `identity:get_project(project_id=3053b3aba2bb4c728ebaafe4553b0ef2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:04.618377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:04.621241 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 161/316] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/projects/3053b3aba2bb4c728ebaafe4553b0ef2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:04.629092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.725338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 156/317] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:04:04.726601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.758935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:04.768011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d94d6-991b-4d91-a41d-c392f8c04017 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:04.820180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.820823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.821105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.821381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.822563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:04.824357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:04.825665 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 162/318] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:04.826517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.845680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:04.865368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d28e70-88e8-4dac-8b3b-a1027964a929 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:04.902849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43bf20-6a24-4a94-9c95-4faf9387c456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:04.904031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43bf20-6a24-4a94-9c95-4faf9387c456 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.904310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43bf20-6a24-4a94-9c95-4faf9387c456 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.904583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43bf20-6a24-4a94-9c95-4faf9387c456 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.915969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43bf20-6a24-4a94-9c95-4faf9387c456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6c43bf20-6a24-4a94-9c95-4faf9387c456 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:04.922023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:04.922912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:04.923687 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 157/319] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:04.927735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac6f0-ceb3-41b7-bbfd-b2e4ad994750 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:04.928020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac6f0-ceb3-41b7-bbfd-b2e4ad994750 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:04.928294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac6f0-ceb3-41b7-bbfd-b2e4ad994750 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:04.929567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 158/320] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:04.930403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac6f0-ceb3-41b7-bbfd-b2e4ad994750 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:04.957593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc52d1-7d0d-4f2e-8348-7712ce3a8a11 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.002815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.003382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.003661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.003933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.005157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.006697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:05.008439 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 163/321] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:05.009215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.039213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.057774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac6f0-ceb3-41b7-bbfd-b2e4ad994750 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.097662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7ebdd-c97b-4a9f-82dd-fd54b8bfe2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.098353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7ebdd-c97b-4a9f-82dd-fd54b8bfe2a1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.098638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7ebdd-c97b-4a9f-82dd-fd54b8bfe2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.098911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7ebdd-c97b-4a9f-82dd-fd54b8bfe2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.099960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7ebdd-c97b-4a9f-82dd-fd54b8bfe2a1 None admin] RBAC: Adding query filter params (group.id=4ab0c7dbe840409498a6a9c175cbaa15, role.id=8ff4721e72e84ea6a7943c7a0b88a5f4, scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:05.100267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7ebdd-c97b-4a9f-82dd-fd54b8bfe2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.101797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7ebdd-c97b-4a9f-82dd-fd54b8bfe2a1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:05.106137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.109499 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 159/322] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Oct 18 13:04:04 2022] GET /identity/v3/role_assignments?group.id=4ab0c7dbe840409498a6a9c175cbaa15&scope.project.id=3053b3aba2bb4c728ebaafe4553b0ef2&role.id=8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:05.110729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0175f-f630-446c-81f0-78fdca5f1ff9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.111013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0175f-f630-446c-81f0-78fdca5f1ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.111286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0175f-f630-446c-81f0-78fdca5f1ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.133420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5dc0175f-f630-446c-81f0-78fdca5f1ff9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:05.134691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5dc0175f-f630-446c-81f0-78fdca5f1ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:05.137381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd06a3-121c-4100-8acf-b7f1bfdab2a5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.186304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.187247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.187525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.187795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.189455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:05.189767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.191219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:05.204356 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 164/323] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:05.205931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.235195 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 160/324] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:05.235725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0175f-f630-446c-81f0-78fdca5f1ff9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.340791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.361267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a18937-e0cc-4c52-bc89-a1de88dfd3d8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.363860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0175f-f630-446c-81f0-78fdca5f1ff9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.406933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.407736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.408081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.408420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.410581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.412006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:05.413868 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 165/325] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:05.415776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.416392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.416669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.416938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.420023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.431441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.510799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.512574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:05.553525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c25a4-9b10-43d4-8521-7d179ff4bfea None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.593537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.594099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.594378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.594643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.595373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] RBAC: Adding query filter params (group.id=4ab0c7dbe840409498a6a9c175cbaa15, role.id=a2471da680c44d5ea10d4af71215fd3d, scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:05.595683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.597103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:05.604210 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 166/326] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/role_assignments?group.id=4ab0c7dbe840409498a6a9c175cbaa15&scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e&role.id=a2471da680c44d5ea10d4af71215fd3d => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:05.605013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.609924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.637709 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 161/327] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:04:05.644401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.708756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.750591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda680ed-5fbd-44cd-b71c-07caabc47df3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.785063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231811-3300-49bb-b0ee-7af70afddd5e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.792574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.793377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.793482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.793734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.805115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:05.811932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:05.812823 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:05.814001 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 167/328] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:05.818831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.824850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.826115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.826362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.826696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] PATH_INFO: `/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.827839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] RBAC: Authorizing `identity:get_project(project_id=2bbf4a0735ff444aa6d7d563f7f75b8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.829279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:05.831239 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 162/329] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/projects/2bbf4a0735ff444aa6d7d563f7f75b8e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:05.836375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:05.898518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.945641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210484b1-b186-4df3-b44d-65c85c4beead None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.967879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590cfe-d5df-405b-921d-7865950ae872 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:05.978761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:05.985883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:05.986555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:05.986832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:05.995361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:05.995361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:05.995361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:05.995361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:06.000150 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 168/330] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:06.007229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:06.009399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:06.010038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:06.010338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:06.010606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] PATH_INFO: `/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:06.012076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] RBAC: Authorizing `identity:get_group(group_id=4ab0c7dbe840409498a6a9c175cbaa15)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:06.013601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:06.015195 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 163/331] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Oct 18 13:04:05 2022] GET /identity/v3/groups/4ab0c7dbe840409498a6a9c175cbaa15 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:06.020961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:06.105596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eef9f-ef1e-47cf-bf82-af6c324e5128 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:06.118301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4734fd-b9ab-4ce6-bae3-c51c0de4df53 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:06.134935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:06.140102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:06.140701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:06.140983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:06.142469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:06.151913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:06.152446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:06.152724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:06.152998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:06.153718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] RBAC: Adding query filter params (group.id=4ab0c7dbe840409498a6a9c175cbaa15, role.id=8ff4721e72e84ea6a7943c7a0b88a5f4, scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:06.154203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:06.155646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:06.161715 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 164/332] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Oct 18 13:04:06 2022] GET /identity/v3/role_assignments?group.id=4ab0c7dbe840409498a6a9c175cbaa15&scope.project.id=2bbf4a0735ff444aa6d7d563f7f75b8e&role.id=8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:06.203973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:06.211752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:06.213239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:06.318611 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 169/333] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 13:04:06.324186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:06.426968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1dfe6-7093-414b-b1e1-81d08041309d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:06.463747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:06.464290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:06.464566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:06.464836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] PATH_INFO: `/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:06.465995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] RBAC: Authorizing `identity:get_project(project_id=5197f824fa2b4aa1886cdd12c796a5bc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:06.467564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:06.469194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 165/334] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:04:06 2022] GET /identity/v3/projects/5197f824fa2b4aa1886cdd12c796a5bc => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:06.475177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:06.567409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:06.573812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080486f-16a9-46c8-b827-1e4edda00c96 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:06.606423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37d078-6607-4f64-a784-7725de4c9797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:06.607079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37d078-6607-4f64-a784-7725de4c9797 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:06.607355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37d078-6607-4f64-a784-7725de4c9797 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:06.607625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37d078-6607-4f64-a784-7725de4c9797 None admin] PATH_INFO: `/v3/groups/d4621667c350455c81a1535a4343afcc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:06.608707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37d078-6607-4f64-a784-7725de4c9797 None admin] RBAC: Authorizing `identity:get_group(group_id=d4621667c350455c81a1535a4343afcc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:06.610147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37d078-6607-4f64-a784-7725de4c9797 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:06.611785 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 170/335] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Oct 18 13:04:06 2022] GET /identity/v3/groups/d4621667c350455c81a1535a4343afcc => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:06.617713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:06.665554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:06.714619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2dd5f-570c-4d8f-8c5e-61d4f80c3ecc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:06.746591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e04c9-44c5-463a-8ea2-54e8d56a8e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:06.747724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e04c9-44c5-463a-8ea2-54e8d56a8e11 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:06.748002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e04c9-44c5-463a-8ea2-54e8d56a8e11 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:06.748272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e04c9-44c5-463a-8ea2-54e8d56a8e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:06.748977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e04c9-44c5-463a-8ea2-54e8d56a8e11 None admin] RBAC: Adding query filter params (group.id=d4621667c350455c81a1535a4343afcc, role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=5197f824fa2b4aa1886cdd12c796a5bc) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:06.749281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e04c9-44c5-463a-8ea2-54e8d56a8e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:06.750732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e04c9-44c5-463a-8ea2-54e8d56a8e11 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:06.756199 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 166/336] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Oct 18 13:04:06 2022] GET /identity/v3/role_assignments?group.id=d4621667c350455c81a1535a4343afcc&scope.project.id=5197f824fa2b4aa1886cdd12c796a5bc&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:09.320323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e461f9f-32cf-45d0-a383-e492da28a8c6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:09.320841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e461f9f-32cf-45d0-a383-e492da28a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:09.320841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e461f9f-32cf-45d0-a383-e492da28a8c6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:09.322220 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 171/337] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:09.329068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dfc51-44a3-43fa-b561-04ace5c69772 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:09.329519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dfc51-44a3-43fa-b561-04ace5c69772 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:09.329594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dfc51-44a3-43fa-b561-04ace5c69772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:09.355131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2c5dfc51-44a3-43fa-b561-04ace5c69772 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:09.356318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c5dfc51-44a3-43fa-b561-04ace5c69772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:09.439281 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 167/338] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:09.471257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbff29-9f49-47b6-87f3-229975663a01 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:09.471541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbff29-9f49-47b6-87f3-229975663a01 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:09.471806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbff29-9f49-47b6-87f3-229975663a01 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:09.473151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 172/339] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:09.479467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89d29-c1d2-4a7e-bb20-cbd60c9a2190 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:09.479749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89d29-c1d2-4a7e-bb20-cbd60c9a2190 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:09.480019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89d29-c1d2-4a7e-bb20-cbd60c9a2190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:09.514998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0df89d29-c1d2-4a7e-bb20-cbd60c9a2190 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:09.516177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0df89d29-c1d2-4a7e-bb20-cbd60c9a2190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:09.558358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:09.599957 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 168/340] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:04:09.751738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3038a-e66b-4f6b-a289-5241d17da3c7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:09.752060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3038a-e66b-4f6b-a289-5241d17da3c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:09.752290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3038a-e66b-4f6b-a289-5241d17da3c7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:09.753890 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 173/341] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:09.758802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929891a-d00b-44b0-8f21-658a278df808 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:09.759088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929891a-d00b-44b0-8f21-658a278df808 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:09.759364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929891a-d00b-44b0-8f21-658a278df808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:09.783518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8929891a-d00b-44b0-8f21-658a278df808 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:09.784683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8929891a-d00b-44b0-8f21-658a278df808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:09.868192 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 169/342] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:09.902543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3038a-e66b-4f6b-a289-5241d17da3c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:09.979239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929891a-d00b-44b0-8f21-658a278df808 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.058883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3038a-e66b-4f6b-a289-5241d17da3c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.112383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929891a-d00b-44b0-8f21-658a278df808 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.113849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:10.123533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.124127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.124406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.124680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.147191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.148673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.149484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.150362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.150835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.151279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:10.168940 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:10.170481 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:10.171320 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:10.171320 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:10.171320 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:10.171320 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 174/343] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:10.171529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.172374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.173853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.190402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:10.192787 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:10.193658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:10.195130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:10.195130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:10.195130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:10.195130 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 170/344] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:10.195130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.299054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1179ff-1f9b-44e2-8358-f8e2718e8d7c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.325492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a01e82-9bfd-44df-b575-ea130c30f622 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.348374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df06f1-c724-4a6e-8621-5136d87388a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.350558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df06f1-c724-4a6e-8621-5136d87388a0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.351294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df06f1-c724-4a6e-8621-5136d87388a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.351778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df06f1-c724-4a6e-8621-5136d87388a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.364771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.365288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df06f1-c724-4a6e-8621-5136d87388a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.365368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.365654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.365928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.366608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:10.366774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df06f1-c724-4a6e-8621-5136d87388a0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.366918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.368331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.385618 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 171/345] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b8df06f1-c724-4a6e-8621-5136d87388a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:10.385763 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:10.386601 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:10.387410 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:10.387410 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:10.387410 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:10.387565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.388160 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 175/346] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:10.389370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346afc5-766f-46db-add9-b6fe1731e48c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.389664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346afc5-766f-46db-add9-b6fe1731e48c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.389944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346afc5-766f-46db-add9-b6fe1731e48c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.391366 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 176/347] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:10.392052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346afc5-766f-46db-add9-b6fe1731e48c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.409005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:10.471454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:10.495242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ce80-7b49-4637-88cd-8bc10ff9544f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.511293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346afc5-766f-46db-add9-b6fe1731e48c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.530921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.531524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.531802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.532069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.532698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:10.532989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.534370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.546318 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 172/348] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:10.548191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3864-6f36-4670-b3eb-58fd0c9528d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.548804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3864-6f36-4670-b3eb-58fd0c9528d8 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.549085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3864-6f36-4670-b3eb-58fd0c9528d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.549361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3864-6f36-4670-b3eb-58fd0c9528d8 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.550011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca3864-6f36-4670-b3eb-58fd0c9528d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.551231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.551606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca3864-6f36-4670-b3eb-58fd0c9528d8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.627194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:10.651992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d2a75-bfae-4772-8fbb-0c003a7141ae None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.658231 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 177/349] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:04:10 2022] POST /identity/v3/users => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:10.659808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416b9c-6d4d-44af-8e02-fa4761a8db2b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.660164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416b9c-6d4d-44af-8e02-fa4761a8db2b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.660510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416b9c-6d4d-44af-8e02-fa4761a8db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.680652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b3416b9c-6d4d-44af-8e02-fa4761a8db2b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:10.682208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3416b9c-6d4d-44af-8e02-fa4761a8db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:10.709377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.710590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.711054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.711691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.713069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:10.713821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.715674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.734618 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 173/350] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:10.735802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.777478 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 178/351] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:10.778893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3416b9c-6d4d-44af-8e02-fa4761a8db2b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:10.848699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:10.855563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57440c-14a8-4658-9f66-2d387af3c0fc None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.906804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba21f2e-52bb-457c-8a54-8ae376636d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.908032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21f2e-52bb-457c-8a54-8ae376636d27 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.908750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21f2e-52bb-457c-8a54-8ae376636d27 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.909175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba21f2e-52bb-457c-8a54-8ae376636d27 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.910165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba21f2e-52bb-457c-8a54-8ae376636d27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.912359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba21f2e-52bb-457c-8a54-8ae376636d27 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:10.914618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3416b9c-6d4d-44af-8e02-fa4761a8db2b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:10.922956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:10.961507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:10.962529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:10.962966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:10.963241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:10.963940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:10.965436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:11.011147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 174/352] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:04:10 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:11.012381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b6d6c-fd6f-4eaa-837d-a3f6adb62e1b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:11.012709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b6d6c-fd6f-4eaa-837d-a3f6adb62e1b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:11.013485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b6d6c-fd6f-4eaa-837d-a3f6adb62e1b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:11.014954 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 175/353] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:11.020681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080371f4-fb12-4fe9-96f3-fce19fbd8b5e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:11.020983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080371f4-fb12-4fe9-96f3-fce19fbd8b5e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:11.021225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080371f4-fb12-4fe9-96f3-fce19fbd8b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:11.044628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-080371f4-fb12-4fe9-96f3-fce19fbd8b5e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:11.046782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-080371f4-fb12-4fe9-96f3-fce19fbd8b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:11.072225 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 179/354] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:04:10 2022] POST /identity/v3/users => generated 248 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:11.114676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:11.168634 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 176/355] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:11.282077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448785-0dad-4810-bbfd-65b15fa1e3e7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:11.290758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:11.317749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:11.318423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:11.318702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:11.318976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:11.330612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:11.332157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:11.349212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:11.350846 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:11.352262 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:11.352262 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:11.352262 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:11.352262 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 180/356] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:11.358610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080371f4-fb12-4fe9-96f3-fce19fbd8b5e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:11.467865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080371f4-fb12-4fe9-96f3-fce19fbd8b5e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:11.485699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:11.499735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:11.527784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:11.528945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:11.529232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:11.529506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:11.530195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:11.530493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:11.531862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:11.559281 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 177/357] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:11.576399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:11.614257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c56b1-000f-4263-b7d1-3bc35fd0ac05 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:11.694924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:11.695964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:11.696442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:11.696908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:11.697802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:11.699429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:11.753514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015e1c9-3b54-4f79-8dcd-4b0b56ce23b4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:11.777410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 13:04:11.777410 n-d-858383-13 devstack@keystone.service[82161]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 18 13:04:11.777410 n-d-858383-13 devstack@keystone.service[82161]: [parameters: {'id': '3ed7ebff14f54e8f9cbcb8418dba3b59', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 18 13:04:11.777410 n-d-858383-13 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 13:04:11.826166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:11.826166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:11.826166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:11.826166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:11.826605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:11.827011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:04:11.828039 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return ref.to_dict() Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:04:11.828849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:04:11.829748 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:04:11.830640 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:04:11.831503 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:04:11.832310 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': '3ed7ebff14f54e8f9cbcb8418dba3b59', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:11.833058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 18 13:04:11.833864 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:11.839081 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 181/358] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Oct 18 13:04:11 2022] POST /identity/v3/roles => generated 144 bytes in 354 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:11.846385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:11.885135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:11.968929 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 178/359] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:04:11 2022] POST /identity/v3/users => generated 249 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:04:11.975440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7ac75-e0cf-412e-a468-ee6d141e7bb0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:12.040513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2cd61-a029-421f-a4e6-79387ccfadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:12.041457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2cd61-a029-421f-a4e6-79387ccfadca None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:12.041944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2cd61-a029-421f-a4e6-79387ccfadca None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:12.042472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2cd61-a029-421f-a4e6-79387ccfadca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:12.063581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2cd61-a029-421f-a4e6-79387ccfadca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c4a2cd61-a029-421f-a4e6-79387ccfadca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:12.069351 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:12.070254 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 13:04:12.071061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:12.073330 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 182/360] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:12.083235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:12.166660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:12.262284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19675c48-3596-45b2-9270-ee22ace0f97c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:12.334577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5465e29-5f4e-46c2-a07c-d11000d3a22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:12.335140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5465e29-5f4e-46c2-a07c-d11000d3a22d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:12.335425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5465e29-5f4e-46c2-a07c-d11000d3a22d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:12.335705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5465e29-5f4e-46c2-a07c-d11000d3a22d None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:12.336401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5465e29-5f4e-46c2-a07c-d11000d3a22d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:12.336709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5465e29-5f4e-46c2-a07c-d11000d3a22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:12.341000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5465e29-5f4e-46c2-a07c-d11000d3a22d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:12.357973 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 179/361] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:13.368327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da038f-549e-4f5c-b580-acc0fa955bb7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:13.368865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da038f-549e-4f5c-b580-acc0fa955bb7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:13.369149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da038f-549e-4f5c-b580-acc0fa955bb7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:13.370913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 183/362] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:13.376746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35594b11-fba3-40d4-991e-3ea32b526534 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:13.377179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35594b11-fba3-40d4-991e-3ea32b526534 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:13.377562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35594b11-fba3-40d4-991e-3ea32b526534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:13.407716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-35594b11-fba3-40d4-991e-3ea32b526534 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:13.409401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-35594b11-fba3-40d4-991e-3ea32b526534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:13.511502 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 180/363] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:13.858299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743761-acf2-472c-8145-dcf645dce161 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:13.858909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743761-acf2-472c-8145-dcf645dce161 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:13.859418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9743761-acf2-472c-8145-dcf645dce161 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:13.861213 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 184/364] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:13.866153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a3b4-8a7c-4cfa-8f6c-66b8546c58cd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:13.866442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a3b4-8a7c-4cfa-8f6c-66b8546c58cd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:13.866719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a3b4-8a7c-4cfa-8f6c-66b8546c58cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:13.877410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9743761-acf2-472c-8145-dcf645dce161 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:13.892088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3025a3b4-8a7c-4cfa-8f6c-66b8546c58cd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:13.893265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3025a3b4-8a7c-4cfa-8f6c-66b8546c58cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:13.922222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:13.967618 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 181/365] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:13.968907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac7bc-d6aa-40e9-b069-6925f0ca9b0e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:13.969186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac7bc-d6aa-40e9-b069-6925f0ca9b0e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:13.969456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac7bc-d6aa-40e9-b069-6925f0ca9b0e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:13.971241 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 182/366] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:13.979242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c52af6-769b-4c31-9d3a-a4e011ca055e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:13.979746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c52af6-769b-4c31-9d3a-a4e011ca055e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:13.980216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c52af6-769b-4c31-9d3a-a4e011ca055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.000488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-72c52af6-769b-4c31-9d3a-a4e011ca055e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:14.001956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72c52af6-769b-4c31-9d3a-a4e011ca055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:14.010383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:14.054706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9743761-acf2-472c-8145-dcf645dce161 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.077888 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 183/367] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:14.125592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.126257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.126532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.126811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.143522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:14.148361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:14.149239 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:14.150025 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 185/368] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:14.157022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c52af6-769b-4c31-9d3a-a4e011ca055e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.265311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.282423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:14.308272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c52af6-769b-4c31-9d3a-a4e011ca055e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.370015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.370713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.370995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.371270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.372040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:14.372344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:14.373791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:14.384065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 184/369] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:14.395008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.446437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1d30-0028-4bea-9b23-49e9a0e81306 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.504869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.505886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.506426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.506912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.518549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:14.524241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:14.525171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:14.525987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:14.533130 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 186/370] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:14.534263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.538418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:14.544418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5b052-3b15-4c44-a6ae-2cd160c02554 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.582286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.582918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.583193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.583462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.597840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:14.599900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:14.618958 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:14.619912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:14.620772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:14.620772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:14.620772 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:14.620772 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 185/371] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:14.620999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.624107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:14.653950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37934-1f67-4b13-a285-07ab302b2c7c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.695589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.696400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.696686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.696961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.713439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:14.722366 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:14.723545 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 187/372] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:14.724375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.754524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291f0c4-8516-443b-baf0-49169230f13f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.810077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:14.810264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.810264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.810264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.810264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.810563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:14.810563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:14.812505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:14.820929 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 186/373] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:14.821933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.851522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce702516-b46e-42b1-8b5a-fa18e06048c3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.886016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:14.887230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.888351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.888596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.888868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.889513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:14.889817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:14.891235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:14.907597 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 188/374] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:14.907597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:14.931187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb132-d1e1-433b-a01b-a761a2ce4db5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:14.965608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925169f-91a8-430f-9344-eb4631abbc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:14.966274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925169f-91a8-430f-9344-eb4631abbc63 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.966553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925169f-91a8-430f-9344-eb4631abbc63 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.966829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925169f-91a8-430f-9344-eb4631abbc63 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.967476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925169f-91a8-430f-9344-eb4631abbc63 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:14.967781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925169f-91a8-430f-9344-eb4631abbc63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:14.969141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925169f-91a8-430f-9344-eb4631abbc63 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:14.977747 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 187/375] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:14.978763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747865-1581-476a-9dcc-5f5738b5b577 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:14.979046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747865-1581-476a-9dcc-5f5738b5b577 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:14.979316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747865-1581-476a-9dcc-5f5738b5b577 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:14.980498 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 188/376] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:14.985635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747865-1581-476a-9dcc-5f5738b5b577 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.016317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f98e2a-9f29-4181-8a72-c956f39588a6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.042639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.054313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.054951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.055235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.055514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.066486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.067967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:15.085221 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:15.086491 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:15.087455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:15.087455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:15.087455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:15.087455 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 189/377] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:15.087937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.101189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747865-1581-476a-9dcc-5f5738b5b577 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.128375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.136306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba8f8c-8e7f-46bf-8a63-3469d673d048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.136940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8f8c-8e7f-46bf-8a63-3469d673d048 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.137213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8f8c-8e7f-46bf-8a63-3469d673d048 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.137484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba8f8c-8e7f-46bf-8a63-3469d673d048 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.145060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba8f8c-8e7f-46bf-8a63-3469d673d048 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.146549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba8f8c-8e7f-46bf-8a63-3469d673d048 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7bba8f8c-8e7f-46bf-8a63-3469d673d048 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:15.159632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:15.160686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:15.161743 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 189/378] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Oct 18 13:04:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:15.162474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c894e-5e10-4056-b66b-780fabe382ab None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.162474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c894e-5e10-4056-b66b-780fabe382ab None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.162474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c894e-5e10-4056-b66b-780fabe382ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.180981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-af8c894e-5e10-4056-b66b-780fabe382ab None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:15.182293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-af8c894e-5e10-4056-b66b-780fabe382ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:15.193411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac669-e5eb-4a7f-9026-1968e5be463c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.226065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f919d-b4aa-49fb-86f7-5b2db9a680fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.226717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f919d-b4aa-49fb-86f7-5b2db9a680fd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.226991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f919d-b4aa-49fb-86f7-5b2db9a680fd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.227261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f919d-b4aa-49fb-86f7-5b2db9a680fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.238210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f919d-b4aa-49fb-86f7-5b2db9a680fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.239646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f919d-b4aa-49fb-86f7-5b2db9a680fd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.247549 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 190/379] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:15.248366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c894e-5e10-4056-b66b-780fabe382ab None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-949f919d-b4aa-49fb-86f7-5b2db9a680fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:15.254000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:15.254959 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 190/380] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655de34-8f55-426e-a88b-f68bc3f36d61 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655de34-8f55-426e-a88b-f68bc3f36d61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655de34-8f55-426e-a88b-f68bc3f36d61 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 191/381] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:15.260255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655de34-8f55-426e-a88b-f68bc3f36d61 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.290365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.363552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c894e-5e10-4056-b66b-780fabe382ab None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.366945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655de34-8f55-426e-a88b-f68bc3f36d61 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.380944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.400323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.400973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.401201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.401472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.402138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:15.402444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.403945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.406644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0bced-da0b-4ec3-8ef2-90c29980095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.407261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0bced-da0b-4ec3-8ef2-90c29980095a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.407535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0bced-da0b-4ec3-8ef2-90c29980095a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.407804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0bced-da0b-4ec3-8ef2-90c29980095a None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.409401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0bced-da0b-4ec3-8ef2-90c29980095a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:15.409401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0bced-da0b-4ec3-8ef2-90c29980095a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.410414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0bced-da0b-4ec3-8ef2-90c29980095a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.419678 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 191/382] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:15.423594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.463050 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 192/383] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:15.464376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b14c3-a77b-4eea-bf9b-a5d860a9d387 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.464655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b14c3-a77b-4eea-bf9b-a5d860a9d387 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.464933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b14c3-a77b-4eea-bf9b-a5d860a9d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.483006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ba7b14c3-a77b-4eea-bf9b-a5d860a9d387 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:15.484224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba7b14c3-a77b-4eea-bf9b-a5d860a9d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:15.535251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d21b47-2c94-47e0-bfb5-5e36a3f6334a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.554996 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 193/384] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:15.555914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b14c3-a77b-4eea-bf9b-a5d860a9d387 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.573550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.580543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.581209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.581494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.581772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.582448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:15.582758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.584196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.596673 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 192/385] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:15.597317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.631449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.659823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b14c3-a77b-4eea-bf9b-a5d860a9d387 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.697009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.697937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.698574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.698857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.700299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f513-717a-48e2-9ff3-fbef67c018f9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.706934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.708890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:15.722758 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:15.723856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 194/386] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:15.729837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.743648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.744285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.744569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.744848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.755940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.757424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:15.773904 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:15.775090 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:15.780567 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:15.780567 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:15.780567 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:15.780567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 193/387] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:15.780567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.822969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.846564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb925-c1be-4939-87c5-4471b61c32e8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.881317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:15.881508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.882172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.882456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.882814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.892523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b87a-4f2e-4070-8734-ad072af1420b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:15.892920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:15.898311 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:15.899370 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 195/388] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:15.900168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.926509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:15.927140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:15.927421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:15.927696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:15.936665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:15.938132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:15.948981 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:15.949977 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 194/389] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:15.951008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:15.999979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d093-cf6e-49a2-bfbf-903aa2b996c3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.032718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.033318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.033602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.033874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.034624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:16.034929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.036350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.038973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.047018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005578a4-124b-43f4-8b99-89b123e85b28 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.054648 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 196/390] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:16.055439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.080359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.080963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.081245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.081521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.082196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:16.082500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.083871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.095652 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 195/391] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:16.096430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.106598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.153458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a0bce-55dd-4215-8e76-c8a81d1766e2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.186566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.187185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.187462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.187728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.193488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e272b5-7485-421a-81f8-8ab08e509170 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.197348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.209634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:16.213800 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:16.214766 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:16.215618 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:16.215618 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.215618 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:16.215618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 197/392] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:16.215842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.229682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.230375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.230656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.230931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.231674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:16.231979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.233378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.241377 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 196/393] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:16.242187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.262443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.311075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.315166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea082-8859-44a9-bdbb-9c003030eb7e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.340109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349fb1-940a-418c-9f9e-a86d5b36eeae None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.347814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.348418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.348701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.348977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.349970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:16.350304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.351733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.368306 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 198/394] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:16.369094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.374223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.374856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.375254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.375532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.386379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.387873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:16.401642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:16.403076 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:16.403953 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:16.403953 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.403953 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:16.403953 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 197/395] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:16.404605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.473362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b924b61-f399-423a-9b8d-0d38e600c389 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.475868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.506999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.507639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.508275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.508560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45df71f-1669-4b14-b1da-f087dd7bdfe7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.508683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.516174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.517697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:16.529893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:16.530784 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:16.531623 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 199/396] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:16.532119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.532651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.545262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.545869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.546857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.546857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.547136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:16.547439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.548804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.560994 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 198/397] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:16.561891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.629449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55436ba5-cc46-4c63-991f-cc897d1496bd None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.659169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee096-fcfa-4456-8613-69f971841d70 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.664852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.665501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.665782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.666252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.676343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.677814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.692638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:16.693129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:16.694170 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:16.695000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:16.695000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.695000 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:16.695156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.695156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.695281 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 200/398] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:16.695351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.695416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.708891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.710380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.716736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:16.729818 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:16.731050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:16.732049 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:16.732049 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:16.732049 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:16.732049 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 199/399] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:16.732049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.767047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.800852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f837aa8-ccb4-44d4-bda8-c7af9f585e21 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.829812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5370cb-b53a-4b7e-9aaf-30d115bf1230 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.833238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.833844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.834159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.834434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.835134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:16.835435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.836826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.848716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 201/400] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:16.849716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.863497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.864301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.864587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.864864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.865564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:16.865875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.867354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:16.884936 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 200/401] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:16.885733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:16.926480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.948523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455971a3-8293-4ce5-a92f-2435ab57bead None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.976716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:16.983263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:16.983420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c1f01-3e97-422e-8d98-eee7830b1ca4 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:16.983808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:16.984084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:16.984354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:16.984987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:16.986426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.016305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.016898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.017172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.017441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.018121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:17.018421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.019775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.031099 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 201/402] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:17.031854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.072735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 202/403] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:04:16 2022] POST /identity/v3/users => generated 247 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:17.073553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.142824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43308d-1612-4876-b948-b864900b7617 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.181051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.181778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.182206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.182483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.183127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:17.183446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.184886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.185679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f4034-2b65-4030-95a4-f139be241a62 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.203776 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 202/404] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:17.203776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.218367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:17.224748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:17.230248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.230900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.231179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.232063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.239946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.241328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:17.255108 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:17.256022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:17.256849 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 203/405] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:17.257501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.319130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16f913-49d8-4a93-a305-371f3ff7d697 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.362600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.363712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.364211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.364682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/793ee1b363f8415f817fe5a8c3c200fd/roles/b1a4be1bc731427ebb4d293cc0c66243` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.366170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bec42c-f5e5-4e53-93e4-69bc465150f4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.381832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=793ee1b363f8415f817fe5a8c3c200fd, role_id=b1a4be1bc731427ebb4d293cc0c66243)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.383374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.401235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.401877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.402188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.402464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.409864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.411318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:17.423198 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:17.424100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:17.424977 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 204/406] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:17.425544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.462538 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 203/407] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:17 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/793ee1b363f8415f817fe5a8c3c200fd/roles/b1a4be1bc731427ebb4d293cc0c66243 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:17.463495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.504596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:17.546807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:17.570241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3fcc7-32e6-4613-91f3-62e1cd87ae7d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.593129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e402e0-1b9e-4ffc-b00f-cdbbd5a3ec63 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.612381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.613017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.613297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.613570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.621381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.623499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.633607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.634615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.635035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.635622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.636508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:17.636955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:17.638658 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:17.639679 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:17.640715 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:17.641573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.642131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 205/408] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:17.643117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.655961 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 204/409] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:17.657061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.776631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9d99-e243-4ff8-8c3f-0fd0a9533738 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.782041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6470a-9cf7-4454-a213-0b8a35507c6d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.799466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:17.802738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:17.814084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.816580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.816580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.816580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.816580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:17.816580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.818147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.826734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:17.827352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:17.827634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:17.828400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:17.829468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:17.829789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:17.831403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 205/410] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:17.831519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:17.832277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.858092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 206/411] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Oct 18 13:04:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:17.858092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:17.964332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f7f47-53e3-4cca-95f2-9a6e069eb195 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:17.973533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77cd0-04cc-47e4-bc46-8c2db89ce02c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:18.005728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:18.006600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:18.006988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:18.007356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/562e50f34bb54c68b428d077efeaca70/roles/b1a4be1bc731427ebb4d293cc0c66243` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:18.024568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=562e50f34bb54c68b428d077efeaca70, role_id=b1a4be1bc731427ebb4d293cc0c66243)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:18.026416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:18.026921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:18.027757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:18.028221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:18.028652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/b6c94378d347410c944afe6fe9a55584/roles/b1a4be1bc731427ebb4d293cc0c66243` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:18.045410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=b6c94378d347410c944afe6fe9a55584, role_id=b1a4be1bc731427ebb4d293cc0c66243)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:18.046987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:18.098143 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 207/412] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:17 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/562e50f34bb54c68b428d077efeaca70/roles/b1a4be1bc731427ebb4d293cc0c66243 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:18.099397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:18.131104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:18.135945 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 206/413] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:17 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/b6c94378d347410c944afe6fe9a55584/roles/b1a4be1bc731427ebb4d293cc0c66243 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:18.221164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae52566-ff6c-4c11-869d-c8d088cb0169 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:18.263441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:18.264094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:18.264374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:18.264631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:18.276485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:18.278793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:18.295920 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:18.296902 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:18.297739 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:18.297739 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:18.297739 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:18.297739 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 208/414] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:18.303042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:18.340222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:18.414666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c9487-c55f-4a4f-9bf0-58627924da99 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:18.458083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:18.458083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:18.458083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:18.458083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:18.458465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:18.458465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:18.458773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:18.479253 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 207/415] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:18.480739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:18.574760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:18.606872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d5cc9-8c1b-431c-9983-98d6c6ebe4be None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:18.657149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:18.657781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:18.658076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:18.658353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:18.667927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:18.669372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:18.691476 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:18.692405 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:18.693229 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:18.696687 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 209/416] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:18.698684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:18.863698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:18.870890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8468f2e-deff-458a-8247-8ea7856d6fd2 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:18.933823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2234a71-c81a-4364-8b9c-76b482cc1dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:18.934490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234a71-c81a-4364-8b9c-76b482cc1dae None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:18.934763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234a71-c81a-4364-8b9c-76b482cc1dae None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:18.934998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234a71-c81a-4364-8b9c-76b482cc1dae None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:18.935704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2234a71-c81a-4364-8b9c-76b482cc1dae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:18.936004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2234a71-c81a-4364-8b9c-76b482cc1dae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:18.937442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2234a71-c81a-4364-8b9c-76b482cc1dae None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:18.958027 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 208/417] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:18.959897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:19.107603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7901f-c80e-4a53-b63c-8eb8c009c43f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:19.140165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:19.146016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ccc68-8034-48f3-b78a-d7d4aacb6079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:19.146948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ccc68-8034-48f3-b78a-d7d4aacb6079 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:19.159709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ccc68-8034-48f3-b78a-d7d4aacb6079 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:19.159709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ccc68-8034-48f3-b78a-d7d4aacb6079 None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/7d7fa3a95a66463c94e757c58ccec244/roles/b1a4be1bc731427ebb4d293cc0c66243` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:19.162691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ccc68-8034-48f3-b78a-d7d4aacb6079 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=7d7fa3a95a66463c94e757c58ccec244, role_id=b1a4be1bc731427ebb4d293cc0c66243)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:19.164378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ccc68-8034-48f3-b78a-d7d4aacb6079 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:19.245746 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 210/418] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:18 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/7d7fa3a95a66463c94e757c58ccec244/roles/b1a4be1bc731427ebb4d293cc0c66243 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:19.406714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af912-024d-4848-880c-4ef9546807eb None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:19.407371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af912-024d-4848-880c-4ef9546807eb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:19.407853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af912-024d-4848-880c-4ef9546807eb None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:19.409514 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 209/419] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:19.424869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858972-e279-4b10-9955-5f1d2acfad78 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:19.425482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858972-e279-4b10-9955-5f1d2acfad78 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:19.425968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858972-e279-4b10-9955-5f1d2acfad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:19.447613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a858972-e279-4b10-9955-5f1d2acfad78 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:19.449270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a858972-e279-4b10-9955-5f1d2acfad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:19.530161 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 211/420] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:19.821343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af912-024d-4848-880c-4ef9546807eb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:19.930664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af912-024d-4848-880c-4ef9546807eb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:19.959200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c479bb-12ac-44b3-b500-443e4e2ff538 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:19.959721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c479bb-12ac-44b3-b500-443e4e2ff538 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:19.959721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c479bb-12ac-44b3-b500-443e4e2ff538 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:19.961308 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 212/421] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:04:19.966921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be5429-1255-45f4-a872-17be92780df1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:19.967195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be5429-1255-45f4-a872-17be92780df1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:19.967462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be5429-1255-45f4-a872-17be92780df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:19.967787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda76064-627c-4173-89db-a0814538879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:19.968423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda76064-627c-4173-89db-a0814538879e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:19.968704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda76064-627c-4173-89db-a0814538879e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:19.968979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda76064-627c-4173-89db-a0814538879e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:19.980232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda76064-627c-4173-89db-a0814538879e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-bda76064-627c-4173-89db-a0814538879e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:19.985642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:19.986565 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:19.987364 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:19.987964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-70be5429-1255-45f4-a872-17be92780df1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:19.988034 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 210/422] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:19.988587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-70be5429-1255-45f4-a872-17be92780df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:19.992716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda76064-627c-4173-89db-a0814538879e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:20.011206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:20.079031 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 213/423] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:20.110075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda76064-627c-4173-89db-a0814538879e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:20.146065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:20.146684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:20.147017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:20.147297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:20.147955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:20.148315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:20.149748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:20.158944 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 211/424] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:20.164539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be5429-1255-45f4-a872-17be92780df1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:20.210411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:20.286744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be5429-1255-45f4-a872-17be92780df1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:20.335820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:20.336376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:20.336651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:20.336919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:20.351235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:20.352839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:20.372719 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:20.374968 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:20.377036 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:20.377036 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:20.377036 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:20.377036 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 214/425] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:20.379583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:20.425553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:20.511849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:20.543687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853f38-b3f5-49cd-88aa-dedc9cb8430d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:20.581782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:20.582808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:20.583315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:20.583806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:20.584679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:20.585194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:20.586920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:20.601015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 212/426] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:20.606891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:20.625022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:20.644204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70260cad-c17c-46e4-8a6a-4772f40a5401 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:20.714569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55217199-d07e-42fc-b5e9-f7c9017f9ec1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:20.714760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:20.715362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:20.715679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:20.715958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:20.746653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:20.752336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:20.752573 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:20.753389 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:20.754212 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:20.754818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:20.754818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:20.754818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:20.756173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 215/427] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:20.758202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:20.763594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:20.765536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:20.767246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:20.779862 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:20.791192 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 213/428] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:20.792079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:20.936544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba59b-9a06-44e1-8b55-1e830d0bf120 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:20.969820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4927-01b9-4449-a581-e299e12d4489 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.008638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea79ac7-be91-4ada-8f52-82886f4836af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.009602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79ac7-be91-4ada-8f52-82886f4836af None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.010149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79ac7-be91-4ada-8f52-82886f4836af None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.010652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79ac7-be91-4ada-8f52-82886f4836af None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.011578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea79ac7-be91-4ada-8f52-82886f4836af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:21.012101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea79ac7-be91-4ada-8f52-82886f4836af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.014301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea79ac7-be91-4ada-8f52-82886f4836af None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.040240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.041211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.041692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.042230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.043265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:21.047966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.049799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.069806 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 216/429] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:21.080357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.085303 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 214/430] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Oct 18 13:04:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:21.086846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74db79-c176-48aa-b0f5-7e7dfab44888 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.087136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74db79-c176-48aa-b0f5-7e7dfab44888 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.087410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74db79-c176-48aa-b0f5-7e7dfab44888 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.088920 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 215/431] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:21.095011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74db79-c176-48aa-b0f5-7e7dfab44888 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.109743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:21.172064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:21.198989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806d792-10fb-46c0-ad57-6ca8527a209e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.225687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74db79-c176-48aa-b0f5-7e7dfab44888 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.234103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d4973-6806-4dc8-bff6-945d23259abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.234980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4973-6806-4dc8-bff6-945d23259abf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.235318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4973-6806-4dc8-bff6-945d23259abf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.235596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4973-6806-4dc8-bff6-945d23259abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.247497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d4973-6806-4dc8-bff6-945d23259abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.248979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d4973-6806-4dc8-bff6-945d23259abf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.260818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f8ccb-2c9d-4fdb-b929-f292237aa9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.261438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8ccb-2c9d-4fdb-b929-f292237aa9f7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.261715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8ccb-2c9d-4fdb-b929-f292237aa9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.261986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8ccb-2c9d-4fdb-b929-f292237aa9f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-315d4973-6806-4dc8-bff6-945d23259abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:21.264438 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:21.265333 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:21.266317 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:21.266317 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:21.266317 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:21.266317 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 217/432] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:21.267196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51e6b-dfe4-417d-a998-b2337a9dfd4a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.267196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51e6b-dfe4-417d-a998-b2337a9dfd4a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.267367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc51e6b-dfe4-417d-a998-b2337a9dfd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.278644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f8ccb-2c9d-4fdb-b929-f292237aa9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.280147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f8ccb-2c9d-4fdb-b929-f292237aa9f7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.285619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fbc51e6b-dfe4-417d-a998-b2337a9dfd4a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:21.286851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fbc51e6b-dfe4-417d-a998-b2337a9dfd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-229f8ccb-2c9d-4fdb-b929-f292237aa9f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:21.296314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:21.297189 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:21.298135 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:21.298135 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:21.298135 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:21.298135 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 216/433] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:21.298883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0087d4-a1a1-4936-a18f-916c9fcb586b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.299219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0087d4-a1a1-4936-a18f-916c9fcb586b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.299330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0087d4-a1a1-4936-a18f-916c9fcb586b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.305034 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 217/434] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:21.305034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0087d4-a1a1-4936-a18f-916c9fcb586b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.360327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:21.374078 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 218/435] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:21.374078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51e6b-dfe4-417d-a998-b2337a9dfd4a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.411266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0087d4-a1a1-4936-a18f-916c9fcb586b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.418586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:21.449823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9761-edd8-4211-bf69-933e9286f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.449823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9761-edd8-4211-bf69-933e9286f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.449823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9761-edd8-4211-bf69-933e9286f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.449823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9761-edd8-4211-bf69-933e9286f0b3 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.450362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9761-edd8-4211-bf69-933e9286f0b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:21.450362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9761-edd8-4211-bf69-933e9286f0b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.450823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9761-edd8-4211-bf69-933e9286f0b3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.464298 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 218/436] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:21.468056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33ace-2551-4d1c-bede-5370fd0f0ee8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.468056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33ace-2551-4d1c-bede-5370fd0f0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.468056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33ace-2551-4d1c-bede-5370fd0f0ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.494366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc51e6b-dfe4-417d-a998-b2337a9dfd4a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.496669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-23a33ace-2551-4d1c-bede-5370fd0f0ee8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:21.498084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23a33ace-2551-4d1c-bede-5370fd0f0ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:21.534547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.535483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.535937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.536382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.537195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:21.537673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.539354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.552784 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 219/437] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:21.554100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.567842 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 219/438] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:21.568705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33ace-2551-4d1c-bede-5370fd0f0ee8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.625551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:21.686889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133563-db0f-4373-bdcd-4c73cb9582e8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.722409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:21.728312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.729253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.729771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.729998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33ace-2551-4d1c-bede-5370fd0f0ee8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.730470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.740499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.742873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:21.758530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:21.759443 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:21.760352 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:21.763075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 220/439] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:21.764853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.771374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.772014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.772288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.772554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.780632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.782757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:21.798362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:21.799201 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:21.800031 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 220/440] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:21.800482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.897320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeade4dc-154c-4189-8b3e-a319191bbe41 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.916418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:21.925628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a389-f030-4c6a-a640-125eb9603ca8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:21.933614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.934332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.935115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.935384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.946778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:21.952599 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:21.953526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:21.954361 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 221/441] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:21.955018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:21.969095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:21.969806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:21.969996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:21.970295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:21.971027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:21.971333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:21.972812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:21.995247 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 221/442] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:21.995247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.006865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.060670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b644-5104-403b-8aec-2deb573e56c2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.087723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e8ca-19a8-4866-aa93-7fd1aa7e4c6e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.093342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.093952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.094263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.094537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.095223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:22.095524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.096928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.115365 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 222/443] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:22.116162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.126480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00132c8b-6569-4ca0-b5b9-741d9a0e2fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.127118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132c8b-6569-4ca0-b5b9-741d9a0e2fb1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.127703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132c8b-6569-4ca0-b5b9-741d9a0e2fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.127978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132c8b-6569-4ca0-b5b9-741d9a0e2fb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.138329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00132c8b-6569-4ca0-b5b9-741d9a0e2fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-00132c8b-6569-4ca0-b5b9-741d9a0e2fb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:22.143050 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:22.143928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:22.144716 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 222/444] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:22.145995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d6f1-97fa-4b2d-90ee-ae83f571033d None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.146299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d6f1-97fa-4b2d-90ee-ae83f571033d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.146568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89d6f1-97fa-4b2d-90ee-ae83f571033d None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.147777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 223/445] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:22.148458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d6f1-97fa-4b2d-90ee-ae83f571033d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.159669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.218523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7f381-cf86-4b3a-9f04-4479aeab912a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.222913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.248839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89d6f1-97fa-4b2d-90ee-ae83f571033d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.252328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.252924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.253199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.253464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.254140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:22.254440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.255796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.263585 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 223/446] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:22.264376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.284208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.284929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.285212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.285487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.350187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.351656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.359881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.362502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a262-1e33-4cb2-8121-caf07a76dabe None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.395018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb7f6a-fd6c-4c20-a0cc-1fc24c761438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.395666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb7f6a-fd6c-4c20-a0cc-1fc24c761438 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.395943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb7f6a-fd6c-4c20-a0cc-1fc24c761438 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.396214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb7f6a-fd6c-4c20-a0cc-1fc24c761438 None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/025cbd75396f4aa09e2fc5c6c77be077/roles/b1a4be1bc731427ebb4d293cc0c66243` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.410410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb7f6a-fd6c-4c20-a0cc-1fc24c761438 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=025cbd75396f4aa09e2fc5c6c77be077, role_id=b1a4be1bc731427ebb4d293cc0c66243)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.411892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb7f6a-fd6c-4c20-a0cc-1fc24c761438 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.423263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.446957 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 224/447] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:04:22.447789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.469218 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 224/448] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:22 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/025cbd75396f4aa09e2fc5c6c77be077/roles/b1a4be1bc731427ebb4d293cc0c66243 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:22.470485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c0a2-0fe3-485d-aa90-2b5f1b0752e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.470769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c0a2-0fe3-485d-aa90-2b5f1b0752e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.471043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c0a2-0fe3-485d-aa90-2b5f1b0752e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.504901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5963c0a2-0fe3-485d-aa90-2b5f1b0752e9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:22.506451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5963c0a2-0fe3-485d-aa90-2b5f1b0752e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:22.561633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2b7ba-14ff-422e-b7a6-74770af4ae92 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.589434 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 225/449] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:22.590446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963c0a2-0fe3-485d-aa90-2b5f1b0752e9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.605956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.607391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.607862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.608634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.609825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:22.610388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.612750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.624899 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 225/450] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:22.626070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.672643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.714472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.732301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963c0a2-0fe3-485d-aa90-2b5f1b0752e9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.748030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6e56f-a6d1-49b2-b9ba-6d76d194ca6d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.777766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.778884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.779696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.780469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.784251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.784952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.785350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.785759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.793693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.795812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.797165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.798723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:22.813570 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:22.814527 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:22.815346 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:22.815346 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:22.815346 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:22.816171 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:22.816997 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:22.817867 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:22.817867 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:22.817867 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:22.819462 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 226/451] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:22.824394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.824823 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 226/452] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:22.827403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:22.921711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.934034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff205e2-dec5-4397-bf92-bf043408d5c9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.947548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8a4f1-acdc-4428-bd53-779196555298 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:22.975926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.976554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.976842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.977110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.978238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:22.983068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:22.983677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:22.983958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:22.984233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:22.984872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:22.985174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.986662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.987961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:22.994198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:22.999644 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 227/453] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:23.000634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:23.004959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:23.005992 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:23.007347 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:23.007347 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:23.007347 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:23.010688 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 227/454] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:23.011375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.105052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535145-9995-4fe7-b606-6923c1a97f77 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.119230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65471616-b032-44a9-bfce-782480bec2cb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.140725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.141338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.141621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.141895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.142645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:23.142952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.144328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.161522 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 228/455] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:23.161522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.164464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.165719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.165719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.165719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.175531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.179892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:23.186725 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:23.187795 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:23.188596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 228/456] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:23.189261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.221012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.269841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970013e-aecb-412f-aa10-d9850f75a8cc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.305556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.306219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.306510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.306788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.314142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.315614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:23.327793 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:23.328609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:23.329456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:23.329883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c80f37-5feb-46e2-af42-f47edec3fecf None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.333807 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 229/457] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:23.334676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.363479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.364088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.364370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.364650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.365296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:23.365597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.367110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.380253 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 229/458] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:23.381123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.441634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.447755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a434609-bfa4-44ae-a32a-7dc4b6601af0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.463040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.488574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bab40e-7a7c-4772-8e62-7388bf8e374b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.488827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.489408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.489694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.489974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.500582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.502177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:23.521113 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:23.522139 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 230/459] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:23.523015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.540051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.540660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.540940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.541217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.541880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:23.542242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.543665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.552139 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 230/460] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:23.552912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.630530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaee27-1389-430d-b07e-c00a202cf1c0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.657647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3185-5aae-447e-b090-cda717f0dd1e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.663615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.664233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.664516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.664791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.665898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:23.666244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.668048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.685500 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 231/461] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:23.685500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.686616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.698893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.703264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.703264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.703264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] PATH_INFO: `/v3/users/glance` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.708130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.709571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.717788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:23.721800 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:23.722753 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:23.723621 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 231/462] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:23.724862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.797474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441dd1-f0c3-47cd-8ecb-f9f94045693e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.832035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffcbe3-2d87-4ce3-9b08-e085c25031bd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:23.833446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.834048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.834355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.835190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.835385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:23.835659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.837084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.860481 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 232/463] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:23.860481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.874549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:23.875178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:23.875479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:23.875725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:23.887163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:23.889197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:23.903839 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:23.904727 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:23.905539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:23.905539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:23.905539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:23.905539 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 232/464] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:23.905750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:23.940014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.957790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:23.967852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20089b78-a362-4d40-856d-b8ac017e6dc2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.005015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.005613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.005894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.006205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.006306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36468d15-adfa-4a5b-b58c-297395fba57b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.006930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] RBAC: Adding query filter params (role.id=b1a4be1bc731427ebb4d293cc0c66243, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=793ee1b363f8415f817fe5a8c3c200fd) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:24.007235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.008665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.015059 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 233/465] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/role_assignments?user.id=793ee1b363f8415f817fe5a8c3c200fd&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=b1a4be1bc731427ebb4d293cc0c66243 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:24.015846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.056699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.057885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.058214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.058487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.059278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:24.059576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.061042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.086749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 233/466] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Oct 18 13:04:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:24.086749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.149905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa83c4c-104e-4ed0-b8f0-a2a497ca89f5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.191616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.192575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.193032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.193581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.212911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:24.226529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:24.229683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496483f9-67c5-48a6-81e3-2681e66e79b6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.298386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.298578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.299029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.299308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.299638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.300239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.300343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:24.300569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.301919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.314036 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 234/467] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:24.314999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.431270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b125f3-a31f-4b31-8d3f-8f9a26cbed66 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.434129 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 234/468] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:04:24.435693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.481179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.482740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.483226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.483751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.507736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:24.512243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:24.560096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a607ea-53b9-46f7-b015-fcdf01716a85 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.576230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.578959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.613366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.613999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.614298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.614626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.623922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.625325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:24.638404 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:24.639345 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 235/469] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:24.642888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.715291 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 235/470] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:04:24.715291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.757011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68144-4875-4829-93d5-2e7d38ccd354 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.767589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:24.770746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:24.790547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff4ca4-ff07-4e75-8d64-658ceeb11b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.791178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4ca4-ff07-4e75-8d64-658ceeb11b04 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.791456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4ca4-ff07-4e75-8d64-658ceeb11b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.791728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4ca4-ff07-4e75-8d64-658ceeb11b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.803010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff4ca4-ff07-4e75-8d64-658ceeb11b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.804474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff4ca4-ff07-4e75-8d64-658ceeb11b04 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.818529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43193fa7-feea-4a01-8fd1-603c1e3a2e1f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3eff4ca4-ff07-4e75-8d64-658ceeb11b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:24.819299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:24.820349 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:24.821359 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:24.821359 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:24.821359 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:24.827509 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 236/471] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:24.827509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122d89-55f3-4cbc-8698-f1e9a8c3a8fa None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.827509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122d89-55f3-4cbc-8698-f1e9a8c3a8fa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.827509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e122d89-55f3-4cbc-8698-f1e9a8c3a8fa None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.830430 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 237/472] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:24.831227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122d89-55f3-4cbc-8698-f1e9a8c3a8fa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.862872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.863491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.863774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.864055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.864781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:24.865091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.866588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:24.884001 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 236/473] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:24.884812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:24.946516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e122d89-55f3-4cbc-8698-f1e9a8c3a8fa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.984192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05895ea2-315b-4d12-b2a3-f9219f9d600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:24.984757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05895ea2-315b-4d12-b2a3-f9219f9d600e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:24.985040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05895ea2-315b-4d12-b2a3-f9219f9d600e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:24.985311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05895ea2-315b-4d12-b2a3-f9219f9d600e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:24.988374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaa862-dba6-4d3f-bacd-1d1392b03e9d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:24.997823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05895ea2-315b-4d12-b2a3-f9219f9d600e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:24.999327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05895ea2-315b-4d12-b2a3-f9219f9d600e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.001618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-05895ea2-315b-4d12-b2a3-f9219f9d600e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:25.014567 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:25.015466 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:25.016299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:25.016299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:25.016299 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:25.016299 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 238/474] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:25.017321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd32be-62da-4c39-8f05-562f1f18879d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.017565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd32be-62da-4c39-8f05-562f1f18879d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.017919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd32be-62da-4c39-8f05-562f1f18879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.032373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.033596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.033891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.034197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.034839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:25.035141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.036533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.037888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78fd32be-62da-4c39-8f05-562f1f18879d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:25.039590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78fd32be-62da-4c39-8f05-562f1f18879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:25.048950 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 237/475] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:25.050428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.054701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.114235 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 239/476] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:25.114235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd32be-62da-4c39-8f05-562f1f18879d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.159529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf46d7c-7025-4280-9287-6fc531d12646 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.206370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.206994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.207276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.207550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.241139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd32be-62da-4c39-8f05-562f1f18879d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.265516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.302179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.303886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.304284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.305062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.305496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.306206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.307927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:25.308410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.310528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.326643 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 240/477] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:25.331735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.348443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.424967 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 238/478] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:04:25.426479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.452451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52150fc3-56b0-42fd-b0c2-c3771ab2c995 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.494044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.494628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.494909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.495179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.501582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.501793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.503308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:25.515563 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:25.527686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 241/479] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:25.529408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.548889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196088f-04ad-4e87-a83b-cf3028cf6b24 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.583558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.584188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.584470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.584743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.591192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.592647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.601590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:25.605404 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:25.606791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:25.607642 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 239/480] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:25.608166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.637592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614576e-af9e-40d8-ad1f-f7c435fb2461 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.677616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.679178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.679653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.680437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.694590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:25.701520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:25.702418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:25.703185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:25.703778 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 242/481] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:25.704355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.715447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de705b-9b7d-403a-952d-093f8d568a80 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.744881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.751077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.751741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.757840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.757840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.763664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.765260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:25.781610 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:25.782617 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:25.784015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:25.784015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:25.784015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:25.784015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 240/482] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:25.784015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.818171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4f78-773f-4a1a-8c5b-3eb713addd91 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.847374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:25.856748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.857620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.858077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.858551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.859244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:25.860785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.861075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.877154 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 243/483] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:25.877154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.894278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9b52-1adb-439a-988a-5b4edc2dffb9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.929985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:25.930623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:25.930907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:25.931180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:25.931867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:25.932173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:25.933593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:25.950144 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 241/484] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:25.950144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:25.981786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beb01c-b177-49f9-8616-22cb2c5654d5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:25.995471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:26.021051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.022375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.022706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.022985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.023682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:26.024014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.025369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.034164 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 244/485] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:26.034785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.057967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d03cb5-2285-4d2b-accd-3d497ad40b27 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.084729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:26.094889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.095499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.099828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.099828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.099828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:26.099828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.099828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.110780 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 242/486] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:26.111704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.142350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da332ae-e557-47d9-a97a-7ef8b8ecc2c8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.178153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.179090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.179557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.179907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.180665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] RBAC: Adding query filter params (role.id=b1a4be1bc731427ebb4d293cc0c66243, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=b6c94378d347410c944afe6fe9a55584) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:26.180975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.182481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.198083 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 245/487] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/role_assignments?user.id=b6c94378d347410c944afe6fe9a55584&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=b1a4be1bc731427ebb4d293cc0c66243 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:26.198083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.228096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4a904-a8a4-49e4-bb94-a34f98427528 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.229856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:26.269571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.270150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.270429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.270701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.271605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] RBAC: Adding query filter params (role.id=b1a4be1bc731427ebb4d293cc0c66243, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=562e50f34bb54c68b428d077efeaca70) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:26.271923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.273609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.281147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 243/488] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/role_assignments?user.id=562e50f34bb54c68b428d077efeaca70&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=b1a4be1bc731427ebb4d293cc0c66243 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:26.281999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.330210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa426-0244-4cf9-a472-21a9219f8c96 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.352778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:26.380091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f01e0-c3c6-4793-836a-f04b9b340970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.380874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f01e0-c3c6-4793-836a-f04b9b340970 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.381243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f01e0-c3c6-4793-836a-f04b9b340970 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.381607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f01e0-c3c6-4793-836a-f04b9b340970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.397244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f01e0-c3c6-4793-836a-f04b9b340970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.399999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f01e0-c3c6-4793-836a-f04b9b340970 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-475f01e0-c3c6-4793-836a-f04b9b340970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:26.416880 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:26.418008 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:26.419099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:26.419099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:26.419099 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:26.420881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 246/489] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:26.421380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f22e67-dff8-4b52-9a36-f12561df4348 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.421732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f22e67-dff8-4b52-9a36-f12561df4348 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.422109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f22e67-dff8-4b52-9a36-f12561df4348 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.423757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 247/490] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:26.427231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f22e67-dff8-4b52-9a36-f12561df4348 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.428988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541b51d-2dba-40bf-af7f-9e2e2449634d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.480203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec4bab-ef75-469e-a06d-0da152725a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.481698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4bab-ef75-469e-a06d-0da152725a24 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.481979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4bab-ef75-469e-a06d-0da152725a24 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.482287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec4bab-ef75-469e-a06d-0da152725a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.490493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec4bab-ef75-469e-a06d-0da152725a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.492368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec4bab-ef75-469e-a06d-0da152725a24 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-00ec4bab-ef75-469e-a06d-0da152725a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:26.506360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:26.507237 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:26.508601 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 244/491] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:26.509221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7ada-696d-4e24-bb8d-37a61fd381c6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.509221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7ada-696d-4e24-bb8d-37a61fd381c6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.509352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e7ada-696d-4e24-bb8d-37a61fd381c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.528133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d0e7ada-696d-4e24-bb8d-37a61fd381c6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:26.529232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d0e7ada-696d-4e24-bb8d-37a61fd381c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:26.560272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:26.565046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f22e67-dff8-4b52-9a36-f12561df4348 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.604601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.605272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.605591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.605871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.606703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:26.606930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.608414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.626577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 248/492] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:26.627701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.629576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 245/493] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:26.636415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7ada-696d-4e24-bb8d-37a61fd381c6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.680239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:26.799262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e7ada-696d-4e24-bb8d-37a61fd381c6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.819714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb11f2-870a-47d0-9689-14ef2826c26f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:26.840682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.841322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.841598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.841867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.862491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.863947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.877454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:26.878092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:26.878376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:26.878646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:26.879468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:26.879772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:26.886219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:26.890784 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:26.891735 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:26.892696 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:26.898423 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 246/494] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:26.906648 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 249/495] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:26.907635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.917114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:26.937901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.021859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.026849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63952e6-053c-4148-a2d2-6d915c81f2fd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.037847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fabc2-26de-4b67-b915-0a03b8414a8e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.064017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.064602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.064829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.065098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.065825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:27.066185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:27.067671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:27.076248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.077100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.077576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.078021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.078976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] RBAC: Adding query filter params (role.id=b1a4be1bc731427ebb4d293cc0c66243, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=7d7fa3a95a66463c94e757c58ccec244) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:27.079459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:27.081085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:27.087759 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 250/497] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/role_assignments?user.id=7d7fa3a95a66463c94e757c58ccec244&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=b1a4be1bc731427ebb4d293cc0c66243 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:27.088906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:27.091299 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 247/497] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Oct 18 13:04:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:27.092835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:27.181197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.211189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41db7b-7471-45a0-873e-a0ca1d111f65 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.253836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.254922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.255458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.255920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.296720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e67bc3-5122-4f6d-ac7a-6d6935606b1f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.335755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:27.337159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:27.342243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.343467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.343960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.344425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.358837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:27.366163 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:27.367062 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:27.367877 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:27.370606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 251/498] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:27.376539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:27.392897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.425034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.493002 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 248/499] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 13:04:27.500015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:27.518999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b663-1ae2-4c86-ba21-ce93af83521d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.561836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.562784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.563236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.563826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.564679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:27.565148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:27.566712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:27.577608 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 252/500] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:27.583754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:27.668144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.697172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7c159-9b69-432f-87c0-a3463aba84d1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.702524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487516-7008-4123-9592-8a3ddefce2cf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.739181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.739817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.740096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.740369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.750996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:27.752513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:27.765968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.766926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.767407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.767868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:27.768036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:27.769355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:27.770248 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:27.770248 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:27.770248 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:27.770248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 249/501] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:27.786964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:27.788660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:27.795800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:27.803963 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:27.805071 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:27.805982 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:27.805982 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:27.805982 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:27.807915 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 253/502] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:27.812910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:27.850567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.919590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4462d-3dea-475f-a73a-d8d9120807e5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:27.944612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:27.957130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:27.958010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:27.968426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:27.968426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:27.968426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:27.968426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:27.968426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:27.976513 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 254/503] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:27.982411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:28.011733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f0271-cfcf-4238-8635-b3dde5f7ab76 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.051454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:28.052070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.052349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.052622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.053266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:28.053570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:28.054975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:28.081134 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 250/504] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:28.088350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:28.185353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40052760-a75d-41f2-bc03-3b155c3beb72 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.247294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:28.248501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:28.251385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.251660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.251928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.265780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:28.267244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:28.275383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aae997-678b-415b-b452-47c3ff8baa14 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:28.287061 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:28.287984 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:28.289606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 255/505] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Oct 18 13:04:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:28.295533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:28.343723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:28.344378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.344652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.344918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.361916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:28.364210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:28.383080 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:28.385094 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:28.387715 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:28.393069 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 251/506] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:28.393268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:28.395365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:28.496784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d569-acd2-4a90-8195-bc61f971f057 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.570248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:28.570865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.571142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.571413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.572144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:28.572449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:28.573864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:28.591948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079cdde-d689-464f-926a-6f03de8c884f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.610356 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 256/507] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Oct 18 13:04:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:28.617037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:28.661603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8bf97-e8b2-4f17-9ad2-2ef458001a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:28.662951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8bf97-e8b2-4f17-9ad2-2ef458001a4a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.662951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8bf97-e8b2-4f17-9ad2-2ef458001a4a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.662951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8bf97-e8b2-4f17-9ad2-2ef458001a4a None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.663938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8bf97-e8b2-4f17-9ad2-2ef458001a4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:28.664222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8bf97-e8b2-4f17-9ad2-2ef458001a4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:28.665964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8bf97-e8b2-4f17-9ad2-2ef458001a4a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:28.685206 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 252/508] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:28.686705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a97fe9-5bb9-4101-baf6-7d52c46e3686 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.687000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a97fe9-5bb9-4101-baf6-7d52c46e3686 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.687279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a97fe9-5bb9-4101-baf6-7d52c46e3686 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.692384 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 253/509] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:28.692384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a97fe9-5bb9-4101-baf6-7d52c46e3686 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:28.726569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:28.752644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9166666-7fab-4320-90ea-1f9847f2ebe9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.754443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:28.790291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c507d0-aa07-4083-81af-73786a4eca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:28.790861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c507d0-aa07-4083-81af-73786a4eca0a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.791141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c507d0-aa07-4083-81af-73786a4eca0a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.791408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c507d0-aa07-4083-81af-73786a4eca0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.802978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c507d0-aa07-4083-81af-73786a4eca0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:28.804528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c507d0-aa07-4083-81af-73786a4eca0a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:28.809681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a97fe9-5bb9-4101-baf6-7d52c46e3686 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-76c507d0-aa07-4083-81af-73786a4eca0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:28.820421 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:28.821377 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:28.822401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:28.822401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:28.822401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:28.826159 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 257/510] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:28.827570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871257e-ec50-448f-98db-ecf56b2233af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.827854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871257e-ec50-448f-98db-ecf56b2233af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.828123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871257e-ec50-448f-98db-ecf56b2233af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.848542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7871257e-ec50-448f-98db-ecf56b2233af None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:28.849982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7871257e-ec50-448f-98db-ecf56b2233af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:28.851348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:28.852269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.852771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.853242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.854213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] RBAC: Adding query filter params (role.id=b1a4be1bc731427ebb4d293cc0c66243, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=025cbd75396f4aa09e2fc5c6c77be077) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:28.854722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:28.856387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:28.862865 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 254/511] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:28 2022] GET /identity/v3/role_assignments?user.id=025cbd75396f4aa09e2fc5c6c77be077&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=b1a4be1bc731427ebb4d293cc0c66243 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:28.863912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:28.946318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:28.951363 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 258/512] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:28.953085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab672d-38c3-4885-be61-44ddef3362c6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.953532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab672d-38c3-4885-be61-44ddef3362c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.953948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab672d-38c3-4885-be61-44ddef3362c6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.957891 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 259/513] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:28.962543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651307-e872-48bb-97f9-47c931ff545f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:28.962843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651307-e872-48bb-97f9-47c931ff545f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:28.963122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651307-e872-48bb-97f9-47c931ff545f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:28.987064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ee720-99a3-4d50-9b85-b5cda6f4917f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:28.987831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9a651307-e872-48bb-97f9-47c931ff545f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:28.989045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a651307-e872-48bb-97f9-47c931ff545f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:29.028490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.029620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.030194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.030718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.031628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:29.032149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.033726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.056582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 255/514] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:29.063687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.077579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 260/515] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:29.165121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559587-d9c5-4976-8a76-5b815e3c0d32 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.194655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:29.201246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.201884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.202191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.202462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.209350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.210820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:29.221945 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:29.222846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:29.223717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 256/516] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:29.229192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651307-e872-48bb-97f9-47c931ff545f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.246125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:29.284948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.342683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651307-e872-48bb-97f9-47c931ff545f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.382199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.382951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.383301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.383574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.384264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:29.384811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.386259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.399325 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 261/517] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:29.400218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.435729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307e98-a5f7-46a3-8c31-dc6fd8aaeac7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.476450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.477178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.477609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.478225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.479334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.482372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.495963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:29.497946 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:29.499142 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:29.500113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:29.502488 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 257/518] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Oct 18 13:04:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:29.503508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.537396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcdc69-f648-4d12-b688-3eb827eaae64 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.572685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:29.577931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.578833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.579284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.579782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.591476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.593174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:29.610334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:29.611341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:29.612243 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:29.612243 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:29.612243 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:29.614347 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 262/519] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:29.615603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.626913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f6084-d7e3-4f49-a6b7-d2806a7dd68f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.673143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.673809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.674109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.674387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/793ee1b363f8415f817fe5a8c3c200fd/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.676736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=793ee1b363f8415f817fe5a8c3c200fd, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.678230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.730448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7158378-9424-4e52-9eed-4d0c3e30ef62 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.743694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 258/520] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:29 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/793ee1b363f8415f817fe5a8c3c200fd/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:29.744589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.770989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:29.776789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1ea0-5e24-4931-9de5-7f14170efe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.777411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1ea0-5e24-4931-9de5-7f14170efe48 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.777684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1ea0-5e24-4931-9de5-7f14170efe48 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.777991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1ea0-5e24-4931-9de5-7f14170efe48 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.778648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1ea0-5e24-4931-9de5-7f14170efe48 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:29.778946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1ea0-5e24-4931-9de5-7f14170efe48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.780375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1ea0-5e24-4931-9de5-7f14170efe48 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.790254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 263/521] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Oct 18 13:04:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:29.793416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c33d-4747-49b0-ac8e-5c379dcfa2a2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.793701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c33d-4747-49b0-ac8e-5c379dcfa2a2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.798255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007c33d-4747-49b0-ac8e-5c379dcfa2a2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.800162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 264/522] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:29.801298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007c33d-4747-49b0-ac8e-5c379dcfa2a2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:29.876549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395bc2f-6854-429f-920e-6707d4561bae None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.893004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:29.915702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007c33d-4747-49b0-ac8e-5c379dcfa2a2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:29.916238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000a3d3-c4a3-459c-9b34-43962aa9fdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.917112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000a3d3-c4a3-459c-9b34-43962aa9fdf8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.917820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000a3d3-c4a3-459c-9b34-43962aa9fdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.918340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000a3d3-c4a3-459c-9b34-43962aa9fdf8 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.919845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000a3d3-c4a3-459c-9b34-43962aa9fdf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:29.920362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000a3d3-c4a3-459c-9b34-43962aa9fdf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.921975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000a3d3-c4a3-459c-9b34-43962aa9fdf8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.936278 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 259/523] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:29.937924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7c906-3e1d-4945-9020-1eef0c57128e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.938449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7c906-3e1d-4945-9020-1eef0c57128e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.938912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7c906-3e1d-4945-9020-1eef0c57128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.957143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:29.958216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:29.958216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:29.958443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:29.958950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:29.959300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:29.959463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-abc7c906-3e1d-4945-9020-1eef0c57128e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:29.960614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abc7c906-3e1d-4945-9020-1eef0c57128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:29.960721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:29.968102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 265/524] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Oct 18 13:04:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:29.968935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:30.035353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:30.045620 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 260/525] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:30.108284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569da7-dcb7-4a37-9175-fe187eefb5aa None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:30.147583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:30.148222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:30.148503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:30.148781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:30.149467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:30.151020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:30.246085 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 266/526] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:04:29 2022] POST /identity/v3/users => generated 254 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:30.398942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7c906-3e1d-4945-9020-1eef0c57128e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:30.508683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7c906-3e1d-4945-9020-1eef0c57128e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:30.512041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:30.559887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:30.560536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:30.560816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:30.561094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] PATH_INFO: `/v3/services/network` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:30.561687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:30.563160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:30.573109 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:30.574188 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:30.575675 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 261/527] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:30 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:30.580533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:30.728445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9256bd-8d3b-4b4c-a924-be9b339411e0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:30.743571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:30.775898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cc60c-4ada-448d-ba84-1915a7c26ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:30.776891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc60c-4ada-448d-ba84-1915a7c26ba4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:30.777393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc60c-4ada-448d-ba84-1915a7c26ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:30.777863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc60c-4ada-448d-ba84-1915a7c26ba4 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:30.778716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cc60c-4ada-448d-ba84-1915a7c26ba4 None admin] RBAC: Adding query filter params (name=network) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:30.779219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cc60c-4ada-448d-ba84-1915a7c26ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:30.785577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cc60c-4ada-448d-ba84-1915a7c26ba4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:30.790383 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 267/528] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:30.796698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:30.929668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56a20c-0166-423d-9c5e-700caf971804 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:30.977337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5834f-37c8-48b9-bf4c-934fa16163c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:30.978334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5834f-37c8-48b9-bf4c-934fa16163c7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:30.978893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5834f-37c8-48b9-bf4c-934fa16163c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:30.979362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5834f-37c8-48b9-bf4c-934fa16163c7 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:30.980184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5834f-37c8-48b9-bf4c-934fa16163c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:30.980683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5834f-37c8-48b9-bf4c-934fa16163c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:30.982865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5834f-37c8-48b9-bf4c-934fa16163c7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:30.994911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 262/529] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:31.690292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4e0b-4b04-4b7e-b5a5-d01512b2e8fe None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:31.690799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4e0b-4b04-4b7e-b5a5-d01512b2e8fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:31.690876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4e0b-4b04-4b7e-b5a5-d01512b2e8fe None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:31.692428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 268/530] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:31.700408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb8f4-3c8a-47f0-ab87-e47d1a2da5ae None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:31.700832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb8f4-3c8a-47f0-ab87-e47d1a2da5ae None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:31.701011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbb8f4-3c8a-47f0-ab87-e47d1a2da5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:31.724382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9dbb8f4-3c8a-47f0-ab87-e47d1a2da5ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:31.725760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9dbb8f4-3c8a-47f0-ab87-e47d1a2da5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:31.752452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:31.808641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 263/531] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:32.146321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4e0b-4b04-4b7e-b5a5-d01512b2e8fe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:32.271711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4e0b-4b04-4b7e-b5a5-d01512b2e8fe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:32.314991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:32.315637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.315922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.316198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.340159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:32.345520 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:32.346471 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:32.347308 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 269/532] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:32.351089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65741c9-bd28-4a43-a236-0914ee9ab14c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.351380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65741c9-bd28-4a43-a236-0914ee9ab14c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.351659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65741c9-bd28-4a43-a236-0914ee9ab14c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.354952 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 264/533] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:32.356469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:32.360176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da63c26-6073-477d-a7ab-e0284550ad5f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.360461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da63c26-6073-477d-a7ab-e0284550ad5f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.360731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da63c26-6073-477d-a7ab-e0284550ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.395111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1da63c26-6073-477d-a7ab-e0284550ad5f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:32.395549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:32.397544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1da63c26-6073-477d-a7ab-e0284550ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:32.482709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143e4c-6c3d-434f-a51d-0d67d00fea04 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:32.517770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3f567-50e3-42f5-82ed-4f0272decbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:32.518481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3f567-50e3-42f5-82ed-4f0272decbec None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.518774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3f567-50e3-42f5-82ed-4f0272decbec None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.519049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3f567-50e3-42f5-82ed-4f0272decbec None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.519714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3f567-50e3-42f5-82ed-4f0272decbec None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:32.520015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3f567-50e3-42f5-82ed-4f0272decbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:32.521382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3f567-50e3-42f5-82ed-4f0272decbec None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:32.531550 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 270/534] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:32.533167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ad6-a169-4fe3-ba77-1ab1f5a230bc None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.533458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ad6-a169-4fe3-ba77-1ab1f5a230bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.533740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ad6-a169-4fe3-ba77-1ab1f5a230bc None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.535194 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 271/535] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:32.540036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e092dc-3fe4-48d0-9617-abb6436eb90f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.540315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e092dc-3fe4-48d0-9617-abb6436eb90f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.540586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e092dc-3fe4-48d0-9617-abb6436eb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.561398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a6e092dc-3fe4-48d0-9617-abb6436eb90f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:32.562821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6e092dc-3fe4-48d0-9617-abb6436eb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:32.568206 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 265/536] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:32.569389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da63c26-6073-477d-a7ab-e0284550ad5f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:32.693370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:32.703553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da63c26-6073-477d-a7ab-e0284550ad5f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:32.708800 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 272/537] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:04:32.742013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:32.743017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.743501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.743998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.755278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:32.757060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:32.772965 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:32.773903 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:32.774852 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:32.774852 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:32.774852 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:32.776890 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 266/538] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:32.787129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e092dc-3fe4-48d0-9617-abb6436eb90f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:32.835706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:32.931851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e092dc-3fe4-48d0-9617-abb6436eb90f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:32.957496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:32.974123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:32.974123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:32.974123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:32.974123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:32.974517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:32.974517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:32.974517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:32.990080 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 273/539] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:32.991887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.090593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:33.105589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dae01-9a1b-48b2-bd40-cb01d5e91502 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.134812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6ceac-55dc-4115-8683-6ac13d81c09d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.140131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.141348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.141752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.142171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.153271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:33.156095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:33.174537 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:33.175810 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:33.176973 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:33.183791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.183791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.183791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.183791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.184863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 274/540] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:33.186416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.195194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:33.201130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:33.202265 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:33.203320 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:33.204680 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 267/541] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:33.205500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.210675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:33.316876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03cc4-38d9-4865-8ec5-908a948778a7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.317108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11cb9f-5717-420d-b850-4510eeed0e65 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.352511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab945a-5fbe-4051-bee6-27ec47d51f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.353114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab945a-5fbe-4051-bee6-27ec47d51f00 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.353394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab945a-5fbe-4051-bee6-27ec47d51f00 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.353670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab945a-5fbe-4051-bee6-27ec47d51f00 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.354357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab945a-5fbe-4051-bee6-27ec47d51f00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:33.355719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab945a-5fbe-4051-bee6-27ec47d51f00 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:33.359364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.360206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.360704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.361223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.362969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:33.363304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:33.364726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:33.381881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 268/542] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Oct 18 13:04:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:33.382935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.434252 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 275/543] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:04:33 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:33.436879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748d4d4-e988-4c3f-aa14-3ba38534687f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.437593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748d4d4-e988-4c3f-aa14-3ba38534687f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.438183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748d4d4-e988-4c3f-aa14-3ba38534687f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.441126 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 276/544] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:33.442271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748d4d4-e988-4c3f-aa14-3ba38534687f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.454753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:33.467589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:33.511126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e520fe-5682-4513-b5ea-8e13423ec87a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.568526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2d815-2c9f-4338-9a0b-b1bdc00c133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.569705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d815-2c9f-4338-9a0b-b1bdc00c133f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.570191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d815-2c9f-4338-9a0b-b1bdc00c133f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.570643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2d815-2c9f-4338-9a0b-b1bdc00c133f None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.572579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2d815-2c9f-4338-9a0b-b1bdc00c133f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:33.573153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2d815-2c9f-4338-9a0b-b1bdc00c133f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:33.580115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2d815-2c9f-4338-9a0b-b1bdc00c133f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:33.600973 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 269/545] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:33.602723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8b7e-78f1-4ec7-af6d-9f5bca367914 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.603223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8b7e-78f1-4ec7-af6d-9f5bca367914 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.603702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8b7e-78f1-4ec7-af6d-9f5bca367914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.619768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748d4d4-e988-4c3f-aa14-3ba38534687f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.630414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1f2c8b7e-78f1-4ec7-af6d-9f5bca367914 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:33.632379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f2c8b7e-78f1-4ec7-af6d-9f5bca367914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:33.670591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e09a8-8b05-4393-9ae2-6b0bb0d0103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.671786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e09a8-8b05-4393-9ae2-6b0bb0d0103e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.672221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e09a8-8b05-4393-9ae2-6b0bb0d0103e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.672494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e09a8-8b05-4393-9ae2-6b0bb0d0103e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.685696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e09a8-8b05-4393-9ae2-6b0bb0d0103e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:33.688389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e09a8-8b05-4393-9ae2-6b0bb0d0103e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:33.709991 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 270/546] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:33.710882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c8b7e-78f1-4ec7-af6d-9f5bca367914 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f22e09a8-8b05-4393-9ae2-6b0bb0d0103e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:33.716159 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:33.717396 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:33.718334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:33.718334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:33.718334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:33.720693 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 277/547] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:33.722200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7b36-2fe5-4961-bf92-d81eca45a042 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.722679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7b36-2fe5-4961-bf92-d81eca45a042 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.723142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7b36-2fe5-4961-bf92-d81eca45a042 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.725123 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 278/548] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:33.729846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe7b36-2fe5-4961-bf92-d81eca45a042 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.769587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:33.797085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:33.825518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c8b7e-78f1-4ec7-af6d-9f5bca367914 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.852776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe7b36-2fe5-4961-bf92-d81eca45a042 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:33.862640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdafa1-4de3-4bd6-a76a-bb053cc41d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.863595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdafa1-4de3-4bd6-a76a-bb053cc41d1c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.864069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdafa1-4de3-4bd6-a76a-bb053cc41d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.864531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdafa1-4de3-4bd6-a76a-bb053cc41d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.876304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdafa1-4de3-4bd6-a76a-bb053cc41d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:33.878188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdafa1-4de3-4bd6-a76a-bb053cc41d1c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:33.892626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:33.893233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.893513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.893795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.894467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:33.894776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-debdafa1-4de3-4bd6-a76a-bb053cc41d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:33.895144 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:33.896036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:33.896908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:33.896908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:33.896908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:33.897104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:33.899481 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 271/549] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:33.900908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553924ac-df7b-4333-8b2c-a838bfecdeb2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:33.901396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553924ac-df7b-4333-8b2c-a838bfecdeb2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:33.901858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553924ac-df7b-4333-8b2c-a838bfecdeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:33.910157 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 279/550] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:33.911358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:33.929754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-553924ac-df7b-4333-8b2c-a838bfecdeb2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:33.931256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-553924ac-df7b-4333-8b2c-a838bfecdeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:34.026156 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 272/551] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:04:34.026156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553924ac-df7b-4333-8b2c-a838bfecdeb2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.028313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1278-74ed-436f-945f-33e7b2450849 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.054407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:34.055436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:34.068058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.068676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.068957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.069229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.069871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:34.070204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.071639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.083463 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 280/552] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:34.084417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.125462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553924ac-df7b-4333-8b2c-a838bfecdeb2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.160240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.160893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.161181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.161467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.168329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.170407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:34.181615 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:34.182624 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:34.183539 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:34.188528 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 273/553] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:34.189374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.191484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70edf3-df45-49d8-9dab-372499802e39 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.235231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.235877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.236155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.236434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.248586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:34.255813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:34.256753 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:34.257591 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 281/554] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:34.258314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.310486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:34.316314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:34.325372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a2b9e-5f1a-4e50-b2b2-7830388d4ada None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.360100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.361173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.361697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.362498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.369778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.371271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.376306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d426f-34b1-4671-bdff-aee07a32ad62 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:34.384444 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:34.385420 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:34.386791 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 274/555] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:34.387951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.415912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.416554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.416836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.417109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.417802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:34.418136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.420091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.437649 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 282/556] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:34.437649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.507928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd176-5017-405f-a2d9-4a94ea1a1232 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.541667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:34.545222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c61c59-cc07-49d4-b9db-b0440e140c2e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.546551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.547161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.550213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.550213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.550213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:34.550213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.550213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.558784 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 275/557] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:34.559712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.579038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:34.586963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.587711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.588046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.589486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.589486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.591344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.657529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 283/558] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:04:34 2022] POST /identity/v3/services => generated 240 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:34.658475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.664954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee90c6b-a0cd-4b1a-a8e6-df9381ab1555 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.715665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.717120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.717772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.718304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.719512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:34.719512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.721236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.747267 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 276/559] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:34.748151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.813856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d927eb-8d15-48a7-b7c6-bb134fdee285 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.824783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:34.863108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f608856-f578-4a23-9e77-a14e1efc3371 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:34.865192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.865956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.866342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.866687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/025cbd75396f4aa09e2fc5c6c77be077/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.869103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=025cbd75396f4aa09e2fc5c6c77be077, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.870900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.901444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:34.902468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:34.902468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:34.903262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:34.913760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:34.915252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:34.931306 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:34.938368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:34.939250 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:34.939250 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:34.939250 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:34.939250 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 277/560] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:34.939250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.945308 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 284/561] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:34 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/025cbd75396f4aa09e2fc5c6c77be077/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:04:34.947257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:34.972735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:35.076761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fabe9c-cc81-4c14-b47f-343df96bf755 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:35.119442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:35.120139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.120450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.120729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.121433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:35.121749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:35.124367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:35.141558 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 285/562] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:35.148120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:35.189649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1b45-4793-47e2-8b46-9f160a8d376e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:35.217814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:35.239972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:35.240940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.241412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.241875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.299116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:35.339423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdeae-1c4e-443d-b178-83706a5cc63c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:35.360114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:35.361751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:35.414870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:35.415759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.416206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.416627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.434804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:35.436485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:35.455004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:35.456140 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:35.457329 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:35.459696 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 286/563] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:04:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:35.462774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:35.503311 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 278/564] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:04:35.508392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:35.539874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:35.631592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545e5e0-5d04-4cd9-9fb1-74c183be61ef None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:35.667872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:35.668439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.668725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.669000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.669737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:35.670382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:35.673096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91682cfc-bb5b-4685-868f-3f1717cb7aee None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:35.675824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:35.694401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:35.712676 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 287/565] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Oct 18 13:04:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:35.718289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:35.748357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:35.749009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.749332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.749608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.769007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:35.770810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:35.802392 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:35.803385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:35.804248 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:35.804248 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:35.804248 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:35.804248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 279/566] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:35.808857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:35.893653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d436fe3-20d3-4b0a-84f2-8dadc2f8be5e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:35.899287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:35.930435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf7cc-d7fa-4eb3-bede-b12ce1862325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:35.930999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf7cc-d7fa-4eb3-bede-b12ce1862325 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.931281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf7cc-d7fa-4eb3-bede-b12ce1862325 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.931558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf7cc-d7fa-4eb3-bede-b12ce1862325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.933304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770e020-ff09-4249-bf7a-63b7d8a68f1b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:35.942691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf7cc-d7fa-4eb3-bede-b12ce1862325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:35.944279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf7cc-d7fa-4eb3-bede-b12ce1862325 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e5bcf7cc-d7fa-4eb3-bede-b12ce1862325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:35.960224 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:35.961178 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:35.962078 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:35.962078 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:35.962078 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:35.962078 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 288/567] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:35.967268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e463a0-bcf1-4ade-91be-e0f4a2c1f9e4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.967560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e463a0-bcf1-4ade-91be-e0f4a2c1f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.967968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e463a0-bcf1-4ade-91be-e0f4a2c1f9e4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.969510 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 289/568] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:35.970235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e463a0-bcf1-4ade-91be-e0f4a2c1f9e4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:35.973876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d51bd7-9fd0-4d26-af38-ea07f6fa80dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:35.975249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51bd7-9fd0-4d26-af38-ea07f6fa80dc None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.975620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51bd7-9fd0-4d26-af38-ea07f6fa80dc None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.975986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51bd7-9fd0-4d26-af38-ea07f6fa80dc None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:35.976722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d51bd7-9fd0-4d26-af38-ea07f6fa80dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:35.977258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d51bd7-9fd0-4d26-af38-ea07f6fa80dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:35.978874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d51bd7-9fd0-4d26-af38-ea07f6fa80dc None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:35.993659 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 280/569] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:35.995366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d89b-4c44-49f0-be4e-e6b104787faa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:35.995658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d89b-4c44-49f0-be4e-e6b104787faa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:35.995982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37d89b-4c44-49f0-be4e-e6b104787faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.015711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3f37d89b-4c44-49f0-be4e-e6b104787faa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:36.017009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f37d89b-4c44-49f0-be4e-e6b104787faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:36.033130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:36.092545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e463a0-bcf1-4ade-91be-e0f4a2c1f9e4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.092986 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 281/570] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:36.093929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d89b-4c44-49f0-be4e-e6b104787faa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.132032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.133089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.133629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.134133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.135069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:36.135572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.137161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.151239 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 290/571] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:36.163056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.163523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:36.205338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37d89b-4c44-49f0-be4e-e6b104787faa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.243301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.244150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.244571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.245076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.253447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.255223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:36.267843 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:36.271984 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:36.273245 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 282/572] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:36.274783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.386219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec1d24-c8d1-4faf-bcea-07622da2fea6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.410742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:36.428909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.429521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.429804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.430098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.431116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:36.431116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.432517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.440250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec75c89-e2a8-4576-a050-80dd5a0c83ba None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.444869 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 283/573] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:36.446075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.456371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:36.490347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.491038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.491316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.491591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.498911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.500175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:36.512018 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:36.512953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 291/574] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:36.514469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.561711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910a5f-a1a6-4f2f-89f8-22a45679198f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.596594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.597590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.598091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.598567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.599349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.601193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:36.611146 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:36.612130 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:36.612967 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:36.615538 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 284/575] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:36.620370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa583b63-d4c0-4761-a38d-2a40f56a1c7e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.621579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.656617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.657228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.657511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.657783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.658644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=793ee1b363f8415f817fe5a8c3c200fd) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:36.658982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.660558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.666907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 292/576] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/role_assignments?user.id=793ee1b363f8415f817fe5a8c3c200fd&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:36.667827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.694509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:36.704370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:36.741702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc6825-327a-45a1-ab12-43d93e307497 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.782072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276718c3-3b10-48ef-b25b-7a89235b067d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.788229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.789543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.790661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.791188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.792224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:36.792718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.795153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.810725 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 285/577] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:36.822092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.838909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:36.839536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:36.839817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:36.840089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:36.841339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:36.841642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:36.844704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:36.854699 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 293/578] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:36.861464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:36.981251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621b98a-978e-4498-adf3-169edea1c95d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:36.988399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:36.993315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:37.000235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fc09-626e-4935-b9f3-a21fb7cf9e86 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:37.020574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae6d62-de47-43ac-b0fc-94f9cd294d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:37.021250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6d62-de47-43ac-b0fc-94f9cd294d8e None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.021534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6d62-de47-43ac-b0fc-94f9cd294d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.021813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae6d62-de47-43ac-b0fc-94f9cd294d8e None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/386db40d108b4e93996394790debbfef/roles/b1a4be1bc731427ebb4d293cc0c66243` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.040779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:37.041418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.041697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.041967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.042648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:37.043032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:37.045408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:37.048475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae6d62-de47-43ac-b0fc-94f9cd294d8e None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=386db40d108b4e93996394790debbfef, role_id=b1a4be1bc731427ebb4d293cc0c66243)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:37.051176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae6d62-de47-43ac-b0fc-94f9cd294d8e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:37.056959 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 294/579] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Oct 18 13:04:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:37.063904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:37.146444 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 286/580] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:36 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/386db40d108b4e93996394790debbfef/roles/b1a4be1bc731427ebb4d293cc0c66243 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:04:37.161881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772631b-a92c-41c6-b5ad-6f563079fc73 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.162210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772631b-a92c-41c6-b5ad-6f563079fc73 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.162462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772631b-a92c-41c6-b5ad-6f563079fc73 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.164031 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 287/581] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:37.169755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827f224-e8b6-4403-a01a-a84a727c13cf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.170048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827f224-e8b6-4403-a01a-a84a727c13cf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.170348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827f224-e8b6-4403-a01a-a84a727c13cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.179505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a2c9-fcff-4a8c-a955-8d513415574a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:37.207420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1827f224-e8b6-4403-a01a-a84a727c13cf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:37.209045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1827f224-e8b6-4403-a01a-a84a727c13cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:37.228283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:37.228989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.229274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.229650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.230410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] RBAC: Adding query filter params (interface=public, service_id=195db88bdc7145c4b772c5828d8226c1, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:37.230748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:37.233577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:37.258728 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 295/582] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:04:37 2022] GET /identity/v3/endpoints?service_id=195db88bdc7145c4b772c5828d8226c1&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:37.264573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:37.309578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:37.357565 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 288/583] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:37.392700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c124-046b-4acd-9f74-6b9130bdcc47 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:37.428932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bc76b-fe71-4cc7-a0af-f6f3e55cb329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:37.429553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc76b-fe71-4cc7-a0af-f6f3e55cb329 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.429834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc76b-fe71-4cc7-a0af-f6f3e55cb329 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.430136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc76b-fe71-4cc7-a0af-f6f3e55cb329 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.430814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bc76b-fe71-4cc7-a0af-f6f3e55cb329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:37.432264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bc76b-fe71-4cc7-a0af-f6f3e55cb329 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:37.438488 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 296/584] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:04:37 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:37.604404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7870-1d46-4cb7-a43d-9a2144bf378e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.605090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7870-1d46-4cb7-a43d-9a2144bf378e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.605593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd7870-1d46-4cb7-a43d-9a2144bf378e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.608065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 289/585] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:37.614005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93e41-2760-411d-9038-2ea31b1618ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.614653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93e41-2760-411d-9038-2ea31b1618ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.615180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a93e41-2760-411d-9038-2ea31b1618ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.639636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-49a93e41-2760-411d-9038-2ea31b1618ed None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:37.641272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49a93e41-2760-411d-9038-2ea31b1618ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:37.642358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd7870-1d46-4cb7-a43d-9a2144bf378e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:37.752905 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 297/586] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:37.774108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:37.791187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd7870-1d46-4cb7-a43d-9a2144bf378e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:37.829103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:37.829797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:37.830084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:37.830453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] PATH_INFO: `/v3/services/network` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:37.831059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:37.832501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:37.842937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:37.844002 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:37.844870 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:37.846950 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 290/587] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:37 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:37.853465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93e41-2760-411d-9038-2ea31b1618ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:37.874362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:37.960410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a93e41-2760-411d-9038-2ea31b1618ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:38.003617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:38.005072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:38.005521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:38.005958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:38.006825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] RBAC: Adding query filter params (name=network) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:38.007297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:38.008926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:38.014972 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 298/588] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:38.020921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:38.115163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:38.154919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdb1a5-9bfd-41fc-bd82-f1de1fc5cc97 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:38.235177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:38.236476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:38.237101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:38.238685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:38.239555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:38.240192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:38.244309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:38.257940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:38.279324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc79bec-b1f1-4e9e-9238-7c45542a3542 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:38.311712 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 291/589] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:38.320095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:38.337777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:38.338718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:38.340402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:38.340863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:38.351131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:38.366151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:38.378035 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:38.379087 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:04:38.379948 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:38.387903 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 299/590] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:38.393068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:38.536114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11812ff-fc6c-404c-8e72-c28b78a7f0a8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:38.607073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c460c5-846c-4927-9625-22b9f46481be None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:38.612766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:38.614223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:38.617893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:38.618347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:38.619195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] RBAC: Adding query filter params (interface=public, service_id=b3f1e1c5e4ab4674979a090b4302aad2, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:38.619650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:38.621166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:38.638938 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 292/591] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:04:38 2022] GET /identity/v3/endpoints?service_id=b3f1e1c5e4ab4674979a090b4302aad2&interface=public®ion_id=RegionOne => generated 194 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:38.644553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:38.682600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:38.690580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:38.691071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:38.691477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:38.692287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:38.692765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:38.694341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:38.718322 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 300/592] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:04:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:38.724108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:38.740196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:38.776548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:38.802145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d906a08-f809-43df-8b8b-1f4187962e47 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:38.848066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:38.848686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:38.848971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:38.849246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:38.852660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:38.852660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:38.857817 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 293/593] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:04:38 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:38.975191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6d69b-7407-48b4-bb06-4f8790a51ac8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:39.015877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:39.016675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.016863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.017134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.029504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:39.030993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:39.047210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:39.048227 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:39.049103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:39.049103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:39.049103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:39.049103 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 301/594] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:39.054884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:39.169925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639f4e6-82b3-44d4-b027-949e60173a0a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:39.206326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80e677-30a9-4af6-9aa8-c3dfecb4ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:39.210803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80e677-30a9-4af6-9aa8-c3dfecb4ef93 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.210803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80e677-30a9-4af6-9aa8-c3dfecb4ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.210803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80e677-30a9-4af6-9aa8-c3dfecb4ef93 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.210803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80e677-30a9-4af6-9aa8-c3dfecb4ef93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:39.210803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80e677-30a9-4af6-9aa8-c3dfecb4ef93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:39.210803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80e677-30a9-4af6-9aa8-c3dfecb4ef93 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:39.224482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 294/595] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:39.230113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:39.294393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:39.341555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9871-598c-4fd0-ae65-20c820f56aea None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:39.377561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:39.378228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.378514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.378787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.386876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:39.388421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:39.400355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:39.401493 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 13:04:39.403208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:39.405658 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 302/596] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:04:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:39.411840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46bf2-85af-4ac3-a370-7b0d99d26bdf None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.412126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46bf2-85af-4ac3-a370-7b0d99d26bdf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.412401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46bf2-85af-4ac3-a370-7b0d99d26bdf None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.413842 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 295/597] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:39.414637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:39.420040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be1c9-905d-4c98-b9a9-33be4756135f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.420537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be1c9-905d-4c98-b9a9-33be4756135f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.421021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be1c9-905d-4c98-b9a9-33be4756135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.428369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:39.453158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2c2be1c9-905d-4c98-b9a9-33be4756135f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:39.454845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c2be1c9-905d-4c98-b9a9-33be4756135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:39.572842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda75233-2ea0-4a3f-8ea2-6621e14d15f3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:39.589941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:39.600971 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 296/598] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:04:39.609013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126075b0-c1f2-417a-8410-951687e88f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:39.609630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126075b0-c1f2-417a-8410-951687e88f95 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.609912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126075b0-c1f2-417a-8410-951687e88f95 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.610217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126075b0-c1f2-417a-8410-951687e88f95 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.610949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126075b0-c1f2-417a-8410-951687e88f95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:39.611258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126075b0-c1f2-417a-8410-951687e88f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:39.612695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126075b0-c1f2-417a-8410-951687e88f95 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:39.630786 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 303/599] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Oct 18 13:04:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:39.636464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be1c9-905d-4c98-b9a9-33be4756135f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:39.660457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cfe99-a373-467f-94b2-145e29ff6372 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.660934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cfe99-a373-467f-94b2-145e29ff6372 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.661416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cfe99-a373-467f-94b2-145e29ff6372 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.666043 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 304/600] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:39.673161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49de6-c810-4fb5-9aa6-5ae49769adc8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.673662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49de6-c810-4fb5-9aa6-5ae49769adc8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.674021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed49de6-c810-4fb5-9aa6-5ae49769adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.704842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ed49de6-c810-4fb5-9aa6-5ae49769adc8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:39.706993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ed49de6-c810-4fb5-9aa6-5ae49769adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:39.795693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be1c9-905d-4c98-b9a9-33be4756135f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:39.850127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:39.861277 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 305/601] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:39.861802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:39.862447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:39.862724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:39.866194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:39.931289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49de6-c810-4fb5-9aa6-5ae49769adc8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:39.953680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:39.955422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.091759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 297/602] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:04:40.098829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.125365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed49de6-c810-4fb5-9aa6-5ae49769adc8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.145017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:40.159195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:40.165249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.166145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.175118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.175118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.175118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:40.175118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:40.180496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:40.181419 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:40.182326 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:40.185548 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 306/603] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Oct 18 13:04:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:40.194161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.267306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5624-8f47-459e-b41d-20674c0932b1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.306602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.307353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.307698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.307980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.321869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:40.323543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.324472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb6b69-d0d0-4a76-a22d-de2c246a06ef None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:40.341901 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:40.342930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:40.344376 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:40.344376 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:40.344376 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:40.344376 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 298/604] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:40.344376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.370622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.371237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.372014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.372285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.372922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:40.373224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:40.374607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.379202 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 307/605] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:40.382138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.414819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:40.438779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:40.454948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d373f0-c5a4-48ed-8441-10ce2dc47ef0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.491798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8948f-0bbc-4bda-b2ca-998846a15c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.492443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8948f-0bbc-4bda-b2ca-998846a15c0e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.492721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8948f-0bbc-4bda-b2ca-998846a15c0e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.493000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8948f-0bbc-4bda-b2ca-998846a15c0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.496180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f554-d961-4b2e-b026-824c406551ff None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.506619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8948f-0bbc-4bda-b2ca-998846a15c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-abe8948f-0bbc-4bda-b2ca-998846a15c0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:40.511897 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:40.512791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:40.513632 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 299/606] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:40.514925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253ac4-bfeb-4174-ae3d-5dea46e02ec7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.514925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253ac4-bfeb-4174-ae3d-5dea46e02ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.515078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253ac4-bfeb-4174-ae3d-5dea46e02ec7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.519420 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 300/607] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:40.519420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253ac4-bfeb-4174-ae3d-5dea46e02ec7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.537263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.537972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.538286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.538581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.539203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:40.539507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:40.540907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.554122 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 308/608] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:40.554964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.629888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253ac4-bfeb-4174-ae3d-5dea46e02ec7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.646993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:40.655962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409657-dcbd-44c6-bcaa-238bd6d9f9ab None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.664256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1c70c-1857-4a01-9b77-b83d43a7c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.665033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1c70c-1857-4a01-9b77-b83d43a7c523 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.665451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1c70c-1857-4a01-9b77-b83d43a7c523 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.665882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1c70c-1857-4a01-9b77-b83d43a7c523 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.666627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1c70c-1857-4a01-9b77-b83d43a7c523 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:40.666922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1c70c-1857-4a01-9b77-b83d43a7c523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:40.668923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1c70c-1857-4a01-9b77-b83d43a7c523 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.673463 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 301/609] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:40.674837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa58a9-6746-4207-a3b0-e687984be116 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.675127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa58a9-6746-4207-a3b0-e687984be116 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.675400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa58a9-6746-4207-a3b0-e687984be116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.699012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-11aa58a9-6746-4207-a3b0-e687984be116 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:40.700268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-11aa58a9-6746-4207-a3b0-e687984be116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:40.702657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:40.705901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.706864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.707288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.707709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.708537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:40.708993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:40.710967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.726133 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 309/610] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:40.727208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.794117 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 302/611] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:40.795379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa58a9-6746-4207-a3b0-e687984be116 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.860567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97708125-4d89-458d-8870-a21cda3c8c9f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:40.901768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:40.902382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:40.903255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:40.903526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:40.910564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:40.912414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:40.925251 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:40.926173 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:40.927060 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:40.928995 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 310/612] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:40.934505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:40.957414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:40.963132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa58a9-6746-4207-a3b0-e687984be116 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.004190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.005221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.005768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.006262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.013618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:41.018529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.020273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:41.036688 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:41.037680 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:41.038601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:41.038601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:41.038601 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:41.040660 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 303/613] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:41.059454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.064832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32075fcf-f151-4ff0-8130-275644eeb4c5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.099660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.100536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.100820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.101088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.101783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:41.102114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.103561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.117086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 311/614] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:41.118276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.198566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:41.200299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60766bb4-db9e-4783-91ac-bfde3aeb41aa None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.220854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d573f-766d-4cee-af48-b46852602cd7 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.242109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.242109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.242109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.242109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.242526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:41.242526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.242526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.258139 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 304/615] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:41.259006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.260414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.261109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.261391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.261662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.262841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.264263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:41.273542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:41.274553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 13:04:41.275392 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:41.278285 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 312/616] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:41.279118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.318576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:41.374977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4a2d0-9e98-41c2-bd9e-c9843e5ede3e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.402091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77089e-01f8-4314-a77d-130811a57402 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.422469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.423344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.423622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.423920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.425609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=025cbd75396f4aa09e2fc5c6c77be077) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:41.426081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.427822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.430827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.431573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.431957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.432332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.438249 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 305/617] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/role_assignments?user.id=025cbd75396f4aa09e2fc5c6c77be077&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:41.440270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.449967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.455880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.459766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:41.485022 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:41.486046 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:41.487019 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:41.487634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 313/618] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:41.492456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.591682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1c5ae-bd6e-4c22-b162-a255f7cfdefd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.614385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:41.631933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904bb0b-66ba-4599-8737-2faf87c43c35 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.643736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de375da5-a856-4a18-b2f4-45c8d4cd1d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.644823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375da5-a856-4a18-b2f4-45c8d4cd1d90 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.645100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375da5-a856-4a18-b2f4-45c8d4cd1d90 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.645372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de375da5-a856-4a18-b2f4-45c8d4cd1d90 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.646441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de375da5-a856-4a18-b2f4-45c8d4cd1d90 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:41.646743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de375da5-a856-4a18-b2f4-45c8d4cd1d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.648406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de375da5-a856-4a18-b2f4-45c8d4cd1d90 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.653869 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 306/619] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:41.655135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364b5c8-1b76-450d-8982-4a63b0282e20 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.655409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364b5c8-1b76-450d-8982-4a63b0282e20 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.655681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364b5c8-1b76-450d-8982-4a63b0282e20 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.657237 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 307/620] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:41.664878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07baf67-f379-47cc-aee7-7b172ad3f668 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.665161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07baf67-f379-47cc-aee7-7b172ad3f668 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.665426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07baf67-f379-47cc-aee7-7b172ad3f668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.674871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.675483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.675761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.676033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.676763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:41.677066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.678529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.685606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b07baf67-f379-47cc-aee7-7b172ad3f668 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:41.690190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b07baf67-f379-47cc-aee7-7b172ad3f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:41.703680 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 314/621] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:41.705408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.778203 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 308/622] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:41.779472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07baf67-f379-47cc-aee7-7b172ad3f668 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.780852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:41.833368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbd29e-8468-4ae2-a616-69fbe38f2657 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.887604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:41.888431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:41.888705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:41.888970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:41.890789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:41.891094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:41.892445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:41.900832 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 315/623] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:41.906500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:41.972830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07baf67-f379-47cc-aee7-7b172ad3f668 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:41.985133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:42.031537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:42.032348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:42.032548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:42.032821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:42.055473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbff0-42b9-469a-a90e-48cd982fdc7d None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:42.082681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:42.092354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:42.093155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:42.093601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:42.094015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:42.094835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:42.096569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:42.144185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:42.145658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:42.180462 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 316/624] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:04:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:42.187202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:42.273717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 309/625] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:04:42.279686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:42.304255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:42.438942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e561c0-3afa-4fcc-956d-241b3680ea4b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:42.461857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b3d04-11d2-48c6-bcc2-f19458cd7c47 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:42.486771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:42.487470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:42.487755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:42.488028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:42.500433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:42.503197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:42.507060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:42.507708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:42.507987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:42.508261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] PATH_INFO: `/v3/services/network` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:42.508849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:42.510792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:42.520736 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:42.521699 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:42.523113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:42.523113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:42.523113 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:42.523452 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:42.524807 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:42.525817 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 317/626] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:42 2022] GET /identity/v3/services/network => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:42.526834 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 310/627] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:42.531460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:42.531713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:42.577531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:42.601389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:42.661286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcec3-108d-4a5d-8154-87ccac535748 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:42.668718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fca91-0697-44af-8205-f76d6f638a93 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:42.704434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:42.705050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:42.705330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:42.705602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:42.709020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] RBAC: Adding query filter params (name=network) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:42.709020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:42.709020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:42.714085 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 318/628] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:42.719840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:42.747656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:42.748685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:42.749187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:42.749774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:42.750746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:42.751249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:42.752935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:42.778092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 311/629] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:42.783530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:42.860296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:42.864056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d32a0f-1227-4b9c-a946-3f1908aa6364 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:42.925471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:42.926504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:42.927122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:42.928277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:42.930223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] RBAC: Adding query filter params (type=network) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:42.930789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:42.932644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:42.939986 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 319/630] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:42.946132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:42.978221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30f52-9576-4c9c-bacc-6e63c2daf006 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:43.014466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:43.034901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:43.034901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:43.034901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:43.034901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:43.041521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:43.043045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:43.057285 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:43.058206 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:43.059131 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 312/631] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:43.065981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:43.129689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2e975-e5fb-41c0-a112-b1da5fe9d2fc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:43.175537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccee1c-6267-4549-97e6-955381bcd18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:43.176548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccee1c-6267-4549-97e6-955381bcd18e None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:43.177008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccee1c-6267-4549-97e6-955381bcd18e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:43.177455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccee1c-6267-4549-97e6-955381bcd18e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:43.178354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccee1c-6267-4549-97e6-955381bcd18e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:43.180395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccee1c-6267-4549-97e6-955381bcd18e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:43.206678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508841-46a8-482c-8569-3ed403449ed6 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:43.242537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccb0f3-0900-4be6-b13f-fa30e9f9eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:43.243141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb0f3-0900-4be6-b13f-fa30e9f9eb89 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:43.243420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb0f3-0900-4be6-b13f-fa30e9f9eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:43.243698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccb0f3-0900-4be6-b13f-fa30e9f9eb89 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:43.244375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccb0f3-0900-4be6-b13f-fa30e9f9eb89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:43.244676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccb0f3-0900-4be6-b13f-fa30e9f9eb89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:43.246138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccb0f3-0900-4be6-b13f-fa30e9f9eb89 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:43.265177 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 313/632] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:43.265177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10036f-a8e4-4a3b-84ed-d4324463924c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:43.265177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10036f-a8e4-4a3b-84ed-d4324463924c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:43.265177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10036f-a8e4-4a3b-84ed-d4324463924c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:43.269485 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 314/633] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:43.270458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10036f-a8e4-4a3b-84ed-d4324463924c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:43.277344 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 320/634] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:04:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:43.287317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223db08-dcf7-4ab7-b203-2e333c60b027 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:43.287317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223db08-dcf7-4ab7-b203-2e333c60b027 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:43.287317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223db08-dcf7-4ab7-b203-2e333c60b027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:43.305786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a223db08-dcf7-4ab7-b203-2e333c60b027 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:43.307777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a223db08-dcf7-4ab7-b203-2e333c60b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:43.329146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:43.365017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:43.411874 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 321/635] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:43.500066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10036f-a8e4-4a3b-84ed-d4324463924c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:43.544557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36db8b2-47eb-4bfe-89cb-b2c80c1c3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:43.545083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db8b2-47eb-4bfe-89cb-b2c80c1c3614 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:43.545357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db8b2-47eb-4bfe-89cb-b2c80c1c3614 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:43.545626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db8b2-47eb-4bfe-89cb-b2c80c1c3614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:43.546373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36db8b2-47eb-4bfe-89cb-b2c80c1c3614 None admin] RBAC: Adding query filter params (role.id=b1a4be1bc731427ebb4d293cc0c66243, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=386db40d108b4e93996394790debbfef) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:43.546677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36db8b2-47eb-4bfe-89cb-b2c80c1c3614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:43.548215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36db8b2-47eb-4bfe-89cb-b2c80c1c3614 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:43.557673 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 315/636] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:43 2022] GET /identity/v3/role_assignments?user.id=386db40d108b4e93996394790debbfef&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=b1a4be1bc731427ebb4d293cc0c66243 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:43.716820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223db08-dcf7-4ab7-b203-2e333c60b027 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:43.832061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223db08-dcf7-4ab7-b203-2e333c60b027 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:43.868532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6c40a-203d-4319-9470-944659a55b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:43.869555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c40a-203d-4319-9470-944659a55b03 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:43.870035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c40a-203d-4319-9470-944659a55b03 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:43.870597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6c40a-203d-4319-9470-944659a55b03 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:43.871982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6c40a-203d-4319-9470-944659a55b03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:43.873533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6c40a-203d-4319-9470-944659a55b03 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:43.955609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 322/637] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:04:43 2022] POST /identity/v3/services => generated 269 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:44.076830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4222613-5448-404b-8859-046694680600 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:44.077354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4222613-5448-404b-8859-046694680600 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:44.077354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4222613-5448-404b-8859-046694680600 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:44.079077 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 316/638] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:44.084944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c17a-d0ad-4c05-be45-77c177a53e5e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:44.085131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c17a-d0ad-4c05-be45-77c177a53e5e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:44.085415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648c17a-d0ad-4c05-be45-77c177a53e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:44.099612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:44.105661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1648c17a-d0ad-4c05-be45-77c177a53e5e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:44.107723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1648c17a-d0ad-4c05-be45-77c177a53e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:44.190191 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 323/639] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:44 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:44.459249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4222613-5448-404b-8859-046694680600 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:44.582744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4222613-5448-404b-8859-046694680600 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:44.585227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:44.618362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce514e-4141-42d7-a051-323fba351e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:44.618977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce514e-4141-42d7-a051-323fba351e58 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:44.619264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce514e-4141-42d7-a051-323fba351e58 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:44.619536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce514e-4141-42d7-a051-323fba351e58 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:44.620114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce514e-4141-42d7-a051-323fba351e58 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:44.622074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce514e-4141-42d7-a051-323fba351e58 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-06ce514e-4141-42d7-a051-323fba351e58 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:44.630844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:44.631792 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:44.632820 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 317/640] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:44.640669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c17a-d0ad-4c05-be45-77c177a53e5e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:44.749680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648c17a-d0ad-4c05-be45-77c177a53e5e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:44.770740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3438-1ed1-4485-a5d4-d016767dddb2 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:44.771089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3438-1ed1-4485-a5d4-d016767dddb2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:44.771295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3438-1ed1-4485-a5d4-d016767dddb2 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:44.772875 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 318/641] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:04:44.777960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50502a-a3ed-43e9-8069-4a5d7c368d3b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:44.778287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50502a-a3ed-43e9-8069-4a5d7c368d3b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:44.778561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50502a-a3ed-43e9-8069-4a5d7c368d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:44.784499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:44.789256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:44.789865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:44.790170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:44.790441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:44.791107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:44.791409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:44.792818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:44.797773 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 324/642] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:44.800505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ec50502a-a3ed-43e9-8069-4a5d7c368d3b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:44.806623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec50502a-a3ed-43e9-8069-4a5d7c368d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:44.806728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:44.890081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 319/643] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:44 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:44.916589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681b735-3c8b-44b0-8a96-209f2662c529 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:44.953057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:44.953662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:44.953936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:44.954240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:44.954877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:44.955176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:44.956601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:44.966246 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 325/644] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:45.159122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50502a-a3ed-43e9-8069-4a5d7c368d3b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:45.258659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:45.263473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50502a-a3ed-43e9-8069-4a5d7c368d3b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:45.298819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:45.299822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:45.300391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:45.300865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:45.301645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:45.303288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:45.312492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:45.318649 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:45.319532 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 320/645] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:45.327161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:45.391981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:45.433977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039c830-13cd-49c2-9a6a-0193ba762258 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:45.480071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215f05b-351f-4ef2-8996-d80366539ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:45.481597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215f05b-351f-4ef2-8996-d80366539ce3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:45.482182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215f05b-351f-4ef2-8996-d80366539ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:45.482685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215f05b-351f-4ef2-8996-d80366539ce3 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:45.483516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215f05b-351f-4ef2-8996-d80366539ce3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:45.484018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215f05b-351f-4ef2-8996-d80366539ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:45.485572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215f05b-351f-4ef2-8996-d80366539ce3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:45.490779 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 326/646] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:45.499944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:45.601840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557f32-50c6-4c7f-9201-1d62be9b937e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:45.640725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c00879-8fa3-401e-9c24-6efd632a2961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:45.641338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00879-8fa3-401e-9c24-6efd632a2961 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:45.641622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00879-8fa3-401e-9c24-6efd632a2961 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:45.641897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00879-8fa3-401e-9c24-6efd632a2961 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:45.642560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c00879-8fa3-401e-9c24-6efd632a2961 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:45.642864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c00879-8fa3-401e-9c24-6efd632a2961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:45.644238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c00879-8fa3-401e-9c24-6efd632a2961 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:45.649341 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 321/647] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:45.934522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836dcfd-776f-4aa8-a12d-c6e423ddd7a7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:45.935075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836dcfd-776f-4aa8-a12d-c6e423ddd7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:45.935344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836dcfd-776f-4aa8-a12d-c6e423ddd7a7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:45.937035 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 327/648] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:45.942287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f19a64-4b88-4f95-828d-869f6254dab5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:45.942690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f19a64-4b88-4f95-828d-869f6254dab5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:45.943068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f19a64-4b88-4f95-828d-869f6254dab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:45.962038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-84f19a64-4b88-4f95-828d-869f6254dab5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:45.963250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84f19a64-4b88-4f95-828d-869f6254dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:45.985067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:46.036231 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 322/649] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:46.222640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a7cbc-987f-4c0e-9ef6-346d72eb229b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.223264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a7cbc-987f-4c0e-9ef6-346d72eb229b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.223754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a7cbc-987f-4c0e-9ef6-346d72eb229b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.225837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 328/650] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:46.231375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2a918-222a-464a-8ee2-c1be042e440d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.231853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2a918-222a-464a-8ee2-c1be042e440d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.231938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2a918-222a-464a-8ee2-c1be042e440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.251783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5bd2a918-222a-464a-8ee2-c1be042e440d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:46.253331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bd2a918-222a-464a-8ee2-c1be042e440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:46.306933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a7cbc-987f-4c0e-9ef6-346d72eb229b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:46.334081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 323/651] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:46 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:46.414609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a7cbc-987f-4c0e-9ef6-346d72eb229b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:46.439781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:46.451066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:46.454312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.454312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.454312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.467349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:46.474080 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:46.475314 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:04:46.476156 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:46.478402 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 329/652] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Oct 18 13:04:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:46.487174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2a918-222a-464a-8ee2-c1be042e440d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:46.578733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:46.593603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2a918-222a-464a-8ee2-c1be042e440d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:46.617778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:46.629956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:46.630622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.630904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.631181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.631855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:46.632136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:46.633578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:46.642188 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 324/653] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Oct 18 13:04:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:46.647954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:46.731778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dadf8-19d8-421d-a239-9cff2c1684af None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:46.750723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d19e0-d843-4108-a2bb-f41d2e233fc3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:46.770470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:46.771607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.772094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.772577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.773398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:46.775191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:46.785502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:46.786489 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:46.787379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:46.788111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:46.788111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.788111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.788111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.795244 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 330/654] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Oct 18 13:04:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:46.797425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:46.799089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:46.800611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:46.809209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:46.815869 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:46.816912 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:46.817805 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:46.817805 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:46.817805 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:46.821840 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 325/655] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:46.839518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:46.856978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:46.921235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07069eec-d27d-40a2-950b-444f2a64aac6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:46.946993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f21098-2e5e-4986-a5c6-b90b99df5b53 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:46.957722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:46.958984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.959461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.959945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.960832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:46.961342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:46.962944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:46.973166 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 331/656] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:46.974289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:46.988097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:46.988646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:46.988926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:46.989201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:46.990190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:46.990503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:46.992270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.010208 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 326/657] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:47.013002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.093616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d20a-e936-41eb-83b6-634c24bfc1d8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.095236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:47.110459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:47.134453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.135363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.135840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.136305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.137935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:47.138538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.140277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.150805 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 332/658] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:47.151738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc5710-0b2c-495f-ba95-769a35a6d971 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.152076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.192203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb601938-584c-48ba-b8d1-822db94e7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.193213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb601938-584c-48ba-b8d1-822db94e7aa7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.193711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb601938-584c-48ba-b8d1-822db94e7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.194259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb601938-584c-48ba-b8d1-822db94e7aa7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.202985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb601938-584c-48ba-b8d1-822db94e7aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.204797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb601938-584c-48ba-b8d1-822db94e7aa7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cb601938-584c-48ba-b8d1-822db94e7aa7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:47.218140 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:47.219141 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:47.220081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 327/659] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:04:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:47.220722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd00f-01a0-48d8-90f5-42a51c43e6b7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.220722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd00f-01a0-48d8-90f5-42a51c43e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.220902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd00f-01a0-48d8-90f5-42a51c43e6b7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.222596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 328/660] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:47.229805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61817-0ea8-4976-92af-b337446835f6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.230258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61817-0ea8-4976-92af-b337446835f6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.230561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61817-0ea8-4976-92af-b337446835f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.248743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b8a61817-0ea8-4976-92af-b337446835f6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:47.250588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8a61817-0ea8-4976-92af-b337446835f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:47.273464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05eddd-c609-4ae7-901b-e5934905999f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.309728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.310366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.310647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.310926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.311621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] RBAC: Adding query filter params (interface=public, service_id=ea0dd24d0b4f4d7f80613203464c5db6, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:47.311928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.313276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.323113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 333/661] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:04:47 2022] GET /identity/v3/endpoints?service_id=ea0dd24d0b4f4d7f80613203464c5db6&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:47.323113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.325527 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 329/662] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:47.331121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a61817-0ea8-4976-92af-b337446835f6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.378878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:47.386573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:47.439449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a61817-0ea8-4976-92af-b337446835f6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.456285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315a65-96ce-4e6d-80f8-439ba2363bee None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.486008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.486959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.487308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.488059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.488771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.490734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.506161 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 330/663] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:04:47 2022] GET /identity/v3/services => generated 1029 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:04:47.508222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.508862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.509140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.509409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.510206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:47.510513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.512529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.534149 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 334/664] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Oct 18 13:04:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:47.543282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.615546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.657326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38278de-ed4d-478a-aa51-36730778a728 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.674406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:47.703415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.704079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.704357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.704626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.718252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.720505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:47.740217 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:47.741221 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:47.742152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:47.742152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:47.742152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:47.742152 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 331/665] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:47.748888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.750894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:47.766566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a28f2-46dd-4aeb-8862-e05dac5cc4ec None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.793069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bdd47-a0f1-405f-8c8b-c11ec984f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.793974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bdd47-a0f1-405f-8c8b-c11ec984f84c None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.794466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bdd47-a0f1-405f-8c8b-c11ec984f84c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.795015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bdd47-a0f1-405f-8c8b-c11ec984f84c None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.795877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bdd47-a0f1-405f-8c8b-c11ec984f84c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.797419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bdd47-a0f1-405f-8c8b-c11ec984f84c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.857934 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 335/666] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:04:47 2022] POST /identity/v3/services => generated 241 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:04:47.859164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27607551-1d19-4fed-bd2e-d69cf2e25f44 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.859455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27607551-1d19-4fed-bd2e-d69cf2e25f44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.859738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27607551-1d19-4fed-bd2e-d69cf2e25f44 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.861108 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 336/667] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:47.870014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2610-f43e-4906-8b5a-ecf4489938ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.870014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2610-f43e-4906-8b5a-ecf4489938ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.870014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2610-f43e-4906-8b5a-ecf4489938ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.872917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93049a50-57ee-4603-a879-2da9461f6820 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:47.890148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57bc2610-f43e-4906-8b5a-ecf4489938ac None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:47.891655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57bc2610-f43e-4906-8b5a-ecf4489938ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:47.930127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:47.930848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:47.931189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:47.931524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:47.932246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:47.932613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:47.934772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:47.952395 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 332/668] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:47.958184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:47.978795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 337/669] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:47 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:04:48.002547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:48.082759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21e74d-63ed-4827-8707-d9c697a0a267 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:48.119408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:48.120042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:48.120322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:48.120595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:48.127957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:48.129393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:48.140666 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:48.141779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:48.143006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 333/670] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:48.149343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2610-f43e-4906-8b5a-ecf4489938ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:48.243428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:48.250885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:48.257310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2610-f43e-4906-8b5a-ecf4489938ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:48.303188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:48.304166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:48.304650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:48.305122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:48.306103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:48.307205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:48.309397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:48.327487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 338/671] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:48.333702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:48.357616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:48.377647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0337e69-8290-4a67-94bc-b5544d9df199 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:48.414705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673348e4-8e9c-4f10-b78a-34c37e93b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:48.415315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673348e4-8e9c-4f10-b78a-34c37e93b483 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:48.415600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673348e4-8e9c-4f10-b78a-34c37e93b483 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:48.415878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673348e4-8e9c-4f10-b78a-34c37e93b483 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:48.416541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673348e4-8e9c-4f10-b78a-34c37e93b483 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:48.418780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673348e4-8e9c-4f10-b78a-34c37e93b483 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:48.466124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b10709-8b47-4603-b7b9-d6477b556462 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:48.489060 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 334/672] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:04:48 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:48.520274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecbb28-c519-44e9-9640-b8b9b53dcdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:48.521408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbb28-c519-44e9-9640-b8b9b53dcdca None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:48.521930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbb28-c519-44e9-9640-b8b9b53dcdca None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:48.522491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbb28-c519-44e9-9640-b8b9b53dcdca None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/386db40d108b4e93996394790debbfef/roles/79d46a51115c40e9b8f018a7efe6d9f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:48.525269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecbb28-c519-44e9-9640-b8b9b53dcdca None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=386db40d108b4e93996394790debbfef, role_id=79d46a51115c40e9b8f018a7efe6d9f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:48.527084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecbb28-c519-44e9-9640-b8b9b53dcdca None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:48.594309 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 339/673] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:04:48 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/386db40d108b4e93996394790debbfef/roles/79d46a51115c40e9b8f018a7efe6d9f6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:04:49.799669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f906-e26a-4b6c-8c39-a29e53fbe54e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:49.800160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f906-e26a-4b6c-8c39-a29e53fbe54e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:49.800160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2f906-e26a-4b6c-8c39-a29e53fbe54e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:49.801680 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 335/674] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:49.807159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148778-b25e-4b68-b103-de64b14b8b88 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:49.807570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148778-b25e-4b68-b103-de64b14b8b88 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:49.807759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148778-b25e-4b68-b103-de64b14b8b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:49.815613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:49.827185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e2148778-b25e-4b68-b103-de64b14b8b88 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:49.828380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2148778-b25e-4b68-b103-de64b14b8b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:49.902145 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 340/675] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:50.058204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e2c2-87a6-4c5b-9e1c-2fff6d82165f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.058500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e2c2-87a6-4c5b-9e1c-2fff6d82165f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.059224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e2c2-87a6-4c5b-9e1c-2fff6d82165f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.060797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 336/676] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:50.067418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233dd0-42c6-4ae1-8e89-3791be466e52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.067809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233dd0-42c6-4ae1-8e89-3791be466e52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.068180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233dd0-42c6-4ae1-8e89-3791be466e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.087224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48233dd0-42c6-4ae1-8e89-3791be466e52 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:50.088398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48233dd0-42c6-4ae1-8e89-3791be466e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:50.157256 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 341/677] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:50.176705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e2c2-87a6-4c5b-9e1c-2fff6d82165f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:50.278965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e2c2-87a6-4c5b-9e1c-2fff6d82165f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:50.315457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:50.316017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.316296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.316570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.317153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:50.318583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:50.327588 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:50.328545 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:50.329465 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 337/678] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Oct 18 13:04:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:50.334554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48233dd0-42c6-4ae1-8e89-3791be466e52 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:50.398468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:50.438366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:50.444877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48233dd0-42c6-4ae1-8e89-3791be466e52 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:50.478459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:50.483259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:50.483869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.484153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.484428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.488946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:50.488946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:50.488946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:50.491979 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 342/679] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:50.499764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:50.559568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b35cd4-eb4b-4520-a61b-67007384ec45 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:50.599048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:50.599753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.600493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.600839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.601812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:50.603728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:50.615655 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:50.616675 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:50.617766 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 338/680] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:50.624299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310200b1-2446-42a1-b1c5-d22b4c130553 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:50.627151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:50.653974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:50.663008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:50.666451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.666451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.666451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.666451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:50.666451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:50.666844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:50.677662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 343/681] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:50.678697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:50.750451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:50.762044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb3cb9-f29e-4857-94f0-f14995c7889b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:50.804011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e48a5-214f-422a-a8c8-3389447c77c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:50.804678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e48a5-214f-422a-a8c8-3389447c77c6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.804879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e48a5-214f-422a-a8c8-3389447c77c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.805156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e48a5-214f-422a-a8c8-3389447c77c6 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.805774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e48a5-214f-422a-a8c8-3389447c77c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:50.806160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e48a5-214f-422a-a8c8-3389447c77c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:50.807561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e48a5-214f-422a-a8c8-3389447c77c6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:50.808361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125bda7-4fdc-4cef-8a1e-98975f51b631 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:50.812308 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 339/682] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:50.813454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eae89-fb59-4b22-a0a8-83d8f5e7b02c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.813732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eae89-fb59-4b22-a0a8-83d8f5e7b02c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.814002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eae89-fb59-4b22-a0a8-83d8f5e7b02c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.815461 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 340/683] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:50.817735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eae89-fb59-4b22-a0a8-83d8f5e7b02c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:50.847754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b82a-3a67-42b2-9207-1558db6b0d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:50.848376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b82a-3a67-42b2-9207-1558db6b0d09 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.848652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b82a-3a67-42b2-9207-1558db6b0d09 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.848925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b82a-3a67-42b2-9207-1558db6b0d09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.849653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b82a-3a67-42b2-9207-1558db6b0d09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:50.851250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b82a-3a67-42b2-9207-1558db6b0d09 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:50.923624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eae89-fb59-4b22-a0a8-83d8f5e7b02c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:50.953157 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 344/684] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:04:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:50.954531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313026a5-9d1e-4a6d-9359-e911b65c89d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.954817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313026a5-9d1e-4a6d-9359-e911b65c89d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.955094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313026a5-9d1e-4a6d-9359-e911b65c89d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.963679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:50.970239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca46e6-bc8a-44b8-8ceb-70af83251de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:50.971193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca46e6-bc8a-44b8-8ceb-70af83251de4 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.971473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca46e6-bc8a-44b8-8ceb-70af83251de4 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.971739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca46e6-bc8a-44b8-8ceb-70af83251de4 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.972418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca46e6-bc8a-44b8-8ceb-70af83251de4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:50.972690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca46e6-bc8a-44b8-8ceb-70af83251de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:50.974132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca46e6-bc8a-44b8-8ceb-70af83251de4 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:50.976846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-313026a5-9d1e-4a6d-9359-e911b65c89d1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:50.978140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-313026a5-9d1e-4a6d-9359-e911b65c89d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:50.980592 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 341/685] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:50.981851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5610ee-72e1-4fce-a0ee-dba8f35dc3b9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:50.982193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5610ee-72e1-4fce-a0ee-dba8f35dc3b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:50.982470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5610ee-72e1-4fce-a0ee-dba8f35dc3b9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:50.983804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 342/686] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:50.990147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5610ee-72e1-4fce-a0ee-dba8f35dc3b9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.038862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:51.074092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 345/687] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:51.074092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d530-71d7-4b89-bfba-bcb2afd4a12a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.074092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d530-71d7-4b89-bfba-bcb2afd4a12a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.074092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d530-71d7-4b89-bfba-bcb2afd4a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.093488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eab6d530-71d7-4b89-bfba-bcb2afd4a12a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:51.094754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eab6d530-71d7-4b89-bfba-bcb2afd4a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:51.122783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5610ee-72e1-4fce-a0ee-dba8f35dc3b9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.168132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.168746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.169029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.169312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.170075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] RBAC: Adding query filter params (interface=public, service_id=f0731f98a92d422ea6709b7eb2d3ade9, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:51.170393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:51.171755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:51.177694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 343/688] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:04:50 2022] GET /identity/v3/endpoints?service_id=f0731f98a92d422ea6709b7eb2d3ade9&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:51.184420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.185703 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 346/689] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:51.247386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:51.291217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a7c99-92d7-4eab-a084-3d75bf8e4f02 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.326011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.327060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.327533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.327996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.328810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:51.330400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:51.336746 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 344/690] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:04:51.350572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d530-71d7-4b89-bfba-bcb2afd4a12a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.456709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.470107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d530-71d7-4b89-bfba-bcb2afd4a12a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.481186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:51.509005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.509649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.509930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.510250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.510846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:51.513050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:51.523698 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:51.524718 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:51.525542 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 347/691] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:51.533129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.592789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6d96-1e01-41e7-97a5-60719e721a1b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.616436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:51.628650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.629398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.637290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.637290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.642242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:04:51.647153 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:51.648152 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:51.648959 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 345/692] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:51.654193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.677822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77a3fa-b2c2-49e8-bbb3-29d8c8a64af1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.727565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.728371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.728648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.728923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.729564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:51.729865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:51.732134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:51.739334 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 348/693] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:51.744676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.769143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad999b-31f1-4ae2-83f4-2caabb848d85 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.786108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:51.805989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.807721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.808300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.809367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.810217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:51.810833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:51.813167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:51.824928 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 346/694] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:51.830351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.861982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf299b-5c15-42ea-b9e8-f0b9ee59ef8f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.896851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.897356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:51.897469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.897725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.897995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:51.899044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:51.899347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:51.900835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:51.906203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 349/695] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:51.912074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:51.961601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f9d1-d112-4e71-8608-f64a426b14ff None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:51.998490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:51.999103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:51.999324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:51.999603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:52.011835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:52.013334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:52.028180 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:52.029174 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:52.030118 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:52.030118 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:52.030118 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:52.034019 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 347/696] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:52.034868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:52.049613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:52.053872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c334-3658-4883-8b68-a6168a0b63d9 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:52.099142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:52.100881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:52.101465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:52.102100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:52.102986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] RBAC: Adding query filter params (interface=public, service_id=358fe5a8c1ed4edaa89b18b5e00bdcb7, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:52.103482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:52.105264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:52.118426 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 350/697] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:04:51 2022] GET /identity/v3/endpoints?service_id=358fe5a8c1ed4edaa89b18b5e00bdcb7&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:52.119608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:52.139931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:52.146426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a91f6-68ee-46ff-8b25-ac6b712f09f3 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:52.184197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:52.184822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:52.185206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:52.185550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:52.186337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:52.186792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:52.188377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:52.207683 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 348/698] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:52.208810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:52.251612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d5fd-308d-4d5b-8912-e351abed88b3 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:52.289678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:52.290425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:52.290795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:52.291132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:52.291804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:52.293955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:52.306671 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 351/699] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:04:52 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:04:52.346344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0883-0410-46c2-9a08-675f2506597a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:52.387337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:52.388297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:52.388750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:52.389245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:52.398422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:52.400338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:04:52.414321 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:52.415332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 13:04:52.416238 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:52.418576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 349/700] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:04:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:52.427538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:52.461256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:52.538668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5bf5e-06de-4d74-a5b0-dd5cc93ecd91 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:52.572295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:52.572956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:52.573237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:52.573512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:52.574844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:52.575151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:52.576630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:52.594664 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 352/701] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Oct 18 13:04:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:52.600273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:52.620004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:52.707719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db9447-06d2-460c-a8c0-c2fd635c056f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:52.743711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:52.744582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:52.745005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:52.745420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:52.816141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:52.818269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:52.835736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:52.924430 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 350/702] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:04:52 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:04:52.930263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:53.019001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:53.040207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f81e6-3fb4-4cc1-8e89-92a55dc2cb9c None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:53.075878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:53.076430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.076707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.076977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.087444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:53.088871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:04:53.104378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:53.106102 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:04:53.107276 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:04:53.107276 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:04:53.107276 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:53.107276 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 353/703] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:53.113269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:53.224663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bea908-cfe0-4ed1-a459-85a48f4e9aa7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:53.245270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:53.265251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a35d6-6c79-4379-a5b6-909742a3d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:53.266235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a35d6-6c79-4379-a5b6-909742a3d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.266782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a35d6-6c79-4379-a5b6-909742a3d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.267301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a35d6-6c79-4379-a5b6-909742a3d6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.268158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a35d6-6c79-4379-a5b6-909742a3d6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:53.268650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a35d6-6c79-4379-a5b6-909742a3d6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:53.270257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a35d6-6c79-4379-a5b6-909742a3d6d6 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:53.283169 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 351/704] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:53.288980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:53.304294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b833-9221-4b3f-8073-87a5780b7d36 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.304582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b833-9221-4b3f-8073-87a5780b7d36 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.304860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b833-9221-4b3f-8073-87a5780b7d36 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.307539 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 352/705] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:53.311612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0869a-04f4-499f-a508-e9d2e2f5c400 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.311898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0869a-04f4-499f-a508-e9d2e2f5c400 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.312173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0869a-04f4-499f-a508-e9d2e2f5c400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.340699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ece0869a-04f4-499f-a508-e9d2e2f5c400 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:53.342746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ece0869a-04f4-499f-a508-e9d2e2f5c400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:53.403696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6de39-832e-4969-af2b-d8a6a8c7565b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:53.430742 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 353/706] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:53.446883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fec15-54fd-4dfd-8854-938d14bbdb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:53.447517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fec15-54fd-4dfd-8854-938d14bbdb04 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.447801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fec15-54fd-4dfd-8854-938d14bbdb04 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.448067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fec15-54fd-4dfd-8854-938d14bbdb04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.462097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fec15-54fd-4dfd-8854-938d14bbdb04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:53.462097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fec15-54fd-4dfd-8854-938d14bbdb04 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:53.462097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-756fec15-54fd-4dfd-8854-938d14bbdb04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:53.471912 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:53.478641 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:53.479533 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 354/707] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:53.480011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0869a-04f4-499f-a508-e9d2e2f5c400 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:53.586778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0869a-04f4-499f-a508-e9d2e2f5c400 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:53.594551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:53.623685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:53.624301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.624577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.624845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.625535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:53.625834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:53.627350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:53.631816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b70b-4397-4e40-92db-29b45fe91bc4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.632100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b70b-4397-4e40-92db-29b45fe91bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.632380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b70b-4397-4e40-92db-29b45fe91bc4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.633964 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 355/708] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:04:53.639410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1bba8-5acb-4601-9630-541e13d35a4b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.639691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1bba8-5acb-4601-9630-541e13d35a4b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.639961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1bba8-5acb-4601-9630-541e13d35a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.640156 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 354/709] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:53.646187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:53.662572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51a1bba8-5acb-4601-9630-541e13d35a4b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:53.663752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51a1bba8-5acb-4601-9630-541e13d35a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:53.734164 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 356/710] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:53.739296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1bba8-5acb-4601-9630-541e13d35a4b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:53.750335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69169d-c819-4434-915b-42d2b7772801 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:53.787078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:53.788122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.788122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.788332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.788960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] RBAC: Adding query filter params (role.id=79d46a51115c40e9b8f018a7efe6d9f6, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=386db40d108b4e93996394790debbfef) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:53.789270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:53.790752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:53.797055 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 355/711] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:04:53 2022] GET /identity/v3/role_assignments?user.id=386db40d108b4e93996394790debbfef&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=79d46a51115c40e9b8f018a7efe6d9f6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:53.869683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1bba8-5acb-4601-9630-541e13d35a4b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:53.901324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:53.910520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:53.912164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:53.912164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:53.912164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] PATH_INFO: `/v3/services/compute` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:53.913114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:53.914735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:53.925129 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:53.926241 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:04:53.927086 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:53.934188 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 357/712] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:53.938327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:53.973058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:54.008848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:54.051597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7bc34-f685-44eb-a79b-80c434e435c7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:54.094568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:54.096020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.096456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.096878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.097658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:54.098144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:54.100605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:54.112135 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 356/713] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:54.114171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:54.144728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e309c6-776f-4f57-82da-d1e00d6f861e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:54.192094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:54.192741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.193022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.193296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.193885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:54.195270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:54.210105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:54.211133 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:54.211974 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:54.220740 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 358/714] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:54.221143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:54.241021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:54.248500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb795-6a49-4073-be65-02b984012454 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:54.285078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:54.285693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.285976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.286281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.287100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:54.287410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:54.289036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:54.300928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:54.301338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 357/715] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:54.353136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61754b-64b0-47da-9449-289137862c17 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:54.392364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67383a-a349-4eaa-80b1-cf8a3c889907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:54.392996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67383a-a349-4eaa-80b1-cf8a3c889907 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.393370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67383a-a349-4eaa-80b1-cf8a3c889907 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.393643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67383a-a349-4eaa-80b1-cf8a3c889907 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.394323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67383a-a349-4eaa-80b1-cf8a3c889907 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:54.394627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67383a-a349-4eaa-80b1-cf8a3c889907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:54.396069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67383a-a349-4eaa-80b1-cf8a3c889907 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:54.401868 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 359/716] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:54.408447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:54.524835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca742812-9591-4eb8-8c84-b216f085c554 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:54.531407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680a044-6fdc-481d-9652-4c0898256ea9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.531700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680a044-6fdc-481d-9652-4c0898256ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.531954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680a044-6fdc-481d-9652-4c0898256ea9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.533529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 360/717] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:54.540595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592c7e4-9e65-4576-8167-bcdde9b421ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.540877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592c7e4-9e65-4576-8167-bcdde9b421ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.541160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592c7e4-9e65-4576-8167-bcdde9b421ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.562543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b592c7e4-9e65-4576-8167-bcdde9b421ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:54.563951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b592c7e4-9e65-4576-8167-bcdde9b421ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:54.564974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:54.565766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.566305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.566727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.567525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:54.567837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:54.569227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:54.574986 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 358/718] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:54.581653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:54.614400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:54.646278 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 361/719] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:04:54.696880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2407ac-8335-4636-bdc9-f87cf86ab158 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:54.732489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:54.733446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:54.733873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:54.734332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:54.735176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:54.736782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:54.801729 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 359/720] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:04:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:04:54.923200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592c7e4-9e65-4576-8167-bcdde9b421ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:54.979329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:55.033514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592c7e4-9e65-4576-8167-bcdde9b421ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:55.075944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:55.076586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:55.076866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:55.077141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:55.077731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:55.079123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:55.088292 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:55.089278 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 13:04:55.090197 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:55.094191 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 362/721] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:55.095813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:55.178046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:55.201587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ef97c-67d1-4bd5-9240-5b7fce826418 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:55.236901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:55.237544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:55.237829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:55.238163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:55.238885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:55.244587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:55.244587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:55.251995 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 360/722] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:55.253374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:55.359356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabf69f-b6aa-4e6b-ba88-7deda1b3855b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:55.370302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:55.395408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968644e2-57fd-4c04-96b6-78185ca4860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:55.396017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968644e2-57fd-4c04-96b6-78185ca4860a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:55.396298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968644e2-57fd-4c04-96b6-78185ca4860a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:55.396567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968644e2-57fd-4c04-96b6-78185ca4860a None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:55.397195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968644e2-57fd-4c04-96b6-78185ca4860a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:55.397496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968644e2-57fd-4c04-96b6-78185ca4860a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:55.398933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968644e2-57fd-4c04-96b6-78185ca4860a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:55.406041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 363/723] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Oct 18 13:04:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:55.415637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:55.519670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefea203-10b0-4508-9122-2270f9f0ebac None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:55.554479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c84d1-cc71-47fa-bc00-c4061a06f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:55.555089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c84d1-cc71-47fa-bc00-c4061a06f74a None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:55.555368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c84d1-cc71-47fa-bc00-c4061a06f74a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:55.555643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c84d1-cc71-47fa-bc00-c4061a06f74a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:55.556313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c84d1-cc71-47fa-bc00-c4061a06f74a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:55.557682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c84d1-cc71-47fa-bc00-c4061a06f74a None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:55.629408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:55.635891 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 361/724] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:04:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:56.023474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fec4-c4b4-4f21-ac74-0d66fbd9840b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:56.024026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fec4-c4b4-4f21-ac74-0d66fbd9840b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:56.024026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fec4-c4b4-4f21-ac74-0d66fbd9840b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:56.025622 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 364/725] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:56.032009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a79a55-add3-447d-9de1-a2b98afb9879 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:56.032548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a79a55-add3-447d-9de1-a2b98afb9879 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:56.033025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a79a55-add3-447d-9de1-a2b98afb9879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:56.052740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d2a79a55-add3-447d-9de1-a2b98afb9879 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:56.054317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2a79a55-add3-447d-9de1-a2b98afb9879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:56.134506 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 362/726] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:56.407478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fec4-c4b4-4f21-ac74-0d66fbd9840b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:56.530015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fec4-c4b4-4f21-ac74-0d66fbd9840b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:56.541914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283af0-f148-4648-b9f0-1be7c1e20c07 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:56.542283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283af0-f148-4648-b9f0-1be7c1e20c07 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:56.542513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283af0-f148-4648-b9f0-1be7c1e20c07 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:56.544256 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 363/727] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:56.549992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c81f1-c875-4a7b-ae8e-bb1a18cacd80 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:56.550342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c81f1-c875-4a7b-ae8e-bb1a18cacd80 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:56.550582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c81f1-c875-4a7b-ae8e-bb1a18cacd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:56.572560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a03c81f1-c875-4a7b-ae8e-bb1a18cacd80 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:56.574683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a03c81f1-c875-4a7b-ae8e-bb1a18cacd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:56.575243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:56.575936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:56.576221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:56.576491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] PATH_INFO: `/v3/services/image` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:56.577075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:56.579433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:56.590023 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:56.591042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:56.592358 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 365/728] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Oct 18 13:04:56 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:56.597801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:56.654915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:56.662665 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 364/729] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:56.720726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b753e7-f279-4621-8ea7-ab425b074cd6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:56.756746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:56.757707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:56.758224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:56.758697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:56.759545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] RBAC: Adding query filter params (name=image) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:56.760045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:56.762174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:56.767488 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 366/730] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:56.773281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c81f1-c875-4a7b-ae8e-bb1a18cacd80 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:56.834953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:56.880924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c81f1-c875-4a7b-ae8e-bb1a18cacd80 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:56.916430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6a659-36b5-4f83-b471-371b58761bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:56.917445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6a659-36b5-4f83-b471-371b58761bd1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:56.918478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6a659-36b5-4f83-b471-371b58761bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:56.918966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6a659-36b5-4f83-b471-371b58761bd1 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:56.919786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6a659-36b5-4f83-b471-371b58761bd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:56.920282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6a659-36b5-4f83-b471-371b58761bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:56.921880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6a659-36b5-4f83-b471-371b58761bd1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:56.926862 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 365/731] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:04:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:56.936024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:57.054165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd035284-97c4-4e61-80a5-e10f6da950d1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:57.063683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:57.095083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9adfb6-1984-4594-9c9a-394736b6550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:57.095716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9adfb6-1984-4594-9c9a-394736b6550f None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:57.095999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9adfb6-1984-4594-9c9a-394736b6550f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:57.096272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9adfb6-1984-4594-9c9a-394736b6550f None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:57.096943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9adfb6-1984-4594-9c9a-394736b6550f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:57.098401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9adfb6-1984-4594-9c9a-394736b6550f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:57.149950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 367/732] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:04:56 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:57.178228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba965-efdf-4b24-bc92-bc76672ddb58 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:57.178752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba965-efdf-4b24-bc92-bc76672ddb58 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:57.178833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba965-efdf-4b24-bc92-bc76672ddb58 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:57.180383 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 366/733] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:57.187786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9727-e456-4284-8ea9-f9e8e281a886 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:57.188107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9727-e456-4284-8ea9-f9e8e281a886 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:57.188545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9727-e456-4284-8ea9-f9e8e281a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:57.209545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-795d9727-e456-4284-8ea9-f9e8e281a886 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:57.210974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-795d9727-e456-4284-8ea9-f9e8e281a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:57.299993 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 368/734] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:57.574205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba965-efdf-4b24-bc92-bc76672ddb58 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:57.687743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba965-efdf-4b24-bc92-bc76672ddb58 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:57.706659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:57.727561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef1c14-1b85-4253-8906-0f0eb995d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:57.728292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef1c14-1b85-4253-8906-0f0eb995d41b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:57.728576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef1c14-1b85-4253-8906-0f0eb995d41b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:57.732602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef1c14-1b85-4253-8906-0f0eb995d41b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:57.732602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef1c14-1b85-4253-8906-0f0eb995d41b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:57.732602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef1c14-1b85-4253-8906-0f0eb995d41b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-40ef1c14-1b85-4253-8906-0f0eb995d41b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:57.743314 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:57.744362 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:57.745641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 367/735] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:04:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:57.751080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d9727-e456-4284-8ea9-f9e8e281a886 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:57.854540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:57.865994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d9727-e456-4284-8ea9-f9e8e281a886 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:57.884231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6410c-4fa9-4c1d-9c97-f55cb51b3716 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:57.885133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6410c-4fa9-4c1d-9c97-f55cb51b3716 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:57.885624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6410c-4fa9-4c1d-9c97-f55cb51b3716 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:57.888436 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 368/736] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:57.901984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15f0f-bb5b-4f11-a6ef-e3ecc9fd6f9b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:57.906978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15f0f-bb5b-4f11-a6ef-e3ecc9fd6f9b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:57.906978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd15f0f-bb5b-4f11-a6ef-e3ecc9fd6f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:57.926275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:57.926275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:57.926275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:57.926275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:57.926711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:57.926711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:57.926711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:57.930216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ebd15f0f-bb5b-4f11-a6ef-e3ecc9fd6f9b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:57.931640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ebd15f0f-bb5b-4f11-a6ef-e3ecc9fd6f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:57.931819 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 369/737] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:57.938694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:58.038409 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 369/738] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:04:58.063542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9ebf-09b4-4323-a8f7-42660f4b9751 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:58.103898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:58.104882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:58.105455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:58.105934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:58.106791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:58.107332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:58.108987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:58.114756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 370/739] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:04:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:04:58.121409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15f0f-bb5b-4f11-a6ef-e3ecc9fd6f9b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:58.241531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd15f0f-bb5b-4f11-a6ef-e3ecc9fd6f9b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:58.273849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:58.278807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:58.279424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:58.279704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:58.279981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:58.280692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] RBAC: Adding query filter params (interface=admin, service_id=f0731f98a92d422ea6709b7eb2d3ade9, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:58.281002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:58.282411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:58.288094 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 370/740] 10.222.0.27 () {56 vars in 1249 bytes} [Tue Oct 18 13:04:58 2022] GET /identity/v3/endpoints?service_id=f0731f98a92d422ea6709b7eb2d3ade9&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:58.293889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:58.317403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:58.392982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:58.401020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d097-7b01-42b7-b95e-14b0183207ad None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:58.453396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:58.454479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:58.454962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:58.456129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:58.456948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:58.458573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:58.467476 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 371/741] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:04:58 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:04:58.532707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4a2e8-64dc-43a3-aee8-5a4530d54686 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:58.575801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:58.576868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:58.577359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:58.577840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:58.578806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:58.580514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:58.583497 n-d-858383-13 devstack@keystone.service[82160]: WARNING keystone.server.flask.common [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 18 13:04:58.660939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.sql.core [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 13:04:58.660939 n-d-858383-13 devstack@keystone.service[82160]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:04:58.660939 n-d-858383-13 devstack@keystone.service[82160]: [parameters: {'id': '4ce1b0dd85694407ab08cce11fcb35ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 13:04:58.660939 n-d-858383-13 devstack@keystone.service[82160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ce1b0dd85694407ab08cce11fcb35ea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ce1b0dd85694407ab08cce11fcb35ea. Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:04:58.669964 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 13:04:58.670908 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Oct 18 13:04:58.671930 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:04:58.672798 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 13:04:58.673658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:04:58.675661 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [parameters: {'id': '4ce1b0dd85694407ab08cce11fcb35ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:58.677948 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:58.679907 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ce1b0dd85694407ab08cce11fcb35ea. Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:58.681993 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 371/742] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Oct 18 13:04:58 2022] POST /identity/v3/projects => generated 262 bytes in 279 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:04:58.684442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:58.775035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:58.796095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a1e2-bed5-466e-a04f-419ba00ac952 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:58.831660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c91c5e-799b-4bec-9e54-5fc07b973d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:58.832614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91c5e-799b-4bec-9e54-5fc07b973d70 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:58.833107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91c5e-799b-4bec-9e54-5fc07b973d70 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:58.833573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91c5e-799b-4bec-9e54-5fc07b973d70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:58.841543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91c5e-799b-4bec-9e54-5fc07b973d70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:58.843287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91c5e-799b-4bec-9e54-5fc07b973d70 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-12c91c5e-799b-4bec-9e54-5fc07b973d70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:04:58.855932 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:58.856837 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:04:58.857708 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:04:58.860144 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 372/743] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:58.866180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:58.899279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:58.971780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823e6a-3349-4ed3-9cfe-c0992ee2c069 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:59.009174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11380797-857f-4105-8de9-ecbd4f3c0eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:59.009794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380797-857f-4105-8de9-ecbd4f3c0eb2 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:59.010088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380797-857f-4105-8de9-ecbd4f3c0eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:59.010377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11380797-857f-4105-8de9-ecbd4f3c0eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:59.011051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11380797-857f-4105-8de9-ecbd4f3c0eb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:04:59.011353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11380797-857f-4105-8de9-ecbd4f3c0eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:59.013034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11380797-857f-4105-8de9-ecbd4f3c0eb2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:59.036103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 372/744] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:04:59.206216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15a58-68bb-4528-9996-1b528222fa0b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:59.206735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15a58-68bb-4528-9996-1b528222fa0b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:59.206735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15a58-68bb-4528-9996-1b528222fa0b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:59.211241 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 373/745] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:59.214140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae2fe-0ec1-43a3-94d5-e53bb836d350 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:59.214429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae2fe-0ec1-43a3-94d5-e53bb836d350 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:59.215277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae2fe-0ec1-43a3-94d5-e53bb836d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:59.235484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9d8ae2fe-0ec1-43a3-94d5-e53bb836d350 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:59.237004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d8ae2fe-0ec1-43a3-94d5-e53bb836d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:59.317116 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 373/746] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:59.386074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585feaca-3d59-4b2e-8995-4c814e05b747 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:59.386917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585feaca-3d59-4b2e-8995-4c814e05b747 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:59.387181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585feaca-3d59-4b2e-8995-4c814e05b747 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:59.388767 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 374/747] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:04:59.394039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe768e5a-a152-4f7d-9a3b-874ca5ab423e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:59.394369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe768e5a-a152-4f7d-9a3b-874ca5ab423e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:59.394649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe768e5a-a152-4f7d-9a3b-874ca5ab423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:59.414710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fe768e5a-a152-4f7d-9a3b-874ca5ab423e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:04:59.416197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe768e5a-a152-4f7d-9a3b-874ca5ab423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:04:59.436338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:59.495032 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 374/748] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:04:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:04:59.607386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585feaca-3d59-4b2e-8995-4c814e05b747 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:59.715991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585feaca-3d59-4b2e-8995-4c814e05b747 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:59.750970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:59.751496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:59.751771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:59.752036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:59.752683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:59.754028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:59.765713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe768e5a-a152-4f7d-9a3b-874ca5ab423e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:04:59.840994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:04:59.852236 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 375/749] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:04:59 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:04:59.882011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe768e5a-a152-4f7d-9a3b-874ca5ab423e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:04:59.940188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:04:59.941402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:04:59.941932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:04:59.942476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] PATH_INFO: `/v3/services/compute` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:04:59.943332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:04:59.945093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:04:59.955789 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:04:59.956868 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:04:59.957846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:04:59.960494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 375/750] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:04:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:04:59.966707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:00.076044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9abca-bbbe-4274-a1dc-9dc0674acd7b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:00.110247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:00.110919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:00.111197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:00.111469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:00.112096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:00.112395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:00.113754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:00.124289 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 376/751] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:04:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:00.125617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:00.141396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:00.231469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8866eb-9d42-4b2b-be0f-0e5236dc142b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:00.267585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:00.268464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:00.268899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:00.269314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:00.270124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:00.270570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:00.272083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:00.278555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 376/752] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:05:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:00.287459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:00.353413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:00.391625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdd1fd-5dfc-4f98-9228-45e4a0529407 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:00.428898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a47b42-d6ec-417d-b18d-79662233293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:00.429752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a47b42-d6ec-417d-b18d-79662233293c None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:00.430203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a47b42-d6ec-417d-b18d-79662233293c None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:00.430636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a47b42-d6ec-417d-b18d-79662233293c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:00.431474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a47b42-d6ec-417d-b18d-79662233293c None admin] RBAC: Adding query filter params (interface=public, service_id=f55ea8f6d8e740739857ca00fe2b42a2, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:00.431921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a47b42-d6ec-417d-b18d-79662233293c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:00.433508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a47b42-d6ec-417d-b18d-79662233293c None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:00.439309 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 377/753] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:05:00 2022] GET /identity/v3/endpoints?service_id=f55ea8f6d8e740739857ca00fe2b42a2&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:00.447145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:00.536619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:00.560015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8bff1-5431-4e36-9b67-482299c2ae42 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:00.595904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54850e0a-f982-445e-b34f-005b0b1e3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:00.596516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54850e0a-f982-445e-b34f-005b0b1e3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:00.596838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54850e0a-f982-445e-b34f-005b0b1e3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:00.597112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54850e0a-f982-445e-b34f-005b0b1e3bf5 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:00.597708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54850e0a-f982-445e-b34f-005b0b1e3bf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:00.599098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54850e0a-f982-445e-b34f-005b0b1e3bf5 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:00.614205 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 377/754] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:05:00 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:05:00.785143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcdb20-c1fa-4780-a325-a1859710f2f2 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:00.785508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcdb20-c1fa-4780-a325-a1859710f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:00.785704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcdb20-c1fa-4780-a325-a1859710f2f2 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:00.787363 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 378/755] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:00.792722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dbe0b-79ec-4b76-94f9-db9093ac241c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:00.793009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dbe0b-79ec-4b76-94f9-db9093ac241c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:00.793290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dbe0b-79ec-4b76-94f9-db9093ac241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:00.813439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5d4dbe0b-79ec-4b76-94f9-db9093ac241c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:00.814637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d4dbe0b-79ec-4b76-94f9-db9093ac241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:00.887939 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 378/756] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:01.159778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcdb20-c1fa-4780-a325-a1859710f2f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:01.276268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcdb20-c1fa-4780-a325-a1859710f2f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:01.304554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:01.314464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fce0c-3f2e-4ebd-aa25-1c4ff27d19de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:01.315368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fce0c-3f2e-4ebd-aa25-1c4ff27d19de None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:01.315842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fce0c-3f2e-4ebd-aa25-1c4ff27d19de None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:01.316416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fce0c-3f2e-4ebd-aa25-1c4ff27d19de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:01.317190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fce0c-3f2e-4ebd-aa25-1c4ff27d19de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:01.318871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fce0c-3f2e-4ebd-aa25-1c4ff27d19de None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-990fce0c-3f2e-4ebd-aa25-1c4ff27d19de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:01.328813 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:01.330098 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 13:05:01.331010 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:01.333735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 379/757] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Oct 18 13:05:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:01.339615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dbe0b-79ec-4b76-94f9-db9093ac241c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:01.357607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c92a12-c0f1-417b-b57d-fc9b568c08d0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:01.357939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c92a12-c0f1-417b-b57d-fc9b568c08d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:01.358201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c92a12-c0f1-417b-b57d-fc9b568c08d0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:01.359828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 380/758] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:05:01.365280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af2c3e-3e4a-4938-820b-c6c957276fee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:01.365563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af2c3e-3e4a-4938-820b-c6c957276fee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:01.365837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af2c3e-3e4a-4938-820b-c6c957276fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:01.385087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89af2c3e-3e4a-4938-820b-c6c957276fee None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:01.386340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89af2c3e-3e4a-4938-820b-c6c957276fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:01.422331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:01.459265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dbe0b-79ec-4b76-94f9-db9093ac241c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:01.498303 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 381/759] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:01 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:05:01.503246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:01.504055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:01.504482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:01.504902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:01.505751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:01.506228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:01.507776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:01.513555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 379/760] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:05:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:01.519675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af2c3e-3e4a-4938-820b-c6c957276fee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:01.628697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af2c3e-3e4a-4938-820b-c6c957276fee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:01.651463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:01.663145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:01.663807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:01.664092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:01.668161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:01.668161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:01.668161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:01.668161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:01.672394 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 382/761] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Oct 18 13:05:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:01.678182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:01.784183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5562b7b-7aa1-43c8-ae3d-78984bef7f06 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:01.823953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:01.826253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:01.826867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:01.827143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:01.827414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:01.828280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:01.830526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:01.835812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:01.936062 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 380/762] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:05:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:05:01.938938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c04d1-114f-4ae3-8314-d7064f90ba96 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:01.995495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:01.996227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:01.996514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:01.996787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:01.997508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:01.999078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:02.001749 n-d-858383-13 devstack@keystone.service[82161]: WARNING keystone.server.flask.common [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 18 13:05:02.051515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 13:05:02.051515 n-d-858383-13 devstack@keystone.service[82161]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 18 13:05:02.051515 n-d-858383-13 devstack@keystone.service[82161]: [parameters: {'user_id': '7d00dd872e0147dbbe35fca52db78277', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 18 13:05:02.051515 n-d-858383-13 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-a537d48d-bd14-42e5-8a97-0d535e3edc2d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:05:02.059423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:05:02.060373 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:05:02.061402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:05:02.063146 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:05:02.065294 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:05:02.067341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'user_id': '7d00dd872e0147dbbe35fca52db78277', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:02.069324 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 18 13:05:02.071330 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 18 13:05:02.081257 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 18 13:05:02.081257 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 18 13:05:02.081257 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 13:05:02.081257 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 13:05:02.081257 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 18 13:05:02.081257 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.081257 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 383/763] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Oct 18 13:05:01 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:02.082203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:02.190608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcbb7c-50ad-4a7e-9784-0de15d497168 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.190911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcbb7c-50ad-4a7e-9784-0de15d497168 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.191080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcbb7c-50ad-4a7e-9784-0de15d497168 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.195668 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 384/764] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:02.196155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd00b5-8faa-41f6-a8fe-2509a8011035 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:02.201641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0afe5-edd6-4fd7-9001-3ad5a5094f84 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.201925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0afe5-edd6-4fd7-9001-3ad5a5094f84 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.202292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0afe5-edd6-4fd7-9001-3ad5a5094f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.227120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e4d0afe5-edd6-4fd7-9001-3ad5a5094f84 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:02.229276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4d0afe5-edd6-4fd7-9001-3ad5a5094f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:02.235909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:02.236787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.237322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.237778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.246148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:02.247950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:05:02.264154 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:02.265122 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:02.266079 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 381/765] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:05:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:02.272571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:02.281700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:02.320170 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 385/766] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:02 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:05:02.340952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:02.389808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f48729-c943-4398-9b6a-1a307f9f6497 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:02.425612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:02.426673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.427208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.427684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.428586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:02.429106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:02.430766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:02.473677 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 382/767] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Oct 18 13:05:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:02.590244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0afe5-edd6-4fd7-9001-3ad5a5094f84 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:02.699592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0afe5-edd6-4fd7-9001-3ad5a5094f84 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:02.739573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3651f-5430-437e-a333-84eb67797c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:02.740137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3651f-5430-437e-a333-84eb67797c5d None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.740416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3651f-5430-437e-a333-84eb67797c5d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.740689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3651f-5430-437e-a333-84eb67797c5d None admin] PATH_INFO: `/v3/services/image` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.741290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3651f-5430-437e-a333-84eb67797c5d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:02.742972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3651f-5430-437e-a333-84eb67797c5d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-89a3651f-5430-437e-a333-84eb67797c5d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:02.752953 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:02.753947 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:02.754799 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 386/768] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Oct 18 13:05:02 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:02.760300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:02.816275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc8049-ce7a-4fd6-9580-93cfe4f651dc None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.816564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc8049-ce7a-4fd6-9580-93cfe4f651dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.816837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc8049-ce7a-4fd6-9580-93cfe4f651dc None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.818513 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 387/769] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:02.823362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3342-7cbe-405c-bb98-6c2f5d27e006 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.824484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3342-7cbe-405c-bb98-6c2f5d27e006 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.824955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3342-7cbe-405c-bb98-6c2f5d27e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.846373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-87fd3342-7cbe-405c-bb98-6c2f5d27e006 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:02.848342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-87fd3342-7cbe-405c-bb98-6c2f5d27e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:02.867825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273ba7d-d71e-451e-9753-ff218e0ed51c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:02.881334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:02.885984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:02.907678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:02.908306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:02.908586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:02.908857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:02.909506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] RBAC: Adding query filter params (name=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:02.909811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:02.911254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:02.916809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 383/770] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:02.923038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:02.932674 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 388/771] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:02 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:05:03.022187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcd9a3-7202-499b-8263-86b59a410d38 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:03.055325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:03.055922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:03.056259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:03.056538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:03.057155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] RBAC: Adding query filter params (type=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:03.057456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:03.059438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:03.066197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 384/772] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:03.070295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd3342-7cbe-405c-bb98-6c2f5d27e006 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:03.168364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd3342-7cbe-405c-bb98-6c2f5d27e006 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:03.199180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:03.201809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:03.202431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:03.202708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:03.202977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:03.203672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] RBAC: Adding query filter params (interface=public, service_id=e5a3039d0d614d2a88e95d73054c9d27, region_id=RegionOne) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:03.203975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:03.205315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:03.215410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 389/773] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:05:03 2022] GET /identity/v3/endpoints?service_id=e5a3039d0d614d2a88e95d73054c9d27&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:03.216474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:03.246754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:03.252575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:03.310169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7dfca-c9c6-433b-af64-4a3f02699a5b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:03.326203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd8ace-3650-4e21-8ab8-762aa2780c7e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:03.347340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:03.347970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:03.348251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:03.348524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:03.349096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:03.350759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:03.359937 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:03.360919 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:03.361734 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 385/774] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:05:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:03.366736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:03.368825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:03.369439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:03.369723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:03.369994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:03.370711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:03.372064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:03.379107 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 390/775] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:05:03 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:05:03.493355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777aee-7815-4308-bae2-20676adc4fa9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:03.495962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:03.530511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:03.531133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:03.531414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:03.531688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:03.532332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:03.532634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:03.534025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:03.543924 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 386/776] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:05:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:03.546293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:03.643155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:03.649044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d77c0-b020-47ad-9880-e83270d39bbc None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:03.683881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7be27e-81f0-4c84-8b5d-e34e46b383ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:03.684490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be27e-81f0-4c84-8b5d-e34e46b383ab None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:03.684768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be27e-81f0-4c84-8b5d-e34e46b383ab None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:03.685037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be27e-81f0-4c84-8b5d-e34e46b383ab None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:03.685663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7be27e-81f0-4c84-8b5d-e34e46b383ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:03.685985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7be27e-81f0-4c84-8b5d-e34e46b383ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:03.687364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7be27e-81f0-4c84-8b5d-e34e46b383ab None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:03.692456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 391/777] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Oct 18 13:05:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:03.697867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:03.798257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49493077-5b39-46de-8f83-09b89fae21d8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:03.831947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7ae41-a58a-48de-b70e-cbbeb664f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:03.832555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ae41-a58a-48de-b70e-cbbeb664f3c2 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:03.832834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ae41-a58a-48de-b70e-cbbeb664f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:03.833108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7ae41-a58a-48de-b70e-cbbeb664f3c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:03.833783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7ae41-a58a-48de-b70e-cbbeb664f3c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:03.835190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7ae41-a58a-48de-b70e-cbbeb664f3c2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:03.937234 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 387/778] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:05:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:04.188164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c09fb-00e9-4532-854e-6c2a5d3218d6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:04.188374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c09fb-00e9-4532-854e-6c2a5d3218d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:04.188659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c09fb-00e9-4532-854e-6c2a5d3218d6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:04.190014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 392/779] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:04.195511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a1f7-42f9-4801-924b-22ed9cdf7d3d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:04.195796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a1f7-42f9-4801-924b-22ed9cdf7d3d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:04.196068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316a1f7-42f9-4801-924b-22ed9cdf7d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:04.215941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6316a1f7-42f9-4801-924b-22ed9cdf7d3d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:04.217139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6316a1f7-42f9-4801-924b-22ed9cdf7d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:04.235841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:04.293807 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 388/780] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:04.558741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c09fb-00e9-4532-854e-6c2a5d3218d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:04.664368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c09fb-00e9-4532-854e-6c2a5d3218d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:04.698408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835917b-45fe-47a0-8c36-c48dff0906b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:04.699601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835917b-45fe-47a0-8c36-c48dff0906b1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:04.699884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835917b-45fe-47a0-8c36-c48dff0906b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:04.700159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835917b-45fe-47a0-8c36-c48dff0906b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:04.701280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835917b-45fe-47a0-8c36-c48dff0906b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:04.702730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835917b-45fe-47a0-8c36-c48dff0906b1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:04.704511 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 393/781] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:04.710021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316a1f7-42f9-4801-924b-22ed9cdf7d3d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:04.810751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316a1f7-42f9-4801-924b-22ed9cdf7d3d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:04.844363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093219d-3c1d-4702-8f70-a629b014d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:04.844974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093219d-3c1d-4702-8f70-a629b014d268 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:04.845256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093219d-3c1d-4702-8f70-a629b014d268 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:04.845531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093219d-3c1d-4702-8f70-a629b014d268 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:04.846219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093219d-3c1d-4702-8f70-a629b014d268 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:04.847647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093219d-3c1d-4702-8f70-a629b014d268 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:04.942083 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 389/782] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:05:04 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:05:05.559598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0177d6-f732-40eb-bfc2-9c23f28aecb9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:05.560110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0177d6-f732-40eb-bfc2-9c23f28aecb9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:05.560186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0177d6-f732-40eb-bfc2-9c23f28aecb9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:05.561623 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 394/783] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:05.566777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80b633-db82-4fc5-87f0-7868827ae42e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:05.567065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80b633-db82-4fc5-87f0-7868827ae42e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:05.567338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80b633-db82-4fc5-87f0-7868827ae42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:05.573480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:05.585636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3f80b633-db82-4fc5-87f0-7868827ae42e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:05.586826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f80b633-db82-4fc5-87f0-7868827ae42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:05.653857 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 390/784] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:05.923496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0177d6-f732-40eb-bfc2-9c23f28aecb9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:05.951631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:06.028316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0177d6-f732-40eb-bfc2-9c23f28aecb9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:06.064048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a22fc8-16f0-4402-b83f-8074818fd452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:06.064703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a22fc8-16f0-4402-b83f-8074818fd452 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.064980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a22fc8-16f0-4402-b83f-8074818fd452 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.065247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a22fc8-16f0-4402-b83f-8074818fd452 None admin] PATH_INFO: `/v3/services/image` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.065842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a22fc8-16f0-4402-b83f-8074818fd452 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:06.067265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a22fc8-16f0-4402-b83f-8074818fd452 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e8a22fc8-16f0-4402-b83f-8074818fd452 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:06.076922 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:06.077987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 13:05:06.079295 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:06.082155 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 395/785] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Oct 18 13:05:05 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:06.084606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80b633-db82-4fc5-87f0-7868827ae42e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:06.166755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c956-3812-424c-babb-3be075c009eb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.167040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c956-3812-424c-babb-3be075c009eb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.167323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c956-3812-424c-babb-3be075c009eb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.169389 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 396/786] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:06.174388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3241-ff65-45b9-9975-86c7c5aac12e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.174601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3241-ff65-45b9-9975-86c7c5aac12e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.174875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3241-ff65-45b9-9975-86c7c5aac12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.187585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80b633-db82-4fc5-87f0-7868827ae42e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:06.194534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-837e3241-ff65-45b9-9975-86c7c5aac12e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:06.195708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-837e3241-ff65-45b9-9975-86c7c5aac12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:06.217951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:06.222758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:06.223372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.223650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.223920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.224546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] RBAC: Adding query filter params (name=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:06.225174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:06.226506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:06.231809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 391/787] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:06.237422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:06.267313 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 397/788] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:05:06.340177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae846c-a7e4-4d05-b06f-f45d8d38afee None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:06.373679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:06.374609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.375094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.375567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.376401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] RBAC: Adding query filter params (type=image) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:06.376957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:06.378598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:06.383893 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 392/789] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:06.389555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e3241-ff65-45b9-9975-86c7c5aac12e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:06.414374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:06.497697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e3241-ff65-45b9-9975-86c7c5aac12e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:06.530511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:06.531706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:06.532327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.532604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.532874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.533551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:06.535038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:06.588888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:06.606085 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 398/790] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:05:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:06.636754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd57bba-7c5b-40fd-bd96-26a3c3753f66 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:06.680847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:06.681491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.681822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.682178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.693802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:06.700816 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:06.701821 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:06.707232 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 393/791] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Oct 18 13:05:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:05:06.708573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:06.797184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:06.819655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b09c0c-80f5-4168-8175-971493d6cdce None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:06.855322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:06.856465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:06.857104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:06.857628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:06.858883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:06.859204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:06.860559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:06.868963 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 399/792] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Oct 18 13:05:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:06.874583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:06.975876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef50c5-ed0e-40c5-9ab6-fa066ec7a245 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:06.992158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:07.010512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa20a2-6980-49cf-a798-2200a26fbb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.011905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa20a2-6980-49cf-a798-2200a26fbb1d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.012280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa20a2-6980-49cf-a798-2200a26fbb1d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.012645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa20a2-6980-49cf-a798-2200a26fbb1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.023307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa20a2-6980-49cf-a798-2200a26fbb1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.024916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa20a2-6980-49cf-a798-2200a26fbb1d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c0fa20a2-6980-49cf-a798-2200a26fbb1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:05:07.042236 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:07.043422 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:05:07.044516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:05:07.044516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:07.044516 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:07.045833 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 394/793] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:05:07.051772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:07.146916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835e6e-b769-4373-b9af-71d5109b19a0 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.147436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835e6e-b769-4373-b9af-71d5109b19a0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.147436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835e6e-b769-4373-b9af-71d5109b19a0 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.148788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 395/794] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:07.153729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39768-4129-4c7b-9910-e1b6f00a3e94 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.154014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39768-4129-4c7b-9910-e1b6f00a3e94 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.154323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39768-4129-4c7b-9910-e1b6f00a3e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.157847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11094086-7a53-418a-9b7f-44b8deabf932 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:07.172145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b1b39768-4129-4c7b-9910-e1b6f00a3e94 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:07.173326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1b39768-4129-4c7b-9910-e1b6f00a3e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:07.193848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.194494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.194774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.195060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.195712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:07.196020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.197385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.208394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:07.212443 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 400/795] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:07.217388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:07.253116 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 396/796] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:07.325010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06d2ec-b8df-4e98-9d91-4b82f2a57c0f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:07.359183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.359897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.360240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.360576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.367678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.369155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:05:07.381192 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:07.382346 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:05:07.383648 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:07.389672 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 401/797] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Oct 18 13:05:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:05:07.390422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b39768-4129-4c7b-9910-e1b6f00a3e94 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:07.492650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:07.499351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b39768-4129-4c7b-9910-e1b6f00a3e94 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:07.515795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:07.537721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.538369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.538914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.538914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.539640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:07.539943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.541380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.560879 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 397/798] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Oct 18 13:05:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:07.566505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:07.582318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:07.627734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc4405-ea77-40a9-b045-f93788d0a236 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:07.662610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.663239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.663512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.663784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.664870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.666324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.668396 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 402/799] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:07.673926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:07.675532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4dd0-b236-497d-a2a4-c8f48b99405e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:07.710004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.710653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.710930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.711195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.721487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.723142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:05:07.738223 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:07.739167 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:05:07.740389 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:05:07.740389 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:07.740389 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:07.740389 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 398/800] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:05:07.744952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:07.757278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:07.785129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee144da-c6b1-4a08-8278-f87be5f3f923 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:07.812385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:07.822478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.823378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.823905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.824373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.825219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.826693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.858100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b868fc-0e0d-4b76-94fe-887ccfea65fb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:07.891327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:07.891944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:07.892224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:07.892496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:07.893131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:07.893432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:07.894834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:07.907855 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 399/801] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:07.918109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 403/802] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:05:07 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:05:07.919718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:08.001544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:08.038747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e215fd3-be4a-4a1f-acc6-ecbd0ee75f44 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:08.075515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:08.076165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:08.076449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:08.076729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:08.083769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:08.085212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:05:08.097368 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:08.098331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:08.099239 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 400/803] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:08.104646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:08.209072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04531af7-47cf-49be-bbf6-929343489c01 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:08.244316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb84e56-194a-4058-81b1-180e9832ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:08.244923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb84e56-194a-4058-81b1-180e9832ee55 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:08.245203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb84e56-194a-4058-81b1-180e9832ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:08.245475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb84e56-194a-4058-81b1-180e9832ee55 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:08.246228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb84e56-194a-4058-81b1-180e9832ee55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:08.246535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb84e56-194a-4058-81b1-180e9832ee55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:08.247948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb84e56-194a-4058-81b1-180e9832ee55 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:08.260363 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 404/804] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:08.266748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:08.367354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1580c22-4bbf-4390-bab0-6c51c5af6764 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:08.393255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:08.401296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ef66-c182-459f-9e3d-868427bd882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:08.402566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ef66-c182-459f-9e3d-868427bd882d None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:08.402848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ef66-c182-459f-9e3d-868427bd882d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:08.406759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ef66-c182-459f-9e3d-868427bd882d None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/793ee1b363f8415f817fe5a8c3c200fd/roles/79d46a51115c40e9b8f018a7efe6d9f6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:08.406759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ef66-c182-459f-9e3d-868427bd882d None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=793ee1b363f8415f817fe5a8c3c200fd, role_id=79d46a51115c40e9b8f018a7efe6d9f6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:08.406759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ef66-c182-459f-9e3d-868427bd882d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:08.457868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 401/805] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:05:08 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/793ee1b363f8415f817fe5a8c3c200fd/roles/79d46a51115c40e9b8f018a7efe6d9f6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:05:08.785379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f780-9702-434e-8053-ad4387aac615 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:08.785862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f780-9702-434e-8053-ad4387aac615 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:08.785862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f780-9702-434e-8053-ad4387aac615 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:08.787359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 405/806] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:08.792504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79a50-bb08-4d2d-9af6-35f32e9b9c9c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:08.792790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79a50-bb08-4d2d-9af6-35f32e9b9c9c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:08.793065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda79a50-bb08-4d2d-9af6-35f32e9b9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:08.811291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dda79a50-bb08-4d2d-9af6-35f32e9b9c9c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:08.812455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dda79a50-bb08-4d2d-9af6-35f32e9b9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:08.880740 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 402/807] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:09.143958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f780-9702-434e-8053-ad4387aac615 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:09.192548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:09.249798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f780-9702-434e-8053-ad4387aac615 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:09.285957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:09.286839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:09.287264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:09.287680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:09.288549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:09.290154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:09.335004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 13:05:09.335004 n-d-858383-13 devstack@keystone.service[82161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:05:09.335004 n-d-858383-13 devstack@keystone.service[82161]: [parameters: {'id': '531c0a8f2d5447dea77c11a97261ed18', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 13:05:09.335004 n-d-858383-13 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:05:09.342686 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 13:05:09.343581 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:05:09.344513 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:05:09.345418 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:05:09.347456 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:05:09.349401 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': '531c0a8f2d5447dea77c11a97261ed18', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 13:05:09.351790 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:09.355549 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:09.357797 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 406/808] 10.222.0.27 () {60 vars in 1137 bytes} [Tue Oct 18 13:05:09 2022] POST /identity/v3/domains => generated 190 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:09.359929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79a50-bb08-4d2d-9af6-35f32e9b9c9c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:09.447690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda79a50-bb08-4d2d-9af6-35f32e9b9c9c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:09.470967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:09.487979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8add0-9715-4d68-8155-a091b0a0e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:09.488765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8add0-9715-4d68-8155-a091b0a0e819 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:09.489046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8add0-9715-4d68-8155-a091b0a0e819 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:09.489320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8add0-9715-4d68-8155-a091b0a0e819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:09.498964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8add0-9715-4d68-8155-a091b0a0e819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:09.500429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8add0-9715-4d68-8155-a091b0a0e819 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-9cd8add0-9715-4d68-8155-a091b0a0e819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:05:09.516366 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:09.517319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:05:09.523110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:05:09.523110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:09.523110 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:09.523110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 403/809] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:09.525147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:09.627650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea9251-956d-45ac-93ce-f362c3d21304 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:09.637417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:09.662447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac19b2e-c39f-48dd-a239-d1242db82d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:09.663066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac19b2e-c39f-48dd-a239-d1242db82d6e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:09.663340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac19b2e-c39f-48dd-a239-d1242db82d6e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:09.663606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac19b2e-c39f-48dd-a239-d1242db82d6e None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:09.664367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac19b2e-c39f-48dd-a239-d1242db82d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:09.664667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac19b2e-c39f-48dd-a239-d1242db82d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:09.666012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac19b2e-c39f-48dd-a239-d1242db82d6e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:09.682148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 407/810] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:10.124462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d67d0-e224-4c2c-b352-0ffe4cfcc232 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:10.124753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d67d0-e224-4c2c-b352-0ffe4cfcc232 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:10.125029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d67d0-e224-4c2c-b352-0ffe4cfcc232 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:10.126536 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 404/811] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:10.131942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbcbaa-a8b2-40ab-a64f-0a6534a3cff0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:10.132379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbcbaa-a8b2-40ab-a64f-0a6534a3cff0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:10.132486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbcbaa-a8b2-40ab-a64f-0a6534a3cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:10.150987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6fcbcbaa-a8b2-40ab-a64f-0a6534a3cff0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:10.152181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fcbcbaa-a8b2-40ab-a64f-0a6534a3cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:10.217298 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 408/812] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:10.484228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d67d0-e224-4c2c-b352-0ffe4cfcc232 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:10.583819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d67d0-e224-4c2c-b352-0ffe4cfcc232 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:10.588925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb887ae-094b-4b75-8eb7-65b06180ef7b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:10.589214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb887ae-094b-4b75-8eb7-65b06180ef7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:10.589488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb887ae-094b-4b75-8eb7-65b06180ef7b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:10.590866 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 409/813] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:05:10.595549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170876cd-6f38-4739-bd5d-5d31f8c53a8d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:10.595831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170876cd-6f38-4739-bd5d-5d31f8c53a8d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:10.596129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170876cd-6f38-4739-bd5d-5d31f8c53a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:10.614473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-170876cd-6f38-4739-bd5d-5d31f8c53a8d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:10.615636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-170876cd-6f38-4739-bd5d-5d31f8c53a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:10.617690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:10.618349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:10.618631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:10.618902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:10.629571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:10.634298 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:10.635193 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:10.636017 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 405/814] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:10.641199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:10.671193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:10.683666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 410/815] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:05:10.737847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f9544-aa9d-4063-8b29-c0eef0f08798 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:10.769628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:10.770253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:10.770533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:10.770803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:10.771455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:10.771754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:10.773106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:10.781750 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 406/816] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:10.787600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170876cd-6f38-4739-bd5d-5d31f8c53a8d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:10.814703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:10.885382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170876cd-6f38-4739-bd5d-5d31f8c53a8d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:10.919801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:10.920416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:10.920694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:10.920963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] PATH_INFO: `/v3/users/d0665e3c3d144d4485ff8be20a6d19a9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:10.934088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] RBAC: Authorizing `identity:get_user(user_id=d0665e3c3d144d4485ff8be20a6d19a9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:10.935507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:10.937213 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 411/817] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:10 2022] GET /identity/v3/users/d0665e3c3d144d4485ff8be20a6d19a9 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:10.942768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:10.947554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:11.031078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:11.032042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:11.040312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbedca8-9fcc-42a8-9905-cf52489637d9 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.045924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c3f2-c6f7-4e73-835d-8d6be8b09166 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.074004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.080061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.080061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.080061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] PATH_INFO: `/v3/projects/06c70221e3af4374b76556d8465a1303` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.080061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] RBAC: Authorizing `identity:get_project(project_id=06c70221e3af4374b76556d8465a1303)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:11.080061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:11.080061 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 407/818] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:10 2022] GET /identity/v3/projects/06c70221e3af4374b76556d8465a1303 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:11.080533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.080533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.080533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.080785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.085096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:11.092249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:11.096954 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:11.097978 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:11.098876 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 412/819] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Oct 18 13:05:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:05:11.104065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:11.184523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0909f78-44a5-4692-b36c-2b02fc5d1dec None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.202004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db35f-57f6-4318-850d-1d66fbc3a8e0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.217723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.218400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.218679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.218961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] PATH_INFO: `/v3/projects/06c70221e3af4374b76556d8465a1303/users/d0665e3c3d144d4485ff8be20a6d19a9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.220840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] RBAC: Authorizing `identity:create_grant(project_id=06c70221e3af4374b76556d8465a1303, user_id=d0665e3c3d144d4485ff8be20a6d19a9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:11.222283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:11.235165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.235762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.238462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.238462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.238462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:11.238462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:11.238958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:11.247020 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 413/820] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Oct 18 13:05:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:05:11.252665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:11.263982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:11.273986 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 408/821] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:05:11 2022] PUT /identity/v3/projects/06c70221e3af4374b76556d8465a1303/users/d0665e3c3d144d4485ff8be20a6d19a9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:05:11.358341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671e180-1653-4282-967d-d0c8f9192365 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.393069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.393715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.393994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.394294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.406528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:11.407986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:05:11.423365 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:11.429477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:05:11.430665 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:05:11.430665 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:11.430665 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:11.430665 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 414/822] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:05:11.431407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:11.458085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:11.538720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c64b-cbf1-413c-bb7b-4bb9a6c59044 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.572244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.572845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.573122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.573391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.574666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:11.574967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:11.576345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:11.587313 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 409/823] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:11.593000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:11.651409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:11.691452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96c8f2-8ac9-4c75-abbd-64e5fd88e713 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.724089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.724711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.725245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.725514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.732823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:11.734269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:05:11.745079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:11.746999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:11.747966 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 415/824] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Oct 18 13:05:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:11.752538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:11.831072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:11.849098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad798072-78a4-4162-bd16-2bd3b2aeb556 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:11.882179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:11.882780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:11.883061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:11.883336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:11.884054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:11.884361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:11.885776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:11.903366 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 410/825] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Oct 18 13:05:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:11.908849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:12.007136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed87c2-e672-4640-a4cd-0574d97d58c8 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:12.030530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:12.045165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:12.045776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:12.046586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:12.046586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:12.112630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:12.114104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:12.212343 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 416/826] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:05:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:05:12.217425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:12.315127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6c8a-8ce6-4ce2-adbc-0bf98ff6798e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:12.347704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:12.348332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:12.348615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:12.348891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:12.356120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:12.359805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:12.361245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:05:12.375230 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:12.376348 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:05:12.377445 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:05:12.377445 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:05:12.377445 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:12.378215 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 411/827] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:12.381912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:12.403350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:12.492732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f6b98-3093-4e50-b78f-bf4196841e4b None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:12.528156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:12.529011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:12.529435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:12.529851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:12.530686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:12.531131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:12.532639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:12.545366 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 417/828] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:12.550966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:12.650391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bb8f3-3574-4c38-94c4-ccf8b8e95c1c None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:12.684783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:12.685416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:12.685701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:12.685977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:12.692629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:12.694089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:05:12.706275 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:12.707155 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:12.708037 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 412/829] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:12.713294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:12.797168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:12.815164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883925bd-f1cd-478b-881d-dca5c2e8d016 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:12.848463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca61a8d-19ec-4dbe-87fb-e95e4bbe7687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:12.849071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca61a8d-19ec-4dbe-87fb-e95e4bbe7687 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:12.849355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca61a8d-19ec-4dbe-87fb-e95e4bbe7687 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:12.849632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca61a8d-19ec-4dbe-87fb-e95e4bbe7687 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:12.850618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca61a8d-19ec-4dbe-87fb-e95e4bbe7687 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:12.850925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca61a8d-19ec-4dbe-87fb-e95e4bbe7687 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:12.852341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca61a8d-19ec-4dbe-87fb-e95e4bbe7687 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:12.864069 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 418/830] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:12.870139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:12.919103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:12.968743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2eeb-c7fd-4597-96c5-1da80780f571 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:13.001433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaba0c-6711-4470-bebe-f5b89e382d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:13.002032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaba0c-6711-4470-bebe-f5b89e382d90 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:13.002338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaba0c-6711-4470-bebe-f5b89e382d90 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:13.002610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaba0c-6711-4470-bebe-f5b89e382d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:13.003324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaba0c-6711-4470-bebe-f5b89e382d90 None admin] RBAC: Adding query filter params (role.id=79d46a51115c40e9b8f018a7efe6d9f6, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=793ee1b363f8415f817fe5a8c3c200fd) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:13.003631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaba0c-6711-4470-bebe-f5b89e382d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:13.005061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaba0c-6711-4470-bebe-f5b89e382d90 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:13.010669 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 413/831] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:05:12 2022] GET /identity/v3/role_assignments?user.id=793ee1b363f8415f817fe5a8c3c200fd&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=79d46a51115c40e9b8f018a7efe6d9f6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:13.389729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d7834-5622-4047-bd84-6e33a6dcd7f4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:13.390296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d7834-5622-4047-bd84-6e33a6dcd7f4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:13.390296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d7834-5622-4047-bd84-6e33a6dcd7f4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:13.391796 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 419/832] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:13.396955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26356223-bff9-442e-9f10-284f5040d7fd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:13.397241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26356223-bff9-442e-9f10-284f5040d7fd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:13.397516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26356223-bff9-442e-9f10-284f5040d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:13.416278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26356223-bff9-442e-9f10-284f5040d7fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:13.417979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26356223-bff9-442e-9f10-284f5040d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:13.490153 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 414/833] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:13.753485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d7834-5622-4047-bd84-6e33a6dcd7f4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:13.856079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d7834-5622-4047-bd84-6e33a6dcd7f4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:13.888733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:13.889360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:13.889642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:13.889917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:13.897304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:13.900268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:13.905538 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:13.906652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:13.907898 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 420/834] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:13.912766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26356223-bff9-442e-9f10-284f5040d7fd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:13.955570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:14.006879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26356223-bff9-442e-9f10-284f5040d7fd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:14.041734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:14.042945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:14.043229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:14.043494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:14.044143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:14.044438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:14.045794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:14.053442 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 415/835] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:14.059505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:14.155706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f80-8511-4f65-96da-1851a5ad6425 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:14.187812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:14.188425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:14.188704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:14.188973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] PATH_INFO: `/v3/users/d0665e3c3d144d4485ff8be20a6d19a9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:14.190100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] RBAC: Authorizing `identity:get_user(user_id=d0665e3c3d144d4485ff8be20a6d19a9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:14.191517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:14.193041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 421/836] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:14 2022] GET /identity/v3/users/d0665e3c3d144d4485ff8be20a6d19a9 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:14.199191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:14.294248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd00366-e40b-4325-883f-858eafcdd41f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:14.300952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:14.327259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:14.327852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:14.328127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:14.328401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:14.391590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:14.393023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:14.486433 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 416/837] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:05:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:05:14.492229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:14.556254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:14.588740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e64c4-da72-4bc3-a115-7255e4746b8e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:14.621146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcb8dd-fd3a-4e12-bad6-97ebd66588f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:14.621754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcb8dd-fd3a-4e12-bad6-97ebd66588f5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:14.622029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcb8dd-fd3a-4e12-bad6-97ebd66588f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:14.622325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcb8dd-fd3a-4e12-bad6-97ebd66588f5 None admin] PATH_INFO: `/v3/projects/06c70221e3af4374b76556d8465a1303` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:14.623417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcb8dd-fd3a-4e12-bad6-97ebd66588f5 None admin] RBAC: Authorizing `identity:get_project(project_id=06c70221e3af4374b76556d8465a1303)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:14.624822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcb8dd-fd3a-4e12-bad6-97ebd66588f5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:14.626430 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 422/838] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:14 2022] GET /identity/v3/projects/06c70221e3af4374b76556d8465a1303 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:14.632334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:14.640672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:14.727987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbd9fc-8755-4cd0-95ca-1f16b5af3100 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:14.759982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207387-f0e6-4f18-904d-98602812f088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:14.760567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207387-f0e6-4f18-904d-98602812f088 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:14.760843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207387-f0e6-4f18-904d-98602812f088 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:14.761691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207387-f0e6-4f18-904d-98602812f088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:14.762430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf207387-f0e6-4f18-904d-98602812f088 None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=06c70221e3af4374b76556d8465a1303, user.id=d0665e3c3d144d4485ff8be20a6d19a9) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:14.762736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf207387-f0e6-4f18-904d-98602812f088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:14.764146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf207387-f0e6-4f18-904d-98602812f088 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:14.769598 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 417/839] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:05:14 2022] GET /identity/v3/role_assignments?user.id=d0665e3c3d144d4485ff8be20a6d19a9&scope.project.id=06c70221e3af4374b76556d8465a1303&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:16.896149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327d86-2b3c-4ef5-be31-cef215e7a3cf None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:16.896714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327d86-2b3c-4ef5-be31-cef215e7a3cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:16.896714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327d86-2b3c-4ef5-be31-cef215e7a3cf None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:16.898009 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 423/840] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:16.903629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75ee3-e468-459a-90c7-bb2920624741 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:16.904069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75ee3-e468-459a-90c7-bb2920624741 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:16.904171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd75ee3-e468-459a-90c7-bb2920624741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:16.922320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8dd75ee3-e468-459a-90c7-bb2920624741 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:16.923489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8dd75ee3-e468-459a-90c7-bb2920624741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:16.983507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:16.987749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 418/841] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:05:17.259050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5327d86-2b3c-4ef5-be31-cef215e7a3cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:17.368622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5327d86-2b3c-4ef5-be31-cef215e7a3cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:17.401485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b643e-5e59-4712-986a-74f19cfb01c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:17.402150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b643e-5e59-4712-986a-74f19cfb01c9 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:17.402426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b643e-5e59-4712-986a-74f19cfb01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:17.402694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b643e-5e59-4712-986a-74f19cfb01c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:17.403882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b643e-5e59-4712-986a-74f19cfb01c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:17.405352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b643e-5e59-4712-986a-74f19cfb01c9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:17.406907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 424/842] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:17.412646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75ee3-e468-459a-90c7-bb2920624741 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:17.507985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd75ee3-e468-459a-90c7-bb2920624741 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:17.540421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a37839-dbfb-4f51-b294-47d8b914bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:17.540961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37839-dbfb-4f51-b294-47d8b914bb0d None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:17.541239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37839-dbfb-4f51-b294-47d8b914bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:17.541511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37839-dbfb-4f51-b294-47d8b914bb0d None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:17.542184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a37839-dbfb-4f51-b294-47d8b914bb0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:17.544130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a37839-dbfb-4f51-b294-47d8b914bb0d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:17.627520 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 419/843] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:05:17 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:19.753210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d47fc-71b5-4f39-a474-66a0b13f710f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:19.753725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d47fc-71b5-4f39-a474-66a0b13f710f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:19.753725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d47fc-71b5-4f39-a474-66a0b13f710f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:19.755068 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 425/844] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:19.760108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927c75e-6769-45a2-9d8e-92ba6142ce63 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:19.760492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927c75e-6769-45a2-9d8e-92ba6142ce63 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:19.760653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927c75e-6769-45a2-9d8e-92ba6142ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:19.778720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1927c75e-6769-45a2-9d8e-92ba6142ce63 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:19.779882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1927c75e-6769-45a2-9d8e-92ba6142ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:19.827232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:19.842944 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 420/845] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:20.112423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d47fc-71b5-4f39-a474-66a0b13f710f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:20.116319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:20.210113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d47fc-71b5-4f39-a474-66a0b13f710f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:20.243273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:20.244778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:20.244778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:20.244778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] PATH_INFO: `/v3/roles/8ff4721e72e84ea6a7943c7a0b88a5f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:20.245840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] RBAC: Authorizing `identity:get_role(role_id=8ff4721e72e84ea6a7943c7a0b88a5f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:20.247246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:20.248533 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 426/846] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:20 2022] GET /identity/v3/roles/8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:20.254373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927c75e-6769-45a2-9d8e-92ba6142ce63 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:20.349580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927c75e-6769-45a2-9d8e-92ba6142ce63 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:20.382038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:20.382638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:20.382917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:20.383188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] PATH_INFO: `/v3/users/97b70f4025b74390aab9dd4f163ea9a5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:20.396912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] RBAC: Authorizing `identity:get_user(user_id=97b70f4025b74390aab9dd4f163ea9a5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:20.398378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:20.399976 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 421/847] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:20 2022] GET /identity/v3/users/97b70f4025b74390aab9dd4f163ea9a5 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:20.406422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:20.476365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:20.504517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b51f7-8362-4a24-8e0e-f152349aff77 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:20.536661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58ec94-3a80-43ea-a1c9-2e62c0e38c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:20.537274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ec94-3a80-43ea-a1c9-2e62c0e38c2e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:20.537551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ec94-3a80-43ea-a1c9-2e62c0e38c2e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:20.537819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58ec94-3a80-43ea-a1c9-2e62c0e38c2e None admin] PATH_INFO: `/v3/projects/06c70221e3af4374b76556d8465a1303` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:20.538945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58ec94-3a80-43ea-a1c9-2e62c0e38c2e None admin] RBAC: Authorizing `identity:get_project(project_id=06c70221e3af4374b76556d8465a1303)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:20.540342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58ec94-3a80-43ea-a1c9-2e62c0e38c2e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:20.541939 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 427/848] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:20 2022] GET /identity/v3/projects/06c70221e3af4374b76556d8465a1303 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:20.547810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:20.591739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:20.643573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f99d34-cdc1-4d5a-9149-017ef763fe36 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:20.675182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982f762-c061-46b0-a5cc-2341c428e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:20.675826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982f762-c061-46b0-a5cc-2341c428e8c3 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:20.676105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982f762-c061-46b0-a5cc-2341c428e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:20.676379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982f762-c061-46b0-a5cc-2341c428e8c3 None admin] PATH_INFO: `/v3/projects/06c70221e3af4374b76556d8465a1303/users/97b70f4025b74390aab9dd4f163ea9a5/roles/8ff4721e72e84ea6a7943c7a0b88a5f4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:20.678505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982f762-c061-46b0-a5cc-2341c428e8c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=06c70221e3af4374b76556d8465a1303, user_id=97b70f4025b74390aab9dd4f163ea9a5, role_id=8ff4721e72e84ea6a7943c7a0b88a5f4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:20.679931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982f762-c061-46b0-a5cc-2341c428e8c3 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:20.770620 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 422/849] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:05:20 2022] PUT /identity/v3/projects/06c70221e3af4374b76556d8465a1303/users/97b70f4025b74390aab9dd4f163ea9a5/roles/8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:05:22.874424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c622a-5c53-4973-9349-ace3f4fb8399 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:22.874933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c622a-5c53-4973-9349-ace3f4fb8399 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:22.875038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c622a-5c53-4973-9349-ace3f4fb8399 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:22.876293 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 428/850] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:22.881371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e58db-e717-4c7c-a7cc-6dd008f4505e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:22.881803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e58db-e717-4c7c-a7cc-6dd008f4505e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:22.881931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e58db-e717-4c7c-a7cc-6dd008f4505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:22.900356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fc9e58db-e717-4c7c-a7cc-6dd008f4505e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:22.901542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc9e58db-e717-4c7c-a7cc-6dd008f4505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:22.965485 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 423/851] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:23.233452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c622a-5c53-4973-9349-ace3f4fb8399 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:23.331468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c622a-5c53-4973-9349-ace3f4fb8399 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:23.364704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:23.365314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:23.365590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:23.365855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] PATH_INFO: `/v3/roles/8ff4721e72e84ea6a7943c7a0b88a5f4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:23.367248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] RBAC: Authorizing `identity:get_role(role_id=8ff4721e72e84ea6a7943c7a0b88a5f4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:23.368594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:23.369872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 429/852] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:23 2022] GET /identity/v3/roles/8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:23.376134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e58db-e717-4c7c-a7cc-6dd008f4505e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:23.407823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:23.472951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e58db-e717-4c7c-a7cc-6dd008f4505e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:23.506299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:23.506865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:23.507142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:23.507413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] PATH_INFO: `/v3/users/97b70f4025b74390aab9dd4f163ea9a5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:23.508514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] RBAC: Authorizing `identity:get_user(user_id=97b70f4025b74390aab9dd4f163ea9a5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:23.509954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:23.511553 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 424/853] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:23 2022] GET /identity/v3/users/97b70f4025b74390aab9dd4f163ea9a5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:23.517394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:23.528405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:23.614238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df813a7-1b0d-44c1-a4ad-d7c7a562fb38 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:23.646327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:23.646920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:23.647201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:23.647473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:23.711555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:23.712984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:23.722537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:23.807508 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 430/854] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:05:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:05:23.813812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:23.908502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10186e-af0c-44c5-a5e9-79053ff79e6b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:23.909968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:23.942797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ca625-9888-4ef5-9596-850acfbbf3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:23.943415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ca625-9888-4ef5-9596-850acfbbf3a8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:23.943699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ca625-9888-4ef5-9596-850acfbbf3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:23.943974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ca625-9888-4ef5-9596-850acfbbf3a8 None admin] PATH_INFO: `/v3/projects/06c70221e3af4374b76556d8465a1303` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:23.945152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ca625-9888-4ef5-9596-850acfbbf3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=06c70221e3af4374b76556d8465a1303)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:23.946611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ca625-9888-4ef5-9596-850acfbbf3a8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:23.948197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 425/855] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:23 2022] GET /identity/v3/projects/06c70221e3af4374b76556d8465a1303 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:23.954802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:24.050001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03500-9291-4adb-bb49-72f3a720b757 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:24.059100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:24.084849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c286-01c4-4bc8-9a6f-50d5a17e2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:24.085449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c286-01c4-4bc8-9a6f-50d5a17e2af0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:24.085726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c286-01c4-4bc8-9a6f-50d5a17e2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:24.085991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c286-01c4-4bc8-9a6f-50d5a17e2af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:24.086735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c286-01c4-4bc8-9a6f-50d5a17e2af0 None admin] RBAC: Adding query filter params (role.id=8ff4721e72e84ea6a7943c7a0b88a5f4, scope.project.id=06c70221e3af4374b76556d8465a1303, user.id=97b70f4025b74390aab9dd4f163ea9a5) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:24.087089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c286-01c4-4bc8-9a6f-50d5a17e2af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:24.088509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c286-01c4-4bc8-9a6f-50d5a17e2af0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:24.094817 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 431/856] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:05:23 2022] GET /identity/v3/role_assignments?user.id=97b70f4025b74390aab9dd4f163ea9a5&scope.project.id=06c70221e3af4374b76556d8465a1303&role.id=8ff4721e72e84ea6a7943c7a0b88a5f4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:26.226972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c883-5382-4e0b-8a7b-2b0f5be9ba49 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:26.227520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c883-5382-4e0b-8a7b-2b0f5be9ba49 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:26.227520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c883-5382-4e0b-8a7b-2b0f5be9ba49 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:26.228833 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 426/857] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:26.234113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38ae6-f318-48fd-8ad3-51f67a2cbca3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:26.234517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38ae6-f318-48fd-8ad3-51f67a2cbca3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:26.234667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38ae6-f318-48fd-8ad3-51f67a2cbca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:26.252385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bbf38ae6-f318-48fd-8ad3-51f67a2cbca3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:26.253557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbf38ae6-f318-48fd-8ad3-51f67a2cbca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:26.317406 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 432/858] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:26.585234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c883-5382-4e0b-8a7b-2b0f5be9ba49 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:26.681239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c883-5382-4e0b-8a7b-2b0f5be9ba49 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:26.713499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b5e46-54ea-4ecb-add9-f138a8f4ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:26.714187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5e46-54ea-4ecb-add9-f138a8f4ce62 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:26.714465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5e46-54ea-4ecb-add9-f138a8f4ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:26.714734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5e46-54ea-4ecb-add9-f138a8f4ce62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:26.715825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b5e46-54ea-4ecb-add9-f138a8f4ce62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:26.717232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b5e46-54ea-4ecb-add9-f138a8f4ce62 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:26.718759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 427/859] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:26.724366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38ae6-f318-48fd-8ad3-51f67a2cbca3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:26.818826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38ae6-f318-48fd-8ad3-51f67a2cbca3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:26.820285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:26.851779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58de6b2-5d9e-41b4-9b3a-66eb263379d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:26.852317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de6b2-5d9e-41b4-9b3a-66eb263379d9 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:26.852594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de6b2-5d9e-41b4-9b3a-66eb263379d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:26.852861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de6b2-5d9e-41b4-9b3a-66eb263379d9 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:26.853500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de6b2-5d9e-41b4-9b3a-66eb263379d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:26.855000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de6b2-5d9e-41b4-9b3a-66eb263379d9 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:26.920097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 433/860] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:05:26 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:29.049222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1090e99-fb06-4002-ab12-1e891565be1a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:29.049778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1090e99-fb06-4002-ab12-1e891565be1a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:29.049778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1090e99-fb06-4002-ab12-1e891565be1a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:29.051103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 428/861] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:29.056335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd07fe-cf9c-4c43-8329-30ea427195c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:29.056744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd07fe-cf9c-4c43-8329-30ea427195c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:29.056895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd07fe-cf9c-4c43-8329-30ea427195c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:29.074839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0cbd07fe-cf9c-4c43-8329-30ea427195c5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:29.076028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cbd07fe-cf9c-4c43-8329-30ea427195c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:29.142837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 434/862] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:29.410867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1090e99-fb06-4002-ab12-1e891565be1a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:29.450722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:29.509415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1090e99-fb06-4002-ab12-1e891565be1a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:29.541924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c3476-d9a0-4c6d-8ac0-851d2494b7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:29.542643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3476-d9a0-4c6d-8ac0-851d2494b7d1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:29.542920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3476-d9a0-4c6d-8ac0-851d2494b7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:29.543187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c3476-d9a0-4c6d-8ac0-851d2494b7d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:29.544274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c3476-d9a0-4c6d-8ac0-851d2494b7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:29.545693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c3476-d9a0-4c6d-8ac0-851d2494b7d1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:29.547254 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 429/863] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:29.552995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd07fe-cf9c-4c43-8329-30ea427195c5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:29.633512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:29.648920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd07fe-cf9c-4c43-8329-30ea427195c5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:29.684108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3724df-1650-4568-8fae-47da5aebda8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:29.684810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3724df-1650-4568-8fae-47da5aebda8b None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:29.685137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3724df-1650-4568-8fae-47da5aebda8b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:29.685590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3724df-1650-4568-8fae-47da5aebda8b None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:29.686657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3724df-1650-4568-8fae-47da5aebda8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:29.688081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3724df-1650-4568-8fae-47da5aebda8b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:29.770246 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 435/864] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:05:29 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:31.921930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0284c77-1969-46e7-8161-6a14d8a11461 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:31.922502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0284c77-1969-46e7-8161-6a14d8a11461 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:31.922631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0284c77-1969-46e7-8161-6a14d8a11461 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:31.923893 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 430/865] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:31.928958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e56b-fe33-4859-98f3-ecc3d4976ea7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:31.929329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e56b-fe33-4859-98f3-ecc3d4976ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:31.929504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e56b-fe33-4859-98f3-ecc3d4976ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:31.947774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a24e56b-fe33-4859-98f3-ecc3d4976ea7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:31.949600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a24e56b-fe33-4859-98f3-ecc3d4976ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:32.013377 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 436/866] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:32.289625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0284c77-1969-46e7-8161-6a14d8a11461 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:32.427237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0284c77-1969-46e7-8161-6a14d8a11461 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:32.434758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:32.460065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:32.460691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:32.460969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:32.461241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:32.471094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:32.476373 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:32.477523 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:32.478634 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:32.482203 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 431/867] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:32.483879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24e56b-fe33-4859-98f3-ecc3d4976ea7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:32.550306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:32.578998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24e56b-fe33-4859-98f3-ecc3d4976ea7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:32.612710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:32.613312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:32.613594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:32.613868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:32.614559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:32.614864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:32.616222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:32.624389 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 437/868] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:32.630224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:32.726768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfce2c-8c9a-4856-ae47-8a03c20717f5 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:32.758967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:32.759578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:32.759862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:32.760139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] PATH_INFO: `/v3/users/8165d659b3834f26bdb04f90b0fad8a1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:32.773182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] RBAC: Authorizing `identity:get_user(user_id=8165d659b3834f26bdb04f90b0fad8a1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:32.774655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:32.776696 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 432/869] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:32 2022] GET /identity/v3/users/8165d659b3834f26bdb04f90b0fad8a1 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:32.782250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:32.877995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50978865-ff23-4859-8b10-0b601d6fef42 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:32.906318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:32.910973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa4ecc-ef10-457a-b6af-4d11a24373f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:32.911589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4ecc-ef10-457a-b6af-4d11a24373f2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:32.911871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4ecc-ef10-457a-b6af-4d11a24373f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:32.912145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4ecc-ef10-457a-b6af-4d11a24373f2 None admin] PATH_INFO: `/v3/projects/2677d3d6725b4256aa284b66f0655500` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:32.913240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa4ecc-ef10-457a-b6af-4d11a24373f2 None admin] RBAC: Authorizing `identity:get_project(project_id=2677d3d6725b4256aa284b66f0655500)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:32.914677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa4ecc-ef10-457a-b6af-4d11a24373f2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:32.916257 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 438/870] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:32 2022] GET /identity/v3/projects/2677d3d6725b4256aa284b66f0655500 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:32.922101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:32.946103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:33.016153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8dbf0-4b43-40a8-bb1d-b3442376716b None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:33.048000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd56fb-45de-4a53-941a-6fd3c281be03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:33.048632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd56fb-45de-4a53-941a-6fd3c281be03 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:33.048906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd56fb-45de-4a53-941a-6fd3c281be03 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:33.049176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd56fb-45de-4a53-941a-6fd3c281be03 None admin] PATH_INFO: `/v3/projects/2677d3d6725b4256aa284b66f0655500/users/8165d659b3834f26bdb04f90b0fad8a1/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:33.051030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd56fb-45de-4a53-941a-6fd3c281be03 None admin] RBAC: Authorizing `identity:create_grant(project_id=2677d3d6725b4256aa284b66f0655500, user_id=8165d659b3834f26bdb04f90b0fad8a1, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:33.052437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd56fb-45de-4a53-941a-6fd3c281be03 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:33.122378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 433/871] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:05:32 2022] PUT /identity/v3/projects/2677d3d6725b4256aa284b66f0655500/users/8165d659b3834f26bdb04f90b0fad8a1/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:05:35.210688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae04e-a29e-42f1-8412-b72e8d2b1d76 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:35.211257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae04e-a29e-42f1-8412-b72e8d2b1d76 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:35.211257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae04e-a29e-42f1-8412-b72e8d2b1d76 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:35.212633 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 439/872] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:35.218471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa908-5200-4832-a908-017f4bc129c3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:35.219053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa908-5200-4832-a908-017f4bc129c3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:35.219156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa908-5200-4832-a908-017f4bc129c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:35.236826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d1fa908-5200-4832-a908-017f4bc129c3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:35.237981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d1fa908-5200-4832-a908-017f4bc129c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:35.301197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 434/873] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:35.574630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ae04e-a29e-42f1-8412-b72e8d2b1d76 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:35.673675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ae04e-a29e-42f1-8412-b72e8d2b1d76 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:35.706032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:35.706675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:35.706955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:35.707227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:35.717362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:35.723079 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:35.724154 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:35.725606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 440/874] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:35.730324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa908-5200-4832-a908-017f4bc129c3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:35.744531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:35.824717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa908-5200-4832-a908-017f4bc129c3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:35.856609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:35.857198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:35.857477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:35.857749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:35.858429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:35.858730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:35.860083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:35.867696 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 435/875] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:35.873909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:35.930971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:35.970252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e35d0-606f-4594-b702-c09cc7c8db0a None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:36.003074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:36.003679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:36.003955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:36.004224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] PATH_INFO: `/v3/users/8165d659b3834f26bdb04f90b0fad8a1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:36.005321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] RBAC: Authorizing `identity:get_user(user_id=8165d659b3834f26bdb04f90b0fad8a1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:36.006832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:36.008349 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 441/876] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:35 2022] GET /identity/v3/users/8165d659b3834f26bdb04f90b0fad8a1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:36.014078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:36.087379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:36.115590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40ab3f-1f44-4254-82b4-2f08ad10612d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:36.155180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:36.155778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:36.156058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:36.156330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:36.220160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:36.221595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:36.292423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:36.314637 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 436/877] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:05:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:05:36.320686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:36.530809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361673df-2252-4810-8e2e-6361aeac2a10 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:36.555503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:36.563512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3d042-4db2-4de2-a813-1d28230de303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:36.564129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3d042-4db2-4de2-a813-1d28230de303 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:36.564407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3d042-4db2-4de2-a813-1d28230de303 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:36.564679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3d042-4db2-4de2-a813-1d28230de303 None admin] PATH_INFO: `/v3/projects/2677d3d6725b4256aa284b66f0655500` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:36.565773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3d042-4db2-4de2-a813-1d28230de303 None admin] RBAC: Authorizing `identity:get_project(project_id=2677d3d6725b4256aa284b66f0655500)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:36.567205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3d042-4db2-4de2-a813-1d28230de303 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:36.568891 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 442/878] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:36 2022] GET /identity/v3/projects/2677d3d6725b4256aa284b66f0655500 => generated 311 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:36.575608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:36.671145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda5b6-edb3-4598-9648-5e407db6d955 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:36.818726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9a57-25fe-4c0a-8b72-9f85f0e2db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:36.819231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9a57-25fe-4c0a-8b72-9f85f0e2db4c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:36.819511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9a57-25fe-4c0a-8b72-9f85f0e2db4c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:36.819781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9a57-25fe-4c0a-8b72-9f85f0e2db4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:36.820490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9a57-25fe-4c0a-8b72-9f85f0e2db4c None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=2677d3d6725b4256aa284b66f0655500, user.id=8165d659b3834f26bdb04f90b0fad8a1) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:36.820797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9a57-25fe-4c0a-8b72-9f85f0e2db4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:36.822214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9a57-25fe-4c0a-8b72-9f85f0e2db4c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:36.827747 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 437/879] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:05:36 2022] GET /identity/v3/role_assignments?user.id=8165d659b3834f26bdb04f90b0fad8a1&scope.project.id=2677d3d6725b4256aa284b66f0655500&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:38.939275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189628-29c4-4824-adf6-e6dbd0b9b08b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:38.939819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189628-29c4-4824-adf6-e6dbd0b9b08b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:38.939819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69189628-29c4-4824-adf6-e6dbd0b9b08b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:38.941127 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 443/880] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:38.946270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940706-4dee-4320-ae67-32ba21b73219 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:38.946692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940706-4dee-4320-ae67-32ba21b73219 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:38.946819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940706-4dee-4320-ae67-32ba21b73219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:38.964310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-87940706-4dee-4320-ae67-32ba21b73219 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:38.965483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87940706-4dee-4320-ae67-32ba21b73219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:38.998890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:39.029009 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 438/881] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:39.294727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189628-29c4-4824-adf6-e6dbd0b9b08b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:39.392157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69189628-29c4-4824-adf6-e6dbd0b9b08b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:39.425043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b42380-09df-470d-848d-702f1ee3dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:39.425627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b42380-09df-470d-848d-702f1ee3dcde None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:39.425900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b42380-09df-470d-848d-702f1ee3dcde None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:39.426198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b42380-09df-470d-848d-702f1ee3dcde None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:39.426855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b42380-09df-470d-848d-702f1ee3dcde None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:39.428185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b42380-09df-470d-848d-702f1ee3dcde None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:39.537186 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 444/882] 10.222.0.27 () {60 vars in 1138 bytes} [Tue Oct 18 13:05:39 2022] POST /identity/v3/domains => generated 267 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:41.685347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b8cd8-b485-48a0-89d4-1993e9c5beba None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:41.685885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b8cd8-b485-48a0-89d4-1993e9c5beba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:41.685885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b8cd8-b485-48a0-89d4-1993e9c5beba None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:41.687260 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 439/883] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:41.692504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e1cd-59d5-499b-b47e-88bdc180913f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:41.692942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e1cd-59d5-499b-b47e-88bdc180913f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:41.693033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7e1cd-59d5-499b-b47e-88bdc180913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:41.711105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-07d7e1cd-59d5-499b-b47e-88bdc180913f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:41.712212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07d7e1cd-59d5-499b-b47e-88bdc180913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:41.759843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:41.776960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 445/884] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:42.041015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b8cd8-b485-48a0-89d4-1993e9c5beba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:42.138077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b8cd8-b485-48a0-89d4-1993e9c5beba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:42.170181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4b08e-5374-4037-b552-6699c0d482cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:42.170791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b08e-5374-4037-b552-6699c0d482cf None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:42.171071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b08e-5374-4037-b552-6699c0d482cf None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:42.171343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4b08e-5374-4037-b552-6699c0d482cf None admin] PATH_INFO: `/v3/domains/90bc21855c504b7c858e651698283c8f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:42.185125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4b08e-5374-4037-b552-6699c0d482cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=90bc21855c504b7c858e651698283c8f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:42.186754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4b08e-5374-4037-b552-6699c0d482cf None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:42.188351 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 440/885] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Oct 18 13:05:42 2022] GET /identity/v3/domains/90bc21855c504b7c858e651698283c8f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:42.194135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7e1cd-59d5-499b-b47e-88bdc180913f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:42.288972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7e1cd-59d5-499b-b47e-88bdc180913f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:42.321132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b564a-4eee-4d5d-ab2c-71669be31401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:42.321666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b564a-4eee-4d5d-ab2c-71669be31401 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:42.321939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b564a-4eee-4d5d-ab2c-71669be31401 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:42.322233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b564a-4eee-4d5d-ab2c-71669be31401 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:42.322874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b564a-4eee-4d5d-ab2c-71669be31401 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:42.324318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b564a-4eee-4d5d-ab2c-71669be31401 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:42.439664 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 446/886] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:05:42 2022] POST /identity/v3/projects => generated 361 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:44.604789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1fdb-5ad9-4da0-a2e2-419db925bba2 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:44.605324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1fdb-5ad9-4da0-a2e2-419db925bba2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:44.605324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1fdb-5ad9-4da0-a2e2-419db925bba2 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:44.606710 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 441/887] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:44.611829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c392ef-c8a9-4442-a1f7-56a90420e84b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:44.612247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c392ef-c8a9-4442-a1f7-56a90420e84b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:44.612379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c392ef-c8a9-4442-a1f7-56a90420e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:44.630690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12c392ef-c8a9-4442-a1f7-56a90420e84b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:44.631873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12c392ef-c8a9-4442-a1f7-56a90420e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:44.660576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:44.696544 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 447/888] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:44.968934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b1fdb-5ad9-4da0-a2e2-419db925bba2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:44.999607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:45.066228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b1fdb-5ad9-4da0-a2e2-419db925bba2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:45.097984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5e6b7-3656-4854-b89f-30a9d21c1e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:45.098639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5e6b7-3656-4854-b89f-30a9d21c1e91 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:45.098913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5e6b7-3656-4854-b89f-30a9d21c1e91 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:45.099182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5e6b7-3656-4854-b89f-30a9d21c1e91 None admin] PATH_INFO: `/v3/domains/90bc21855c504b7c858e651698283c8f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:45.100548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5e6b7-3656-4854-b89f-30a9d21c1e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=90bc21855c504b7c858e651698283c8f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:45.101960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5e6b7-3656-4854-b89f-30a9d21c1e91 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:45.103508 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 442/889] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Oct 18 13:05:44 2022] GET /identity/v3/domains/90bc21855c504b7c858e651698283c8f => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:45.109589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c392ef-c8a9-4442-a1f7-56a90420e84b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:45.204172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c392ef-c8a9-4442-a1f7-56a90420e84b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:45.236952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33291dec-375c-48ec-82cb-8b7ffa7334f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:45.237484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291dec-375c-48ec-82cb-8b7ffa7334f8 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:45.237757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291dec-375c-48ec-82cb-8b7ffa7334f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:45.238029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33291dec-375c-48ec-82cb-8b7ffa7334f8 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:45.238722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291dec-375c-48ec-82cb-8b7ffa7334f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:45.240151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33291dec-375c-48ec-82cb-8b7ffa7334f8 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:45.339654 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 448/890] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:05:45 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:05:47.497889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14718ea1-c4af-4353-8635-087d8602deb0 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:47.498453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14718ea1-c4af-4353-8635-087d8602deb0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:47.498607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14718ea1-c4af-4353-8635-087d8602deb0 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:47.499944 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 443/891] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:47.505226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719e82-69c8-4a41-8f5e-66df24433a53 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:47.505647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719e82-69c8-4a41-8f5e-66df24433a53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:47.505747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719e82-69c8-4a41-8f5e-66df24433a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:47.523932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e2719e82-69c8-4a41-8f5e-66df24433a53 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:47.525097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2719e82-69c8-4a41-8f5e-66df24433a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:47.542614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:47.589552 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 449/892] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:05:47.859426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14718ea1-c4af-4353-8635-087d8602deb0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:47.951506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:47.955992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14718ea1-c4af-4353-8635-087d8602deb0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:47.988659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:47.989268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:47.989547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:47.989817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:47.999477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:48.004166 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:48.005283 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:05:48.006471 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 444/893] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:05:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:48.011700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719e82-69c8-4a41-8f5e-66df24433a53 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:48.106297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719e82-69c8-4a41-8f5e-66df24433a53 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:48.138772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:48.139363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:48.139642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:48.139913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:48.140573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:48.140875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:48.142251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:48.149938 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 450/894] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:48.156018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:48.259378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a83e1c-7ef2-4589-beed-478c582f7bdd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:48.341555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:48.342202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:48.342481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:48.342750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] PATH_INFO: `/v3/users/a122ca10afb54b9c81c72b45fc84efe0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:48.355228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] RBAC: Authorizing `identity:get_user(user_id=a122ca10afb54b9c81c72b45fc84efe0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:48.356731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:48.358326 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 445/895] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:48 2022] GET /identity/v3/users/a122ca10afb54b9c81c72b45fc84efe0 => generated 311 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:48.364146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:48.382377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:48.460723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866af4ab-9bb8-4440-bb74-f52e5c9676a5 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:48.492798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d651c14-daf2-45d6-8092-85cdb8f9c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:48.493419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651c14-daf2-45d6-8092-85cdb8f9c4cc None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:48.493697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651c14-daf2-45d6-8092-85cdb8f9c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:48.493968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651c14-daf2-45d6-8092-85cdb8f9c4cc None admin] PATH_INFO: `/v3/projects/080c4782331741c3a29a7604fc4cf822` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:48.495624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d651c14-daf2-45d6-8092-85cdb8f9c4cc None admin] RBAC: Authorizing `identity:get_project(project_id=080c4782331741c3a29a7604fc4cf822)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:48.497025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d651c14-daf2-45d6-8092-85cdb8f9c4cc None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:48.498668 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 451/896] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:48 2022] GET /identity/v3/projects/080c4782331741c3a29a7604fc4cf822 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:48.504615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:48.522508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:48.599348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4491b-3672-4177-bbb7-7c6ca84cab20 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:48.631587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ffb4-a9cc-4e59-98c8-d09ee78b63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:48.632227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ffb4-a9cc-4e59-98c8-d09ee78b63ea None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:48.632506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ffb4-a9cc-4e59-98c8-d09ee78b63ea None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:48.632779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ffb4-a9cc-4e59-98c8-d09ee78b63ea None admin] PATH_INFO: `/v3/projects/080c4782331741c3a29a7604fc4cf822/users/a122ca10afb54b9c81c72b45fc84efe0/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:48.634658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ffb4-a9cc-4e59-98c8-d09ee78b63ea None admin] RBAC: Authorizing `identity:create_grant(project_id=080c4782331741c3a29a7604fc4cf822, user_id=a122ca10afb54b9c81c72b45fc84efe0, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:48.636634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ffb4-a9cc-4e59-98c8-d09ee78b63ea None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:48.695511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 446/897] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:05:48 2022] PUT /identity/v3/projects/080c4782331741c3a29a7604fc4cf822/users/a122ca10afb54b9c81c72b45fc84efe0/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:05:50.810654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac6c7-351d-4880-b917-3fb296af06af None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:50.811172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac6c7-351d-4880-b917-3fb296af06af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:50.811172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac6c7-351d-4880-b917-3fb296af06af None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:50.812472 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 452/898] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:05:50.817819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae21c3-c9a0-4e4a-8e51-7bec4bb64a58 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:50.818268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae21c3-c9a0-4e4a-8e51-7bec4bb64a58 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:50.818400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae21c3-c9a0-4e4a-8e51-7bec4bb64a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:50.836472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-70ae21c3-c9a0-4e4a-8e51-7bec4bb64a58 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:05:50.837636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-70ae21c3-c9a0-4e4a-8e51-7bec4bb64a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:05:50.900989 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 447/899] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:05:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:05:51.167561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac6c7-351d-4880-b917-3fb296af06af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:51.250889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:51.266645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac6c7-351d-4880-b917-3fb296af06af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:51.300124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:51.300746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:51.301026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:51.301301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:51.311124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:05:51.315871 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:05:51.316952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:05:51.317921 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 453/900] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:05:51.322919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae21c3-c9a0-4e4a-8e51-7bec4bb64a58 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:51.330756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:51.417890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae21c3-c9a0-4e4a-8e51-7bec4bb64a58 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:51.449095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:51.449690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:51.449966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:51.450277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:51.450934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:51.451235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:51.452620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:51.460512 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 448/901] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:51.466946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:51.562981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04758e29-f52f-43b3-ba14-0e717706d85f None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:51.595549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:51.596151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:51.596434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:51.596710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] PATH_INFO: `/v3/users/a122ca10afb54b9c81c72b45fc84efe0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:51.597822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=a122ca10afb54b9c81c72b45fc84efe0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:51.599265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:51.601088 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 454/902] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Oct 18 13:05:51 2022] GET /identity/v3/users/a122ca10afb54b9c81c72b45fc84efe0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:51.607407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:51.670842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:51.702315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c0ec6-d852-4f23-b037-cb59ab197781 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:51.735337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:51.735933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:51.736213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:51.736486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:51.800209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:51.801637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:51.863830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:51.897377 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 449/903] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:05:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:05:51.903925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:51.918208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:05:52.000575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637314ce-eef0-4681-af23-ca426cf02fe1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:52.033010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f646df8-eca5-4749-b9b0-4c405874a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:52.033615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f646df8-eca5-4749-b9b0-4c405874a086 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:52.033889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f646df8-eca5-4749-b9b0-4c405874a086 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:52.034186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f646df8-eca5-4749-b9b0-4c405874a086 None admin] PATH_INFO: `/v3/projects/080c4782331741c3a29a7604fc4cf822` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:52.035268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f646df8-eca5-4749-b9b0-4c405874a086 None admin] RBAC: Authorizing `identity:get_project(project_id=080c4782331741c3a29a7604fc4cf822)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:52.036664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f646df8-eca5-4749-b9b0-4c405874a086 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:52.038317 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 455/904] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Oct 18 13:05:51 2022] GET /identity/v3/projects/080c4782331741c3a29a7604fc4cf822 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:05:52.044276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:05:52.138787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da1e0-46ef-47a4-8f14-056184f22228 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:05:52.170346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b5527-6132-46d3-8d04-503ae8892546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:05:52.170928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5527-6132-46d3-8d04-503ae8892546 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:05:52.171202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5527-6132-46d3-8d04-503ae8892546 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:05:52.171471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5527-6132-46d3-8d04-503ae8892546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:05:52.172171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b5527-6132-46d3-8d04-503ae8892546 None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=080c4782331741c3a29a7604fc4cf822, user.id=a122ca10afb54b9c81c72b45fc84efe0) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:05:52.172474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b5527-6132-46d3-8d04-503ae8892546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:05:52.173881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b5527-6132-46d3-8d04-503ae8892546 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:05:52.179325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 450/905] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:05:52 2022] GET /identity/v3/role_assignments?user.id=a122ca10afb54b9c81c72b45fc84efe0&scope.project.id=080c4782331741c3a29a7604fc4cf822&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:06:02.029016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=60 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:02.176847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:04.631491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84d56e-8be9-4be3-bd4b-6bc807f527b3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:04.632077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84d56e-8be9-4be3-bd4b-6bc807f527b3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:04.632077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84d56e-8be9-4be3-bd4b-6bc807f527b3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:04.633348 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 456/906] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:04.638837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f05fd-96fd-495d-bb52-fcfe36383c0d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:04.640989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f05fd-96fd-495d-bb52-fcfe36383c0d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:04.643007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f05fd-96fd-495d-bb52-fcfe36383c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:04.662025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c27f05fd-96fd-495d-bb52-fcfe36383c0d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:04.663239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c27f05fd-96fd-495d-bb52-fcfe36383c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:04.727825 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 451/907] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:07:04.999827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84d56e-8be9-4be3-bd4b-6bc807f527b3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:05.098105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84d56e-8be9-4be3-bd4b-6bc807f527b3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:05.131825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:05.132436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:05.132708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:05.132974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:05.142842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:05.144254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:05.158402 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:05.159682 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:05.160869 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:05.160869 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:05.160869 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:05.160869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 457/908] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:05.165793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f05fd-96fd-495d-bb52-fcfe36383c0d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:05.262391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f05fd-96fd-495d-bb52-fcfe36383c0d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:05.289191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:05.294856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202375e5-4703-4839-bc93-e02182ac3999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:05.295987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202375e5-4703-4839-bc93-e02182ac3999 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:05.296268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202375e5-4703-4839-bc93-e02182ac3999 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:05.296545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202375e5-4703-4839-bc93-e02182ac3999 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:05.297183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202375e5-4703-4839-bc93-e02182ac3999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:05.297488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202375e5-4703-4839-bc93-e02182ac3999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:05.298911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202375e5-4703-4839-bc93-e02182ac3999 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:05.309730 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 452/909] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:05.316313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:05.368104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:05.413149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171587f-c9b1-47c5-8bb7-b5487ab92415 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:05.446917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3155984-ebb9-434c-863d-be2ccb654872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:05.447540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155984-ebb9-434c-863d-be2ccb654872 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:05.447817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155984-ebb9-434c-863d-be2ccb654872 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:05.448085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155984-ebb9-434c-863d-be2ccb654872 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:05.448728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3155984-ebb9-434c-863d-be2ccb654872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:05.450307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3155984-ebb9-434c-863d-be2ccb654872 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:05.543092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 458/910] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Oct 18 13:07:05 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:07:07.705412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f3307-c5b2-4b91-86c5-6e06336b6539 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:07.705930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f3307-c5b2-4b91-86c5-6e06336b6539 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:07.705930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f3307-c5b2-4b91-86c5-6e06336b6539 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:07.707236 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 453/911] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:07.712424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6da60-23ad-414d-9f86-98328a652bb1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:07.712820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6da60-23ad-414d-9f86-98328a652bb1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:07.712983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6da60-23ad-414d-9f86-98328a652bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:07.731333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a3e6da60-23ad-414d-9f86-98328a652bb1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:07.732511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3e6da60-23ad-414d-9f86-98328a652bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:07.799171 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 459/912] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:08.072605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f3307-c5b2-4b91-86c5-6e06336b6539 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:08.174904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f3307-c5b2-4b91-86c5-6e06336b6539 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:08.206635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:08.207254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:08.207529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:08.207797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:08.218111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:07:08.222732 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:08.223846 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:08.224718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 454/913] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:08.230167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6da60-23ad-414d-9f86-98328a652bb1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:08.268773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:08.324953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6da60-23ad-414d-9f86-98328a652bb1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:08.358202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:08.381380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:08.381380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:08.381380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:08.381380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] RBAC: Adding query filter params (name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:08.381380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:08.381380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:08.386846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 460/914] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:07:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:08.386947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:08.428207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:08.476705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f8adf-4b3e-4b10-91a8-a7cab57a287a None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:08.509346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:08.509971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:08.510277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:08.510576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:08.521523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:08.523070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:08.537563 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:08.538658 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:08.539550 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:08.539550 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:08.539550 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:08.539550 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 455/915] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:07:08.544572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:08.640033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:08.642911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cf2f9-1ce2-42c0-9cc6-9a477da57547 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:08.675733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:08.676378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:08.676655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:08.676922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:08.677549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:08.677860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:08.679221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:08.691450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 461/916] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:08.697879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:08.798438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f4570-344b-437e-910c-118d2b5ec02d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:08.800054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:08.831174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:08.831803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:08.832083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:08.832357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:08.839539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:08.840972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:07:08.852779 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:08.853898 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:08.855211 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 456/917] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:08.859836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:08.957324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e058f1-13bb-43b2-95f2-291f6df65991 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:08.991800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:08.992401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:08.992676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:08.992947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:08.993668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:08.993972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:08.995412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:09.011962 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 462/918] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Oct 18 13:07:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:09.018369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:09.117387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a611b2-0f5d-4e9b-993e-0e176ea08249 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:09.150047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:09.150694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:09.150975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:09.151249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:09.161256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:09.162743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:09.176686 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:09.177802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:09.179065 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:09.179065 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:09.179065 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:09.179065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 457/919] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:07:09.183540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:09.203202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:09.281090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9823cf-a20c-4b66-a086-2ad9967460f1 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:09.314684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:09.315306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:09.315576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:09.315841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:09.316472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:09.316802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:09.318196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:09.329790 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 463/920] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:09.335490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:09.351951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:09.432282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6bab5-85e7-4f2e-9c68-1951c00cf05f None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:09.465748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:09.466435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:09.466857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:09.469999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:09.473777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:09.475241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:07:09.486860 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:09.487844 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:09.488828 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 458/921] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:09.493864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:09.571217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:09.591646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf5d8e-667c-4d21-89a6-8c4f5d132165 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:09.624147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb83c20-2cc6-4799-8d06-880487319410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:09.624749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83c20-2cc6-4799-8d06-880487319410 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:09.625029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83c20-2cc6-4799-8d06-880487319410 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:09.625303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83c20-2cc6-4799-8d06-880487319410 None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:09.625994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb83c20-2cc6-4799-8d06-880487319410 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:09.626326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb83c20-2cc6-4799-8d06-880487319410 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:09.627734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb83c20-2cc6-4799-8d06-880487319410 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:09.639361 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 464/922] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:07:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:09.645478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:09.718421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:09.742480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29f8f-c2cc-4df1-b4b8-aa122871d971 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:09.775180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62e52-bc90-4db9-bf0f-11cc99dc8ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:09.775844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62e52-bc90-4db9-bf0f-11cc99dc8ba2 None admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:09.776182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62e52-bc90-4db9-bf0f-11cc99dc8ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:09.776464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62e52-bc90-4db9-bf0f-11cc99dc8ba2 None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/211feea67b824d5b8f77e491cc96a022/roles/b1a4be1bc731427ebb4d293cc0c66243` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:09.791886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d62e52-bc90-4db9-bf0f-11cc99dc8ba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=211feea67b824d5b8f77e491cc96a022, role_id=b1a4be1bc731427ebb4d293cc0c66243)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:09.797420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d62e52-bc90-4db9-bf0f-11cc99dc8ba2 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:09.899888 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 459/923] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:07:09 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/211feea67b824d5b8f77e491cc96a022/roles/b1a4be1bc731427ebb4d293cc0c66243 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:07:12.011760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3792048-185c-47e6-b147-44c4d12afe86 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:12.012311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3792048-185c-47e6-b147-44c4d12afe86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:12.012311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3792048-185c-47e6-b147-44c4d12afe86 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:12.014207 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 465/924] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:12.019538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d382ee-f535-4518-b48a-5f239d138f6d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:12.019918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d382ee-f535-4518-b48a-5f239d138f6d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:12.020077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d382ee-f535-4518-b48a-5f239d138f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:12.038365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-25d382ee-f535-4518-b48a-5f239d138f6d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:12.039526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-25d382ee-f535-4518-b48a-5f239d138f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:12.105037 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 460/925] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:12.371174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3792048-185c-47e6-b147-44c4d12afe86 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:12.471469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3792048-185c-47e6-b147-44c4d12afe86 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:12.504935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:12.505550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:12.505826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:12.506126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:12.512567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:12.516267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:07:12.520939 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:12.522007 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:12.522881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 466/926] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Oct 18 13:07:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:12.528186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d382ee-f535-4518-b48a-5f239d138f6d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:12.581790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:12.626132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d382ee-f535-4518-b48a-5f239d138f6d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:12.658582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:12.659178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:12.659457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:12.659728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:12.660388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:12.660692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:12.662091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:12.669690 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 461/927] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Oct 18 13:07:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:12.676151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:12.774939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421c03-4c95-45a2-a556-371a8fbcd698 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:12.807401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:12.808014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:12.808288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:12.808556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:12.818777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:12.820185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:12.834085 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:12.835298 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:12.842633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:12.842633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:12.842633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:12.842633 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 467/928] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:12.842917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:12.938429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298bd4b-1f68-4402-9595-37c8b9ed6df7 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:12.955679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:12.973988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:12.974666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:12.974943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:12.975212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:12.976167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:12.976530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:12.977885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:12.990182 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 462/929] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:07:12.995931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:13.051655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:13.101814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b99c99-5aa1-40b8-b671-659305cc0eb2 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:13.136727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:13.137354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:13.137633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:13.137902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:13.145575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:13.147039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:07:13.159609 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:13.162685 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:13.163712 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 468/930] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:13.166589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:13.266307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2877f-c9fa-4a7a-a29f-e198a51135f8 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:13.298861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:13.299472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:13.299750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:13.300026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:13.300745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:13.301052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:13.302508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:13.318861 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 463/931] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Oct 18 13:07:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:13.324676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:13.423056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3fb2-f42b-4491-9ccc-12b258315383 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:13.433101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:13.455970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:13.456600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:13.456880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:13.457155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:13.523793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:13.525165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:13.619874 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 469/932] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:07:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:13.626381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:13.660350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:13.723455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d86d8-de0a-4159-8878-a226ceee6ccd None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:13.757891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:13.758544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:13.758824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:13.759088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:13.769880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:13.771393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:13.789105 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:13.790251 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:13.791331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:13.791331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:13.791331 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:13.791331 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 464/933] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:13.792885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:13.804247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:13.890962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f60530-7d6d-4d52-9afa-6d25ebdd9598 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:13.924274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:13.924871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:13.925147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:13.925415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:13.926044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:13.926373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:13.927709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:13.939169 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 470/934] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:13.945044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:14.027727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:14.041822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7eff2-81a8-4fc1-a953-c3567a0ad5f1 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:14.074203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:14.074825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:14.075101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:14.075372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:14.081907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:14.083367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:07:14.094209 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:14.095396 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:14.096662 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 465/935] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:14.101623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:14.169533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:14.200192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6ebb-3c9b-4366-8acf-4ddd11c7b4c0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:14.237360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1ee1d-7186-4f5c-9624-fbc58123556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:14.237956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ee1d-7186-4f5c-9624-fbc58123556b None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:14.238256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ee1d-7186-4f5c-9624-fbc58123556b None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:14.238527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1ee1d-7186-4f5c-9624-fbc58123556b None admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:14.239252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ee1d-7186-4f5c-9624-fbc58123556b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:14.239551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ee1d-7186-4f5c-9624-fbc58123556b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:14.240952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1ee1d-7186-4f5c-9624-fbc58123556b None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:14.253384 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 471/936] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:14.259694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:14.359015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3fe99-93dd-470f-961b-fcacd4d0872e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:14.391088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be86b02-51a0-4ad6-9114-accfeb040e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:14.391685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86b02-51a0-4ad6-9114-accfeb040e41 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:14.392001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86b02-51a0-4ad6-9114-accfeb040e41 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:14.392276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be86b02-51a0-4ad6-9114-accfeb040e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:14.392987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be86b02-51a0-4ad6-9114-accfeb040e41 None admin] RBAC: Adding query filter params (role.id=b1a4be1bc731427ebb4d293cc0c66243, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=211feea67b824d5b8f77e491cc96a022) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:14.393295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be86b02-51a0-4ad6-9114-accfeb040e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:14.394757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be86b02-51a0-4ad6-9114-accfeb040e41 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:14.400404 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 466/937] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:07:14 2022] GET /identity/v3/role_assignments?user.id=211feea67b824d5b8f77e491cc96a022&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=b1a4be1bc731427ebb4d293cc0c66243 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:16.536213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d8e9-eb7e-4034-b367-1322a3ffe44b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:16.536779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d8e9-eb7e-4034-b367-1322a3ffe44b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:16.536779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d8e9-eb7e-4034-b367-1322a3ffe44b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:16.538117 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 472/938] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:16.543395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6fd1e-24b3-46e7-acf1-6f45183de98c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:16.543807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6fd1e-24b3-46e7-acf1-6f45183de98c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:16.543935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6fd1e-24b3-46e7-acf1-6f45183de98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:16.561828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-22b6fd1e-24b3-46e7-acf1-6f45183de98c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:16.563046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22b6fd1e-24b3-46e7-acf1-6f45183de98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:16.565806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:16.627577 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 467/939] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:16.896855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2d8e9-eb7e-4034-b367-1322a3ffe44b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:16.996133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2d8e9-eb7e-4034-b367-1322a3ffe44b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:17.023901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:17.029491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:17.030178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:17.030458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:17.030722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:17.040653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:07:17.045987 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:17.047093 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:17.047941 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 473/940] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:17.053149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6fd1e-24b3-46e7-acf1-6f45183de98c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:17.150405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6fd1e-24b3-46e7-acf1-6f45183de98c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:17.184341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:17.184943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:17.185239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:17.186072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:17.186737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:17.187066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:17.188414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:17.196585 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 468/941] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:17.202314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:17.299021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4004-3e09-4257-b3a7-275e55526562 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:17.331920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:17.348047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:17.348047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:17.348047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:17.348047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:17.348047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:17.359730 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:17.360825 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:17.361893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:17.361893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:17.361893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:17.361893 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 474/942] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:17.366608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:17.369473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:17.463467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cf61e-ec2a-443c-941e-54603b9887ad None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:17.497237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:17.497801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:17.498101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:17.508592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:17.508592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:17.508592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:17.508592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:17.512081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 469/943] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:17.517721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:17.560124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:17.615961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4298a9-375d-4c48-b18c-f38588267828 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:17.649240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:17.649869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:17.650186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:17.650456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:17.658212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:17.659626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:07:17.671058 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:17.673952 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:17.675208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 475/944] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:17.677943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:17.740382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:17.777138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc6347-0e68-435e-b5f0-4787f7974829 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:17.809551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:17.810217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:17.810493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:17.810762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:17.811469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:17.811784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:17.813178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:17.830444 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 470/945] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Oct 18 13:07:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:17.836489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:17.933549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f801808-d9e2-4b77-bf4a-db4678b3cab6 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:17.935066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:17.966092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:17.967310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:17.967594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:17.967871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:17.978247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:17.979669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:17.993284 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:17.994385 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:17.995288 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:17.995288 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:17.995288 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:17.995288 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 476/946] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:18.000515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:18.097287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062c4fd-4a82-433a-a159-9ac38e10a85d None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:18.117344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:18.131785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:18.132394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:18.132675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:18.132977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:18.133661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:18.133968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:18.135379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:18.146749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 471/947] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:18.152591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:18.252212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5b9ef-7216-4eba-8d76-a91f66d1c3ea None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:18.284913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:18.285526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:18.285802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:18.286092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:18.292560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:18.293966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:07:18.304996 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:18.305863 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:18.306907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 477/948] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:07:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:18.312686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:18.409884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62e48-f8c9-4ec0-9d6b-666f727ee449 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:18.441820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a408c1-b8a7-4704-9bd2-fd35063a238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:18.442447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a408c1-b8a7-4704-9bd2-fd35063a238b None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:18.442726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a408c1-b8a7-4704-9bd2-fd35063a238b None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:18.442997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a408c1-b8a7-4704-9bd2-fd35063a238b None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:18.443675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a408c1-b8a7-4704-9bd2-fd35063a238b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:18.443977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a408c1-b8a7-4704-9bd2-fd35063a238b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:18.445390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a408c1-b8a7-4704-9bd2-fd35063a238b None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:18.458569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 472/949] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:18.466272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:18.482988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:18.563664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a91e-ec70-4b8f-a577-646ee9b6a62e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:18.596319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60976-5419-4321-9483-b1dc96a7a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:18.596971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60976-5419-4321-9483-b1dc96a7a66d None admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:18.597249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60976-5419-4321-9483-b1dc96a7a66d None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:18.597523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60976-5419-4321-9483-b1dc96a7a66d None admin] PATH_INFO: `/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/211feea67b824d5b8f77e491cc96a022/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:18.599444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60976-5419-4321-9483-b1dc96a7a66d None admin] RBAC: Authorizing `identity:create_grant(project_id=57ddba45e6d543cb82195059710ea7d4, user_id=211feea67b824d5b8f77e491cc96a022, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:18.601119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60976-5419-4321-9483-b1dc96a7a66d None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:18.777520 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 478/950] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Oct 18 13:07:18 2022] PUT /identity/v3/projects/57ddba45e6d543cb82195059710ea7d4/users/211feea67b824d5b8f77e491cc96a022/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:07:20.909555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e806-4289-4848-b7ae-38e60d96d5f9 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:20.910136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e806-4289-4848-b7ae-38e60d96d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:20.910136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e806-4289-4848-b7ae-38e60d96d5f9 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:20.911472 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 473/951] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:20.916666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0669-faed-4720-9b26-de431ac7c7af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:20.917056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0669-faed-4720-9b26-de431ac7c7af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:20.917250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b0669-faed-4720-9b26-de431ac7c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:20.935209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-be1b0669-faed-4720-9b26-de431ac7c7af None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:20.936383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be1b0669-faed-4720-9b26-de431ac7c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:21.000872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 479/952] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:21.270606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e806-4289-4848-b7ae-38e60d96d5f9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:21.312299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:21.367390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e806-4289-4848-b7ae-38e60d96d5f9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:21.400289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:21.400906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:21.401183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:21.401452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:21.410988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 13:07:21.415652 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:21.416944 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:21.417873 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 474/953] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Oct 18 13:07:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:21.422684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b0669-faed-4720-9b26-de431ac7c7af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:21.425703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:21.520969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b0669-faed-4720-9b26-de431ac7c7af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:21.553997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:21.554618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:21.554898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:21.555162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:21.555815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:21.556120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:21.557453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:21.565872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 480/954] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Oct 18 13:07:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:21.571831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:21.665791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:21.668497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20486ea9-ba8a-4fcb-8c3e-49359a3d6fa0 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:21.700388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:21.701035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:21.701313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:21.701584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:21.711636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:21.713104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:21.727156 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:21.728160 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:21.736407 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:21.736407 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:21.736407 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:21.736407 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 475/955] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:21.736687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:21.798101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:21.833629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98cb5f-bf55-4246-857a-d23f6fd0b497 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:21.867150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:21.867751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:21.868026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:21.868294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:21.868927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:21.869317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:21.870712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:21.882093 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 481/956] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:21.887796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:21.985930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b36f-a4f7-4a73-a933-e5285f12ae59 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:22.019240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:22.019858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:22.020134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:22.020402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:22.027643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:22.029088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 13:07:22.039928 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:22.042457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:22.043602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 476/957] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:22.046872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:22.144446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080f4a7-914d-4276-bfa5-f8702827218e None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:22.169743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:22.177973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:22.178602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:22.178877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:22.179151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:22.179867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:22.180166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:22.181570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:22.198339 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 482/958] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Oct 18 13:07:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:22.204673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:22.219742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:22.300893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153f63d-08a9-45ee-9f1d-bc8485cfb419 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:22.333536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:22.334158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:22.334437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:22.334708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:22.399668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:22.401055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:22.414143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:22.497214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 477/959] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Oct 18 13:07:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:22.503652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:22.601524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e0fbf-3486-43e1-be93-276b7dacc2cf None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:22.634234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:22.634850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:22.635123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:22.635389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:22.645134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:22.646596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 13:07:22.661818 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:22.662803 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 13:07:22.664142 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:07:22.664142 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 13:07:22.664142 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:22.664142 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 483/960] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:22.668600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:22.772471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4c7cd-81e2-4ddb-a202-671613fdc2bb None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:22.786396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:22.806908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:22.807508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:22.807787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:22.808056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:22.808689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:22.808991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:22.810430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:22.820979 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 478/961] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Oct 18 13:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:22.826805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:22.862649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:22.926301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651c8f4-7b0f-4606-92f9-9fac1e8f19f4 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:22.958743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:22.959357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:22.959632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:22.959923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:22.966253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:22.968164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 13:07:22.979101 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:22.981732 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:07:22.983450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 484/962] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Oct 18 13:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:22.986639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:23.082649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae6d0e-c84e-4d71-a157-b750063d7015 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:23.115230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa5526-a5eb-46ba-b0ea-a3bc1863ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:23.115824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa5526-a5eb-46ba-b0ea-a3bc1863ae61 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:23.116104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa5526-a5eb-46ba-b0ea-a3bc1863ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:23.116397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa5526-a5eb-46ba-b0ea-a3bc1863ae61 None admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:23.117036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa5526-a5eb-46ba-b0ea-a3bc1863ae61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:23.117337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa5526-a5eb-46ba-b0ea-a3bc1863ae61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:23.118799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa5526-a5eb-46ba-b0ea-a3bc1863ae61 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:23.130427 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 479/963] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Oct 18 13:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:23.136594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:23.229004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:23.234611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09ee00-51fc-4efb-9a2b-4b04b98ebef0 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:23.266556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfae173-af6a-4b23-9d10-2016e5997e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:23.267162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfae173-af6a-4b23-9d10-2016e5997e48 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:23.267443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfae173-af6a-4b23-9d10-2016e5997e48 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:23.267716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfae173-af6a-4b23-9d10-2016e5997e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:23.268435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfae173-af6a-4b23-9d10-2016e5997e48 None admin] RBAC: Adding query filter params (role.id=6896c84ae1cb498793bc04c2699d3e70, scope.project.id=57ddba45e6d543cb82195059710ea7d4, user.id=211feea67b824d5b8f77e491cc96a022) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:23.268745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfae173-af6a-4b23-9d10-2016e5997e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:23.270197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfae173-af6a-4b23-9d10-2016e5997e48 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:23.275907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 485/964] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Oct 18 13:07:23 2022] GET /identity/v3/role_assignments?user.id=211feea67b824d5b8f77e491cc96a022&scope.project.id=57ddba45e6d543cb82195059710ea7d4&role.id=6896c84ae1cb498793bc04c2699d3e70 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:25.400278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73cf3-1804-4c96-ab58-08e3fa50cac0 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:25.400810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73cf3-1804-4c96-ab58-08e3fa50cac0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:25.400810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73cf3-1804-4c96-ab58-08e3fa50cac0 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:25.402162 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 480/965] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:25.407514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d488-ac47-41e6-a447-1d645e4b800b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:25.407945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d488-ac47-41e6-a447-1d645e4b800b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:25.408037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d488-ac47-41e6-a447-1d645e4b800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:25.426178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3df9d488-ac47-41e6-a447-1d645e4b800b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:25.427342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3df9d488-ac47-41e6-a447-1d645e4b800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:25.493412 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 486/966] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:25.759026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73cf3-1804-4c96-ab58-08e3fa50cac0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:25.789111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:25.855044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73cf3-1804-4c96-ab58-08e3fa50cac0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:25.887655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:25.888301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:25.888578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:25.888844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:25.889421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:25.890805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:25.899333 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:25.900564 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:25.901849 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 481/967] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:07:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:07:25.906928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9d488-ac47-41e6-a447-1d645e4b800b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:25.993891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:26.002815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9d488-ac47-41e6-a447-1d645e4b800b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:26.036196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84440f-150d-4a42-a8ee-b331e127354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:26.036736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84440f-150d-4a42-a8ee-b331e127354a None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:26.037017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84440f-150d-4a42-a8ee-b331e127354a None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:26.037283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84440f-150d-4a42-a8ee-b331e127354a None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:26.037900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84440f-150d-4a42-a8ee-b331e127354a None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:26.038228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84440f-150d-4a42-a8ee-b331e127354a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:26.039573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84440f-150d-4a42-a8ee-b331e127354a None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:26.044169 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 487/968] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Oct 18 13:07:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:26.049976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:26.141588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:26.147197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b960b-61e5-4026-a96a-3d9801eacd89 None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:26.180770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461c510-0343-408b-9694-cb7edab8b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:26.181488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c510-0343-408b-9694-cb7edab8b123 None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:26.182147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c510-0343-408b-9694-cb7edab8b123 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:26.182687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461c510-0343-408b-9694-cb7edab8b123 None admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:26.183353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461c510-0343-408b-9694-cb7edab8b123 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:26.183850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461c510-0343-408b-9694-cb7edab8b123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:26.185648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461c510-0343-408b-9694-cb7edab8b123 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:26.190486 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 482/969] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Oct 18 13:07:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:28.283839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb9f9-ed25-467b-a28c-66c50abc673a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:28.284392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb9f9-ed25-467b-a28c-66c50abc673a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:28.284392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb9f9-ed25-467b-a28c-66c50abc673a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:28.285713 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 488/970] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:28.290823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b255-0d0e-4be0-adcd-964ae8bbc4cf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:28.291188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b255-0d0e-4be0-adcd-964ae8bbc4cf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:28.291373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b255-0d0e-4be0-adcd-964ae8bbc4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:28.309534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0f03b255-0d0e-4be0-adcd-964ae8bbc4cf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:28.311326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f03b255-0d0e-4be0-adcd-964ae8bbc4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:28.375765 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 483/971] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:28.644807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bb9f9-ed25-467b-a28c-66c50abc673a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:28.743004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bb9f9-ed25-467b-a28c-66c50abc673a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:28.776404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629cf89-e0c8-4ae5-b44e-905f6cbdb6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:28.777007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629cf89-e0c8-4ae5-b44e-905f6cbdb6c4 None admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:28.777287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629cf89-e0c8-4ae5-b44e-905f6cbdb6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:28.777807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629cf89-e0c8-4ae5-b44e-905f6cbdb6c4 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:28.778216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629cf89-e0c8-4ae5-b44e-905f6cbdb6c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:28.779769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629cf89-e0c8-4ae5-b44e-905f6cbdb6c4 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:28.860393 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 489/972] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Oct 18 13:07:28 2022] POST /identity/v3/services => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:07:31.005468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7d7b-2aea-41b9-a7ea-7a24b512270e None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:31.006218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7d7b-2aea-41b9-a7ea-7a24b512270e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:31.006218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7d7b-2aea-41b9-a7ea-7a24b512270e None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:31.007371 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 484/973] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:31.013836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852bf38-2072-4b7b-bc83-c884b8e2b3f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:31.014328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852bf38-2072-4b7b-bc83-c884b8e2b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:31.016549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852bf38-2072-4b7b-bc83-c884b8e2b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:31.033474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1852bf38-2072-4b7b-bc83-c884b8e2b3f6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:31.034683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1852bf38-2072-4b7b-bc83-c884b8e2b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:31.044017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:31.108420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 490/974] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:31.371171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7d7b-2aea-41b9-a7ea-7a24b512270e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:31.459953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:31.470842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7d7b-2aea-41b9-a7ea-7a24b512270e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:31.504182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:31.504797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:31.505073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:31.505344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] PATH_INFO: `/v3/services/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:31.505913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:31.507309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:31.521355 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:31.522497 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:31.523385 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 485/975] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:07:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:07:31.524176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852bf38-2072-4b7b-bc83-c884b8e2b3f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:31.630268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852bf38-2072-4b7b-bc83-c884b8e2b3f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:31.667532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:31.668131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:31.668404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:31.668670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:31.669287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:31.669606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:31.673269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:31.685629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 491/976] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Oct 18 13:07:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:31.685845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:31.797681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd3fa7-bda7-493c-b737-e0fde1a5108e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:31.830762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c8b8-29cd-4816-b3fb-314c8427483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:31.831365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c8b8-29cd-4816-b3fb-314c8427483c None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:31.831649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c8b8-29cd-4816-b3fb-314c8427483c None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:31.831922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c8b8-29cd-4816-b3fb-314c8427483c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:31.832620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5c8b8-29cd-4816-b3fb-314c8427483c None admin] RBAC: Adding query filter params (interface=public, service_id=9f5fd89418ac44278b32781c43cf9b93, region_id=RegionOne) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:31.832930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5c8b8-29cd-4816-b3fb-314c8427483c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:31.834327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5c8b8-29cd-4816-b3fb-314c8427483c None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:31.839344 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 486/977] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Oct 18 13:07:31 2022] GET /identity/v3/endpoints?service_id=9f5fd89418ac44278b32781c43cf9b93&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:31.845161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:31.848976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:31.942762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d181-e6c3-405b-a26e-ecca6628ec75 None admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:31.976607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b1bbe-3d33-4116-9c15-c10a55221ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:31.977205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b1bbe-3d33-4116-9c15-c10a55221ec2 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:31.977479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b1bbe-3d33-4116-9c15-c10a55221ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:31.977746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b1bbe-3d33-4116-9c15-c10a55221ec2 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:31.978368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b1bbe-3d33-4116-9c15-c10a55221ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:31.979703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b1bbe-3d33-4116-9c15-c10a55221ec2 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:32.006148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 492/978] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Oct 18 13:07:31 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:07:34.128331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126d38-7492-41f2-bbe3-08b44be11478 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:34.128908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126d38-7492-41f2-bbe3-08b44be11478 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:34.128908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126d38-7492-41f2-bbe3-08b44be11478 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:34.130224 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 487/979] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:07:34.135307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a508b-bac9-4bab-ad24-c98b523407a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:34.135721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a508b-bac9-4bab-ad24-c98b523407a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:34.135860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a508b-bac9-4bab-ad24-c98b523407a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:34.154139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d38a508b-bac9-4bab-ad24-c98b523407a5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:07:34.155318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d38a508b-bac9-4bab-ad24-c98b523407a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:07:34.214923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:34.220178 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 493/980] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:07:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 13:07:34.484544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126d38-7492-41f2-bbe3-08b44be11478 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:34.504106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:34.585648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126d38-7492-41f2-bbe3-08b44be11478 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:34.619169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:34.619805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:34.620201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:34.620480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] PATH_INFO: `/v3/services/placement` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:34.621061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:34.622461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:07:34.631190 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:07:34.634310 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:07:34.635372 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 488/981] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Oct 18 13:07:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:07:34.638279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a508b-bac9-4bab-ad24-c98b523407a5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:34.734443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a508b-bac9-4bab-ad24-c98b523407a5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:34.766800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0461cc0-7ee4-440b-857d-1a3fece9f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:34.767409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461cc0-7ee4-440b-857d-1a3fece9f457 None admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:34.767691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461cc0-7ee4-440b-857d-1a3fece9f457 None admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:34.767962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461cc0-7ee4-440b-857d-1a3fece9f457 None admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:34.768590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0461cc0-7ee4-440b-857d-1a3fece9f457 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:07:34.768895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0461cc0-7ee4-440b-857d-1a3fece9f457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:34.770283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0461cc0-7ee4-440b-857d-1a3fece9f457 None admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:34.775463 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 494/982] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Oct 18 13:07:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:07:34.781717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:07:34.867046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:34.884396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ae239-44dd-476e-9b87-f8a947eb2c7e None admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:07:34.917465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468141b-33fa-4f71-bc28-ac663a299eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:07:34.918086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468141b-33fa-4f71-bc28-ac663a299eb1 None admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:07:34.918369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468141b-33fa-4f71-bc28-ac663a299eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:07:34.918640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468141b-33fa-4f71-bc28-ac663a299eb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:07:34.919984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468141b-33fa-4f71-bc28-ac663a299eb1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:07:34.921388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468141b-33fa-4f71-bc28-ac663a299eb1 None admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:07:34.991478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 489/983] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:07:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:07:44.772458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=69 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:44.986948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:31.319418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0872-c487-4b68-bd59-54b1531cf3f1 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:31.319954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0872-c487-4b68-bd59-54b1531cf3f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:31.319954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0872-c487-4b68-bd59-54b1531cf3f1 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:31.322159 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 495/984] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:31.327184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56450-80cb-4db3-b14b-912bdeebb8aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:31.327620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56450-80cb-4db3-b14b-912bdeebb8aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:31.327802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56450-80cb-4db3-b14b-912bdeebb8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:31.506197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c6d56450-80cb-4db3-b14b-912bdeebb8aa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:31.507853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6d56450-80cb-4db3-b14b-912bdeebb8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:31.665067 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 490/985] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:31.980684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838aa65-5713-40c3-8159-725d66cdf060 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:31.981726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838aa65-5713-40c3-8159-725d66cdf060 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:31.982492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838aa65-5713-40c3-8159-725d66cdf060 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:31.984288 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 496/986] 10.222.0.27 () {54 vars in 964 bytes} [Tue Oct 18 13:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:31.990171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652126a6-3556-46fb-b973-4068ced04808 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:31.990460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652126a6-3556-46fb-b973-4068ced04808 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:31.990748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652126a6-3556-46fb-b973-4068ced04808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:32.082806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-652126a6-3556-46fb-b973-4068ced04808 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:32.083927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-652126a6-3556-46fb-b973-4068ced04808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:32.107799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:32.181526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838aa65-5713-40c3-8159-725d66cdf060 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:32.183640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1838aa65-5713-40c3-8159-725d66cdf060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:32.188620 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 491/987] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Oct 18 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:32.319917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838aa65-5713-40c3-8159-725d66cdf060 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:32.410189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ebcc6-38bf-4cd2-bc61-1d1e7a605e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:32.410807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ebcc6-38bf-4cd2-bc61-1d1e7a605e83 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:32.411087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ebcc6-38bf-4cd2-bc61-1d1e7a605e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:32.411367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ebcc6-38bf-4cd2-bc61-1d1e7a605e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:32.412988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-604ebcc6-38bf-4cd2-bc61-1d1e7a605e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:32.483094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:32.543532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ebcc6-38bf-4cd2-bc61-1d1e7a605e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:32.545183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ebcc6-38bf-4cd2-bc61-1d1e7a605e83 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:32.566200 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 497/988] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:13:35.020662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1bcc-b56b-457e-8689-885a92062848 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:35.021190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1bcc-b56b-457e-8689-885a92062848 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:35.021190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1bcc-b56b-457e-8689-885a92062848 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:35.022596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 492/989] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:35.028322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166a96-ade1-4a66-bd97-cd481cc917af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:35.028718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166a96-ade1-4a66-bd97-cd481cc917af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:35.028906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166a96-ade1-4a66-bd97-cd481cc917af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:35.110328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06166a96-ade1-4a66-bd97-cd481cc917af None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:35.111543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06166a96-ade1-4a66-bd97-cd481cc917af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:35.207504 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 498/990] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:35.488153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1bcc-b56b-457e-8689-885a92062848 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:35.489701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-04fe1bcc-b56b-457e-8689-885a92062848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:35.592875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1bcc-b56b-457e-8689-885a92062848 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:35.663128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:35.665931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d6abd-1d40-41b7-8b76-cda6360ae1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:35.666562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6abd-1d40-41b7-8b76-cda6360ae1db service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:35.666840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6abd-1d40-41b7-8b76-cda6360ae1db service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:35.667113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6abd-1d40-41b7-8b76-cda6360ae1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:35.668703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-701d6abd-1d40-41b7-8b76-cda6360ae1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:35.774234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d6abd-1d40-41b7-8b76-cda6360ae1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:35.775595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d6abd-1d40-41b7-8b76-cda6360ae1db service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:35.793396 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 493/991] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:13:38.462442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f3e2-3ef5-47f9-80d9-1d435e39c60b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:38.462879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f3e2-3ef5-47f9-80d9-1d435e39c60b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:38.462993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12f3e2-3ef5-47f9-80d9-1d435e39c60b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:38.464353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 499/992] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:38.469693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac7f39-fa40-45a2-bed6-6b32b5240388 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:38.470241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac7f39-fa40-45a2-bed6-6b32b5240388 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:38.470398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac7f39-fa40-45a2-bed6-6b32b5240388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:38.534612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5cac7f39-fa40-45a2-bed6-6b32b5240388 None None] MFA Rules not processed for user `effd4496ae734b3eaec9441f0ab77050`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:38.535798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cac7f39-fa40-45a2-bed6-6b32b5240388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:38.587840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:38.631065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 494/993] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:38.914749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12f3e2-3ef5-47f9-80d9-1d435e39c60b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:38.916798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a12f3e2-3ef5-47f9-80d9-1d435e39c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:38.928635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:39.020000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12f3e2-3ef5-47f9-80d9-1d435e39c60b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:39.090852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434bb36-cde9-4d29-86a2-43bfd281c965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:39.091445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434bb36-cde9-4d29-86a2-43bfd281c965 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:39.091719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434bb36-cde9-4d29-86a2-43bfd281c965 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:39.091987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434bb36-cde9-4d29-86a2-43bfd281c965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:39.093558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1434bb36-cde9-4d29-86a2-43bfd281c965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:39.154049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:39.199911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434bb36-cde9-4d29-86a2-43bfd281c965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:39.201263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434bb36-cde9-4d29-86a2-43bfd281c965 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:39.219273 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 500/994] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:13:42.178536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd792c50-e488-4f6d-b2ba-0024ab3d2197 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:42.179099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd792c50-e488-4f6d-b2ba-0024ab3d2197 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:42.179099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd792c50-e488-4f6d-b2ba-0024ab3d2197 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:42.180419 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 495/995] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:42.186300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6e481-293e-4ebc-b5ce-e19d1dc58ebd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:42.186684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6e481-293e-4ebc-b5ce-e19d1dc58ebd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:42.186864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6e481-293e-4ebc-b5ce-e19d1dc58ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:42.252038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4cb6e481-293e-4ebc-b5ce-e19d1dc58ebd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:42.253240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cb6e481-293e-4ebc-b5ce-e19d1dc58ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:42.346837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 501/996] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:42.629170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd792c50-e488-4f6d-b2ba-0024ab3d2197 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:42.630778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd792c50-e488-4f6d-b2ba-0024ab3d2197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:42.732967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd792c50-e488-4f6d-b2ba-0024ab3d2197 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:42.805020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862a096-40b8-474f-87ce-87b24c8d594f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:42.805620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862a096-40b8-474f-87ce-87b24c8d594f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:42.805899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862a096-40b8-474f-87ce-87b24c8d594f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:42.806203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862a096-40b8-474f-87ce-87b24c8d594f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:42.807787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4862a096-40b8-474f-87ce-87b24c8d594f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:42.814487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:42.912817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862a096-40b8-474f-87ce-87b24c8d594f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:42.914275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862a096-40b8-474f-87ce-87b24c8d594f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:42.932301 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 496/997] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:13:46.026068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c10ef-eedb-4a44-a925-bb12e8b2b057 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:46.026633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c10ef-eedb-4a44-a925-bb12e8b2b057 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:46.026633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c10ef-eedb-4a44-a925-bb12e8b2b057 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:46.027969 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 502/998] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:46.033120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71c96f-ac86-4bab-b0a5-b448d68da97f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:46.033571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71c96f-ac86-4bab-b0a5-b448d68da97f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:46.033799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71c96f-ac86-4bab-b0a5-b448d68da97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:46.101205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc71c96f-ac86-4bab-b0a5-b448d68da97f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:46.102457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc71c96f-ac86-4bab-b0a5-b448d68da97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:46.169258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:46.211019 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 497/999] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:46.497580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c10ef-eedb-4a44-a925-bb12e8b2b057 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:46.499222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-506c10ef-eedb-4a44-a925-bb12e8b2b057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:46.519882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:46.604476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c10ef-eedb-4a44-a925-bb12e8b2b057 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:46.676991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36818546-9716-411f-8025-099b1d09eeaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:46.677591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818546-9716-411f-8025-099b1d09eeaa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:46.677870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818546-9716-411f-8025-099b1d09eeaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:46.678176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36818546-9716-411f-8025-099b1d09eeaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:46.679759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36818546-9716-411f-8025-099b1d09eeaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:46.750198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:46.786556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36818546-9716-411f-8025-099b1d09eeaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:46.788001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36818546-9716-411f-8025-099b1d09eeaa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:46.805497 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 503/1000] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:13:48.985270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ba25-2185-4280-9eec-1400c5226d69 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:48.985787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ba25-2185-4280-9eec-1400c5226d69 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:48.985787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224ba25-2185-4280-9eec-1400c5226d69 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:48.987592 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 498/1001] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:48.993297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa01578-4a2d-4283-865e-5a82364c77ab None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:48.993832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa01578-4a2d-4283-865e-5a82364c77ab None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:48.993832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa01578-4a2d-4283-865e-5a82364c77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:49.060079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3fa01578-4a2d-4283-865e-5a82364c77ab None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:49.061271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fa01578-4a2d-4283-865e-5a82364c77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:49.156826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 504/1002] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:49.436298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224ba25-2185-4280-9eec-1400c5226d69 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:49.437915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5224ba25-2185-4280-9eec-1400c5226d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:49.545003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224ba25-2185-4280-9eec-1400c5226d69 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:49.618780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359e6bf-d80d-4319-8b64-239c2992a23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:49.619960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359e6bf-d80d-4319-8b64-239c2992a23c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:49.620237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359e6bf-d80d-4319-8b64-239c2992a23c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:49.620510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359e6bf-d80d-4319-8b64-239c2992a23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:49.622142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b359e6bf-d80d-4319-8b64-239c2992a23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:49.640438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:49.734242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359e6bf-d80d-4319-8b64-239c2992a23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:49.735633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359e6bf-d80d-4319-8b64-239c2992a23c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:49.753925 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 499/1003] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:13:51.942772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653461a6-75ca-432f-ba41-381542a3b5fb None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:51.943300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653461a6-75ca-432f-ba41-381542a3b5fb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:51.943300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653461a6-75ca-432f-ba41-381542a3b5fb None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:51.944685 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 505/1004] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:51.949879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9379-e829-4ec7-b9dd-47d0d1d96de5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:51.950306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9379-e829-4ec7-b9dd-47d0d1d96de5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:51.950457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f9379-e829-4ec7-b9dd-47d0d1d96de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:52.019859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-079f9379-e829-4ec7-b9dd-47d0d1d96de5 None None] MFA Rules not processed for user `effd4496ae734b3eaec9441f0ab77050`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:52.021070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-079f9379-e829-4ec7-b9dd-47d0d1d96de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:52.086877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:52.118897 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 500/1005] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:52.402597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653461a6-75ca-432f-ba41-381542a3b5fb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:52.404463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-653461a6-75ca-432f-ba41-381542a3b5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:52.436999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:52.519343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653461a6-75ca-432f-ba41-381542a3b5fb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:52.596649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6664a-3581-4dde-bc61-fd0e87f95283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:52.597256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6664a-3581-4dde-bc61-fd0e87f95283 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:52.597532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6664a-3581-4dde-bc61-fd0e87f95283 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:52.597801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6664a-3581-4dde-bc61-fd0e87f95283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:52.599419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89c6664a-3581-4dde-bc61-fd0e87f95283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:52.675849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:52.708541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6664a-3581-4dde-bc61-fd0e87f95283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:52.709958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6664a-3581-4dde-bc61-fd0e87f95283 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:52.728866 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 506/1006] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:13:55.282742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddb4c7-3fa0-4d37-bfdc-a45a1ba046bb None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:55.283243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddb4c7-3fa0-4d37-bfdc-a45a1ba046bb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:55.283243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddb4c7-3fa0-4d37-bfdc-a45a1ba046bb None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:55.284540 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 501/1007] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:55.289938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e82f-7129-4377-80de-1a912bd17e3b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:55.290453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e82f-7129-4377-80de-1a912bd17e3b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:55.290545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e82f-7129-4377-80de-1a912bd17e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:55.356018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0140e82f-7129-4377-80de-1a912bd17e3b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:55.357465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0140e82f-7129-4377-80de-1a912bd17e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:55.451728 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 507/1008] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:55.736668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddb4c7-3fa0-4d37-bfdc-a45a1ba046bb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:55.738274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2dddb4c7-3fa0-4d37-bfdc-a45a1ba046bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:55.841327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddb4c7-3fa0-4d37-bfdc-a45a1ba046bb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:55.912782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750870ad-a1a8-48b1-b4d7-d88997ea3652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:55.913379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750870ad-a1a8-48b1-b4d7-d88997ea3652 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:55.913654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750870ad-a1a8-48b1-b4d7-d88997ea3652 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:55.913923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750870ad-a1a8-48b1-b4d7-d88997ea3652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:55.915536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-750870ad-a1a8-48b1-b4d7-d88997ea3652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:55.941477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:56.021090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750870ad-a1a8-48b1-b4d7-d88997ea3652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:56.022492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750870ad-a1a8-48b1-b4d7-d88997ea3652 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:56.047021 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 502/1009] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:13:58.237059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c2b6-e26a-4a56-919d-f47b2d746c69 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:58.237674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c2b6-e26a-4a56-919d-f47b2d746c69 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:58.237674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c2b6-e26a-4a56-919d-f47b2d746c69 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:58.239029 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 508/1010] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:13:58.244573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c669bc5-079c-4b12-952e-7aeea277f5fa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:58.245004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c669bc5-079c-4b12-952e-7aeea277f5fa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:58.245142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c669bc5-079c-4b12-952e-7aeea277f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:58.315827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7c669bc5-079c-4b12-952e-7aeea277f5fa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:13:58.317330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c669bc5-079c-4b12-952e-7aeea277f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:58.393982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:58.416757 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 503/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:13:58.705844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c2b6-e26a-4a56-919d-f47b2d746c69 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:13:58.707447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d422c2b6-e26a-4a56-919d-f47b2d746c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:58.747008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:58.809494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c2b6-e26a-4a56-919d-f47b2d746c69 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:13:58.882390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863fb40-df34-4d8c-9e6b-187d2478d5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:13:58.882973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863fb40-df34-4d8c-9e6b-187d2478d5ef service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:13:58.883250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863fb40-df34-4d8c-9e6b-187d2478d5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:13:58.883519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863fb40-df34-4d8c-9e6b-187d2478d5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:13:58.885095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0863fb40-df34-4d8c-9e6b-187d2478d5ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:13:58.965410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:13:58.991919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863fb40-df34-4d8c-9e6b-187d2478d5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:13:58.993349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863fb40-df34-4d8c-9e6b-187d2478d5ef service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:13:59.012665 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 509/1012] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:01.718509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b605-6267-4cc0-bbf8-c2e6981f58cb None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:01.719059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b605-6267-4cc0-bbf8-c2e6981f58cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:01.719059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b605-6267-4cc0-bbf8-c2e6981f58cb None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:01.720640 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 504/1013] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:01.725688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45cae-12a7-4fd5-9dd1-a468d64bfef5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:01.726160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45cae-12a7-4fd5-9dd1-a468d64bfef5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:01.726261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45cae-12a7-4fd5-9dd1-a468d64bfef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:01.792318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-18d45cae-12a7-4fd5-9dd1-a468d64bfef5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:01.793513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18d45cae-12a7-4fd5-9dd1-a468d64bfef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:01.888873 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 510/1014] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:02.183867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70b84-57be-4998-8fcd-1899e880592f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:02.184150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70b84-57be-4998-8fcd-1899e880592f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:02.184425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70b84-57be-4998-8fcd-1899e880592f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:02.185755 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 505/1015] 10.222.0.27 () {54 vars in 964 bytes} [Tue Oct 18 13:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:02.191606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072c498-6b7e-452e-b7e0-c9e99a530306 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:02.191894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072c498-6b7e-452e-b7e0-c9e99a530306 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:02.192168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072c498-6b7e-452e-b7e0-c9e99a530306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:02.247236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:02.268586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4072c498-6b7e-452e-b7e0-c9e99a530306 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:02.269784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4072c498-6b7e-452e-b7e0-c9e99a530306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:02.344831 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 511/1016] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Oct 18 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:14:02.353925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70b84-57be-4998-8fcd-1899e880592f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:02.355469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-97d70b84-57be-4998-8fcd-1899e880592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:02.457143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70b84-57be-4998-8fcd-1899e880592f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:02.529398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461466b0-05f8-41e1-b087-10cc71c0f396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:02.538800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461466b0-05f8-41e1-b087-10cc71c0f396 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:02.538800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461466b0-05f8-41e1-b087-10cc71c0f396 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:02.538800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461466b0-05f8-41e1-b087-10cc71c0f396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:02.538800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-461466b0-05f8-41e1-b087-10cc71c0f396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:02.567454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:02.640510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461466b0-05f8-41e1-b087-10cc71c0f396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:02.641968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461466b0-05f8-41e1-b087-10cc71c0f396 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:02.660140 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 506/1017] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:07.586141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016425c2-759e-4cdc-9037-f87687f33778 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:07.586718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016425c2-759e-4cdc-9037-f87687f33778 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:07.586718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016425c2-759e-4cdc-9037-f87687f33778 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:07.588550 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 512/1018] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:07.593935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be255a6-b956-420d-89f9-263d379448d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:07.594372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be255a6-b956-420d-89f9-263d379448d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:07.594560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be255a6-b956-420d-89f9-263d379448d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:07.662752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0be255a6-b956-420d-89f9-263d379448d0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:07.664239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0be255a6-b956-420d-89f9-263d379448d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:07.749977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:07.760809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 507/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:08.042277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016425c2-759e-4cdc-9037-f87687f33778 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:08.043935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-016425c2-759e-4cdc-9037-f87687f33778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:08.156817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016425c2-759e-4cdc-9037-f87687f33778 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:08.194345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:08.229475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab75c41-1d64-449a-84ed-50357b1426e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:08.230097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75c41-1d64-449a-84ed-50357b1426e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:08.230376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75c41-1d64-449a-84ed-50357b1426e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:08.230645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75c41-1d64-449a-84ed-50357b1426e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:08.232213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ab75c41-1d64-449a-84ed-50357b1426e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:08.341249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75c41-1d64-449a-84ed-50357b1426e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:08.342622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75c41-1d64-449a-84ed-50357b1426e6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:08.360360 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 513/1020] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:11.437734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e2dd-9511-4c3a-b15d-7c73515b2f20 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:11.438314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e2dd-9511-4c3a-b15d-7c73515b2f20 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:11.438314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e2dd-9511-4c3a-b15d-7c73515b2f20 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:11.439783 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 508/1021] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:11.444726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44abbb1-f257-498d-af20-f172fc5f0701 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:11.445129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44abbb1-f257-498d-af20-f172fc5f0701 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:11.445275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44abbb1-f257-498d-af20-f172fc5f0701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:11.515629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c44abbb1-f257-498d-af20-f172fc5f0701 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:11.516926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c44abbb1-f257-498d-af20-f172fc5f0701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:11.537813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:11.617731 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 514/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:11.903385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313e2dd-9511-4c3a-b15d-7c73515b2f20 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:11.904988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9313e2dd-9511-4c3a-b15d-7c73515b2f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:12.009637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313e2dd-9511-4c3a-b15d-7c73515b2f20 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:12.084590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ae49-15d2-4bbf-ad88-b3cc85c17baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:12.085187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ae49-15d2-4bbf-ad88-b3cc85c17baa service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:12.085463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ae49-15d2-4bbf-ad88-b3cc85c17baa service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:12.085731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ae49-15d2-4bbf-ad88-b3cc85c17baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:12.087375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbc1ae49-15d2-4bbf-ad88-b3cc85c17baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:12.140344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:12.222140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ae49-15d2-4bbf-ad88-b3cc85c17baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:12.223576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ae49-15d2-4bbf-ad88-b3cc85c17baa service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:12.241763 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 509/1023] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:16.464074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988fec-3e3d-4f4b-93be-d15559fb5b99 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:16.464616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988fec-3e3d-4f4b-93be-d15559fb5b99 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:16.464616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988fec-3e3d-4f4b-93be-d15559fb5b99 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:16.466151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 515/1024] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:16.471542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad810d3b-6bc3-48a3-b641-2c2a972ab673 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:16.472004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad810d3b-6bc3-48a3-b641-2c2a972ab673 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:16.472109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad810d3b-6bc3-48a3-b641-2c2a972ab673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:16.543483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ad810d3b-6bc3-48a3-b641-2c2a972ab673 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:16.543483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad810d3b-6bc3-48a3-b641-2c2a972ab673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:16.640695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:16.646083 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 510/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:16.923254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988fec-3e3d-4f4b-93be-d15559fb5b99 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:16.924787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4988fec-3e3d-4f4b-93be-d15559fb5b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:17.031000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988fec-3e3d-4f4b-93be-d15559fb5b99 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:17.080617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:17.107389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db426b9b-16b9-486f-9668-3cc13d4b2e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:17.108279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db426b9b-16b9-486f-9668-3cc13d4b2e59 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:17.108577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db426b9b-16b9-486f-9668-3cc13d4b2e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:17.108847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db426b9b-16b9-486f-9668-3cc13d4b2e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:17.110440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db426b9b-16b9-486f-9668-3cc13d4b2e59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:17.221876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db426b9b-16b9-486f-9668-3cc13d4b2e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:17.223353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db426b9b-16b9-486f-9668-3cc13d4b2e59 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:17.242553 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 516/1026] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:22.151842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e5f8-a3e4-46a9-84a3-e7e554e3ebfc None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:22.152707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e5f8-a3e4-46a9-84a3-e7e554e3ebfc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:22.152988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03e5f8-a3e4-46a9-84a3-e7e554e3ebfc None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:22.154768 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 511/1027] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:14:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:22.160009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6cfc0-b003-4f77-9e1e-d8cf03286914 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:22.160444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6cfc0-b003-4f77-9e1e-d8cf03286914 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:22.162340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6cfc0-b003-4f77-9e1e-d8cf03286914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:22.270329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dfa6cfc0-b003-4f77-9e1e-d8cf03286914 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:22.271855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dfa6cfc0-b003-4f77-9e1e-d8cf03286914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:22.292490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:22.419699 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 517/1028] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:26.634179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775892c-f78b-47f4-a172-3296633e90d1 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:26.634716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775892c-f78b-47f4-a172-3296633e90d1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:26.634716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775892c-f78b-47f4-a172-3296633e90d1 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:26.636069 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 512/1029] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:26.641210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9978b-8681-49bf-b9a3-e8fa08e24d1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:26.641734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9978b-8681-49bf-b9a3-e8fa08e24d1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:26.641854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9978b-8681-49bf-b9a3-e8fa08e24d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:26.723270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-efc9978b-8681-49bf-b9a3-e8fa08e24d1e None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:26.724479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efc9978b-8681-49bf-b9a3-e8fa08e24d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:26.799114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:26.835828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 518/1030] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:28.172334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cb88-161d-466a-9c00-88f1c01c0b6a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:28.172849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cb88-161d-466a-9c00-88f1c01c0b6a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:28.172943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cb88-161d-466a-9c00-88f1c01c0b6a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:28.174445 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 513/1031] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:14:28.179266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c88f-d021-4142-8ad4-e13c2ccfa123 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:28.179697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c88f-d021-4142-8ad4-e13c2ccfa123 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:28.179829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0c88f-d021-4142-8ad4-e13c2ccfa123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:28.258203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13e0c88f-d021-4142-8ad4-e13c2ccfa123 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:28.260104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13e0c88f-d021-4142-8ad4-e13c2ccfa123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:28.373217 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 519/1032] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:14:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:14:31.930316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c223-563a-42c5-8104-f1984349068f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:31.931042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c223-563a-42c5-8104-f1984349068f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:31.931042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c223-563a-42c5-8104-f1984349068f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:31.932360 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 514/1033] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:31.937791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec374-ebe6-49a6-bad7-22fc4331f514 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:31.938621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec374-ebe6-49a6-bad7-22fc4331f514 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:31.939053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec374-ebe6-49a6-bad7-22fc4331f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:31.984082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:32.031686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7c0ec374-ebe6-49a6-bad7-22fc4331f514 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:32.032812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c0ec374-ebe6-49a6-bad7-22fc4331f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:32.138294 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 520/1034] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:32.446809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f0fb8-4276-44e7-86e9-d12481960844 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:32.447302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f0fb8-4276-44e7-86e9-d12481960844 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:32.447746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f0fb8-4276-44e7-86e9-d12481960844 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:32.449514 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 515/1035] 10.222.0.27 () {54 vars in 961 bytes} [Tue Oct 18 13:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:32.461759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ef3c-c750-4f9b-8176-27ce3df72684 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:32.464020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ef3c-c750-4f9b-8176-27ce3df72684 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:32.464432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ef3c-c750-4f9b-8176-27ce3df72684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:32.554572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d95ef3c-c750-4f9b-8176-27ce3df72684 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:32.555834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d95ef3c-c750-4f9b-8176-27ce3df72684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:32.610073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:32.684104 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 521/1036] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:32.691809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f0fb8-4276-44e7-86e9-d12481960844 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:32.693344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ff5f0fb8-4276-44e7-86e9-d12481960844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:32.850277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f0fb8-4276-44e7-86e9-d12481960844 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:32.927272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:32.968636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e0cfc-934f-49b0-af42-76a234eca1a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:32.969288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e0cfc-934f-49b0-af42-76a234eca1a6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:32.969522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e0cfc-934f-49b0-af42-76a234eca1a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:32.969732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e0cfc-934f-49b0-af42-76a234eca1a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:32.971358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba0e0cfc-934f-49b0-af42-76a234eca1a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:33.064430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e0cfc-934f-49b0-af42-76a234eca1a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:33.066024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e0cfc-934f-49b0-af42-76a234eca1a6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:33.084396 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 516/1037] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:35.440174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad465c-5213-4ec5-a96c-7ad9abc5ae71 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:35.440595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad465c-5213-4ec5-a96c-7ad9abc5ae71 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:35.440679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad465c-5213-4ec5-a96c-7ad9abc5ae71 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:35.442013 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 522/1038] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:35.447902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e40f0-eaaa-419f-9f21-9fd9b6a92de8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:35.448299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e40f0-eaaa-419f-9f21-9fd9b6a92de8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:35.448453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e40f0-eaaa-419f-9f21-9fd9b6a92de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:35.521817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f66e40f0-eaaa-419f-9f21-9fd9b6a92de8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:35.523069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f66e40f0-eaaa-419f-9f21-9fd9b6a92de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:35.563275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:35.646224 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 517/1039] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:14:35.933946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad465c-5213-4ec5-a96c-7ad9abc5ae71 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:35.935602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02ad465c-5213-4ec5-a96c-7ad9abc5ae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:36.103181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad465c-5213-4ec5-a96c-7ad9abc5ae71 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:36.115160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:36.240204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ee92-2554-4537-8a87-564ae94c956b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:36.240931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ee92-2554-4537-8a87-564ae94c956b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:36.241272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ee92-2554-4537-8a87-564ae94c956b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:36.241606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ee92-2554-4537-8a87-564ae94c956b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:36.244089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b698ee92-2554-4537-8a87-564ae94c956b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:36.354910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ee92-2554-4537-8a87-564ae94c956b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:36.358567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ee92-2554-4537-8a87-564ae94c956b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:36.380399 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 523/1040] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:38.975147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21955c20-2b51-47d0-b233-cebe8b031566 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:38.975658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21955c20-2b51-47d0-b233-cebe8b031566 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:38.975658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21955c20-2b51-47d0-b233-cebe8b031566 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:38.976937 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 518/1041] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:38.982373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f29fc3-1fd9-4500-8437-628f55bed854 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:38.983050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f29fc3-1fd9-4500-8437-628f55bed854 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:38.983181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f29fc3-1fd9-4500-8437-628f55bed854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:38.999546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:39.054820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1f29fc3-1fd9-4500-8437-628f55bed854 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:39.056561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1f29fc3-1fd9-4500-8437-628f55bed854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:39.174036 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 524/1042] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:39.488951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6dc4-c85b-4742-bb58-ee9592290daf None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:39.489515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6dc4-c85b-4742-bb58-ee9592290daf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:39.489975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6dc4-c85b-4742-bb58-ee9592290daf None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:39.491388 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 519/1043] 10.222.0.27 () {54 vars in 961 bytes} [Tue Oct 18 13:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:39.498780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8aea-6aa8-4348-8139-aa53e4d9a355 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:39.499687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8aea-6aa8-4348-8139-aa53e4d9a355 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:39.500232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca8aea-6aa8-4348-8139-aa53e4d9a355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:39.592348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8ca8aea-6aa8-4348-8139-aa53e4d9a355 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:39.594233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8ca8aea-6aa8-4348-8139-aa53e4d9a355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:39.649442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:39.772332 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 525/1044] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:39.782173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6dc4-c85b-4742-bb58-ee9592290daf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:39.785190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-08ed6dc4-c85b-4742-bb58-ee9592290daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:39.992183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6dc4-c85b-4742-bb58-ee9592290daf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:40.013607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:40.150816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f925b-a73e-4868-8fe8-39d5e37d015f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:40.152100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f925b-a73e-4868-8fe8-39d5e37d015f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:40.152444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f925b-a73e-4868-8fe8-39d5e37d015f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:40.152724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f925b-a73e-4868-8fe8-39d5e37d015f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:40.155346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a1f925b-a73e-4868-8fe8-39d5e37d015f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:40.267107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f925b-a73e-4868-8fe8-39d5e37d015f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:40.268908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f925b-a73e-4868-8fe8-39d5e37d015f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:40.293502 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 520/1045] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:43.048364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139e91-5380-4185-b8e7-965a40a72cac None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:43.049406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139e91-5380-4185-b8e7-965a40a72cac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:43.049846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139e91-5380-4185-b8e7-965a40a72cac None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:43.058013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783259-e7fc-4f5d-b510-9db6dc114016 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:43.058459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783259-e7fc-4f5d-b510-9db6dc114016 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:43.058636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783259-e7fc-4f5d-b510-9db6dc114016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:43.059014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 526/1046] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:43.091443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:43.133285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a2783259-e7fc-4f5d-b510-9db6dc114016 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:43.134617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a2783259-e7fc-4f5d-b510-9db6dc114016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:43.235420 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 521/1047] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:43.560077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139e91-5380-4185-b8e7-965a40a72cac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:43.561544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6139e91-5380-4185-b8e7-965a40a72cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:43.735362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:43.741080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139e91-5380-4185-b8e7-965a40a72cac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:43.875161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce87d07-9efb-4908-9633-dd465a09c39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:43.876074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87d07-9efb-4908-9633-dd465a09c39d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:43.876350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87d07-9efb-4908-9633-dd465a09c39d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:43.876621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce87d07-9efb-4908-9633-dd465a09c39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:43.878313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cce87d07-9efb-4908-9633-dd465a09c39d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:43.979889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87d07-9efb-4908-9633-dd465a09c39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:43.981477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce87d07-9efb-4908-9633-dd465a09c39d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:43.997976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:44.001706 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 527/1048] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:44.053164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f6f7-4267-4cca-af20-934ed874f61a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:44.053450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f6f7-4267-4cca-af20-934ed874f61a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:44.053729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f6f7-4267-4cca-af20-934ed874f61a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:44.055325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 522/1049] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:44.060871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9faa-a00f-488f-8901-f15036e2835a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:44.061311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9faa-a00f-488f-8901-f15036e2835a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:44.061431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9faa-a00f-488f-8901-f15036e2835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:44.135398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa2a9faa-a00f-488f-8901-f15036e2835a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:44.136619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa2a9faa-a00f-488f-8901-f15036e2835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:44.249080 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 528/1050] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:14:44.596701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd3f2-6100-4759-90ba-19ca6c5b0346 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:44.596701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd3f2-6100-4759-90ba-19ca6c5b0346 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:44.596701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd3f2-6100-4759-90ba-19ca6c5b0346 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:44.598251 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 523/1051] 10.222.0.27 () {54 vars in 963 bytes} [Tue Oct 18 13:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:44.603946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23bb2e-ab4e-4bf5-9465-c6d8e8b84cb9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:44.604233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23bb2e-ab4e-4bf5-9465-c6d8e8b84cb9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:44.604497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23bb2e-ab4e-4bf5-9465-c6d8e8b84cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:44.692281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d23bb2e-ab4e-4bf5-9465-c6d8e8b84cb9 None None] MFA Rules not processed for user `b6c94378d347410c944afe6fe9a55584`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:44.693830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d23bb2e-ab4e-4bf5-9465-c6d8e8b84cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:44.716926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:44.778200 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 529/1052] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Oct 18 13:14:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:44.784811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fd3f2-6100-4759-90ba-19ca6c5b0346 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:44.786609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-353fd3f2-6100-4759-90ba-19ca6c5b0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:44.904195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fd3f2-6100-4759-90ba-19ca6c5b0346 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:44.908129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:44.981522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf951-9f20-4f4f-b461-ffe1b70d30b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:44.982475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf951-9f20-4f4f-b461-ffe1b70d30b1 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:44.983214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf951-9f20-4f4f-b461-ffe1b70d30b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:44.983666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf951-9f20-4f4f-b461-ffe1b70d30b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:44.985471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4cbf951-9f20-4f4f-b461-ffe1b70d30b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:45.106396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf951-9f20-4f4f-b461-ffe1b70d30b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:45.108889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf951-9f20-4f4f-b461-ffe1b70d30b1 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:45.131309 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 524/1053] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:46.341152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563fc0-2774-479c-a093-2e8aaa1fcc1b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:46.341660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563fc0-2774-479c-a093-2e8aaa1fcc1b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:46.341660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563fc0-2774-479c-a093-2e8aaa1fcc1b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:46.343148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 530/1054] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:46.348611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e0ee-baa3-4a4d-a62e-c7093ffcd527 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:46.349011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e0ee-baa3-4a4d-a62e-c7093ffcd527 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:46.349163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e0ee-baa3-4a4d-a62e-c7093ffcd527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:46.398828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:46.424837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b9d8e0ee-baa3-4a4d-a62e-c7093ffcd527 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:46.426209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9d8e0ee-baa3-4a4d-a62e-c7093ffcd527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:46.536356 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 525/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:46.829416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563fc0-2774-479c-a093-2e8aaa1fcc1b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:46.831224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1563fc0-2774-479c-a093-2e8aaa1fcc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:46.998808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563fc0-2774-479c-a093-2e8aaa1fcc1b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:47.035397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:47.140468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266528ce-eb5a-4bef-8e7e-903bb37ba8af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:47.141078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266528ce-eb5a-4bef-8e7e-903bb37ba8af service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:47.141362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266528ce-eb5a-4bef-8e7e-903bb37ba8af service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:47.141629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266528ce-eb5a-4bef-8e7e-903bb37ba8af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:47.143326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-266528ce-eb5a-4bef-8e7e-903bb37ba8af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:47.248363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266528ce-eb5a-4bef-8e7e-903bb37ba8af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:47.251064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266528ce-eb5a-4bef-8e7e-903bb37ba8af service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:47.271320 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 531/1056] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:49.662884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537703-d718-4288-8e27-7bd435b6846a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:49.663763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537703-d718-4288-8e27-7bd435b6846a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:49.664194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537703-d718-4288-8e27-7bd435b6846a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:49.666320 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 526/1057] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:49.672392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da40fc-a3c8-42c9-b5c1-4ffd48224f53 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:49.672830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da40fc-a3c8-42c9-b5c1-4ffd48224f53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:49.672928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da40fc-a3c8-42c9-b5c1-4ffd48224f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:49.719173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:49.747841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5da40fc-a3c8-42c9-b5c1-4ffd48224f53 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:49.750108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5da40fc-a3c8-42c9-b5c1-4ffd48224f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:49.880487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 532/1058] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:50.164885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537703-d718-4288-8e27-7bd435b6846a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:50.166650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4537703-d718-4288-8e27-7bd435b6846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:50.292580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:50.343272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537703-d718-4288-8e27-7bd435b6846a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:50.474881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92cd42-339f-4630-8667-7c81304bfc89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:50.475609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92cd42-339f-4630-8667-7c81304bfc89 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:50.475922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92cd42-339f-4630-8667-7c81304bfc89 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:50.476186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92cd42-339f-4630-8667-7c81304bfc89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:50.478364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e92cd42-339f-4630-8667-7c81304bfc89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:50.578909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:50.600859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92cd42-339f-4630-8667-7c81304bfc89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:50.603377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92cd42-339f-4630-8667-7c81304bfc89 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:50.629810 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 527/1059] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:52.993715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c32d-0316-4be2-89fb-a1b4ab693ccf None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:52.994223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c32d-0316-4be2-89fb-a1b4ab693ccf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:52.994223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c32d-0316-4be2-89fb-a1b4ab693ccf None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:52.998179 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 533/1060] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:53.003406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb567c-9df2-46f2-a6e4-1e61ee7e146f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:53.003792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb567c-9df2-46f2-a6e4-1e61ee7e146f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:53.003940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb567c-9df2-46f2-a6e4-1e61ee7e146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:53.107650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-09bb567c-9df2-46f2-a6e4-1e61ee7e146f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:53.109975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09bb567c-9df2-46f2-a6e4-1e61ee7e146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:53.220527 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 528/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:53.517152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11c32d-0316-4be2-89fb-a1b4ab693ccf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:53.518721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d11c32d-0316-4be2-89fb-a1b4ab693ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:53.632951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:53.680695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11c32d-0316-4be2-89fb-a1b4ab693ccf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:53.806372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2269c32-46dd-4701-ac7a-5b4a8ee5e4c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:53.807311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269c32-46dd-4701-ac7a-5b4a8ee5e4c5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:53.807652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269c32-46dd-4701-ac7a-5b4a8ee5e4c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:53.808001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2269c32-46dd-4701-ac7a-5b4a8ee5e4c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:53.810251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2269c32-46dd-4701-ac7a-5b4a8ee5e4c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:53.893990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:53.910331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2269c32-46dd-4701-ac7a-5b4a8ee5e4c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:53.911918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2269c32-46dd-4701-ac7a-5b4a8ee5e4c5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:53.931487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 534/1062] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:56.072914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129eb3e-322b-495d-8b58-4f6bc780f73b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:56.073450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129eb3e-322b-495d-8b58-4f6bc780f73b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:56.073450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129eb3e-322b-495d-8b58-4f6bc780f73b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:56.074818 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 529/1063] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:14:56.080128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096511d-0d7a-4f2d-ac20-5d1c2c009036 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:56.080680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096511d-0d7a-4f2d-ac20-5d1c2c009036 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:56.080680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096511d-0d7a-4f2d-ac20-5d1c2c009036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:56.150434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0096511d-0d7a-4f2d-ac20-5d1c2c009036 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:56.151641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0096511d-0d7a-4f2d-ac20-5d1c2c009036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:56.250886 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 535/1064] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:56.536067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129eb3e-322b-495d-8b58-4f6bc780f73b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:56.537661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0129eb3e-322b-495d-8b58-4f6bc780f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:56.598340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:56.715659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129eb3e-322b-495d-8b58-4f6bc780f73b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:14:56.844774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3f8ea-e82e-4508-9347-7ca40d75f4a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:14:56.845300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f8ea-e82e-4508-9347-7ca40d75f4a0 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:56.845575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f8ea-e82e-4508-9347-7ca40d75f4a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:56.845841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3f8ea-e82e-4508-9347-7ca40d75f4a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:56.847509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9cf3f8ea-e82e-4508-9347-7ca40d75f4a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:56.861175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:56.945319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3f8ea-e82e-4508-9347-7ca40d75f4a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:14:56.946967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3f8ea-e82e-4508-9347-7ca40d75f4a0 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:14:56.965203 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 530/1065] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:14:59.306613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f1da-615e-4048-af2a-3498c9d6f386 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:59.307181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f1da-615e-4048-af2a-3498c9d6f386 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:59.307181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f1da-615e-4048-af2a-3498c9d6f386 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:59.308417 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 536/1066] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:14:59.313608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ee97-1b74-4f37-813e-7e5afbe9ef79 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:14:59.314096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ee97-1b74-4f37-813e-7e5afbe9ef79 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:14:59.314206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00ee97-1b74-4f37-813e-7e5afbe9ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:14:59.381413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-af00ee97-1b74-4f37-813e-7e5afbe9ef79 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:14:59.382631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-af00ee97-1b74-4f37-813e-7e5afbe9ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:59.470953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:59.482534 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 531/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:14:59.774747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f1da-615e-4048-af2a-3498c9d6f386 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:14:59.776311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54b2f1da-615e-4048-af2a-3498c9d6f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:14:59.829872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:59.923618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f1da-615e-4048-af2a-3498c9d6f386 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:00.037208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6967-f395-4bfa-b844-feb6405afefe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:00.037734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6967-f395-4bfa-b844-feb6405afefe service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:00.038015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6967-f395-4bfa-b844-feb6405afefe service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:00.038320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6967-f395-4bfa-b844-feb6405afefe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:00.039936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-856f6967-f395-4bfa-b844-feb6405afefe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:00.052213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:00.130360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6967-f395-4bfa-b844-feb6405afefe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:00.131954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6967-f395-4bfa-b844-feb6405afefe service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:00.150856 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 537/1068] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:01.041889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ef8f-2048-45fd-b703-5330e30fccfc None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:01.042361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ef8f-2048-45fd-b703-5330e30fccfc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:01.042493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434ef8f-2048-45fd-b703-5330e30fccfc None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:01.043848 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 532/1069] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:01.049223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bb722-0f51-4892-bced-5d0a2f5fc179 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:01.049662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bb722-0f51-4892-bced-5d0a2f5fc179 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:01.049764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bb722-0f51-4892-bced-5d0a2f5fc179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:01.116987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1a4bb722-0f51-4892-bced-5d0a2f5fc179 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:01.118368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a4bb722-0f51-4892-bced-5d0a2f5fc179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:01.208330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:01.220865 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 538/1070] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:01.522925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325302c-fcb3-4953-a65b-13970c7eec8b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:01.523209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325302c-fcb3-4953-a65b-13970c7eec8b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:01.523484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325302c-fcb3-4953-a65b-13970c7eec8b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:01.525446 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 533/1071] 10.222.0.27 () {54 vars in 962 bytes} [Tue Oct 18 13:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:01.530818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac2bd-a06e-4505-973c-183e53647c57 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:01.531108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac2bd-a06e-4505-973c-183e53647c57 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:01.531383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac2bd-a06e-4505-973c-183e53647c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:01.609353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-53bac2bd-a06e-4505-973c-183e53647c57 None None] MFA Rules not processed for user `562e50f34bb54c68b428d077efeaca70`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:01.610581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53bac2bd-a06e-4505-973c-183e53647c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:01.685347 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 539/1072] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Oct 18 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:01.694621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325302c-fcb3-4953-a65b-13970c7eec8b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:01.696196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5325302c-fcb3-4953-a65b-13970c7eec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:01.803613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325302c-fcb3-4953-a65b-13970c7eec8b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:01.879191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf97821-ba3f-4904-b1e7-687ffea5b109 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:01.879903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf97821-ba3f-4904-b1e7-687ffea5b109 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:01.880184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf97821-ba3f-4904-b1e7-687ffea5b109 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:01.880454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf97821-ba3f-4904-b1e7-687ffea5b109 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:01.882096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bdf97821-ba3f-4904-b1e7-687ffea5b109 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:01.924465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:01.991287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf97821-ba3f-4904-b1e7-687ffea5b109 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:01.993418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf97821-ba3f-4904-b1e7-687ffea5b109 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:02.012111 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 534/1073] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:02.456439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992c32-a267-48b0-9dd3-cf3cfe2a0ea6 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:02.456875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992c32-a267-48b0-9dd3-cf3cfe2a0ea6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:02.456978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992c32-a267-48b0-9dd3-cf3cfe2a0ea6 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:02.458360 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 540/1074] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:02.464240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8228f9-95ce-44a7-8502-8eacbd8fbdf8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:02.464730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8228f9-95ce-44a7-8502-8eacbd8fbdf8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:02.464821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8228f9-95ce-44a7-8502-8eacbd8fbdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:02.540052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b8228f9-95ce-44a7-8502-8eacbd8fbdf8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:02.541221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b8228f9-95ce-44a7-8502-8eacbd8fbdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:02.641455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:02.643823 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 535/1075] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:02.932154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5992c32-a267-48b0-9dd3-cf3cfe2a0ea6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:02.933451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610950a1-6d37-4536-9735-359c252a4068 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:02.933805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610950a1-6d37-4536-9735-359c252a4068 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:02.934113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610950a1-6d37-4536-9735-359c252a4068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:02.934365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5992c32-a267-48b0-9dd3-cf3cfe2a0ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:03.002985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-610950a1-6d37-4536-9735-359c252a4068 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:03.004188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-610950a1-6d37-4536-9735-359c252a4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:03.019908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:03.088095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5992c32-a267-48b0-9dd3-cf3cfe2a0ea6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:03.093386 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 536/1076] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:15:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:15:03.139607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e228159-b3e2-4025-a3e3-4a410ffd5917 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:03.139914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e228159-b3e2-4025-a3e3-4a410ffd5917 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:03.140188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e228159-b3e2-4025-a3e3-4a410ffd5917 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:03.141607 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 537/1077] 10.222.0.27 () {54 vars in 943 bytes} [Tue Oct 18 13:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:15:03.148097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167a3e-1a87-4a0c-b1cd-71c9137bd779 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:03.148447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167a3e-1a87-4a0c-b1cd-71c9137bd779 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:03.148758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167a3e-1a87-4a0c-b1cd-71c9137bd779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:03.215427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:03.216122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:03.216400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:03.216670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:03.218298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:03.226627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-73167a3e-1a87-4a0c-b1cd-71c9137bd779 None None] MFA Rules not processed for user `025cbd75396f4aa09e2fc5c6c77be077`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:03.227862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73167a3e-1a87-4a0c-b1cd-71c9137bd779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:03.261739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:03.262947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:03.309906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:03.311529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:03.330297 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 541/1078] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:03.340930 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 538/1079] 10.222.0.27 () {58 vars in 1040 bytes} [Tue Oct 18 13:15:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:03.350576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:03.351795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:03.444591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91d26e-1af3-446f-aa51-883b7e3bf56a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:03.531301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:03.564349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45648d5-5033-433b-8550-b89669de622e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:03.564979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45648d5-5033-433b-8550-b89669de622e service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:03.565263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45648d5-5033-433b-8550-b89669de622e service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:03.565539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45648d5-5033-433b-8550-b89669de622e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:03.567382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c45648d5-5033-433b-8550-b89669de622e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:03.662971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45648d5-5033-433b-8550-b89669de622e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:03.665159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45648d5-5033-433b-8550-b89669de622e service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:03.674564 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 542/1080] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:15:05.641500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8cbf7-05f9-401c-9883-7ffa970ffd7c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:05.642043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8cbf7-05f9-401c-9883-7ffa970ffd7c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:05.642234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8cbf7-05f9-401c-9883-7ffa970ffd7c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:05.643741 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 539/1081] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:05.649309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a926-6f6c-4b80-bc18-757749f8e9ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:05.649746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a926-6f6c-4b80-bc18-757749f8e9ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:05.649865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0a926-6f6c-4b80-bc18-757749f8e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:05.727313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-93b0a926-6f6c-4b80-bc18-757749f8e9ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:05.728493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93b0a926-6f6c-4b80-bc18-757749f8e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:05.796881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:05.836277 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 543/1082] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:06.126951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8cbf7-05f9-401c-9883-7ffa970ffd7c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:06.128555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-35c8cbf7-05f9-401c-9883-7ffa970ffd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:06.296656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8cbf7-05f9-401c-9883-7ffa970ffd7c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:06.300663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:06.420625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb825-ab66-4b43-9ce9-d8b9aad57357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:06.421145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb825-ab66-4b43-9ce9-d8b9aad57357 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:06.421419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb825-ab66-4b43-9ce9-d8b9aad57357 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:06.421689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb825-ab66-4b43-9ce9-d8b9aad57357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:06.425172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-615eb825-ab66-4b43-9ce9-d8b9aad57357 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:06.532175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb825-ab66-4b43-9ce9-d8b9aad57357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:06.534122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb825-ab66-4b43-9ce9-d8b9aad57357 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:06.553204 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 540/1083] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:08.911862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e46d8e-4190-4240-a0c3-aead4db64cc3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:08.911862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e46d8e-4190-4240-a0c3-aead4db64cc3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:08.912520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e46d8e-4190-4240-a0c3-aead4db64cc3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:08.914098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 544/1084] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:08.919878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347766-958e-41b2-b418-bb0dc022a24d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:08.920423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347766-958e-41b2-b418-bb0dc022a24d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:08.920529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4347766-958e-41b2-b418-bb0dc022a24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:08.941273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:09.019116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c4347766-958e-41b2-b418-bb0dc022a24d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:09.020715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4347766-958e-41b2-b418-bb0dc022a24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:09.138301 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 541/1085] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:09.422889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e46d8e-4190-4240-a0c3-aead4db64cc3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:09.424664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-19e46d8e-4190-4240-a0c3-aead4db64cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:09.607586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e46d8e-4190-4240-a0c3-aead4db64cc3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:09.665855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:09.734908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89674800-2a93-4177-ab57-46721c15652c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:09.735525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89674800-2a93-4177-ab57-46721c15652c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:09.735800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89674800-2a93-4177-ab57-46721c15652c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:09.736072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89674800-2a93-4177-ab57-46721c15652c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:09.737687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89674800-2a93-4177-ab57-46721c15652c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:09.838013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89674800-2a93-4177-ab57-46721c15652c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:09.839634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89674800-2a93-4177-ab57-46721c15652c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:09.860225 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 545/1086] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:19.130316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=61 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:19.857651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=76 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:28.517683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6856-24b6-4096-b956-77aa59dc0424 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:28.518278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6856-24b6-4096-b956-77aa59dc0424 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:28.518385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f6856-24b6-4096-b956-77aa59dc0424 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:28.519665 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 542/1087] 10.222.0.27 () {54 vars in 918 bytes} [Tue Oct 18 13:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:28.524816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20430d7-9f38-4f63-bb9b-0c9daf600afc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:28.525270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20430d7-9f38-4f63-bb9b-0c9daf600afc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:28.525393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20430d7-9f38-4f63-bb9b-0c9daf600afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:28.601533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b20430d7-9f38-4f63-bb9b-0c9daf600afc None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:28.602784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b20430d7-9f38-4f63-bb9b-0c9daf600afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:28.710766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 546/1088] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Oct 18 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:28.724634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256436-bf83-4b73-881c-827c1dcaea45 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:28.724917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256436-bf83-4b73-881c-827c1dcaea45 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:28.725190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256436-bf83-4b73-881c-827c1dcaea45 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:28.726537 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 543/1089] 10.222.0.27 () {54 vars in 918 bytes} [Tue Oct 18 13:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:28.731016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9c06-315a-4639-ad78-0fc81f92617c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:28.731307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9c06-315a-4639-ad78-0fc81f92617c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:28.731585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b9c06-315a-4639-ad78-0fc81f92617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:28.804380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:28.808016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea1b9c06-315a-4639-ad78-0fc81f92617c None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:28.809223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea1b9c06-315a-4639-ad78-0fc81f92617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:28.931519 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 547/1090] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Oct 18 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:31.471843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4762-e64e-474f-b261-c9a88733830c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:31.472322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4762-e64e-474f-b261-c9a88733830c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:31.472424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4762-e64e-474f-b261-c9a88733830c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:31.473701 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 544/1091] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:31.479110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeca0df-e3e7-48be-a36d-ab0e5832e54e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:31.479503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeca0df-e3e7-48be-a36d-ab0e5832e54e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:31.479656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeca0df-e3e7-48be-a36d-ab0e5832e54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:31.545489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ceeca0df-e3e7-48be-a36d-ab0e5832e54e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:31.546692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ceeca0df-e3e7-48be-a36d-ab0e5832e54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:31.602496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:31.645047 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 548/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:31.937791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a4762-e64e-474f-b261-c9a88733830c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:31.939333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-532a4762-e64e-474f-b261-c9a88733830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:32.084778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a4762-e64e-474f-b261-c9a88733830c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:32.156102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:32.196195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0306f9-13a9-4eb1-8005-cb6bf162956a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:32.196821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0306f9-13a9-4eb1-8005-cb6bf162956a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:32.197092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0306f9-13a9-4eb1-8005-cb6bf162956a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:32.197354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0306f9-13a9-4eb1-8005-cb6bf162956a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:32.198957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a0306f9-13a9-4eb1-8005-cb6bf162956a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:32.287302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0306f9-13a9-4eb1-8005-cb6bf162956a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:32.288891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0306f9-13a9-4eb1-8005-cb6bf162956a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:32.306856 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 545/1093] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:33.435753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff0ef-4daf-4e92-a090-de4b1a9e40e7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:33.436291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff0ef-4daf-4e92-a090-de4b1a9e40e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:33.436291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff0ef-4daf-4e92-a090-de4b1a9e40e7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:33.437784 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 549/1094] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:33.444286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede75ac-685d-4098-97d1-f7dcc5a0185e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:33.444725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede75ac-685d-4098-97d1-f7dcc5a0185e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:33.444925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede75ac-685d-4098-97d1-f7dcc5a0185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:33.520553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ede75ac-685d-4098-97d1-f7dcc5a0185e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:33.523086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ede75ac-685d-4098-97d1-f7dcc5a0185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:33.548824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:33.617851 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 546/1095] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:15:33.790598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff0ef-4daf-4e92-a090-de4b1a9e40e7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:33.792154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64fff0ef-4daf-4e92-a090-de4b1a9e40e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:33.940582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff0ef-4daf-4e92-a090-de4b1a9e40e7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:33.980079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:34.050516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bf881-8509-4887-899e-6619e8c12cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:34.051115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf881-8509-4887-899e-6619e8c12cd7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:34.051390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf881-8509-4887-899e-6619e8c12cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:34.051660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf881-8509-4887-899e-6619e8c12cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:34.053237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-388bf881-8509-4887-899e-6619e8c12cd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:34.142168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bf881-8509-4887-899e-6619e8c12cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:34.143735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bf881-8509-4887-899e-6619e8c12cd7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:34.161200 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 550/1096] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:35.285939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebad4-44f2-43e1-9140-3275bbaacdad None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:35.286500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebad4-44f2-43e1-9140-3275bbaacdad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:35.286595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebad4-44f2-43e1-9140-3275bbaacdad None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:35.287945 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 547/1097] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:35.294152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44e23-1fcb-4c76-8802-46f9363d7ff6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:35.294549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44e23-1fcb-4c76-8802-46f9363d7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:35.294702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb44e23-1fcb-4c76-8802-46f9363d7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:35.349665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:35.371660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ebb44e23-1fcb-4c76-8802-46f9363d7ff6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:35.372861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ebb44e23-1fcb-4c76-8802-46f9363d7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:35.470112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 551/1098] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:35.621583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ebad4-44f2-43e1-9140-3275bbaacdad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:35.623179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-100ebad4-44f2-43e1-9140-3275bbaacdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:35.766663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ebad4-44f2-43e1-9140-3275bbaacdad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:35.778513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:35.878738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388262c-8f25-413a-ab7e-a87b2de379ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:35.879266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388262c-8f25-413a-ab7e-a87b2de379ff service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:35.879542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388262c-8f25-413a-ab7e-a87b2de379ff service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:35.879811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388262c-8f25-413a-ab7e-a87b2de379ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:35.881393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7388262c-8f25-413a-ab7e-a87b2de379ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:35.967832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388262c-8f25-413a-ab7e-a87b2de379ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:35.969403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388262c-8f25-413a-ab7e-a87b2de379ff service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:35.987802 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 548/1099] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:37.089228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f792-ed9a-43d4-8657-9e2da35eaf1e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:37.089666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f792-ed9a-43d4-8657-9e2da35eaf1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:37.089807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443f792-ed9a-43d4-8657-9e2da35eaf1e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:37.091189 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 552/1100] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:37.097289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aec86f-0ab0-4837-aaa8-7de935c4e406 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:37.097747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aec86f-0ab0-4837-aaa8-7de935c4e406 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:37.097853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aec86f-0ab0-4837-aaa8-7de935c4e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:37.118374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:37.172857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a7aec86f-0ab0-4837-aaa8-7de935c4e406 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:37.174090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7aec86f-0ab0-4837-aaa8-7de935c4e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:37.266757 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 549/1101] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:37.415358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f792-ed9a-43d4-8657-9e2da35eaf1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:37.416875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3443f792-ed9a-43d4-8657-9e2da35eaf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:37.528088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:37.562707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443f792-ed9a-43d4-8657-9e2da35eaf1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:37.675248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65948b90-45a8-4a3f-8bad-2c5df9086157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:37.675772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948b90-45a8-4a3f-8bad-2c5df9086157 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:37.676049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948b90-45a8-4a3f-8bad-2c5df9086157 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:37.676317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65948b90-45a8-4a3f-8bad-2c5df9086157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:37.677901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65948b90-45a8-4a3f-8bad-2c5df9086157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:37.753158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:37.766006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65948b90-45a8-4a3f-8bad-2c5df9086157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:37.769908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65948b90-45a8-4a3f-8bad-2c5df9086157 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:37.785684 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 553/1102] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:38.896119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d4021-87f8-4081-a508-a0a9df2812a8 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:38.896661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d4021-87f8-4081-a508-a0a9df2812a8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:38.896661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d4021-87f8-4081-a508-a0a9df2812a8 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:38.898033 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 550/1103] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:38.904098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8b84-0a17-431c-bfe7-af9772a11be4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:38.904487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8b84-0a17-431c-bfe7-af9772a11be4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:38.904646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8b84-0a17-431c-bfe7-af9772a11be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:38.980822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-33ac8b84-0a17-431c-bfe7-af9772a11be4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:38.982030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33ac8b84-0a17-431c-bfe7-af9772a11be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:39.077904 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 554/1104] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:39.229313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d4021-87f8-4081-a508-a0a9df2812a8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:39.230768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-217d4021-87f8-4081-a508-a0a9df2812a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:39.313913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:39.375020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d4021-87f8-4081-a508-a0a9df2812a8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:39.487343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30bb17-d90f-4351-9657-bdf2ddcbe8d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:39.487866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30bb17-d90f-4351-9657-bdf2ddcbe8d2 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:39.488140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30bb17-d90f-4351-9657-bdf2ddcbe8d2 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:39.488407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30bb17-d90f-4351-9657-bdf2ddcbe8d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:39.489977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4a30bb17-d90f-4351-9657-bdf2ddcbe8d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:39.537645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:39.577481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30bb17-d90f-4351-9657-bdf2ddcbe8d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:39.579089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30bb17-d90f-4351-9657-bdf2ddcbe8d2 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:39.597770 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 551/1105] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:40.714891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d43a-8739-4f5a-aa19-096b46020ead None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:40.715429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d43a-8739-4f5a-aa19-096b46020ead None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:40.715429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d43a-8739-4f5a-aa19-096b46020ead None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:40.716713 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 555/1106] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:40.722928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e824c40-ad19-4fe6-9978-c3289b0e18fb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:40.723365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e824c40-ad19-4fe6-9978-c3289b0e18fb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:40.723458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e824c40-ad19-4fe6-9978-c3289b0e18fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:40.799522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8e824c40-ad19-4fe6-9978-c3289b0e18fb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:40.800726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8e824c40-ad19-4fe6-9978-c3289b0e18fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:40.894923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 552/1107] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:41.049067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d43a-8739-4f5a-aa19-096b46020ead None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:41.050544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5171d43a-8739-4f5a-aa19-096b46020ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:41.099702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:41.197388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d43a-8739-4f5a-aa19-096b46020ead None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:41.308956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0a80c-9ac1-4b1e-9ef4-aa1d601ccf5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:41.309491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a80c-9ac1-4b1e-9ef4-aa1d601ccf5d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:41.309769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a80c-9ac1-4b1e-9ef4-aa1d601ccf5d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:41.310043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0a80c-9ac1-4b1e-9ef4-aa1d601ccf5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:41.311662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88c0a80c-9ac1-4b1e-9ef4-aa1d601ccf5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:41.318546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:41.401196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0a80c-9ac1-4b1e-9ef4-aa1d601ccf5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:41.402815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0a80c-9ac1-4b1e-9ef4-aa1d601ccf5d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:41.420417 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 556/1108] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:42.521773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc1bf-da71-405c-bd53-b130ed3f4b2b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:42.522316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc1bf-da71-405c-bd53-b130ed3f4b2b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:42.522412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdc1bf-da71-405c-bd53-b130ed3f4b2b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:42.524294 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 553/1109] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:42.530830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f73e-366b-4269-b528-61e961e4413a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:42.531313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f73e-366b-4269-b528-61e961e4413a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:42.531421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f73e-366b-4269-b528-61e961e4413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:42.606471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7305f73e-366b-4269-b528-61e961e4413a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:42.607669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7305f73e-366b-4269-b528-61e961e4413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:42.675808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:42.704924 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 557/1110] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:42.853461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc1bf-da71-405c-bd53-b130ed3f4b2b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:42.855023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-41fdc1bf-da71-405c-bd53-b130ed3f4b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:42.873103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:43.003299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdc1bf-da71-405c-bd53-b130ed3f4b2b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:43.088349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:43.113798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0ad2-775d-4aa2-8055-3f77d2927ca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:43.114438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0ad2-775d-4aa2-8055-3f77d2927ca9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:43.114716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0ad2-775d-4aa2-8055-3f77d2927ca9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:43.115025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0ad2-775d-4aa2-8055-3f77d2927ca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:43.117811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-325c0ad2-775d-4aa2-8055-3f77d2927ca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:43.205281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0ad2-775d-4aa2-8055-3f77d2927ca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:43.206948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0ad2-775d-4aa2-8055-3f77d2927ca9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:43.224387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 554/1111] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:44.360339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f725-eef4-49e0-8841-00f6b778220d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:44.360909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f725-eef4-49e0-8841-00f6b778220d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:44.360909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361f725-eef4-49e0-8841-00f6b778220d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:44.362247 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 558/1112] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:44.368927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271c157-f5cc-4481-8044-70e9322fb639 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:44.369368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271c157-f5cc-4481-8044-70e9322fb639 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:44.369536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271c157-f5cc-4481-8044-70e9322fb639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:44.443849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f271c157-f5cc-4481-8044-70e9322fb639 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:44.445674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f271c157-f5cc-4481-8044-70e9322fb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:44.486908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:44.540888 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 555/1113] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:44.692267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361f725-eef4-49e0-8841-00f6b778220d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:44.693788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4361f725-eef4-49e0-8841-00f6b778220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:44.838627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361f725-eef4-49e0-8841-00f6b778220d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:44.891646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:44.950285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3f859-ecc2-44a0-bed6-20095f9fd762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:44.950285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f859-ecc2-44a0-bed6-20095f9fd762 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:44.950599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f859-ecc2-44a0-bed6-20095f9fd762 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:44.950735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f859-ecc2-44a0-bed6-20095f9fd762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:44.952336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6c3f859-ecc2-44a0-bed6-20095f9fd762 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:45.040668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3f859-ecc2-44a0-bed6-20095f9fd762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:45.042271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3f859-ecc2-44a0-bed6-20095f9fd762 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:45.060317 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 559/1114] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:46.146599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd743f-467c-4654-baac-201a91c556a3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:46.147175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd743f-467c-4654-baac-201a91c556a3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:46.147175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd743f-467c-4654-baac-201a91c556a3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:46.149082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 556/1115] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:46.155127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa322-5a68-4ebd-ba52-282b43af95ff None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:46.155545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa322-5a68-4ebd-ba52-282b43af95ff None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:46.155679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa322-5a68-4ebd-ba52-282b43af95ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:46.231676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-40cfa322-5a68-4ebd-ba52-282b43af95ff None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:46.232877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40cfa322-5a68-4ebd-ba52-282b43af95ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:46.235145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:46.330268 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 560/1116] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:46.479874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd743f-467c-4654-baac-201a91c556a3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:46.481457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63dd743f-467c-4654-baac-201a91c556a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:46.626138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd743f-467c-4654-baac-201a91c556a3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:46.653543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:46.737569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade3df6-6a63-4812-8364-a8a87155d262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:46.738113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade3df6-6a63-4812-8364-a8a87155d262 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:46.738394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade3df6-6a63-4812-8364-a8a87155d262 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:46.738683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade3df6-6a63-4812-8364-a8a87155d262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:46.740248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eade3df6-6a63-4812-8364-a8a87155d262 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:46.828787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade3df6-6a63-4812-8364-a8a87155d262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:46.830410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade3df6-6a63-4812-8364-a8a87155d262 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:46.847937 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 557/1117] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:48.881614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6d5c3-a354-44d5-8bdc-cca26ed32e17 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:48.882220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6d5c3-a354-44d5-8bdc-cca26ed32e17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:48.882220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6d5c3-a354-44d5-8bdc-cca26ed32e17 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:48.883570 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 561/1118] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:48.888914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a339-7f06-4ad0-b471-d39b7faddef7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:48.889345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a339-7f06-4ad0-b471-d39b7faddef7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:48.889555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7a339-7f06-4ad0-b471-d39b7faddef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:48.930508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:48.955315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-32f7a339-7f06-4ad0-b471-d39b7faddef7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:48.956503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32f7a339-7f06-4ad0-b471-d39b7faddef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:49.053929 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 558/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:49.342728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6d5c3-a354-44d5-8bdc-cca26ed32e17 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:49.344303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6d6d5c3-a354-44d5-8bdc-cca26ed32e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:49.447468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6d5c3-a354-44d5-8bdc-cca26ed32e17 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:49.480925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:49.520912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209324fb-4547-40c4-8506-81f32b577905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:49.521513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209324fb-4547-40c4-8506-81f32b577905 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:49.521791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209324fb-4547-40c4-8506-81f32b577905 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:49.522085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209324fb-4547-40c4-8506-81f32b577905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:49.523736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-209324fb-4547-40c4-8506-81f32b577905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:49.631485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209324fb-4547-40c4-8506-81f32b577905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:49.632905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209324fb-4547-40c4-8506-81f32b577905 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:49.651119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 562/1120] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:51.910672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e69cb3-e177-474b-9c3e-fc4800335ac4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:51.911231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e69cb3-e177-474b-9c3e-fc4800335ac4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:51.911231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e69cb3-e177-474b-9c3e-fc4800335ac4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:51.912551 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 559/1121] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:51.917782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2c73-71c7-4229-a76c-255976d3005d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:51.918246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2c73-71c7-4229-a76c-255976d3005d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:51.918377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2c73-71c7-4229-a76c-255976d3005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:51.983917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-de8a2c73-71c7-4229-a76c-255976d3005d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:51.985109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de8a2c73-71c7-4229-a76c-255976d3005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:51.998150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:52.082271 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 563/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:52.365281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e69cb3-e177-474b-9c3e-fc4800335ac4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:52.367006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78e69cb3-e177-474b-9c3e-fc4800335ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:52.471772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e69cb3-e177-474b-9c3e-fc4800335ac4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:52.485970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:52.546568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9618-134f-44b2-8bc1-6cbec9703abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:52.547104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9618-134f-44b2-8bc1-6cbec9703abd service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:52.547382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9618-134f-44b2-8bc1-6cbec9703abd service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:52.547653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9618-134f-44b2-8bc1-6cbec9703abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:52.549245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-853f9618-134f-44b2-8bc1-6cbec9703abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:52.657264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9618-134f-44b2-8bc1-6cbec9703abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:52.658723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9618-134f-44b2-8bc1-6cbec9703abd service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:52.676619 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 560/1123] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:55.220793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8763e-957a-4a41-9956-5bd2fdaf55b4 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:55.221325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8763e-957a-4a41-9956-5bd2fdaf55b4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:55.221325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8763e-957a-4a41-9956-5bd2fdaf55b4 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:55.222712 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 564/1124] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:55.228435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e1c59-ee4d-40fb-8344-5b6005e470c3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:55.228881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e1c59-ee4d-40fb-8344-5b6005e470c3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:55.228979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e1c59-ee4d-40fb-8344-5b6005e470c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:55.276075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:55.293874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c1e1c59-ee4d-40fb-8344-5b6005e470c3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:55.296406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c1e1c59-ee4d-40fb-8344-5b6005e470c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:55.390308 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 561/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:15:55.674584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8763e-957a-4a41-9956-5bd2fdaf55b4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:55.676156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50d8763e-957a-4a41-9956-5bd2fdaf55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:55.779112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8763e-957a-4a41-9956-5bd2fdaf55b4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:55.819209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:55.853225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3f792-2afe-4512-a66c-d9aa9f89d63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:55.853830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f792-2afe-4512-a66c-d9aa9f89d63a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:55.854141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f792-2afe-4512-a66c-d9aa9f89d63a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:55.854422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f792-2afe-4512-a66c-d9aa9f89d63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:55.856058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60f3f792-2afe-4512-a66c-d9aa9f89d63a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:55.963354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3f792-2afe-4512-a66c-d9aa9f89d63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:55.964709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3f792-2afe-4512-a66c-d9aa9f89d63a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:55.983210 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 565/1126] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:15:58.235514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b18456-08f1-4dec-847c-eb468e450d3a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:58.236077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b18456-08f1-4dec-847c-eb468e450d3a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:58.236077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b18456-08f1-4dec-847c-eb468e450d3a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:58.237410 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 562/1127] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:15:58.243515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887712-7d94-4eff-9bdd-09955e57e6c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:58.243953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887712-7d94-4eff-9bdd-09955e57e6c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:58.244056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31887712-7d94-4eff-9bdd-09955e57e6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:58.308492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-31887712-7d94-4eff-9bdd-09955e57e6c7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:15:58.309587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31887712-7d94-4eff-9bdd-09955e57e6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:58.329891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:58.406977 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 566/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:15:58.685956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b18456-08f1-4dec-847c-eb468e450d3a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:15:58.687514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-33b18456-08f1-4dec-847c-eb468e450d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:58.790776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b18456-08f1-4dec-847c-eb468e450d3a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:15:58.810924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:58.864397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61f8ed-4d66-4f84-809b-e26c6d2bd15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:15:58.864999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61f8ed-4d66-4f84-809b-e26c6d2bd15b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:15:58.865278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61f8ed-4d66-4f84-809b-e26c6d2bd15b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:15:58.865554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61f8ed-4d66-4f84-809b-e26c6d2bd15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:15:58.867176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e61f8ed-4d66-4f84-809b-e26c6d2bd15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:15:58.974684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61f8ed-4d66-4f84-809b-e26c6d2bd15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:15:58.976069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61f8ed-4d66-4f84-809b-e26c6d2bd15b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:15:58.993683 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 563/1129] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:01.212972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f83d2-0fd2-4ad3-a023-a7dab86fea36 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:01.213508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f83d2-0fd2-4ad3-a023-a7dab86fea36 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:01.213508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f83d2-0fd2-4ad3-a023-a7dab86fea36 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:01.214924 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 567/1130] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:01.220307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b6a50-829a-45e4-88f4-73207c9daa10 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:01.220735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b6a50-829a-45e4-88f4-73207c9daa10 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:01.220840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b6a50-829a-45e4-88f4-73207c9daa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:01.284399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:01.287063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d77b6a50-829a-45e4-88f4-73207c9daa10 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:01.288277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d77b6a50-829a-45e4-88f4-73207c9daa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:01.382359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 564/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:01.665576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f83d2-0fd2-4ad3-a023-a7dab86fea36 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:01.667198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-646f83d2-0fd2-4ad3-a023-a7dab86fea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:01.770738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f83d2-0fd2-4ad3-a023-a7dab86fea36 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:01.818855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:01.844624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0b993-b7fe-4708-9166-d8bc6d011b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:01.845228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b993-b7fe-4708-9166-d8bc6d011b66 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:01.845508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b993-b7fe-4708-9166-d8bc6d011b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:01.845780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b993-b7fe-4708-9166-d8bc6d011b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:01.847474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12c0b993-b7fe-4708-9166-d8bc6d011b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:01.953880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0b993-b7fe-4708-9166-d8bc6d011b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:01.955295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0b993-b7fe-4708-9166-d8bc6d011b66 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:01.973934 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 568/1132] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:04.142681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88786-bc00-4da8-bbd2-f8eb6b81ecfe None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:04.143233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88786-bc00-4da8-bbd2-f8eb6b81ecfe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:04.143233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad88786-bc00-4da8-bbd2-f8eb6b81ecfe None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:04.144583 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 565/1133] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:04.150465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcba71-e182-4a98-a6f1-27077c2e1b3f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:04.150893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcba71-e182-4a98-a6f1-27077c2e1b3f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:04.151009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcba71-e182-4a98-a6f1-27077c2e1b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:04.216368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fbbcba71-e182-4a98-a6f1-27077c2e1b3f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:04.217559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fbbcba71-e182-4a98-a6f1-27077c2e1b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:04.246086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:04.313338 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 569/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:04.601003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad88786-bc00-4da8-bbd2-f8eb6b81ecfe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:04.602621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ad88786-bc00-4da8-bbd2-f8eb6b81ecfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:04.705455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad88786-bc00-4da8-bbd2-f8eb6b81ecfe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:04.734987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:04.780290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1dbe3-ced2-4dfd-adb3-d54a3545120a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:04.780892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dbe3-ced2-4dfd-adb3-d54a3545120a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:04.781163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dbe3-ced2-4dfd-adb3-d54a3545120a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:04.781431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1dbe3-ced2-4dfd-adb3-d54a3545120a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:04.783042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cff1dbe3-ced2-4dfd-adb3-d54a3545120a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:04.890700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1dbe3-ced2-4dfd-adb3-d54a3545120a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:04.892134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1dbe3-ced2-4dfd-adb3-d54a3545120a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:04.909881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 566/1135] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:07.121230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3f49-8809-4879-a382-2e01b4302bd0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:07.121748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3f49-8809-4879-a382-2e01b4302bd0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:07.121857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3f49-8809-4879-a382-2e01b4302bd0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:07.123151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:07.128506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b2ca-ec8f-4ea9-9703-a673e71021df None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:07.128895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b2ca-ec8f-4ea9-9703-a673e71021df None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:07.129046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b2ca-ec8f-4ea9-9703-a673e71021df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:07.193288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a040b2ca-ec8f-4ea9-9703-a673e71021df None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:07.194502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a040b2ca-ec8f-4ea9-9703-a673e71021df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:07.203055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:07.295240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:07.576933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3f49-8809-4879-a382-2e01b4302bd0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:07.578537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af4a3f49-8809-4879-a382-2e01b4302bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:07.683153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3f49-8809-4879-a382-2e01b4302bd0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:07.737962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:07.756368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef492927-fe56-4fe4-a88b-dea4387299ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:07.756969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef492927-fe56-4fe4-a88b-dea4387299ed service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:07.757247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef492927-fe56-4fe4-a88b-dea4387299ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:07.757518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef492927-fe56-4fe4-a88b-dea4387299ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:07.759847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef492927-fe56-4fe4-a88b-dea4387299ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:07.866878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef492927-fe56-4fe4-a88b-dea4387299ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:07.868884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef492927-fe56-4fe4-a88b-dea4387299ed service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:07.886808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 571/1138] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:10.035457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e4df-3237-4d64-aa40-d66d786986a2 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:10.036036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e4df-3237-4d64-aa40-d66d786986a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:10.036036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9e4df-3237-4d64-aa40-d66d786986a2 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:10.037341 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:10.043395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e41f7-795b-4fd6-85a3-892f081f4ee4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:10.043828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e41f7-795b-4fd6-85a3-892f081f4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:10.043928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e41f7-795b-4fd6-85a3-892f081f4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:10.115403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-600e41f7-795b-4fd6-85a3-892f081f4ee4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:10.116610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-600e41f7-795b-4fd6-85a3-892f081f4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:10.156597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:10.216823 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:10.497814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9e4df-3237-4d64-aa40-d66d786986a2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:10.499379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52a9e4df-3237-4d64-aa40-d66d786986a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:10.599927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9e4df-3237-4d64-aa40-d66d786986a2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:10.637704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:10.672829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf33383-83dd-46c6-8469-da97c3d979a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:10.673423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33383-83dd-46c6-8469-da97c3d979a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:10.673698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33383-83dd-46c6-8469-da97c3d979a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:10.673965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33383-83dd-46c6-8469-da97c3d979a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:10.675566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcf33383-83dd-46c6-8469-da97c3d979a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:10.782498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf33383-83dd-46c6-8469-da97c3d979a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:10.783850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf33383-83dd-46c6-8469-da97c3d979a7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:10.803150 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 569/1141] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:16:12.980133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9758e-b1ac-4fba-b053-12f1c4d22315 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:12.980675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9758e-b1ac-4fba-b053-12f1c4d22315 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:12.980675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9758e-b1ac-4fba-b053-12f1c4d22315 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:12.982028 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:12.987628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfc58-a870-4988-ada2-d208e3825e73 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:12.988057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfc58-a870-4988-ada2-d208e3825e73 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:12.988159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dfc58-a870-4988-ada2-d208e3825e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:13.053755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-848dfc58-a870-4988-ada2-d208e3825e73 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:13.055613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-848dfc58-a870-4988-ada2-d208e3825e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:13.073775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:13.151901 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:13.436299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9758e-b1ac-4fba-b053-12f1c4d22315 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:13.437875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4dc9758e-b1ac-4fba-b053-12f1c4d22315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:13.543265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9758e-b1ac-4fba-b053-12f1c4d22315 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:13.610536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:13.616955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d1ee8-f555-4545-b9dd-b8d63a797002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:13.618864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1ee8-f555-4545-b9dd-b8d63a797002 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:13.618864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1ee8-f555-4545-b9dd-b8d63a797002 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:13.618864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1ee8-f555-4545-b9dd-b8d63a797002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:13.619808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da9d1ee8-f555-4545-b9dd-b8d63a797002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:13.729250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d1ee8-f555-4545-b9dd-b8d63a797002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:13.730711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d1ee8-f555-4545-b9dd-b8d63a797002 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:13.749127 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 574/1144] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:15.878965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c55ad7-a759-4c6c-b7ae-a371eed300ad None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:15.879488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c55ad7-a759-4c6c-b7ae-a371eed300ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:15.879585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c55ad7-a759-4c6c-b7ae-a371eed300ad None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:15.880853 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:15.886152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0868e-b97a-4594-87e9-95a0291d8d79 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:15.886538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0868e-b97a-4594-87e9-95a0291d8d79 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:15.886698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0868e-b97a-4594-87e9-95a0291d8d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:15.951488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16e0868e-b97a-4594-87e9-95a0291d8d79 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:15.952692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16e0868e-b97a-4594-87e9-95a0291d8d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:16.001303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:16.049014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:16.337022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c55ad7-a759-4c6c-b7ae-a371eed300ad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:16.338587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4c55ad7-a759-4c6c-b7ae-a371eed300ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:16.439878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c55ad7-a759-4c6c-b7ae-a371eed300ad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:16.487931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:16.514336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768eda3-3999-4e8b-8827-91f954d5610f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:16.514946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768eda3-3999-4e8b-8827-91f954d5610f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:16.515226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768eda3-3999-4e8b-8827-91f954d5610f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:16.515497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768eda3-3999-4e8b-8827-91f954d5610f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:16.517189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7768eda3-3999-4e8b-8827-91f954d5610f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:16.624690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768eda3-3999-4e8b-8827-91f954d5610f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:16.626163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768eda3-3999-4e8b-8827-91f954d5610f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:16.644712 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 572/1147] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:26.081260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=22 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:26.642486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=66 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:36.541090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79ed30-4406-4e2e-b6e0-5b68e398e01e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:36.549859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79ed30-4406-4e2e-b6e0-5b68e398e01e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:36.549859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79ed30-4406-4e2e-b6e0-5b68e398e01e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:36.549859 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 576/1148] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:36.550172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b13ce-e259-4360-90e4-cd104f429ada None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:36.550172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b13ce-e259-4360-90e4-cd104f429ada None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:36.550172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b13ce-e259-4360-90e4-cd104f429ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:36.617084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-739b13ce-e259-4360-90e4-cd104f429ada None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:36.618326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-739b13ce-e259-4360-90e4-cd104f429ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:36.714413 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 573/1149] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:37.010360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d316de-9038-448b-b1fe-6af127258f17 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:37.010646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d316de-9038-448b-b1fe-6af127258f17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:37.010918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d316de-9038-448b-b1fe-6af127258f17 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:37.012265 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 577/1150] 10.222.0.27 () {54 vars in 962 bytes} [Tue Oct 18 13:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:37.017389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063b6f3-248c-4167-a440-b564e57b8145 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:37.017744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063b6f3-248c-4167-a440-b564e57b8145 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:37.018025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063b6f3-248c-4167-a440-b564e57b8145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:37.092092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c063b6f3-248c-4167-a440-b564e57b8145 None None] MFA Rules not processed for user `562e50f34bb54c68b428d077efeaca70`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:37.093283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c063b6f3-248c-4167-a440-b564e57b8145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:37.114514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:37.169269 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 574/1151] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Oct 18 13:16:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:37.177200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d316de-9038-448b-b1fe-6af127258f17 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:37.178744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0d316de-9038-448b-b1fe-6af127258f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:37.284282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d316de-9038-448b-b1fe-6af127258f17 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:37.355546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d40c7f-ecd2-4fd1-b8c4-a4f69fdba765 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:37.356136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d40c7f-ecd2-4fd1-b8c4-a4f69fdba765 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:37.356410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d40c7f-ecd2-4fd1-b8c4-a4f69fdba765 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:37.356676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d40c7f-ecd2-4fd1-b8c4-a4f69fdba765 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:37.358284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82d40c7f-ecd2-4fd1-b8c4-a4f69fdba765 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:37.412372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:37.468043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d40c7f-ecd2-4fd1-b8c4-a4f69fdba765 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:37.469501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d40c7f-ecd2-4fd1-b8c4-a4f69fdba765 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:37.488698 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 578/1152] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:39.705745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eedb00-3d03-4d88-92e7-edcd799d0c95 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:39.706305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eedb00-3d03-4d88-92e7-edcd799d0c95 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:39.706305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eedb00-3d03-4d88-92e7-edcd799d0c95 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:39.707585 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 575/1153] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:39.713266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bb845-fa91-4eb3-a633-589cb62806fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:39.713715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bb845-fa91-4eb3-a633-589cb62806fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:39.713842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bb845-fa91-4eb3-a633-589cb62806fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:39.778674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc7bb845-fa91-4eb3-a633-589cb62806fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:39.779853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc7bb845-fa91-4eb3-a633-589cb62806fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:39.875195 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 579/1154] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:40.145405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eedb00-3d03-4d88-92e7-edcd799d0c95 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:40.146993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14eedb00-3d03-4d88-92e7-edcd799d0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:40.269276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eedb00-3d03-4d88-92e7-edcd799d0c95 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:40.320444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:40.363387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfdbd5-74b2-4876-b43a-e37988ad7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:40.363980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdbd5-74b2-4876-b43a-e37988ad7812 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:40.364254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdbd5-74b2-4876-b43a-e37988ad7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:40.364525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfdbd5-74b2-4876-b43a-e37988ad7812 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:40.365158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdbd5-74b2-4876-b43a-e37988ad7812 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:40.366285 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-93bfdbd5-74b2-4876-b43a-e37988ad7812 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:16:40.366285 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:16:40.366285 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:16:40.367427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfdbd5-74b2-4876-b43a-e37988ad7812 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:40.387073 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 576/1155] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Oct 18 13:16:40 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:16:42.529620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030d925-7877-4f11-9248-d94f414c8bc9 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:42.530179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030d925-7877-4f11-9248-d94f414c8bc9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:42.530179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030d925-7877-4f11-9248-d94f414c8bc9 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:42.531563 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 580/1156] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:42.537155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477324f-8704-403f-b3a5-f22a5952c280 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:42.538564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477324f-8704-403f-b3a5-f22a5952c280 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:42.538564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477324f-8704-403f-b3a5-f22a5952c280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:42.603286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7477324f-8704-403f-b3a5-f22a5952c280 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:42.604477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7477324f-8704-403f-b3a5-f22a5952c280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:42.699081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 577/1157] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:42.989472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030d925-7877-4f11-9248-d94f414c8bc9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:42.991041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9030d925-7877-4f11-9248-d94f414c8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:43.000968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:43.136622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030d925-7877-4f11-9248-d94f414c8bc9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:43.217499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:43.250476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d317b-72cb-4c43-bca8-63b9cf5b3b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:43.251069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d317b-72cb-4c43-bca8-63b9cf5b3b39 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:43.251330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d317b-72cb-4c43-bca8-63b9cf5b3b39 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:43.251600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d317b-72cb-4c43-bca8-63b9cf5b3b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:43.253208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c60d317b-72cb-4c43-bca8-63b9cf5b3b39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:43.343246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d317b-72cb-4c43-bca8-63b9cf5b3b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:43.344812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d317b-72cb-4c43-bca8-63b9cf5b3b39 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:43.362606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 581/1158] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:45.662657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59105-14b4-4c48-9d56-e2ac65fea505 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:45.663212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59105-14b4-4c48-9d56-e2ac65fea505 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:45.663212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec59105-14b4-4c48-9d56-e2ac65fea505 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:45.664547 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 578/1159] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:45.670515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb828-3249-4857-8e4b-da1171953fd2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:45.670900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb828-3249-4857-8e4b-da1171953fd2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:45.671051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb828-3249-4857-8e4b-da1171953fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:45.736344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-15cdb828-3249-4857-8e4b-da1171953fd2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:45.737455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15cdb828-3249-4857-8e4b-da1171953fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:45.782896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:45.832728 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 582/1160] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:46.121624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec59105-14b4-4c48-9d56-e2ac65fea505 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:46.123170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ec59105-14b4-4c48-9d56-e2ac65fea505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:46.146244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:46.223254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec59105-14b4-4c48-9d56-e2ac65fea505 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:46.295310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6e94-066e-4f46-8ef4-aabea154a12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:46.295911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6e94-066e-4f46-8ef4-aabea154a12d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:46.296192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6e94-066e-4f46-8ef4-aabea154a12d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:46.296464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6e94-066e-4f46-8ef4-aabea154a12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:46.298044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79ab6e94-066e-4f46-8ef4-aabea154a12d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:46.371501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:46.404858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6e94-066e-4f46-8ef4-aabea154a12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:46.406584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6e94-066e-4f46-8ef4-aabea154a12d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:46.425243 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 579/1161] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:48.597854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99144-f1eb-4f8f-8876-d2133e5650d1 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:48.598459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99144-f1eb-4f8f-8876-d2133e5650d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:48.598459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99144-f1eb-4f8f-8876-d2133e5650d1 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:48.599838 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 583/1162] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:48.605599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083ecf-988f-4ee2-b828-54a89ca04f7e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:48.606016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083ecf-988f-4ee2-b828-54a89ca04f7e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:48.606188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083ecf-988f-4ee2-b828-54a89ca04f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:48.671946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d083ecf-988f-4ee2-b828-54a89ca04f7e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:48.673141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d083ecf-988f-4ee2-b828-54a89ca04f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:48.766717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 580/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:49.050781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99144-f1eb-4f8f-8876-d2133e5650d1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:49.052376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fec99144-f1eb-4f8f-8876-d2133e5650d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:49.158562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99144-f1eb-4f8f-8876-d2133e5650d1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:49.234642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:49.236328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241f964-5493-4ab8-91ae-0e276cc641a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:49.236947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241f964-5493-4ab8-91ae-0e276cc641a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:49.237225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241f964-5493-4ab8-91ae-0e276cc641a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:49.237498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241f964-5493-4ab8-91ae-0e276cc641a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:49.239210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f241f964-5493-4ab8-91ae-0e276cc641a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:49.350362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241f964-5493-4ab8-91ae-0e276cc641a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:49.351684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241f964-5493-4ab8-91ae-0e276cc641a3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:49.371047 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 584/1164] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:51.630074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f665f-5b47-44c3-9fc4-dffaa35881d3 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:51.630643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f665f-5b47-44c3-9fc4-dffaa35881d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:51.630643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f665f-5b47-44c3-9fc4-dffaa35881d3 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:51.631992 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 581/1165] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:51.637293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8b2f3-cb02-4aca-9ab1-321ed8571440 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:51.637708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8b2f3-cb02-4aca-9ab1-321ed8571440 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:51.637850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8b2f3-cb02-4aca-9ab1-321ed8571440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:51.704572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-31d8b2f3-cb02-4aca-9ab1-321ed8571440 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:51.705706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31d8b2f3-cb02-4aca-9ab1-321ed8571440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:51.757816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:51.801283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 585/1166] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:52.092476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f665f-5b47-44c3-9fc4-dffaa35881d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:52.094019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca0f665f-5b47-44c3-9fc4-dffaa35881d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:52.130613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:52.197356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f665f-5b47-44c3-9fc4-dffaa35881d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:52.270700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46512ed-e752-475c-a0cc-42263dae2c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:52.272540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46512ed-e752-475c-a0cc-42263dae2c90 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:52.272540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46512ed-e752-475c-a0cc-42263dae2c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:52.272540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46512ed-e752-475c-a0cc-42263dae2c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:52.273423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a46512ed-e752-475c-a0cc-42263dae2c90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:52.354389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:52.383106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46512ed-e752-475c-a0cc-42263dae2c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:52.384608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46512ed-e752-475c-a0cc-42263dae2c90 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:52.404325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 582/1167] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:54.887550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76c32-ee69-4dbf-a253-22f14c77ff63 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:54.888109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76c32-ee69-4dbf-a253-22f14c77ff63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:54.888109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76c32-ee69-4dbf-a253-22f14c77ff63 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:54.889424 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 586/1168] 10.222.0.27 () {54 vars in 927 bytes} [Tue Oct 18 13:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:16:54.894549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047be49-0a8c-45f8-8cae-f99aec41d597 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:54.894962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047be49-0a8c-45f8-8cae-f99aec41d597 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:54.895097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047be49-0a8c-45f8-8cae-f99aec41d597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:54.959675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e047be49-0a8c-45f8-8cae-f99aec41d597 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:16:54.960868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e047be49-0a8c-45f8-8cae-f99aec41d597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:55.056101 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 583/1169] 10.222.0.27 () {58 vars in 1024 bytes} [Tue Oct 18 13:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:16:55.341631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76c32-ee69-4dbf-a253-22f14c77ff63 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:16:55.343208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35d76c32-ee69-4dbf-a253-22f14c77ff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:55.446932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76c32-ee69-4dbf-a253-22f14c77ff63 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:16:55.520248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015d29b-e27e-486e-86ae-ac66e9cb5d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:16:55.520837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015d29b-e27e-486e-86ae-ac66e9cb5d2a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:16:55.521113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015d29b-e27e-486e-86ae-ac66e9cb5d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:16:55.521380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015d29b-e27e-486e-86ae-ac66e9cb5d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:16:55.523012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a015d29b-e27e-486e-86ae-ac66e9cb5d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:16:55.531514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:55.630287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015d29b-e27e-486e-86ae-ac66e9cb5d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:16:55.631706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015d29b-e27e-486e-86ae-ac66e9cb5d2a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:16:55.650037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 587/1170] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:17:05.054502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:05.647839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=50 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:28.437848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:28.438479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:28.438479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:28.514502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:18:28.515679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:28.611213 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 584/1171] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:18:28.619355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba713e-414e-4571-9842-2edfb6e0ac71 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:28.619846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba713e-414e-4571-9842-2edfb6e0ac71 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:28.619950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba713e-414e-4571-9842-2edfb6e0ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:28.695019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-87ba713e-414e-4571-9842-2edfb6e0ac71 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:18:28.696711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-87ba713e-414e-4571-9842-2edfb6e0ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:28.791735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 588/1172] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:18:28.796521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:28.797737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:28.809746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d08f2d-b1fb-42a0-ab1d-999041a96224 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:28.870335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:28.904187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:28.904786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:28.905066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:28.905340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:28.905979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:18:28.906317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:28.907333 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:18:28.907333 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:18:28.907333 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:18:28.908227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:28.919155 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 585/1173] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:18:28.928510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba713e-414e-4571-9842-2edfb6e0ac71 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:28.938243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba713e-414e-4571-9842-2edfb6e0ac71 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:28.999827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:29.032280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:29.032878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:29.033150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:29.033415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:29.034044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:29.035161 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:18:29.035161 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:18:29.035161 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:18:29.036372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:29.136282 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 589/1174] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:18:28 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:18:29.140465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:29.141985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:29.175771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7d23-16e8-41ca-a7a6-f22ec6001c53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:29.268008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:29.268544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:29.268822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:29.269091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:29.269724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:29.270782 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:18:29.270782 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:18:29.270782 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:18:29.271994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:29.353206 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 586/1175] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:18:29 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:18:29.357373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:29.358922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:29.420814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98cc3f-9712-439c-99d5-aaaac2656860 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:29.505182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:29.515093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:29.519007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:29.519007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:29.519007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:29.519007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:29.519007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:29.532562 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 590/1176] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:18:29.536612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:29.540422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:29.550194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9de1c-fdec-432c-a6f3-1836d9d24a69 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:29.574627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:29.644182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d0645-7401-4a48-8ce7-8bb74dedfb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:29.644792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0645-7401-4a48-8ce7-8bb74dedfb62 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:29.645071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0645-7401-4a48-8ce7-8bb74dedfb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:29.645344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0645-7401-4a48-8ce7-8bb74dedfb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:29.645987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d0645-7401-4a48-8ce7-8bb74dedfb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:29.647641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d0645-7401-4a48-8ce7-8bb74dedfb62 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:29.660305 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 587/1177] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:18:29.665054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:29.666594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:29.698954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d2f04-ce6f-4ad2-b12c-3516cda45ccc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:29.798682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aad953-7bab-44a1-94b2-c09f25bf64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:29.799257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aad953-7bab-44a1-94b2-c09f25bf64f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:29.799534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aad953-7bab-44a1-94b2-c09f25bf64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:29.799803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aad953-7bab-44a1-94b2-c09f25bf64f5 admin admin] PATH_INFO: `/v3/projects/dd5afe26f4894d4191fec9488fc88dec/users/4d197e6fe40d4e528f2c0d1bdc0a8cd5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:29.822339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aad953-7bab-44a1-94b2-c09f25bf64f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5afe26f4894d4191fec9488fc88dec, user_id=4d197e6fe40d4e528f2c0d1bdc0a8cd5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:29.825113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aad953-7bab-44a1-94b2-c09f25bf64f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:29.884467 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 591/1178] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:18:29 2022] PUT /identity/v3/projects/dd5afe26f4894d4191fec9488fc88dec/users/4d197e6fe40d4e528f2c0d1bdc0a8cd5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:18:29.895479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0603-8c67-4b47-a835-2116a9182d8e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:29.895769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0603-8c67-4b47-a835-2116a9182d8e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:29.896046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0603-8c67-4b47-a835-2116a9182d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:29.951494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-653e0603-8c67-4b47-a835-2116a9182d8e None None] MFA Rules not processed for user `4d197e6fe40d4e528f2c0d1bdc0a8cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:18:29.952690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-653e0603-8c67-4b47-a835-2116a9182d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:30.028751 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 588/1179] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:18:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:18:30.041732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4d6bd-1a12-4e5b-9eb0-a217d8861cd5 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:30.042018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4d6bd-1a12-4e5b-9eb0-a217d8861cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:30.042332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4d6bd-1a12-4e5b-9eb0-a217d8861cd5 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:30.043665 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 592/1180] 10.222.0.27 () {54 vars in 963 bytes} [Tue Oct 18 13:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:18:30.048507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f60a-1d5c-42d4-b7dd-9f22700022ee None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:30.048958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f60a-1d5c-42d4-b7dd-9f22700022ee None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:30.049195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f60a-1d5c-42d4-b7dd-9f22700022ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:30.080451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:30.125266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7f13f60a-1d5c-42d4-b7dd-9f22700022ee None None] MFA Rules not processed for user `b6c94378d347410c944afe6fe9a55584`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:18:30.126490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f13f60a-1d5c-42d4-b7dd-9f22700022ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:30.202574 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 589/1181] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Oct 18 13:18:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:18:30.210252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4d6bd-1a12-4e5b-9eb0-a217d8861cd5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:30.212403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2d4d6bd-1a12-4e5b-9eb0-a217d8861cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:30.262675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:30.316407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4d6bd-1a12-4e5b-9eb0-a217d8861cd5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:30.391626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:30.392230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:30.392511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:30.392784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:30.394428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:30.492978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:30.494460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:30.497868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:30.512597 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 593/1182] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:18:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:18:30.565284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270d8c4-0739-4ebd-98fd-85ea86a24fed None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:30.565724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270d8c4-0739-4ebd-98fd-85ea86a24fed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:30.565839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270d8c4-0739-4ebd-98fd-85ea86a24fed None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:30.567180 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 590/1183] 10.222.0.27 () {52 vars in 830 bytes} [Tue Oct 18 13:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:18:30.571209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:30.572411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:30.670809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d876545-df6d-49e7-8795-3d543b993144 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:30.765689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:30.766375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:30.766657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:30.766930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] PATH_INFO: `/v3/users/4d197e6fe40d4e528f2c0d1bdc0a8cd5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:30.780809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d197e6fe40d4e528f2c0d1bdc0a8cd5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:30.781819 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:18:30.781819 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:18:30.781819 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:18:30.783080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:30.793042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:30.962020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d197e6fe40d4e528f2c0d1bdc0a8cd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:30.962511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d197e6fe40d4e528f2c0d1bdc0a8cd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:31.020449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d197e6fe40d4e528f2c0d1bdc0a8cd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:31.020960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d197e6fe40d4e528f2c0d1bdc0a8cd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:31.035929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d197e6fe40d4e528f2c0d1bdc0a8cd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:31.064620 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 594/1184] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:18:30 2022] DELETE /identity/v3/users/4d197e6fe40d4e528f2c0d1bdc0a8cd5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:18:31.068986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:31.069272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:31.069546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:31.126174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:18:31.127371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:31.202205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:31.216756 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 591/1185] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:18:31.224398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:31.225615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:31.324385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca3ed3-c34b-41c0-a0a9-913e5d7ae934 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:31.380547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:31.400535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dde91-c952-43af-891b-72b961714261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:31.401203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dde91-c952-43af-891b-72b961714261 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:31.401481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dde91-c952-43af-891b-72b961714261 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:31.401754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dde91-c952-43af-891b-72b961714261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:31.403394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c58dde91-c952-43af-891b-72b961714261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:31.512316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dde91-c952-43af-891b-72b961714261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:31.513693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dde91-c952-43af-891b-72b961714261 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:31.532009 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 595/1186] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:18:32.011476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:18:32.015674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:18:32.025933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0d0cb-d6e6-46c8-af09-2e5f14a895f1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:18:32.129386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:18:32.130009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:18:32.130308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:18:32.130576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] PATH_INFO: `/v3/projects/dd5afe26f4894d4191fec9488fc88dec` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:18:32.141311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5afe26f4894d4191fec9488fc88dec)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:18:32.142360 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:18:32.142360 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:18:32.142360 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:18:32.143555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:18:32.259700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5afe26f4894d4191fec9488fc88dec', 'request_id': 'req-cc9d433f-c22f-4943-84c5-f9817a1d69f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:32.272919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5afe26f4894d4191fec9488fc88dec', 'request_id': 'req-cc9d433f-c22f-4943-84c5-f9817a1d69f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:32.357604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5afe26f4894d4191fec9488fc88dec', 'request_id': 'req-cc9d433f-c22f-4943-84c5-f9817a1d69f5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:32.384161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] The token cache is being invalidate because project dd5afe26f4894d4191fec9488fc88dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:18:32.384446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:32.385171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc9d433f-c22f-4943-84c5-f9817a1d69f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:18:32.386708 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 592/1187] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:18:32 2022] DELETE /identity/v3/projects/dd5afe26f4894d4191fec9488fc88dec => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:18:41.529826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=62 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:42.381878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:37.949286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b660b-0563-4712-a76d-b53cfe89074d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:37.949878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b660b-0563-4712-a76d-b53cfe89074d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:37.949878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b660b-0563-4712-a76d-b53cfe89074d None None] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:37.951170 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 596/1188] 10.222.0.15 () {54 vars in 925 bytes} [Tue Oct 18 13:21:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:21:37.958952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed632f-e679-4c8b-b8f5-4fe4f6104e8e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:37.959424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed632f-e679-4c8b-b8f5-4fe4f6104e8e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:37.959532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed632f-e679-4c8b-b8f5-4fe4f6104e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:38.036648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-19ed632f-e679-4c8b-b8f5-4fe4f6104e8e None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:21:38.037868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-19ed632f-e679-4c8b-b8f5-4fe4f6104e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:21:38.125712 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 593/1189] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Oct 18 13:21:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:21:41.186410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469ec2-e3f4-42c5-85c5-9be5d0130e10 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:41.186982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469ec2-e3f4-42c5-85c5-9be5d0130e10 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:41.186982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7469ec2-e3f4-42c5-85c5-9be5d0130e10 None None] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:41.188214 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 597/1190] 10.222.0.25 () {54 vars in 925 bytes} [Tue Oct 18 13:21:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:21:41.210550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b53b-11bc-45f0-a7cb-092af28a89e2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:41.211029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b53b-11bc-45f0-a7cb-092af28a89e2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:41.211126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b53b-11bc-45f0-a7cb-092af28a89e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:41.230496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5787b53b-11bc-45f0-a7cb-092af28a89e2 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:21:41.231683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5787b53b-11bc-45f0-a7cb-092af28a89e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:21:41.240255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 594/1191] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 18 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:21:42.010917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470f5d-6278-4a48-b851-307e67310d5e None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:42.011207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470f5d-6278-4a48-b851-307e67310d5e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:42.011485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470f5d-6278-4a48-b851-307e67310d5e None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:42.012821 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 598/1192] 10.222.0.27 () {54 vars in 961 bytes} [Tue Oct 18 13:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:21:42.017953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94469-ee15-4423-8972-ca3d2e8edc41 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:42.018271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94469-ee15-4423-8972-ca3d2e8edc41 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:42.018550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94469-ee15-4423-8972-ca3d2e8edc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:42.037887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-38b94469-ee15-4423-8972-ca3d2e8edc41 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:21:42.039093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38b94469-ee15-4423-8972-ca3d2e8edc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:21:42.048029 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 595/1193] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 13:21:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:21:42.055415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc470f5d-6278-4a48-b851-307e67310d5e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:21:42.069628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc470f5d-6278-4a48-b851-307e67310d5e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:21:42.074789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf761f3-bec4-43ed-a34f-e7fc232e3c3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:21:42.075379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf761f3-bec4-43ed-a34f-e7fc232e3c3d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:42.075659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf761f3-bec4-43ed-a34f-e7fc232e3c3d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:42.075932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf761f3-bec4-43ed-a34f-e7fc232e3c3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:42.083949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf761f3-bec4-43ed-a34f-e7fc232e3c3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:21:42.085525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf761f3-bec4-43ed-a34f-e7fc232e3c3d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:21:42.095848 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 599/1194] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:21:45.012588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b94469-ee15-4423-8972-ca3d2e8edc41 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:21:45.022221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b94469-ee15-4423-8972-ca3d2e8edc41 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:21:45.027135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42098ade-7d51-484b-91ee-4ae6dc1b7218 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:21:45.027730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098ade-7d51-484b-91ee-4ae6dc1b7218 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:21:45.028007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098ade-7d51-484b-91ee-4ae6dc1b7218 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:21:45.028279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098ade-7d51-484b-91ee-4ae6dc1b7218 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:21:45.036791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42098ade-7d51-484b-91ee-4ae6dc1b7218 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:21:45.038402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42098ade-7d51-484b-91ee-4ae6dc1b7218 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:21:45.048281 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 596/1195] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:21:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:21:52.091152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:55.043805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=75 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:10.722040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584172-47ea-4392-a2c3-74acb2b848a3 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:10.722635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584172-47ea-4392-a2c3-74acb2b848a3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:10.722635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584172-47ea-4392-a2c3-74acb2b848a3 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:10.724652 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 600/1196] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:22:10.729457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08356880-c5c4-48d4-a680-ef5959995b0e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:10.729874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08356880-c5c4-48d4-a680-ef5959995b0e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:10.730006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08356880-c5c4-48d4-a680-ef5959995b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:10.777571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-08356880-c5c4-48d4-a680-ef5959995b0e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:22:10.778821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-08356880-c5c4-48d4-a680-ef5959995b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:22:10.837664 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 597/1197] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:22:10.990858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90584172-47ea-4392-a2c3-74acb2b848a3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:22:10.992562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90584172-47ea-4392-a2c3-74acb2b848a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:22:11.094931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90584172-47ea-4392-a2c3-74acb2b848a3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:22:11.101055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e76f5-c498-4e8c-a664-008018bb08d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:22:11.101682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e76f5-c498-4e8c-a664-008018bb08d5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:11.101960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e76f5-c498-4e8c-a664-008018bb08d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:11.102272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e76f5-c498-4e8c-a664-008018bb08d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:11.110175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e76f5-c498-4e8c-a664-008018bb08d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:22:11.111992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e76f5-c498-4e8c-a664-008018bb08d5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:22:11.121949 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 601/1198] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:22:12.200559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067633-073b-4c0f-90d5-2e6d7ebf0c42 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:12.201126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067633-073b-4c0f-90d5-2e6d7ebf0c42 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:12.201126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067633-073b-4c0f-90d5-2e6d7ebf0c42 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:12.202481 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 598/1199] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 13:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:22:12.208606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e2a9-2008-4db2-b96a-8f67a7b557c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:12.209055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e2a9-2008-4db2-b96a-8f67a7b557c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:12.209153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e2a9-2008-4db2-b96a-8f67a7b557c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:12.228736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7c08e2a9-2008-4db2-b96a-8f67a7b557c5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:22:12.229911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c08e2a9-2008-4db2-b96a-8f67a7b557c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:22:12.237913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 602/1200] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:22:12.387343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067633-073b-4c0f-90d5-2e6d7ebf0c42 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:22:12.401987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067633-073b-4c0f-90d5-2e6d7ebf0c42 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:22:12.407536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923944ec-a2cb-4e61-981e-f084fbe5e3c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:22:12.408127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923944ec-a2cb-4e61-981e-f084fbe5e3c6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:12.408405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923944ec-a2cb-4e61-981e-f084fbe5e3c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:12.408673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923944ec-a2cb-4e61-981e-f084fbe5e3c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:12.417089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923944ec-a2cb-4e61-981e-f084fbe5e3c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:22:12.418751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923944ec-a2cb-4e61-981e-f084fbe5e3c6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:22:12.428009 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 599/1201] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:22:16.263510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e0ee-17ca-41a4-a99e-e1c4b42a261c None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:16.264055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e0ee-17ca-41a4-a99e-e1c4b42a261c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:16.264055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e0ee-17ca-41a4-a99e-e1c4b42a261c None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:16.265462 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 603/1202] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:22:16.270853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5597c28-bc3f-46d8-a750-ebab5557284a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:16.271275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5597c28-bc3f-46d8-a750-ebab5557284a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:16.271403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5597c28-bc3f-46d8-a750-ebab5557284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:16.291104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e5597c28-bc3f-46d8-a750-ebab5557284a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:22:16.292295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5597c28-bc3f-46d8-a750-ebab5557284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:22:16.300092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 600/1203] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:22:16.596584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e0ee-17ca-41a4-a99e-e1c4b42a261c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:22:16.598896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d10e0ee-17ca-41a4-a99e-e1c4b42a261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:22:16.674459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e0ee-17ca-41a4-a99e-e1c4b42a261c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:22:16.678356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb546c69-3f7f-45c3-abc5-859ebd1fb7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:22:16.678959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb546c69-3f7f-45c3-abc5-859ebd1fb7df service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:16.679234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb546c69-3f7f-45c3-abc5-859ebd1fb7df service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:16.679501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb546c69-3f7f-45c3-abc5-859ebd1fb7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:16.688664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb546c69-3f7f-45c3-abc5-859ebd1fb7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:22:16.690114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb546c69-3f7f-45c3-abc5-859ebd1fb7df service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:22:16.700930 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 604/1204] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:22:18.825827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b60d-1661-4a61-8a26-3c7b8743370c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:18.826368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b60d-1661-4a61-8a26-3c7b8743370c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:18.826368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b60d-1661-4a61-8a26-3c7b8743370c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:18.827740 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 601/1205] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 13:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:22:18.833456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e707de-0eac-40ab-a1c6-9f48f64b9207 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:18.836328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e707de-0eac-40ab-a1c6-9f48f64b9207 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:18.836328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e707de-0eac-40ab-a1c6-9f48f64b9207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:18.853758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-26e707de-0eac-40ab-a1c6-9f48f64b9207 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:22:18.854974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26e707de-0eac-40ab-a1c6-9f48f64b9207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:22:18.863067 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 605/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 13:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:22:19.146983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b60d-1661-4a61-8a26-3c7b8743370c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:22:19.157616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b60d-1661-4a61-8a26-3c7b8743370c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:22:19.161125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8712d-0989-4cbe-8667-0f3a5a83e957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:22:19.161707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8712d-0989-4cbe-8667-0f3a5a83e957 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:22:19.161985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8712d-0989-4cbe-8667-0f3a5a83e957 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:22:19.162292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8712d-0989-4cbe-8667-0f3a5a83e957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:22:19.171183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8712d-0989-4cbe-8667-0f3a5a83e957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:22:19.172623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8712d-0989-4cbe-8667-0f3a5a83e957 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:22:19.181952 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 602/1207] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:22:28.848821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:29.177872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=52 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:10.093045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a783f9a-9892-450b-80a5-d1b44c19c2c5 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:10.093620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a783f9a-9892-450b-80a5-d1b44c19c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:10.093620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a783f9a-9892-450b-80a5-d1b44c19c2c5 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:10.094988 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 606/1208] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:23:10.100018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7db0b-ab86-4f56-9cee-fbcc42b998f8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:10.100473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7db0b-ab86-4f56-9cee-fbcc42b998f8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:10.100605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7db0b-ab86-4f56-9cee-fbcc42b998f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:10.120204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-54d7db0b-ab86-4f56-9cee-fbcc42b998f8 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:10.121381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-54d7db0b-ab86-4f56-9cee-fbcc42b998f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:10.130556 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 603/1209] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:23:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:20.115265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:43.054845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77034-0e87-4a77-b153-70b1145ce1c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.056121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77034-0e87-4a77-b153-70b1145ce1c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.057066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77034-0e87-4a77-b153-70b1145ce1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.087403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-23a77034-0e87-4a77-b153-70b1145ce1c7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.089323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23a77034-0e87-4a77-b153-70b1145ce1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.102826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 607/1210] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:23:43.115422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b229f-ff88-4be2-b4ad-2bbd19c14ae7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.116787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b229f-ff88-4be2-b4ad-2bbd19c14ae7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.117276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b229f-ff88-4be2-b4ad-2bbd19c14ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.148124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-606b229f-ff88-4be2-b4ad-2bbd19c14ae7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.150151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-606b229f-ff88-4be2-b4ad-2bbd19c14ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.157879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f11b5-691c-40aa-9583-2c734d8c90e7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.158754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f11b5-691c-40aa-9583-2c734d8c90e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.159268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f11b5-691c-40aa-9583-2c734d8c90e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.176826 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 604/1211] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:23:43.182728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b229f-ff88-4be2-b4ad-2bbd19c14ae7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:43.188512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-344f11b5-691c-40aa-9583-2c734d8c90e7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.189855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-344f11b5-691c-40aa-9583-2c734d8c90e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.194523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b229f-ff88-4be2-b4ad-2bbd19c14ae7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:43.205243 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 608/1212] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:23:43.210041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:43.211358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.211856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.212341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.213209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:43.213890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:43.215920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555bd4c-0895-4161-90de-3ff0af47de7b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.216210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555bd4c-0895-4161-90de-3ff0af47de7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.216492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555bd4c-0895-4161-90de-3ff0af47de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.216907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:43.238255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 605/1213] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:23:43.248080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:43.248570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8555bd4c-0895-4161-90de-3ff0af47de7b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.249897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8555bd4c-0895-4161-90de-3ff0af47de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.259951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a28c6-0953-4301-8704-55643294092a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:43.265661 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 609/1214] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:23:43.271454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555bd4c-0895-4161-90de-3ff0af47de7b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:43.276748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:43.277662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.278224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.278729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.279588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:43.281359 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:23:43.281359 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:23:43.281359 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:23:43.283127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:43.284894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555bd4c-0895-4161-90de-3ff0af47de7b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:43.289803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:43.290465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.290746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.291019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.291975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:43.292281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:43.293301 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:23:43.293301 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:23:43.293301 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:23:43.294224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:43.320565 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 610/1215] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:23:43.335167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:43.364788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab616-2c06-4a42-b193-f16ef3399913 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:43.375136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5912a9-be33-4c0f-b57b-c2d0ff969ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:43.376068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5912a9-be33-4c0f-b57b-c2d0ff969ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.376526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5912a9-be33-4c0f-b57b-c2d0ff969ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.376969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5912a9-be33-4c0f-b57b-c2d0ff969ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.377924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5912a9-be33-4c0f-b57b-c2d0ff969ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:43.380719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5912a9-be33-4c0f-b57b-c2d0ff969ba1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:43.458767 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 606/1216] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/projects => generated 399 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:43.459641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:43.516904 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 611/1217] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:43.521729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e318c-14ee-44b0-aefb-458eb7764a73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.522574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e318c-14ee-44b0-aefb-458eb7764a73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.523056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e318c-14ee-44b0-aefb-458eb7764a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.570920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-958e318c-14ee-44b0-aefb-458eb7764a73 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.574396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-958e318c-14ee-44b0-aefb-458eb7764a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.648698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3775d-4e66-44bb-a9e2-ecfb143bddce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:43.731552 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 612/1218] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:43.738957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e318c-14ee-44b0-aefb-458eb7764a73 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:43.768094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e318c-14ee-44b0-aefb-458eb7764a73 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:43.790772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b7c96-a63e-4d60-a5ad-43b20c95a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:43.791418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7c96-a63e-4d60-a5ad-43b20c95a683 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.791707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7c96-a63e-4d60-a5ad-43b20c95a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.791988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7c96-a63e-4d60-a5ad-43b20c95a683 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.792635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b7c96-a63e-4d60-a5ad-43b20c95a683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:43.793657 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-924b7c96-a63e-4d60-a5ad-43b20c95a683 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:23:43.793657 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:23:43.793657 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:23:43.794783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ded0a9-e4d3-412a-9b06-c5af5881958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:43.794915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b7c96-a63e-4d60-a5ad-43b20c95a683 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:43.795458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ded0a9-e4d3-412a-9b06-c5af5881958b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.795745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ded0a9-e4d3-412a-9b06-c5af5881958b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.796018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ded0a9-e4d3-412a-9b06-c5af5881958b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.796657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ded0a9-e4d3-412a-9b06-c5af5881958b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:43.798968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ded0a9-e4d3-412a-9b06-c5af5881958b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:43.897651 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 607/1219] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/users => generated 300 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:43.899223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7009-3f2a-40dc-8807-93b191d58be1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.899510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7009-3f2a-40dc-8807-93b191d58be1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.899900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd7009-3f2a-40dc-8807-93b191d58be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.920567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2ddd7009-3f2a-40dc-8807-93b191d58be1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.922273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ddd7009-3f2a-40dc-8807-93b191d58be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.927781 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 613/1220] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:43.929314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecbeeb-deeb-487d-8769-d53a82653f9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.929673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecbeeb-deeb-487d-8769-d53a82653f9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.930041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecbeeb-deeb-487d-8769-d53a82653f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.931185 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 608/1221] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:43.932451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d80b9-a0eb-46fe-b65c-f1d20a83b08e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.932740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d80b9-a0eb-46fe-b65c-f1d20a83b08e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.933017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d80b9-a0eb-46fe-b65c-f1d20a83b08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.950579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8eecbeeb-deeb-487d-8769-d53a82653f9d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.952163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8eecbeeb-deeb-487d-8769-d53a82653f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.955493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f15d80b9-a0eb-46fe-b65c-f1d20a83b08e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.956695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f15d80b9-a0eb-46fe-b65c-f1d20a83b08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.960693 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 614/1222] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:43.961740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900fd36-28ed-410f-8411-44784d94e1b6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.962021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900fd36-28ed-410f-8411-44784d94e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.962326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900fd36-28ed-410f-8411-44784d94e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.965125 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 609/1223] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:43.966419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64fbcf-7d3b-4a7e-bc01-42aa97b1a808 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.968151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64fbcf-7d3b-4a7e-bc01-42aa97b1a808 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.968151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64fbcf-7d3b-4a7e-bc01-42aa97b1a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.984138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9900fd36-28ed-410f-8411-44784d94e1b6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.985334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9900fd36-28ed-410f-8411-44784d94e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.987607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6f64fbcf-7d3b-4a7e-bc01-42aa97b1a808 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:43.989349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6f64fbcf-7d3b-4a7e-bc01-42aa97b1a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:43.994213 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 615/1224] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:43.995383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2f4c-f85b-4678-bd79-7859d2be2afd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:43.995665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2f4c-f85b-4678-bd79-7859d2be2afd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:43.995936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb2f4c-f85b-4678-bd79-7859d2be2afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:43.997777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 610/1225] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:44.002171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64fbcf-7d3b-4a7e-bc01-42aa97b1a808 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.012498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64fbcf-7d3b-4a7e-bc01-42aa97b1a808 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.018195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc51a04-6e0e-47a1-b149-ef15ddeddd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.018806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51a04-6e0e-47a1-b149-ef15ddeddd4c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.019135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51a04-6e0e-47a1-b149-ef15ddeddd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.019414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc51a04-6e0e-47a1-b149-ef15ddeddd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.020173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc51a04-6e0e-47a1-b149-ef15ddeddd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.020891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ccbb2f4c-f85b-4678-bd79-7859d2be2afd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:44.021785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc51a04-6e0e-47a1-b149-ef15ddeddd4c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.022114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccbb2f4c-f85b-4678-bd79-7859d2be2afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:44.030082 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 616/1226] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:44.030869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb2f4c-f85b-4678-bd79-7859d2be2afd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.032184 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 611/1227] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:44.033204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee745527-e079-4305-8d41-d29e0db7f77e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.033485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee745527-e079-4305-8d41-d29e0db7f77e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.033765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee745527-e079-4305-8d41-d29e0db7f77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.044255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb2f4c-f85b-4678-bd79-7859d2be2afd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.048890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.049571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.049851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.050148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.057861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.057861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.058591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ee745527-e079-4305-8d41-d29e0db7f77e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:44.058591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee745527-e079-4305-8d41-d29e0db7f77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:44.066112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 617/1229] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:44.066289 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 612/1229] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:44.066579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.066695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262a97-6e97-482a-bd4a-6cdd0fe3b98b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.066695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262a97-6e97-482a-bd4a-6cdd0fe3b98b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.066695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262a97-6e97-482a-bd4a-6cdd0fe3b98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.076130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88545216-9ed9-455c-9706-722f477cd22e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.080915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f3c0d-3f49-4ecc-a33e-8d266ea53488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.081525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f3c0d-3f49-4ecc-a33e-8d266ea53488 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.081803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f3c0d-3f49-4ecc-a33e-8d266ea53488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.082648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f3c0d-3f49-4ecc-a33e-8d266ea53488 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.083298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f3c0d-3f49-4ecc-a33e-8d266ea53488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:44.083604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f3c0d-3f49-4ecc-a33e-8d266ea53488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.085303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f3c0d-3f49-4ecc-a33e-8d266ea53488 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.087277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7f262a97-6e97-482a-bd4a-6cdd0fe3b98b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:44.088447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f262a97-6e97-482a-bd4a-6cdd0fe3b98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:44.096433 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 613/1230] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:44.097423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af6d7-e112-46e5-99a7-bc8097c81308 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.097751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af6d7-e112-46e5-99a7-bc8097c81308 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.106596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af6d7-e112-46e5-99a7-bc8097c81308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.106762 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 618/1231] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:44.106762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53a270-3638-46d5-bca9-407563d400e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.106762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53a270-3638-46d5-bca9-407563d400e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.106762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53a270-3638-46d5-bca9-407563d400e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.107135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:44.120562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5c8af6d7-e112-46e5-99a7-bc8097c81308 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:44.121740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5c8af6d7-e112-46e5-99a7-bc8097c81308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:44.121868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1d53a270-3638-46d5-bca9-407563d400e9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:44.123084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d53a270-3638-46d5-bca9-407563d400e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:44.130500 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 614/1232] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:44.131381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af6d7-e112-46e5-99a7-bc8097c81308 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.134922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 619/1233] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:44.134922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3891-48dc-4f86-9e48-6f46daaf664f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.134922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3891-48dc-4f86-9e48-6f46daaf664f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.134922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d3891-48dc-4f86-9e48-6f46daaf664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.144121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af6d7-e112-46e5-99a7-bc8097c81308 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.149123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.149662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.149941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.150250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.150923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.152568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.153360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ca6d3891-48dc-4f86-9e48-6f46daaf664f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:44.154651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca6d3891-48dc-4f86-9e48-6f46daaf664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:44.162918 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 620/1234] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:44.163132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 615/1235] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:44.163698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d3891-48dc-4f86-9e48-6f46daaf664f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.163889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.173341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078962-1bb9-446e-b18e-9c7285844998 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.176558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d3891-48dc-4f86-9e48-6f46daaf664f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.178717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.179202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.179340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.179607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.179801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.179906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.180085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.180363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.180503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:44.180807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.181065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.182527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.182732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.194161 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 621/1236] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:44.194979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.206181 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 616/1237] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:44.206181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.209606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f973e2-4065-4ac0-b765-2e2c9ced0c88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.211611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa4b68-6efe-45b2-878a-133c80f0b301 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.214174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.214760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.215042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.215319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.215947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.216161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.216732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.217011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.217280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.217880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.217999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:44.218233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.219782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.231721 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 622/1238] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:44.232502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.242817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d2d4-6ff7-4480-a393-f8e79b753e1d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.247391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.247995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.248274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.248688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.249308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:44.249607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.251184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.252743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:44.263813 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 623/1239] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:44.264565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.273992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418572e5-3496-40d8-8f5c-7678ff9207ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.278789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.279481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.279770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.280050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.280675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:44.280980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.282576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.294206 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 624/1240] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:44.294969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.304833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35954838-45fd-4c46-adcc-6a2b5d7d0762 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.308974 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 617/1241] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:44.309835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.312766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.313371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.313655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.313931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.314606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:44.314926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.317059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.336602 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 625/1242] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:44.336602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.340940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966090b1-fb94-4264-b056-00eef3487a25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.376943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc5e3-786e-451c-ace1-1cd76730b33c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.382308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.382968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.383248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.383512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] PATH_INFO: `/v3/projects/a7877794986c42e7832288b3b53816b7/users/22dc271d4d7b4add8a4efc8c7c766379/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.399073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7877794986c42e7832288b3b53816b7, user_id=22dc271d4d7b4add8a4efc8c7c766379, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.401965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.404087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.405093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.405093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.405322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] PATH_INFO: `/v3/projects/36b87172368b42f4b089504ac3b545a8/users/a448bc53c0d343f2bbc87667c88cbd0d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.420341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b87172368b42f4b089504ac3b545a8, user_id=a448bc53c0d343f2bbc87667c88cbd0d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.423114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.469666 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 618/1243] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:44 2022] PUT /identity/v3/projects/a7877794986c42e7832288b3b53816b7/users/22dc271d4d7b4add8a4efc8c7c766379/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:44.473806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.498471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 626/1244] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:44 2022] PUT /identity/v3/projects/36b87172368b42f4b089504ac3b545a8/users/a448bc53c0d343f2bbc87667c88cbd0d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:44.499790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.533272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da9132-f3e0-480b-8b38-c0aa67e9cf50 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.569270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea7e5a-22af-45df-b05f-4f8df927aeec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.571529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:44.574109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.574720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.575002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.575277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.575907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.577832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.589411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.590019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.590330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.590605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.591236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.593157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.685579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 627/1245] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/projects => generated 397 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:44.686282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.700645 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 619/1246] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/projects => generated 403 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:44.700645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.725711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:44.750930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32e29-998a-4c38-95d1-b4174b75826c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.757293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.757903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.758215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.758498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.759119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.761039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e93ae-e245-4ef3-899c-00eddcdcd0c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.761192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.765714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.766470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.766754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.767037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.767669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.770356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.876015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 628/1247] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:44.876820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.888390 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 620/1248] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:44.889258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:44.940746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06f56-9668-4b63-a41a-8ac834ff3a42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.950589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5903359-3380-4811-a1f6-220f5560d0da admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:44.955706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35ec3-bd16-4d5c-a170-4b483a505fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.956310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35ec3-bd16-4d5c-a170-4b483a505fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.956596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35ec3-bd16-4d5c-a170-4b483a505fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.956873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35ec3-bd16-4d5c-a170-4b483a505fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.957935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35ec3-bd16-4d5c-a170-4b483a505fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:44.960580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35ec3-bd16-4d5c-a170-4b483a505fb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:44.996705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141012bf-10c7-4fac-8f69-47a16b1395e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:44.997411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141012bf-10c7-4fac-8f69-47a16b1395e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:44.997626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141012bf-10c7-4fac-8f69-47a16b1395e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:44.997894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141012bf-10c7-4fac-8f69-47a16b1395e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:44.998546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141012bf-10c7-4fac-8f69-47a16b1395e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.000546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141012bf-10c7-4fac-8f69-47a16b1395e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.030426 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 621/1249] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.031556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0f8e-9ed7-4611-a412-ab300aa86e4e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.031838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0f8e-9ed7-4611-a412-ab300aa86e4e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.032110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0f8e-9ed7-4611-a412-ab300aa86e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.059169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9f0e0f8e-9ed7-4611-a412-ab300aa86e4e None None] MFA Rules not processed for user `22dc271d4d7b4add8a4efc8c7c766379`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:45.060360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f0e0f8e-9ed7-4611-a412-ab300aa86e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:45.085726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:45.087606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 629/1250] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:44 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.088859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929f52-8dba-4240-9582-a51dca40c62b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.089150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929f52-8dba-4240-9582-a51dca40c62b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.089425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929f52-8dba-4240-9582-a51dca40c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.117425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5929f52-8dba-4240-9582-a51dca40c62b None None] MFA Rules not processed for user `a448bc53c0d343f2bbc87667c88cbd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:45.118675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5929f52-8dba-4240-9582-a51dca40c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:45.128126 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 622/1251] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:45.129601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e0f8e-9ed7-4611-a412-ab300aa86e4e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.166299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:45.186336 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 630/1252] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:45.187142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929f52-8dba-4240-9582-a51dca40c62b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.195452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e0f8e-9ed7-4611-a412-ab300aa86e4e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.198129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929f52-8dba-4240-9582-a51dca40c62b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.200129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.201201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.201201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.201390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.201867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.203079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.203671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.203835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.203938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.204210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.204885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.206831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.269005 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 623/1253] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.269895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.279188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdec53-af40-476f-a18a-f08251fcad22 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.283732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.284313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.284604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.284863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.290044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.290212 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 631/1254] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.290323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.290439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.298600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836ea6e-e66e-4933-94e7-fe85964794bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.304215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.304805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.305085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.305356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.305973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.307899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.365293 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 624/1255] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.368829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.375693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5cc7b-4ec6-4fe7-b0d5-dea41dd40c4d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.380390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.380972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.381286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.381594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.382255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.384823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.392960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 632/1256] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.395037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.404992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c8bb-b83d-44e2-83cc-ef00e102f80b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.409726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.410877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.411159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.411432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.412065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.413636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.424621 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 633/1257] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.425637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.435431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5da06-81ae-4348-9b1c-6c521a0dd9e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.440119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.440680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.440957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.441226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.441829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.443777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.479332 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 625/1258] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.483858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.490270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccaaec-24c5-42bf-8dec-819672c6ad31 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.494899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.495460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.495736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.496005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.496607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.498524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.540776 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 634/1259] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/projects => generated 399 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.540776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.600093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe217-8178-4569-8276-2929807092cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.604853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.605507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.605788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.606145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.606743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.608378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.614482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 626/1260] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.616556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.618996 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 635/1261] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.619820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.629274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac0a84-2d92-444a-bbe5-96734fc4d908 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.679065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:45.682946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49800f-edcc-4be1-90fb-b1d6cc859a8b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.687378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.687725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.687990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.688267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.688558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.688674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.688822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.689100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.689210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.689782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.690757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.691426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.700573 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 636/1262] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.701601 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 627/1263] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.703081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.703586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.713517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0eb5-97b5-4b97-a827-e2f2d71d1354 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.714204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b665da-1a3f-4567-97c0-5d66f7d78baf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.718128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.718745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.718857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.719025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.719301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.719410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.719665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.719931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.720038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.720562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.721567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.722160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.727866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:45.733575 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 637/1264] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.734422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.737681 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 628/1265] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.738582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.747020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b266a95-fdbb-4390-88b0-25c6734d5983 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.748393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f774c-7c7a-4718-8d80-8b95337837fb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.751857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.752460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.752761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.752976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.753100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.753621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.753739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.753921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.754233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.754855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.755309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.756805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.766661 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 638/1266] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.769033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.779044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9053e-1b03-416e-8faa-5eb2ccbb2401 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.783869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.786174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.786174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.786174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.786174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.788021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.852877 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 629/1267] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/users => generated 306 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.853745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.863443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08edd7a-56a9-4d40-b04c-b2186fc374ca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.867957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.872232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.872232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.872232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.872232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.872232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.878969 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 639/1268] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:45 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:45.878969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.883841 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 630/1269] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.883841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.887069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ceb18-564b-4ec4-a5dd-94a4dd9a8b85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.891473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.892393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.892393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.892579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.893206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.895250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec8c1d-2e51-4306-9b32-e6abc6ff8e1f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.895376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.899951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.900911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.900911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.901125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.901755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.903374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.905863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 640/1270] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.906752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.918247 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 631/1271] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.918247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.918516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333e4e9-3151-4c71-87ab-f8656c5fdb92 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.922738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.923327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.923592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.923858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.924494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.925256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a64e-f1a4-49f0-9819-b263472fdba3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.926079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.929866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.930595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.930883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.931162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] PATH_INFO: `/v3/projects/2fe0437ac3144a399201eeff6f70fda0/users/8c9845a51a614623b1d6f92c457212ef/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.935993 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 641/1272] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.936884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.946448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe0437ac3144a399201eeff6f70fda0, user_id=8c9845a51a614623b1d6f92c457212ef, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.947247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dd754-0dd2-436f-b1f4-3b063c531437 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.949135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.952689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.953412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.953697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.954001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.954674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.956231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.967022 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 642/1273] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:45.967736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:45.979314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048077b-0ce7-4f77-a981-e281c2cc906b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:45.983959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:45.984608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:45.984923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:45.985198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:45.985810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:45.987681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:45.995666 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 632/1274] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:45 2022] PUT /identity/v3/projects/2fe0437ac3144a399201eeff6f70fda0/users/8c9845a51a614623b1d6f92c457212ef/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.006223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.006348 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 643/1275] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:46.006348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.011337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85497-2668-4cf8-b804-2ef791ff48b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.062546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a4e9-9908-45e3-ab5f-4c61bea3c0b7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.067740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.068345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.068623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.068753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.068882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.069317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.069554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.069674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.069920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] PATH_INFO: `/v3/projects/e8aa3924a629405ca8d4940315576ba1/users/fd0b7dc4bfe34473a0ed4d8af2677692/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.071172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.081439 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 633/1276] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:46.082854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.085862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8aa3924a629405ca8d4940315576ba1, user_id=fd0b7dc4bfe34473a0ed4d8af2677692, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.088564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.092966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadaa79-42ce-46bf-8106-acc886f246ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.097691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.098377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.098666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.099056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] PATH_INFO: `/v3/projects/3f754303ccaf4d1caee2638de0df1657/users/3f8997c458e94218bb419010a334f836/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.113566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f754303ccaf4d1caee2638de0df1657, user_id=3f8997c458e94218bb419010a334f836, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.116257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.158516 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 644/1277] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:45 2022] PUT /identity/v3/projects/e8aa3924a629405ca8d4940315576ba1/users/fd0b7dc4bfe34473a0ed4d8af2677692/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.159311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.216129 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 634/1278] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:46 2022] PUT /identity/v3/projects/3f754303ccaf4d1caee2638de0df1657/users/3f8997c458e94218bb419010a334f836/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.216886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.231930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50997-7ca0-4286-9203-e3719924070b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.244985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:46.267400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:46.279427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae287ade-ef79-4c4e-8ccf-ff6887906d04 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.284244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.289265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.289265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.289265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] PATH_INFO: `/v3/projects/8dff05f873b24e56b8cd9f17fddaf616/users/d531836c0a9f4a179bdc1dd87ce79792/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.290741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.291468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.291746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.292017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] PATH_INFO: `/v3/projects/2a89fd93a0d843e1ad91d158b7be21fb/users/d75623286dda46cfb4d8d70608655b9c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.300142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dff05f873b24e56b8cd9f17fddaf616, user_id=d531836c0a9f4a179bdc1dd87ce79792, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.303427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.306842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a89fd93a0d843e1ad91d158b7be21fb, user_id=d75623286dda46cfb4d8d70608655b9c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.309544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.388944 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 635/1279] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:46 2022] PUT /identity/v3/projects/8dff05f873b24e56b8cd9f17fddaf616/users/d531836c0a9f4a179bdc1dd87ce79792/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.390530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.413005 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 645/1280] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:46 2022] PUT /identity/v3/projects/2a89fd93a0d843e1ad91d158b7be21fb/users/d75623286dda46cfb4d8d70608655b9c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.413826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.452843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128d25b-6a64-4882-8755-0527b7eed56d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.476769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6ec84-bdc6-4f6d-b99e-78d1a8970888 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.481536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e9723-8e14-404f-bcae-bdadc63afda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.482301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e9723-8e14-404f-bcae-bdadc63afda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.482532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e9723-8e14-404f-bcae-bdadc63afda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.482800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e9723-8e14-404f-bcae-bdadc63afda1 admin admin] PATH_INFO: `/v3/projects/b8041278f3fb45fc85b8b2fcbd710cdb/users/74bf20bbe43347699c4730b47d4b4030/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.498202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e9723-8e14-404f-bcae-bdadc63afda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8041278f3fb45fc85b8b2fcbd710cdb, user_id=74bf20bbe43347699c4730b47d4b4030, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.501070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e9723-8e14-404f-bcae-bdadc63afda1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.513423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.514107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.514390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.515301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] PATH_INFO: `/v3/projects/faea710b61f141e9b04ea1e1b1c3b3ec/users/802c3abd5f0e4b52aa669e442714c333/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.528364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faea710b61f141e9b04ea1e1b1c3b3ec, user_id=802c3abd5f0e4b52aa669e442714c333, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.531113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.566409 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 646/1281] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:46 2022] PUT /identity/v3/projects/b8041278f3fb45fc85b8b2fcbd710cdb/users/74bf20bbe43347699c4730b47d4b4030/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.568291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c98f5-df57-42e1-a12a-a71be10ec702 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.568577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c98f5-df57-42e1-a12a-a71be10ec702 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.568845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c98f5-df57-42e1-a12a-a71be10ec702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.595351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a51c98f5-df57-42e1-a12a-a71be10ec702 None None] MFA Rules not processed for user `8c9845a51a614623b1d6f92c457212ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:46.596548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a51c98f5-df57-42e1-a12a-a71be10ec702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:46.599447 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 636/1282] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:46 2022] PUT /identity/v3/projects/faea710b61f141e9b04ea1e1b1c3b3ec/users/802c3abd5f0e4b52aa669e442714c333/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.609407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.663149 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 647/1283] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:46.664453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac6aa-46b4-4e42-9b6a-040dc4cece0c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.664747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac6aa-46b4-4e42-9b6a-040dc4cece0c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.665027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac6aa-46b4-4e42-9b6a-040dc4cece0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.670978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b12df-e9b6-414d-aa04-741c2bd10120 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.675643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3798f-fe2d-44ed-a48e-86ca63c17600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.676328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3798f-fe2d-44ed-a48e-86ca63c17600 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.676604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3798f-fe2d-44ed-a48e-86ca63c17600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.676877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3798f-fe2d-44ed-a48e-86ca63c17600 admin admin] PATH_INFO: `/v3/projects/8e8a2ab3d1d341e89321eb0daa775f15/users/6f7b9527ab624cae898a2046f25cf4d8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.684669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:46.689474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:46.692285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3798f-fe2d-44ed-a48e-86ca63c17600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8a2ab3d1d341e89321eb0daa775f15, user_id=6f7b9527ab624cae898a2046f25cf4d8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.694243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6c2ac6aa-46b4-4e42-9b6a-040dc4cece0c None None] MFA Rules not processed for user `fd0b7dc4bfe34473a0ed4d8af2677692`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:46.694243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c2ac6aa-46b4-4e42-9b6a-040dc4cece0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:46.695364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3798f-fe2d-44ed-a48e-86ca63c17600 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.756842 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 648/1284] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:46.757994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d40e-94e4-42c4-ad4f-a615207f682f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.758310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d40e-94e4-42c4-ad4f-a615207f682f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.758582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78d40e-94e4-42c4-ad4f-a615207f682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.770823 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 637/1285] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:46 2022] PUT /identity/v3/projects/8e8a2ab3d1d341e89321eb0daa775f15/users/6f7b9527ab624cae898a2046f25cf4d8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:46.772147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab9e52-948d-4678-b237-4d4f4c0d6b20 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.772435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab9e52-948d-4678-b237-4d4f4c0d6b20 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.772709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab9e52-948d-4678-b237-4d4f4c0d6b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.787055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc78d40e-94e4-42c4-ad4f-a615207f682f None None] MFA Rules not processed for user `3f8997c458e94218bb419010a334f836`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:46.788271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc78d40e-94e4-42c4-ad4f-a615207f682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:46.800869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-55ab9e52-948d-4678-b237-4d4f4c0d6b20 None None] MFA Rules not processed for user `d531836c0a9f4a179bdc1dd87ce79792`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:46.802035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-55ab9e52-948d-4678-b237-4d4f4c0d6b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:46.853112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 649/1286] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:46.854723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a726caa-0c18-499b-a265-cbca0f5b4f6d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.855278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a726caa-0c18-499b-a265-cbca0f5b4f6d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.855558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a726caa-0c18-499b-a265-cbca0f5b4f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.870792 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 638/1287] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:46.871742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab9e52-948d-4678-b237-4d4f4c0d6b20 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.873828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a726caa-0c18-499b-a265-cbca0f5b4f6d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:46.875076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a726caa-0c18-499b-a265-cbca0f5b4f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:46.934684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab9e52-948d-4678-b237-4d4f4c0d6b20 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.935674 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 650/1288] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:46.936911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b6715-9222-4a0b-b811-e3b6e3e4e6b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.937196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b6715-9222-4a0b-b811-e3b6e3e4e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.937472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b6715-9222-4a0b-b811-e3b6e3e4e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.939938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.940616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.940962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.941297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.942580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.944240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.954702 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 639/1289] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:46.955577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:46.965462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837e113-6df8-44d6-bd4e-1bcfdcf0f092 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:46.966720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-573b6715-9222-4a0b-b811-e3b6e3e4e6b1 None None] MFA Rules not processed for user `802c3abd5f0e4b52aa669e442714c333`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:46.967989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-573b6715-9222-4a0b-b811-e3b6e3e4e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:46.969877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:46.970481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:46.970761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:46.971030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:46.971635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:46.973539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:46.988112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.032664 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 651/1290] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:47.033393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b6715-9222-4a0b-b811-e3b6e3e4e6b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.043359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b6715-9222-4a0b-b811-e3b6e3e4e6b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.047911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.048489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.048773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.049049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.049672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.052121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.072312 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 640/1291] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:46 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.072312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.121486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.132961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f29a9-bd72-4f7f-9555-5cbb467c3442 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.137645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.138281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.138562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.138836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.139478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.141075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.146621 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 652/1292] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/projects => generated 397 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.146621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.154628 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 641/1293] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:47.155448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.210348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560732d-c87a-4756-a104-b7e119a89ed6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.211049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77839b81-45dc-4e17-a4ed-1678a5cf43bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.215704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.216326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.216606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.216879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.217537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.219457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.259395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.260011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.260335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.260606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.314585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.315949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.325151 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 642/1294] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:47.326004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.334038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d53f-ac62-4372-9684-1a63a165f5db service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.337773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.338394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.338672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.338943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.342489 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 653/1295] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.343468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.352712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.354428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.366225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 643/1296] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:47.367093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.376702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbd4bb-3433-4bf0-88ec-4183def2a853 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.425295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.428324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fee93f-db8f-4705-9070-64b558d42667 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.433321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.434160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.434442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.434719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] PATH_INFO: `/v3/projects/b8041278f3fb45fc85b8b2fcbd710cdb/users/74bf20bbe43347699c4730b47d4b4030/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.436680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8041278f3fb45fc85b8b2fcbd710cdb, user_id=74bf20bbe43347699c4730b47d4b4030, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.439626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.441391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.442180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.442529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.442877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.443532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.445521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.456882 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 654/1297] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:47 2022] PUT /identity/v3/projects/b8041278f3fb45fc85b8b2fcbd710cdb/users/74bf20bbe43347699c4730b47d4b4030/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:47.458076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.485982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.531180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c424-6a02-421b-89ef-ce5ae5924d88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.536795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.537442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.537727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.537987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.538726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.540823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.563587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 644/1298] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.567256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.629528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318421a-b609-4832-adb3-f7e89c3e7150 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.634336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f6316-ca79-43f2-9e75-d8849bdd2dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.634950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6316-ca79-43f2-9e75-d8849bdd2dcf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.635230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6316-ca79-43f2-9e75-d8849bdd2dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.635502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6316-ca79-43f2-9e75-d8849bdd2dcf admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.636158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f6316-ca79-43f2-9e75-d8849bdd2dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.638102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f6316-ca79-43f2-9e75-d8849bdd2dcf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.662138 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 655/1299] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.662948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.672133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a8b33-452e-4e24-9930-d3f30c90f2c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.677397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.678017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.678327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.678597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] PATH_INFO: `/v3/projects/8e8a2ab3d1d341e89321eb0daa775f15/users/6f7b9527ab624cae898a2046f25cf4d8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.680780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8a2ab3d1d341e89321eb0daa775f15, user_id=6f7b9527ab624cae898a2046f25cf4d8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.683910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.694468 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 656/1300] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:47 2022] PUT /identity/v3/projects/8e8a2ab3d1d341e89321eb0daa775f15/users/6f7b9527ab624cae898a2046f25cf4d8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:47.703173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.748917 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 645/1301] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/users => generated 305 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.751160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f3ff-dbd1-47aa-bb93-cccf409219ed None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.751541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f3ff-dbd1-47aa-bb93-cccf409219ed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.752054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f3ff-dbd1-47aa-bb93-cccf409219ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.779803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5483-aaf4-42f6-9d0d-6758fa5c3b71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.784648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7b91f3ff-dbd1-47aa-bb93-cccf409219ed None None] MFA Rules not processed for user `74bf20bbe43347699c4730b47d4b4030`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:47.786171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.786724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b91f3ff-dbd1-47aa-bb93-cccf409219ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:47.786830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.787180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.787743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.788154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.790090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.862075 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 646/1302] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:47.863434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91f3ff-dbd1-47aa-bb93-cccf409219ed None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.873523 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 657/1303] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.873733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91f3ff-dbd1-47aa-bb93-cccf409219ed None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.874733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:47.881687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.882338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.882616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.882935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.883568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.885818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b2ed6-e96b-48bc-8264-84e69c7d882e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:47.886008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.891960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:47.892713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:47.893099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:47.894151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] PATH_INFO: `/v3/users/d531836c0a9f4a179bdc1dd87ce79792` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:47.895878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d531836c0a9f4a179bdc1dd87ce79792)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:47.897868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:47.993573 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 647/1304] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:47 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:47.994462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.006390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ed4b3-f5b7-4cf2-9897-6827c2374348 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.010988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5da17d-21cb-4273-81ac-3dc212e87cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.011581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5da17d-21cb-4273-81ac-3dc212e87cfb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.011858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5da17d-21cb-4273-81ac-3dc212e87cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.012133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5da17d-21cb-4273-81ac-3dc212e87cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.012788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5da17d-21cb-4273-81ac-3dc212e87cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.014405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5da17d-21cb-4273-81ac-3dc212e87cfb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.025797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 648/1305] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:48.027055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.027342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.027614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.056987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] MFA Rules not processed for user `6f7b9527ab624cae898a2046f25cf4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:48.058250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.062372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.141666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd531836c0a9f4a179bdc1dd87ce79792'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:48.142417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd531836c0a9f4a179bdc1dd87ce79792'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:48.170678 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 649/1306] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:48.171547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.172781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.186607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4eaab-cee0-4dda-891b-c44c8d32d900 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.192310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.192916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.193304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.193547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.194308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.195881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.208467 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 650/1307] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:48.209427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.211339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.223611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd531836c0a9f4a179bdc1dd87ce79792'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:48.227971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0cd8e-45ef-4f7c-9e4f-2cbbff1aa627 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.228089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd531836c0a9f4a179bdc1dd87ce79792'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:48.229621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc4f70-1176-437f-8398-b36b2f21a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.230254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4f70-1176-437f-8398-b36b2f21a9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.230533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4f70-1176-437f-8398-b36b2f21a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.230806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc4f70-1176-437f-8398-b36b2f21a9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.231444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4f70-1176-437f-8398-b36b2f21a9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.232581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd531836c0a9f4a179bdc1dd87ce79792'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:48.233033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc4f70-1176-437f-8398-b36b2f21a9d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.244278 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 651/1308] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:48.245605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca8a81-7b57-4021-83bf-6521b506dac4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.245888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca8a81-7b57-4021-83bf-6521b506dac4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.246185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca8a81-7b57-4021-83bf-6521b506dac4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.247487 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 652/1309] 10.222.0.27 () {54 vars in 961 bytes} [Tue Oct 18 13:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:23:48.248233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca8a81-7b57-4021-83bf-6521b506dac4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.250127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79ca8a81-7b57-4021-83bf-6521b506dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.252434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:INSERT=8,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.259829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 658/1310] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:47 2022] DELETE /identity/v3/users/d531836c0a9f4a179bdc1dd87ce79792 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:48.261040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.263479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.269191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca8a81-7b57-4021-83bf-6521b506dac4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.333966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd3109-046d-4cf7-bba7-5a8219081763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.334764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd3109-046d-4cf7-bba7-5a8219081763 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.335133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf0c5a-212b-4061-bcfd-b8049ee26df0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.335266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd3109-046d-4cf7-bba7-5a8219081763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.335595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd3109-046d-4cf7-bba7-5a8219081763 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.336350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd3109-046d-4cf7-bba7-5a8219081763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.338076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd3109-046d-4cf7-bba7-5a8219081763 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.340432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.341039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.341316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.341591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] PATH_INFO: `/v3/projects/157e0d10956043989dbcd74d2158ee63/users/72cd151d7f6b483b93dca636e575d1e4/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.349079 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 653/1311] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:48.350314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a87d9-ccfb-4c9d-9ff3-e34e03436102 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.350698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a87d9-ccfb-4c9d-9ff3-e34e03436102 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.351075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a87d9-ccfb-4c9d-9ff3-e34e03436102 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.352687 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 654/1312] 10.222.0.27 () {54 vars in 961 bytes} [Tue Oct 18 13:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:23:48.354851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a87d9-ccfb-4c9d-9ff3-e34e03436102 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.358766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157e0d10956043989dbcd74d2158ee63, user_id=72cd151d7f6b483b93dca636e575d1e4, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.362544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.368717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a87d9-ccfb-4c9d-9ff3-e34e03436102 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.373717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec3a99-1439-449b-a68d-c988e8a3f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.374392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec3a99-1439-449b-a68d-c988e8a3f202 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.374674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec3a99-1439-449b-a68d-c988e8a3f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.374949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec3a99-1439-449b-a68d-c988e8a3f202 admin admin] PATH_INFO: `/v3/projects/4293f61372d04f46807f3062c7e192c6/users/ae2e7efa9ee249ea9d14f124fac8235c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.390012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec3a99-1439-449b-a68d-c988e8a3f202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4293f61372d04f46807f3062c7e192c6, user_id=ae2e7efa9ee249ea9d14f124fac8235c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.392782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec3a99-1439-449b-a68d-c988e8a3f202 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.438588 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 659/1313] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:48 2022] PUT /identity/v3/projects/157e0d10956043989dbcd74d2158ee63/users/72cd151d7f6b483b93dca636e575d1e4/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:48.439401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.473551 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 655/1314] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:48 2022] PUT /identity/v3/projects/4293f61372d04f46807f3062c7e192c6/users/ae2e7efa9ee249ea9d14f124fac8235c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:48.475180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0286a8-f130-4aa8-9bd2-a56adade729b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.475466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0286a8-f130-4aa8-9bd2-a56adade729b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.475739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0286a8-f130-4aa8-9bd2-a56adade729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.511512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4ae6-8e5b-42d2-8b81-808a7363daa9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.517949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d0286a8-f130-4aa8-9bd2-a56adade729b None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:48.519273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d0286a8-f130-4aa8-9bd2-a56adade729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.576540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327857d-e3c8-46ed-b40f-b32fdf5c3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.577237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327857d-e3c8-46ed-b40f-b32fdf5c3b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.577498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327857d-e3c8-46ed-b40f-b32fdf5c3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.577772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327857d-e3c8-46ed-b40f-b32fdf5c3b4f admin admin] PATH_INFO: `/v3/projects/81046bafc52c4d0ca3567d4be3c7cc02/users/806ea593b98b4dcd9bdef662fa920a8e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.593816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327857d-e3c8-46ed-b40f-b32fdf5c3b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81046bafc52c4d0ca3567d4be3c7cc02, user_id=806ea593b98b4dcd9bdef662fa920a8e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.595009 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 656/1315] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:48.596527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327857d-e3c8-46ed-b40f-b32fdf5c3b4f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.596715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eabf3e-cada-4191-862c-5d324b8ccac7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.597139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eabf3e-cada-4191-862c-5d324b8ccac7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.597411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eabf3e-cada-4191-862c-5d324b8ccac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.617699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a6eabf3e-cada-4191-862c-5d324b8ccac7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:48.618920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6eabf3e-cada-4191-862c-5d324b8ccac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.626650 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 657/1316] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:48.630508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eabf3e-cada-4191-862c-5d324b8ccac7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.639174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.643526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eabf3e-cada-4191-862c-5d324b8ccac7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.855644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.855644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.855644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.855644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] PATH_INFO: `/v3/projects/9d801f44f8f2417b8ffd5c0fb39c5224/users/52d48bf3743d434b961beba962111ad5/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.856260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d801f44f8f2417b8ffd5c0fb39c5224, user_id=52d48bf3743d434b961beba962111ad5, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.856260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.856385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 660/1317] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:48 2022] PUT /identity/v3/projects/81046bafc52c4d0ca3567d4be3c7cc02/users/806ea593b98b4dcd9bdef662fa920a8e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:48.856385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fcaef-fc68-4f82-acc0-5ce46a54934c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.856385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fcaef-fc68-4f82-acc0-5ce46a54934c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.856385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fcaef-fc68-4f82-acc0-5ce46a54934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.856385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b13fcaef-fc68-4f82-acc0-5ce46a54934c None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:48.856705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b13fcaef-fc68-4f82-acc0-5ce46a54934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.856705 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 661/1318] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 13:23:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:48.856705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fcaef-fc68-4f82-acc0-5ce46a54934c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.856890 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 658/1319] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:48 2022] PUT /identity/v3/projects/9d801f44f8f2417b8ffd5c0fb39c5224/users/52d48bf3743d434b961beba962111ad5/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:48.856890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.874622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fcaef-fc68-4f82-acc0-5ce46a54934c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.881753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951286bd-ea65-4100-8186-2070fe4fcce9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.882483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.883797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.884221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.884500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.885707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.887074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.888241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.888528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.888717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.888810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.889542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:48.891305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:48.905860 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 662/1320] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:48.906232 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 659/1321] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:48.906232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.907810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:48.909757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:48.982391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf373f6-df56-4b17-9b81-6409dbbdea3d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.983077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e77c5-33c6-4e59-8188-f467c6b41c1a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:48.986266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.986961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.987500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.992784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.992906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:48.992906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:48.993062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:48.993133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:48.993133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:48.994954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:49.015557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.017698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.032212 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 663/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:49.033488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.036009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:49.044386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86c84-b3e4-40ff-8041-712f5f1e7f26 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.049184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.049672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.050267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.051687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.052633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.054427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.066432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.068170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.074151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 664/1323] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:49.075081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.082848 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 660/1324] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:49.083715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.095762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095af7bc-b703-45cf-8e8e-ec82b14cc80d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.111662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.112675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769881-a287-4689-a69a-62953fd10398 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.114814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.115233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.116383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.119293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.123603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.129344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.129976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.133757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.133757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.145323 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 661/1325] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:49.148802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.165037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4945fc5-0114-4656-9279-dbe7e8ddf217 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.178195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.178991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.179149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.179440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] PATH_INFO: `/v3/projects/157e0d10956043989dbcd74d2158ee63/users/72cd151d7f6b483b93dca636e575d1e4/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.186791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157e0d10956043989dbcd74d2158ee63, user_id=72cd151d7f6b483b93dca636e575d1e4, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.189688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.226196 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 662/1326] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:49 2022] PUT /identity/v3/projects/157e0d10956043989dbcd74d2158ee63/users/72cd151d7f6b483b93dca636e575d1e4/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:49.226196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.230580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.232816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.251359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 665/1327] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:49.253992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.279394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d4593-080e-4b12-a65a-c3241c4d68e2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.382709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.383680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.383958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.384231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] PATH_INFO: `/v3/projects/81046bafc52c4d0ca3567d4be3c7cc02/users/806ea593b98b4dcd9bdef662fa920a8e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.386590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81046bafc52c4d0ca3567d4be3c7cc02, user_id=806ea593b98b4dcd9bdef662fa920a8e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.389565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.410755 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 666/1328] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:49 2022] PUT /identity/v3/projects/81046bafc52c4d0ca3567d4be3c7cc02/users/806ea593b98b4dcd9bdef662fa920a8e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:49.410755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.421023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d401-4b6b-42b2-b0de-db676df54bd2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.460409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:49.529929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e22ad0-e212-4ef1-a606-261291c70f47 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.539107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40027001-977d-4cd0-8105-7c71bc9d9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.540081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40027001-977d-4cd0-8105-7c71bc9d9e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.541103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40027001-977d-4cd0-8105-7c71bc9d9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.541502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40027001-977d-4cd0-8105-7c71bc9d9e6e admin admin] PATH_INFO: `/v3/projects/9d801f44f8f2417b8ffd5c0fb39c5224/users/52d48bf3743d434b961beba962111ad5/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.544740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40027001-977d-4cd0-8105-7c71bc9d9e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d801f44f8f2417b8ffd5c0fb39c5224, user_id=52d48bf3743d434b961beba962111ad5, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.547949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40027001-977d-4cd0-8105-7c71bc9d9e6e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.574831 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 667/1329] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:49 2022] PUT /identity/v3/projects/9d801f44f8f2417b8ffd5c0fb39c5224/users/52d48bf3743d434b961beba962111ad5/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:49.574999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed068a93-4d56-4eb8-bfe8-e8d1163ea901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.575088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261ea99-3f05-44d5-8792-ad736c30070f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.575088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261ea99-3f05-44d5-8792-ad736c30070f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.575221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed068a93-4d56-4eb8-bfe8-e8d1163ea901 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.575286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261ea99-3f05-44d5-8792-ad736c30070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.575345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed068a93-4d56-4eb8-bfe8-e8d1163ea901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.575345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed068a93-4d56-4eb8-bfe8-e8d1163ea901 admin admin] PATH_INFO: `/v3/projects/4293f61372d04f46807f3062c7e192c6/users/ae2e7efa9ee249ea9d14f124fac8235c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.575345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed068a93-4d56-4eb8-bfe8-e8d1163ea901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4293f61372d04f46807f3062c7e192c6, user_id=ae2e7efa9ee249ea9d14f124fac8235c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.577285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed068a93-4d56-4eb8-bfe8-e8d1163ea901 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.602119 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 663/1330] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:49 2022] PUT /identity/v3/projects/4293f61372d04f46807f3062c7e192c6/users/ae2e7efa9ee249ea9d14f124fac8235c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:49.603804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efd7d-3f5c-4dec-8455-8cb333584f81 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.604253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efd7d-3f5c-4dec-8455-8cb333584f81 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.604813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efd7d-3f5c-4dec-8455-8cb333584f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.631476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4261ea99-3f05-44d5-8792-ad736c30070f None None] MFA Rules not processed for user `72cd151d7f6b483b93dca636e575d1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:49.634393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4261ea99-3f05-44d5-8792-ad736c30070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:49.662834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b2efd7d-3f5c-4dec-8455-8cb333584f81 None None] MFA Rules not processed for user `806ea593b98b4dcd9bdef662fa920a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:49.664095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b2efd7d-3f5c-4dec-8455-8cb333584f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:49.711454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:49.742626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:49.751919 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 668/1331] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:49.763903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261ea99-3f05-44d5-8792-ad736c30070f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.791833 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 664/1332] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:49.793106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326879-105c-46e1-be91-8d5272f59a43 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.793397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326879-105c-46e1-be91-8d5272f59a43 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.793678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f326879-105c-46e1-be91-8d5272f59a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.825495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7f326879-105c-46e1-be91-8d5272f59a43 None None] MFA Rules not processed for user `52d48bf3743d434b961beba962111ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:49.826743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f326879-105c-46e1-be91-8d5272f59a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:49.873756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261ea99-3f05-44d5-8792-ad736c30070f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:49.880790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:49.881543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.882323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.882601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.885318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:49.915276 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 665/1333] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:49.916768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb086-ab81-4902-aff1-b48a4e76c129 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:49.917079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb086-ab81-4902-aff1-b48a4e76c129 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:49.917359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb086-ab81-4902-aff1-b48a4e76c129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:49.954428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-05beb086-ab81-4902-aff1-b48a4e76c129 None None] MFA Rules not processed for user `ae2e7efa9ee249ea9d14f124fac8235c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:49.955754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-05beb086-ab81-4902-aff1-b48a4e76c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:49.980363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:49.982104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:49.992810 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 669/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:49.993616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:49.995127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:50.054303 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 666/1335] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:50.055246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beb086-ab81-4902-aff1-b48a4e76c129 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:50.091390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beb086-ab81-4902-aff1-b48a4e76c129 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.100639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.101458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.101829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.102955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.128578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.131879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f77ec8-786d-4963-9dda-b9e84b49022b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.132708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.148030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.149987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.152064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.154205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] PATH_INFO: `/v3/projects/8dff05f873b24e56b8cd9f17fddaf616` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.155980 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 667/1336] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:50.156737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dff05f873b24e56b8cd9f17fddaf616)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.158015 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:23:50.158015 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:23:50.158015 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:23:50.159446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.178500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:50.234902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:50.247487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd067f2-03ae-45ec-9c2d-4b0c1c9c5532 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.253328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.254580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.254860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.255130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.264013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.265616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.278336 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 668/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:23:50.322619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:50.335810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0285e-51ad-4e2a-8999-79bbf555d6b4 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.342592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dff05f873b24e56b8cd9f17fddaf616', 'request_id': 'req-b3fec082-785d-4e6a-801c-0742819a77cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:50.372039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:50.387333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dff05f873b24e56b8cd9f17fddaf616', 'request_id': 'req-b3fec082-785d-4e6a-801c-0742819a77cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:50.470373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dff05f873b24e56b8cd9f17fddaf616', 'request_id': 'req-b3fec082-785d-4e6a-801c-0742819a77cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:50.471572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece5463-5e01-41bd-a598-294099b50776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.473167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece5463-5e01-41bd-a598-294099b50776 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.473526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece5463-5e01-41bd-a598-294099b50776 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.473878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece5463-5e01-41bd-a598-294099b50776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.491929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] The token cache is being invalidate because project 8dff05f873b24e56b8cd9f17fddaf616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:23:50.492217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:50.493039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:50.495488 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 670/1338] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:49 2022] DELETE /identity/v3/projects/8dff05f873b24e56b8cd9f17fddaf616 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:50.496303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:50.498547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:50.515558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fec082-785d-4e6a-801c-0742819a77cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.531030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eba6df-1774-48ff-b224-6c88bbabf8c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.531684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba6df-1774-48ff-b224-6c88bbabf8c3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.531965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba6df-1774-48ff-b224-6c88bbabf8c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.532242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eba6df-1774-48ff-b224-6c88bbabf8c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.534129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54eba6df-1774-48ff-b224-6c88bbabf8c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:50.560128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece5463-5e01-41bd-a598-294099b50776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.561796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece5463-5e01-41bd-a598-294099b50776 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.573478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 669/1339] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:23:50.574736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.575028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.575338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.595615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:50.596835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:50.616296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eba6df-1774-48ff-b224-6c88bbabf8c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.617989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eba6df-1774-48ff-b224-6c88bbabf8c3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.629069 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 671/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:50.664961 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 670/1341] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:50.676878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf087b-049e-4353-bb90-2eb198d9f475 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.677420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf087b-049e-4353-bb90-2eb198d9f475 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.678414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf087b-049e-4353-bb90-2eb198d9f475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.734343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:50.735642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9bf087b-049e-4353-bb90-2eb198d9f475 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:50.735844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:50.737629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9bf087b-049e-4353-bb90-2eb198d9f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:50.749267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3717b-337a-4649-9318-bdf201523df9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.763226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.763879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.764154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.764590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] PATH_INFO: `/v3/users/8c9845a51a614623b1d6f92c457212ef` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.764723 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 672/1342] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:50.766545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9845a51a614623b1d6f92c457212ef)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.771617 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:23:50.771617 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:23:50.771617 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:23:50.771617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.774702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf087b-049e-4353-bb90-2eb198d9f475 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:50.787148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf087b-049e-4353-bb90-2eb198d9f475 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.802624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.803625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.804048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.804468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.805266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:50.806265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.809485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.828755 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 673/1343] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:50.833457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:50.844294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdbc9d-250a-463d-bc02-0a7c09588a66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:50.850786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:50.851532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:50.851913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:50.852300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:50.853017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:50.855125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:50.976975 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 674/1344] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:50 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:50.980951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.037339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:51.060910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:51.061983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc36c91-a275-495a-a7ac-25c17e7c6492 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:51.065029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9845a51a614623b1d6f92c457212ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.068766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:51.070176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.070521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.070802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.073074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.077544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9845a51a614623b1d6f92c457212ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.078278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9845a51a614623b1d6f92c457212ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.099547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9845a51a614623b1d6f92c457212ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.147668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:51.149754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:51.161238 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 675/1345] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:51.162709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.195392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a5d6753-f169-416c-ac65-8c92ce59f96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9845a51a614623b1d6f92c457212ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.203011 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 671/1346] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:50 2022] DELETE /identity/v3/users/8c9845a51a614623b1d6f92c457212ef => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:23:51.204683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a9a5-ddcf-4107-b09a-ec27d66ad44b None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.205024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a9a5-ddcf-4107-b09a-ec27d66ad44b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.205307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a9a5-ddcf-4107-b09a-ec27d66ad44b None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.215631 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 672/1347] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:23:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:23:51.217343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bf29-18e3-4e8e-a13e-6aa166bc185e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.217343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bf29-18e3-4e8e-a13e-6aa166bc185e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.217343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9bf29-18e3-4e8e-a13e-6aa166bc185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.259871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07e9bf29-18e3-4e8e-a13e-6aa166bc185e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:51.261653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8bef-0f1a-4048-8185-0a968dad03d2 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:51.261816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07e9bf29-18e3-4e8e-a13e-6aa166bc185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.374254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:51.375077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.375179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.375431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.376078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:51.383979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:51.421375 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 673/1348] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:51.423641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.423942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.424225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.462932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:51.464316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.518072 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 676/1349] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:51 2022] POST /identity/v3/users => generated 295 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:51.521028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.523065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.539863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599496a-c992-4f44-b66e-5dbe7bb2d388 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:51.544944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:51.546362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.546648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.546925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] PATH_INFO: `/v3/users/22dc271d4d7b4add8a4efc8c7c766379` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.548079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dc271d4d7b4add8a4efc8c7c766379)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:51.556609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:51.588768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:51.609925 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 674/1350] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:51.611481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.614295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.707803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd636d-518f-411d-80c0-e9e6cba7047e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:51.712393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:51.712676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.712897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.713173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.726112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:51.728810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:51.741981 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 675/1351] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:51.742905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.744325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.761518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:51.771160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dc271d4d7b4add8a4efc8c7c766379'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.772922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dc271d4d7b4add8a4efc8c7c766379'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.774859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76556f3f-4f9b-4ded-b25a-1c71e635b979 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:51.783473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:51.785772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.785772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.785772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.785772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:51.787378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:51.805164 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 676/1352] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:51.806311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.808292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.837617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e7276-fdb5-40d7-8ed6-5122465705eb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:51.847492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:51.848227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.848593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.848988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.856694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.880521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:51.883208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:51.886522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dc271d4d7b4add8a4efc8c7c766379'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.887158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dc271d4d7b4add8a4efc8c7c766379'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.895632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff2f8535-5dc1-45be-bce1-00fca1415e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dc271d4d7b4add8a4efc8c7c766379'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:51.896586 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 677/1353] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:51.897616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.899884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.918312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a2fe3-b99f-4437-bb60-bd5f9276b561 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:51.924681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:51.925548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.926617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.927111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.927942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:51.930107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:51.935458 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 677/1354] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:51 2022] DELETE /identity/v3/users/22dc271d4d7b4add8a4efc8c7c766379 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:51.939774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:51.940166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:51.940565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:51.951864 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 678/1355] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:51.957820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:51.970621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:51.972366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:51.977648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bec4bc-c4df-4c3a-add2-fdce406e3335 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:52.079825 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 678/1356] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:23:52.081954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:52.086558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.095441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:52.096102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.096383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.096658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] PATH_INFO: `/v3/projects/3a90038712264f0a852d014124619cfc/users/31f765d197374f1cb5bdfa5890d74f7d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.108481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbd48b-1f6e-41e6-9712-5426cb206781 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:52.120435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a90038712264f0a852d014124619cfc, user_id=31f765d197374f1cb5bdfa5890d74f7d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:52.121246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:52.121988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.122371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.122721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] PATH_INFO: `/v3/users/802c3abd5f0e4b52aa669e442714c333` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.124929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:52.125935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=802c3abd5f0e4b52aa669e442714c333)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:52.127978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:52.202016 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 679/1357] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:51 2022] PUT /identity/v3/projects/3a90038712264f0a852d014124619cfc/users/31f765d197374f1cb5bdfa5890d74f7d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:52.202016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:52.202016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.336942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cf75d-4af7-41f9-a269-e241b67383c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:52.340820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3417e-0210-4181-a712-36c4f88721ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:52.341436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3417e-0210-4181-a712-36c4f88721ee service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.341710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3417e-0210-4181-a712-36c4f88721ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.341978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3417e-0210-4181-a712-36c4f88721ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.408719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802c3abd5f0e4b52aa669e442714c333'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.409957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802c3abd5f0e4b52aa669e442714c333'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.446668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3417e-0210-4181-a712-36c4f88721ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:52.451481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3417e-0210-4181-a712-36c4f88721ee service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:52.462478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 680/1358] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:52.463697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.466231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.466231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.496433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] MFA Rules not processed for user `31f765d197374f1cb5bdfa5890d74f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:52.497996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.514653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802c3abd5f0e4b52aa669e442714c333'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.516268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802c3abd5f0e4b52aa669e442714c333'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.527594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c8df66f-50cc-4de2-a45e-58ebacbd72a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802c3abd5f0e4b52aa669e442714c333'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.555041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 679/1359] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:52 2022] DELETE /identity/v3/users/802c3abd5f0e4b52aa669e442714c333 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:52.557031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970c55-4629-4bf6-80d5-b378317730c3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.557553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970c55-4629-4bf6-80d5-b378317730c3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.558232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970c55-4629-4bf6-80d5-b378317730c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.594954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64970c55-4629-4bf6-80d5-b378317730c3 None None] MFA Rules not processed for user `a448bc53c0d343f2bbc87667c88cbd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:52.598125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64970c55-4629-4bf6-80d5-b378317730c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.603951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:52.605918 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 681/1360] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:52.606904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:52.609987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.624832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90f2d3-5b4c-45a7-955a-553586d2efe1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:52.665106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:52.670867 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 680/1361] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:52.673302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.673768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.674139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.699153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:52.700469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.740409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:52.741475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.742020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.742628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] PATH_INFO: `/v3/projects/2fe0437ac3144a399201eeff6f70fda0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.744058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe0437ac3144a399201eeff6f70fda0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:52.746444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:52.782090 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 681/1362] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:52.782750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:52.784147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.798922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e66e4-d827-4106-8f92-f9efa1e72b24 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:52.804894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:52.805516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:52.805816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:52.806096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:52.807501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:52.809736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:52.876172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe0437ac3144a399201eeff6f70fda0', 'request_id': 'req-ac9b1877-1b73-49b9-969f-b5e166b2cd02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.897466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe0437ac3144a399201eeff6f70fda0', 'request_id': 'req-ac9b1877-1b73-49b9-969f-b5e166b2cd02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.928689 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 682/1363] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:52 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:52.929753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:52.933251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:52.955116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe0437ac3144a399201eeff6f70fda0', 'request_id': 'req-ac9b1877-1b73-49b9-969f-b5e166b2cd02'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.968613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] The token cache is being invalidate because project 2fe0437ac3144a399201eeff6f70fda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:23:52.969554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.970384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:52.975721 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 682/1364] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:52 2022] DELETE /identity/v3/projects/2fe0437ac3144a399201eeff6f70fda0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:52.977631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:52.979304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.057346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f71f8-d38c-4448-ac23-6d3c99f020b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.063893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.064557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.064871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.065153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.067223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b1877-1b73-49b9-969f-b5e166b2cd02 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.070292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.130589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.130589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.130589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.130589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.138754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.161471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:53.164202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:53.178730 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 683/1365] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:53.179759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:53.182016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.247891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:53.250084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:53.265580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de82a-9038-4c40-95b4-e9786799ee59 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.276094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.276909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.279612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.279724 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 683/1366] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:53.279812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.279812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:53.279953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:53.281048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:53.283694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.303399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab106a0-2e3c-40c6-a9d0-fcb0a16a4ac4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.308509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.309311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.309643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.309924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] PATH_INFO: `/v3/users/72cd151d7f6b483b93dca636e575d1e4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.311291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cd151d7f6b483b93dca636e575d1e4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:53.314128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:53.359299 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 684/1367] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:53 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:53.359299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:53.361249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.393195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0d223-1161-4698-a4ec-e94fc5c161d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.404465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.405329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.405613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.406547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] PATH_INFO: `/v3/projects/a7877794986c42e7832288b3b53816b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.408374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7877794986c42e7832288b3b53816b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:53.411690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:53.585497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cd151d7f6b483b93dca636e575d1e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.600547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cd151d7f6b483b93dca636e575d1e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.601965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7877794986c42e7832288b3b53816b7', 'request_id': 'req-b86f5ae6-d836-48f2-b33f-12a41a9e39da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.602721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cd151d7f6b483b93dca636e575d1e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.623068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cd151d7f6b483b93dca636e575d1e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.625261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7877794986c42e7832288b3b53816b7', 'request_id': 'req-b86f5ae6-d836-48f2-b33f-12a41a9e39da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.702932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-50ce5ff8-5c2e-4511-a064-302baa3ca65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cd151d7f6b483b93dca636e575d1e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.721193 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 684/1368] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:53 2022] DELETE /identity/v3/users/72cd151d7f6b483b93dca636e575d1e4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:53.724705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8caf-bc7c-4e57-93eb-e86ac97707db None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.725025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8caf-bc7c-4e57-93eb-e86ac97707db None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.725352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d8caf-bc7c-4e57-93eb-e86ac97707db None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.742299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:53.746170 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 685/1369] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:23:53 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:23:53.747192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d8caf-bc7c-4e57-93eb-e86ac97707db None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:53.749826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a67d8caf-bc7c-4e57-93eb-e86ac97707db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.787606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7877794986c42e7832288b3b53816b7', 'request_id': 'req-b86f5ae6-d836-48f2-b33f-12a41a9e39da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.807107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] The token cache is being invalidate because project a7877794986c42e7832288b3b53816b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:23:53.809728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.811499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b86f5ae6-d836-48f2-b33f-12a41a9e39da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:53.815203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 685/1370] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:53 2022] DELETE /identity/v3/projects/a7877794986c42e7832288b3b53816b7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:53.818606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.818892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.819169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.860623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:53.861986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.899785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d8caf-bc7c-4e57-93eb-e86ac97707db None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.907018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.908068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.908548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.909002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.909870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:53.913184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:53.925395 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 686/1371] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:53.926668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:53.930331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.951671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4300-911a-46a5-b9e8-d21836d0258d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.960739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.962007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.962323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.962617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] PATH_INFO: `/v3/users/74bf20bbe43347699c4730b47d4b4030` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:53.964347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74bf20bbe43347699c4730b47d4b4030)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:53.966805 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 686/1372] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:23:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:53.967449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:53.974202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:53.974202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:53.991666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce006e7-e159-493c-b1e9-cf87b9547223 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:53.997648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:53.998405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:53.998783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:53.999400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] PATH_INFO: `/v3/projects/faea710b61f141e9b04ea1e1b1c3b3ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:54.001441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faea710b61f141e9b04ea1e1b1c3b3ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:54.002607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:54.198235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74bf20bbe43347699c4730b47d4b4030'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.207622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faea710b61f141e9b04ea1e1b1c3b3ec', 'request_id': 'req-3ec2b5ea-e73a-4a10-8095-3e1d59487894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.207919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74bf20bbe43347699c4730b47d4b4030'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.208978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74bf20bbe43347699c4730b47d4b4030'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.216262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faea710b61f141e9b04ea1e1b1c3b3ec', 'request_id': 'req-3ec2b5ea-e73a-4a10-8095-3e1d59487894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.240655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74bf20bbe43347699c4730b47d4b4030'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.304370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faea710b61f141e9b04ea1e1b1c3b3ec', 'request_id': 'req-3ec2b5ea-e73a-4a10-8095-3e1d59487894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.316956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] The token cache is being invalidate because project faea710b61f141e9b04ea1e1b1c3b3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:23:54.317254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.321653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.323509 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 687/1373] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:53 2022] DELETE /identity/v3/projects/faea710b61f141e9b04ea1e1b1c3b3ec => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:54.324107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:54.325480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:54.337011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:54.393185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74bf20bbe43347699c4730b47d4b4030'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.400457 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 687/1374] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:53 2022] DELETE /identity/v3/users/74bf20bbe43347699c4730b47d4b4030 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:54.400784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:54.402469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:54.407668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2b5ea-e73a-4a10-8095-3e1d59487894 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:54.520489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:54.521475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:54.521860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:54.522604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] PATH_INFO: `/v3/projects/ccb7dff11ce2406393358f6af4d1dd5d/users/7a18ccd1e2e249de86d05ac26a551711/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:54.551292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bf27a-2ffa-43e1-8db3-1dea1965452a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:54.556595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb7dff11ce2406393358f6af4d1dd5d, user_id=7a18ccd1e2e249de86d05ac26a551711, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:54.559715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:54.564641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:54.565350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:54.565726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:54.566007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:54.569985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:54.670880 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 688/1375] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:54 2022] PUT /identity/v3/projects/ccb7dff11ce2406393358f6af4d1dd5d/users/7a18ccd1e2e249de86d05ac26a551711/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:54.674134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:54.674656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:54.678171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:54.681604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:54.697915 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 688/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:54.700153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:54.701993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:54.723573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7eaa5-f50e-49f6-ac00-3dd227e07163 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:54.827201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:54.828965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:54.829418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:54.829893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] PATH_INFO: `/v3/projects/157e0d10956043989dbcd74d2158ee63` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:54.831375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157e0d10956043989dbcd74d2158ee63)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:54.834114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:54.849225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73651240-c3e7-40e6-b41b-968166c8f665 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:54.871003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:54.873506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:54.874482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:54.874951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] PATH_INFO: `/v3/users/52d48bf3743d434b961beba962111ad5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:54.877387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d48bf3743d434b961beba962111ad5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:54.882557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:54.973305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157e0d10956043989dbcd74d2158ee63', 'request_id': 'req-60e9eff0-ebe0-47a2-a19f-1613394893b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:54.989168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157e0d10956043989dbcd74d2158ee63', 'request_id': 'req-60e9eff0-ebe0-47a2-a19f-1613394893b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.091301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d48bf3743d434b961beba962111ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.091957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d48bf3743d434b961beba962111ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.095735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157e0d10956043989dbcd74d2158ee63', 'request_id': 'req-60e9eff0-ebe0-47a2-a19f-1613394893b6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.103935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:55.107259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] The token cache is being invalidate because project 157e0d10956043989dbcd74d2158ee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:23:55.107585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.108270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.110108 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 689/1377] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:54 2022] DELETE /identity/v3/projects/157e0d10956043989dbcd74d2158ee63 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:55.110634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:55.111947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.177550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d48bf3743d434b961beba962111ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.178298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d48bf3743d434b961beba962111ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.191950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9eff0-ebe0-47a2-a19f-1613394893b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:55.192267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c0cd38-05a9-435e-958e-92297bdfba05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d48bf3743d434b961beba962111ad5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.197595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d47c0d-3a45-4d45-8489-cdf6dc3a79b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:55.198275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47c0d-3a45-4d45-8489-cdf6dc3a79b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.198669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47c0d-3a45-4d45-8489-cdf6dc3a79b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.199138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d47c0d-3a45-4d45-8489-cdf6dc3a79b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.199585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47c0d-3a45-4d45-8489-cdf6dc3a79b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:55.201266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d47c0d-3a45-4d45-8489-cdf6dc3a79b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:55.213728 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 690/1378] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:55.214677 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 689/1379] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:54 2022] DELETE /identity/v3/users/52d48bf3743d434b961beba962111ad5 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:55.216042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6748-0fa3-47e5-adda-816355175556 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.216331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6748-0fa3-47e5-adda-816355175556 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.216672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6748-0fa3-47e5-adda-816355175556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.226302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c240d-df68-4a67-9254-22b3ad876477 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.226592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c240d-df68-4a67-9254-22b3ad876477 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.226869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c240d-df68-4a67-9254-22b3ad876477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.241861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:55.245344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-800d6748-0fa3-47e5-adda-816355175556 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:55.246680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-800d6748-0fa3-47e5-adda-816355175556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.263949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-265c240d-df68-4a67-9254-22b3ad876477 None None] MFA Rules not processed for user `d75623286dda46cfb4d8d70608655b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:55.265151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-265c240d-df68-4a67-9254-22b3ad876477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.327077 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 690/1380] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:55.327727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6748-0fa3-47e5-adda-816355175556 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:55.329013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-800d6748-0fa3-47e5-adda-816355175556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.341333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6748-0fa3-47e5-adda-816355175556 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:55.346134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:55.346766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.347042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.347313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] PATH_INFO: `/v3/projects/b8041278f3fb45fc85b8b2fcbd710cdb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.348512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8041278f3fb45fc85b8b2fcbd710cdb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:55.350479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:55.354896 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 691/1381] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:55.356164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c240d-df68-4a67-9254-22b3ad876477 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:55.371327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c240d-df68-4a67-9254-22b3ad876477 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:55.379797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57f165-666c-43ae-b4bb-4b4ef8d4aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:55.380406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f165-666c-43ae-b4bb-4b4ef8d4aedb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.380690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f165-666c-43ae-b4bb-4b4ef8d4aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.380969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f165-666c-43ae-b4bb-4b4ef8d4aedb admin admin] PATH_INFO: `/v3/projects/ccb7dff11ce2406393358f6af4d1dd5d/users/7a18ccd1e2e249de86d05ac26a551711/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.387741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57f165-666c-43ae-b4bb-4b4ef8d4aedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb7dff11ce2406393358f6af4d1dd5d, user_id=7a18ccd1e2e249de86d05ac26a551711, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:55.387741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57f165-666c-43ae-b4bb-4b4ef8d4aedb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:55.407911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 692/1382] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:55 2022] PUT /identity/v3/projects/ccb7dff11ce2406393358f6af4d1dd5d/users/7a18ccd1e2e249de86d05ac26a551711/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:55.422485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.422661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.423143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.452781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:55.456071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.528143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8041278f3fb45fc85b8b2fcbd710cdb', 'request_id': 'req-4658287e-14ed-4a4f-b772-de3c625fb9a9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.542267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8041278f3fb45fc85b8b2fcbd710cdb', 'request_id': 'req-4658287e-14ed-4a4f-b772-de3c625fb9a9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.578137 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 693/1383] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:55.578137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:55.583700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.597948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef5b0a-e3ef-4550-beb2-233ee70a8b05 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:55.623861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8041278f3fb45fc85b8b2fcbd710cdb', 'request_id': 'req-4658287e-14ed-4a4f-b772-de3c625fb9a9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.642310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] The token cache is being invalidate because project b8041278f3fb45fc85b8b2fcbd710cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:23:55.644859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.645738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4658287e-14ed-4a4f-b772-de3c625fb9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:55.649259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 691/1384] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:55 2022] DELETE /identity/v3/projects/b8041278f3fb45fc85b8b2fcbd710cdb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:55.650802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913505b3-6ba7-477e-a392-a92d74d53f01 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.651578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913505b3-6ba7-477e-a392-a92d74d53f01 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.651987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913505b3-6ba7-477e-a392-a92d74d53f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.674613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e1a48-65cc-4e0d-8cbc-8dea02d3a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:55.674613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e1a48-65cc-4e0d-8cbc-8dea02d3a59b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.674902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e1a48-65cc-4e0d-8cbc-8dea02d3a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.675180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e1a48-65cc-4e0d-8cbc-8dea02d3a59b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.677220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e1a48-65cc-4e0d-8cbc-8dea02d3a59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:55.681490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e1a48-65cc-4e0d-8cbc-8dea02d3a59b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:55.708957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-913505b3-6ba7-477e-a392-a92d74d53f01 None None] MFA Rules not processed for user `7a18ccd1e2e249de86d05ac26a551711`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:55.708957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-913505b3-6ba7-477e-a392-a92d74d53f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.776694 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 692/1385] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:55.777927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314bcd7-6802-4b52-a01c-ac492a3b5f1f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.779101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314bcd7-6802-4b52-a01c-ac492a3b5f1f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.779526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314bcd7-6802-4b52-a01c-ac492a3b5f1f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.780983 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 693/1386] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:23:55.781932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e924322-ef43-408c-84f8-1723f442603a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.782295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e924322-ef43-408c-84f8-1723f442603a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.782569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e924322-ef43-408c-84f8-1723f442603a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.784054 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 694/1387] 10.222.0.27 () {54 vars in 961 bytes} [Tue Oct 18 13:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:23:55.784751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e924322-ef43-408c-84f8-1723f442603a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:55.788563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e924322-ef43-408c-84f8-1723f442603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.806405 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 694/1388] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/projects => generated 401 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:55.806405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ec5fe-135b-4c1f-8f87-59d78181466d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.806405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ec5fe-135b-4c1f-8f87-59d78181466d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.806405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ec5fe-135b-4c1f-8f87-59d78181466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.808005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e924322-ef43-408c-84f8-1723f442603a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:55.837645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fa9ec5fe-135b-4c1f-8f87-59d78181466d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:55.838882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa9ec5fe-135b-4c1f-8f87-59d78181466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.888672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a71fd-42e0-45dd-8ece-be9e3b26e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:55.889409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a71fd-42e0-45dd-8ece-be9e3b26e49a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.889752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a71fd-42e0-45dd-8ece-be9e3b26e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.890190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a71fd-42e0-45dd-8ece-be9e3b26e49a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.890975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a71fd-42e0-45dd-8ece-be9e3b26e49a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:55.891507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a71fd-42e0-45dd-8ece-be9e3b26e49a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:55.893338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a71fd-42e0-45dd-8ece-be9e3b26e49a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:55.909720 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 695/1389] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:55.909720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.909720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.909720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.913202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 695/1390] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:55.915773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f5af-03b3-4170-871d-bc6af847c1b3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:55.916336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f5af-03b3-4170-871d-bc6af847c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:55.916771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131f5af-03b3-4170-871d-bc6af847c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:55.932358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:55.934358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:55.939148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0131f5af-03b3-4170-871d-bc6af847c1b3 None None] MFA Rules not processed for user `31f765d197374f1cb5bdfa5890d74f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:55.941480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0131f5af-03b3-4170-871d-bc6af847c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.002647 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 696/1391] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:56.004142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.004431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.004887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.017381 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 696/1392] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:23:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:56.018181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.019634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.027674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:56.029476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.040585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c21548-a2f4-4d6d-8472-afc7d4dec25c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.046443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.047255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.047533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.047804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] PATH_INFO: `/v3/projects/9d801f44f8f2417b8ffd5c0fb39c5224` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.048937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d801f44f8f2417b8ffd5c0fb39c5224)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.051621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.077979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:56.102822 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 697/1393] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:56.103803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.105319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.119752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833c81-8742-495a-825f-c70979cb0f9a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.124187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.124792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.125068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.125340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.125982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.127945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.149399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:56.156112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d801f44f8f2417b8ffd5c0fb39c5224', 'request_id': 'req-1178717d-3e84-4f01-b04b-e61f73b07dc5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:56.162977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d801f44f8f2417b8ffd5c0fb39c5224', 'request_id': 'req-1178717d-3e84-4f01-b04b-e61f73b07dc5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:56.183701 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 698/1394] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/users => generated 307 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:56.184450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.194154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8ebb-2873-4f67-bb1e-0fc5bf0ff71c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.206256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d801f44f8f2417b8ffd5c0fb39c5224', 'request_id': 'req-1178717d-3e84-4f01-b04b-e61f73b07dc5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:56.220229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] The token cache is being invalidate because project 9d801f44f8f2417b8ffd5c0fb39c5224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:23:56.220451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:56.221257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1178717d-3e84-4f01-b04b-e61f73b07dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:23:56.226919 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 697/1395] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:56 2022] DELETE /identity/v3/projects/9d801f44f8f2417b8ffd5c0fb39c5224 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:56.226919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.226919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.226919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.246514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:56.247749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.262039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.263178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.263178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.263325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.263885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.265826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.308249 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 698/1396] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:56.309199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.310555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.373465 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 699/1397] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:56.374375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.376292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.388702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a0bc-09f2-4df1-addd-4182c30abef8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.435802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b42069-3707-4a1e-9647-0c33a45fe75d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.439668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.440291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.440572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.441002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.443257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.468478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.469129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.469412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.469692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.472680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.527674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.529132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.538039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.539831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.540482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 700/1398] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:56.541136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.542543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.555561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:56.566725 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 699/1399] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:56.569246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.571850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.587482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:56.619609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e92b-9ca2-40f8-b307-1d911011a287 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.625485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6617044-5f9f-42cd-b05f-727c343efd36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.626262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6617044-5f9f-42cd-b05f-727c343efd36 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.627015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6617044-5f9f-42cd-b05f-727c343efd36 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.627015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6617044-5f9f-42cd-b05f-727c343efd36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.629549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6617044-5f9f-42cd-b05f-727c343efd36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.641763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6617044-5f9f-42cd-b05f-727c343efd36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.643389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6617044-5f9f-42cd-b05f-727c343efd36 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.662183 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 701/1400] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:56.662553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405f4b-6772-4933-82e0-5e80a1b00fb8 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.665925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.665925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.665925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.676558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.677381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.677800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.678280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.679214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.680973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.701504 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 700/1401] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:56.702516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.704786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:56.706096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.714785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c47fa2-ae13-4a2b-a013-a0976571d10d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.720566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.721242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.722825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.723052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.723763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:56.724074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.725802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.736263 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 702/1402] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:56.736263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.736263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.742688 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 701/1403] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:56.743524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.748441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc71db7-bb97-4cec-bd42-3e03f7caafc4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.755971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b19742-a828-4443-8827-de7c723eca41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:56.756910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a4234-59da-4caf-9ead-e29334e20e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.757821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a4234-59da-4caf-9ead-e29334e20e77 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.758174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a4234-59da-4caf-9ead-e29334e20e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.758456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a4234-59da-4caf-9ead-e29334e20e77 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.759210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a4234-59da-4caf-9ead-e29334e20e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.761281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:56.761484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a4234-59da-4caf-9ead-e29334e20e77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.762015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.762415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.762732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] PATH_INFO: `/v3/projects/2a10d37c93e743faa8cd29e05a06185f/users/6ea6c81b85374045be838535697eb2d2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.785200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a10d37c93e743faa8cd29e05a06185f, user_id=6ea6c81b85374045be838535697eb2d2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:56.787952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:56.867288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 703/1404] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:56.867288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7800-69fb-4035-8047-b24351a3c4c6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:56.867288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7800-69fb-4035-8047-b24351a3c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:56.867288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7800-69fb-4035-8047-b24351a3c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:56.887383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:56.895840 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 702/1405] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:56 2022] PUT /identity/v3/projects/2a10d37c93e743faa8cd29e05a06185f/users/6ea6c81b85374045be838535697eb2d2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:56.897372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:56.921151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b9fe7800-69fb-4035-8047-b24351a3c4c6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:56.924644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9fe7800-69fb-4035-8047-b24351a3c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:56.975086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:57.049481 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 704/1406] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:57.050942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7800-69fb-4035-8047-b24351a3c4c6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.051067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb11bca-3db9-4786-b3e1-8648811fa0cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.057100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.058384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.058814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.059087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.059731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.061750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.064641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7800-69fb-4035-8047-b24351a3c4c6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.073008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.073632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.074633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.074633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.074864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.079586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.087470 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 705/1407] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:57.088360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.098455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498374b6-2468-45ad-bab5-961ff02bb894 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.102929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.103508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.103782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.104051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.104673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.106273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.116626 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 706/1408] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:57.117532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.126829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfdcc-6ac1-4af7-9254-98027e889f04 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.131906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.133395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.133395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.133395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.133608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:23:57.133856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.135416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.146886 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 707/1409] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:23:57.147765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.157028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c135da8-9412-43c2-8331-28afda6f4d28 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.162087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.162656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.162930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.163200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.163819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.165440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.176647 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 708/1410] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:57.177547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.188658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6eb277-b36a-4e99-9f18-06df189d4dee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.196087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.196465 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 703/1411] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:56 2022] POST /identity/v3/projects => generated 395 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:57.197284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.197555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.197876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.198201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] PATH_INFO: `/v3/projects/2a10d37c93e743faa8cd29e05a06185f/users/6ea6c81b85374045be838535697eb2d2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.200211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a10d37c93e743faa8cd29e05a06185f, user_id=6ea6c81b85374045be838535697eb2d2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.203005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.213750 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 709/1412] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:57 2022] PUT /identity/v3/projects/2a10d37c93e743faa8cd29e05a06185f/users/6ea6c81b85374045be838535697eb2d2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:57.214539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.288774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455817e-e754-44eb-be2a-57d2fc39dd44 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.322378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000613-8a0e-40f5-9ade-eefc89660375 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.328200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.329662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.330157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.330442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] PATH_INFO: `/v3/projects/fddd7c4776dd4f8dbb24e1389d48ca88/users/7f4af9a980a64d1e98c7d58fbdadcee5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.368076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:57.369981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.370927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.380506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.380506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.380506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.380506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.390443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddd7c4776dd4f8dbb24e1389d48ca88, user_id=7f4af9a980a64d1e98c7d58fbdadcee5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.399211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.450445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:57.499911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 710/1413] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:57 2022] PUT /identity/v3/projects/fddd7c4776dd4f8dbb24e1389d48ca88/users/7f4af9a980a64d1e98c7d58fbdadcee5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:57.501292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.503315 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 704/1414] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:57 2022] POST /identity/v3/projects => generated 397 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:57.507756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.614469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ac848-60d2-4282-b3f0-33ed0f60496b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.621862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2352c4-5f28-44a4-86a1-c6f65541007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.622536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2352c4-5f28-44a4-86a1-c6f65541007c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.622951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2352c4-5f28-44a4-86a1-c6f65541007c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.623405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2352c4-5f28-44a4-86a1-c6f65541007c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.628681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2352c4-5f28-44a4-86a1-c6f65541007c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.628681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2352c4-5f28-44a4-86a1-c6f65541007c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.651469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924cce3-fb55-41f1-b701-4967709fd6bc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.661409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.662954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.663315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.663936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.665057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.668036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.714443 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 705/1415] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:57 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:23:57.714443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259952f-23a5-4a28-864c-8e622af58700 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.714443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259952f-23a5-4a28-864c-8e622af58700 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.714443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259952f-23a5-4a28-864c-8e622af58700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.751267 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 711/1416] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:57 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:57.752125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.765008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c6e03-ca77-4918-ac1b-603f22630098 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.768449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:57.779617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.780542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.780743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.781498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.783620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.786173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.790329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0259952f-23a5-4a28-864c-8e622af58700 None None] MFA Rules not processed for user `7f4af9a980a64d1e98c7d58fbdadcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:57.794886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0259952f-23a5-4a28-864c-8e622af58700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:57.812759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 712/1417] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:57.814309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.828219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a2ad6-46bf-489d-a19d-e23f1a2f202b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.853738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.855749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.857296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.858276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.861589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.868146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.904562 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 713/1418] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:57.905660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.924530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10807-f7cd-4945-a710-a9e25a53db5f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.929310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 706/1419] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:57.930882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259952f-23a5-4a28-864c-8e622af58700 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.931006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.931768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.932091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.932690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.937121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.937121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.945425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259952f-23a5-4a28-864c-8e622af58700 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.950923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 714/1420] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:57.950923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:57.962478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490a62c-500d-4c9a-b2a4-4b35f52f12f8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:57.967136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.969186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.969734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.970525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.971526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e1bd7-60c3-4b97-906a-9b30acd3af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:57.971991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.972415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1bd7-60c3-4b97-906a-9b30acd3af6b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:57.972900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1bd7-60c3-4b97-906a-9b30acd3af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:57.973257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1bd7-60c3-4b97-906a-9b30acd3af6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:57.974539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e1bd7-60c3-4b97-906a-9b30acd3af6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:57.976759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.986138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e1bd7-60c3-4b97-906a-9b30acd3af6b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:57.990746 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 707/1421] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:57.992131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.009310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00f7b-2236-4f61-9962-476d12d8a7be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:58.018329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:58.019904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.020338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.020785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] PATH_INFO: `/v3/projects/5d09f371e0a64ff99d885489a5ca3bd2/users/fa4ca05a0c6a405f8fa014ee06dbcef4/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.053255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d09f371e0a64ff99d885489a5ca3bd2, user_id=fa4ca05a0c6a405f8fa014ee06dbcef4, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:58.056215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:58.158111 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 708/1422] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:57 2022] PUT /identity/v3/projects/5d09f371e0a64ff99d885489a5ca3bd2/users/fa4ca05a0c6a405f8fa014ee06dbcef4/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:58.160333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.166866 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 715/1423] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:57 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:58.169698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6b64-9d91-4243-a788-35ae4a91895c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.169985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6b64-9d91-4243-a788-35ae4a91895c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.170287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b6b64-9d91-4243-a788-35ae4a91895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.224993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-883b6b64-9d91-4243-a788-35ae4a91895c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:58.226823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-883b6b64-9d91-4243-a788-35ae4a91895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:58.293259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045ec69-cfbe-4496-8ddf-83604352d49a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:58.295308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:58.308656 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 716/1424] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:58.309607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b6b64-9d91-4243-a788-35ae4a91895c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.327651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b6b64-9d91-4243-a788-35ae4a91895c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:58.334502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:58.335184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.335461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.335732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.336445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:58.338768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:58.400839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:58.401753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.402220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.402623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] PATH_INFO: `/v3/projects/b17eaaeceb504f379c236f5ec5d997a8/users/2874de9adc2649f1bed54cbc7acc6565/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.429820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17eaaeceb504f379c236f5ec5d997a8, user_id=2874de9adc2649f1bed54cbc7acc6565, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:58.434018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:58.443590 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 717/1425] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:58 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:58.444833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.521589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:58.526982 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 709/1426] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:58 2022] PUT /identity/v3/projects/b17eaaeceb504f379c236f5ec5d997a8/users/2874de9adc2649f1bed54cbc7acc6565/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:58.528040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.540733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63c69-c1b0-4077-8644-a1bb40ba09f4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:58.609737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:58.610757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.611176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.611586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.626370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12012a1-6fb7-4112-9343-37e1cd7085fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:58.632303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb61f71-0dd0-4d70-b3d2-aed690dab7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:58.633063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61f71-0dd0-4d70-b3d2-aed690dab7fd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.633445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61f71-0dd0-4d70-b3d2-aed690dab7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.633814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb61f71-0dd0-4d70-b3d2-aed690dab7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.634658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb61f71-0dd0-4d70-b3d2-aed690dab7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:58.636403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb61f71-0dd0-4d70-b3d2-aed690dab7fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:58.659104 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 710/1427] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:58.659104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b7f7-3281-4e03-8a7f-d48198b1801e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.659104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b7f7-3281-4e03-8a7f-d48198b1801e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.659104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5b7f7-3281-4e03-8a7f-d48198b1801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.688760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5e5b7f7-3281-4e03-8a7f-d48198b1801e None None] MFA Rules not processed for user `2874de9adc2649f1bed54cbc7acc6565`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:58.690323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5e5b7f7-3281-4e03-8a7f-d48198b1801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:58.693866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:58.695584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:58.708182 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 718/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:58.709028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.720830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560269cf-4d25-4062-a2ca-5ecd500a9da4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:58.728605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:58.729292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.729572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.729845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] PATH_INFO: `/v3/projects/af41b86d99fa40c38ffc60c41d44d02f/users/8c145e03fb9841048b03e29a0f061c3f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.748350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af41b86d99fa40c38ffc60c41d44d02f, user_id=8c145e03fb9841048b03e29a0f061c3f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:58.752502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:58.758174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:58.787106 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 711/1429] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:58.790016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b7f7-3281-4e03-8a7f-d48198b1801e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.804284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5b7f7-3281-4e03-8a7f-d48198b1801e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:58.818826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:58.819606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:58.819898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:58.820184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:58.820971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:58.823946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:58.870602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 719/1430] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:58 2022] PUT /identity/v3/projects/af41b86d99fa40c38ffc60c41d44d02f/users/8c145e03fb9841048b03e29a0f061c3f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:58.874431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:58.997242 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 712/1431] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:23:58 2022] POST /identity/v3/projects => generated 395 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:23:59.001473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.003469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e161-2f69-4167-8677-d6b66cfc78e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.127491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7285612-638a-4864-8fa4-bfd19a9ac511 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.128312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.129514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.129800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.130094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.130760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.132745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:59.134462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.135357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.136019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.136461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.137422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.140111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:59.144702 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 720/1432] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:59.150118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.179790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f312aa-8627-420a-8330-f3f15869514e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.186713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfda5d8-a8d7-4f43-bc21-26470a63a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.187515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda5d8-a8d7-4f43-bc21-26470a63a3da admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.197391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda5d8-a8d7-4f43-bc21-26470a63a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.200702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda5d8-a8d7-4f43-bc21-26470a63a3da admin admin] PATH_INFO: `/v3/projects/af41b86d99fa40c38ffc60c41d44d02f/users/8c145e03fb9841048b03e29a0f061c3f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.204993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfda5d8-a8d7-4f43-bc21-26470a63a3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=af41b86d99fa40c38ffc60c41d44d02f, user_id=8c145e03fb9841048b03e29a0f061c3f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.209557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfda5d8-a8d7-4f43-bc21-26470a63a3da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:59.225164 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 721/1433] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:59 2022] PUT /identity/v3/projects/af41b86d99fa40c38ffc60c41d44d02f/users/8c145e03fb9841048b03e29a0f061c3f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:59.237680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.238621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.238974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.294219 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 713/1434] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:23:59 2022] POST /identity/v3/users => generated 304 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:23:59.294986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.299821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] MFA Rules not processed for user `8c145e03fb9841048b03e29a0f061c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:23:59.303284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:59.321583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6e155-dcdd-4e0b-bdd3-2d0f7dcea32c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.404000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:59.482421 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 722/1435] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:23:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:23:59.494203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.494853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.495267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.495434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.496110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.497833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.502607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:59.504913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:23:59.531688 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 714/1436] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:59.535307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.556683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af852e-58dd-4460-8b7e-96eb66744bb7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.575580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.576283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.576569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.576936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] PATH_INFO: `/v3/projects/7c567a72e16343c4b3ff36eac5b6ad1c/users/f56f9b4f65a94432a4c97350ed0ccbc6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.630190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c567a72e16343c4b3ff36eac5b6ad1c, user_id=f56f9b4f65a94432a4c97350ed0ccbc6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.637624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:59.650689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:59.716435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8c039-ddba-4f9b-90e4-675e0e7f479d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.733075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.733741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.734007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.734307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.751885 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 715/1437] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:59 2022] PUT /identity/v3/projects/7c567a72e16343c4b3ff36eac5b6ad1c/users/f56f9b4f65a94432a4c97350ed0ccbc6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:23:59.756046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.920430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.922332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:59.942202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb106-110b-4ca0-a0d6-dd95b39c4370 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.946271 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 723/1438] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:23:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:23:59.966028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.966705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.966999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.970381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.972192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.974241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.976322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:23:59.986714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1814ad6-dbc0-4d2b-864d-5fb05d9bbaee service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:23:59.989118 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 716/1439] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:23:59.992512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:23:59.993751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:23:59.994614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:23:59.994900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:23:59.995175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] PATH_INFO: `/v3/users/7f4af9a980a64d1e98c7d58fbdadcee5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:23:59.997061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4af9a980a64d1e98c7d58fbdadcee5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:23:59.999143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:00.004578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d2cab-9185-4712-926d-e79b4c82bdcf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:00.011219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c837d-9fd3-49a9-a39b-b3e3f480652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:00.012186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c837d-9fd3-49a9-a39b-b3e3f480652e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:00.012846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c837d-9fd3-49a9-a39b-b3e3f480652e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:00.012846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c837d-9fd3-49a9-a39b-b3e3f480652e admin admin] PATH_INFO: `/v3/projects/7c567a72e16343c4b3ff36eac5b6ad1c/users/f56f9b4f65a94432a4c97350ed0ccbc6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:00.023383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c837d-9fd3-49a9-a39b-b3e3f480652e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c567a72e16343c4b3ff36eac5b6ad1c, user_id=f56f9b4f65a94432a4c97350ed0ccbc6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:00.023383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c837d-9fd3-49a9-a39b-b3e3f480652e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:00.041688 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 717/1440] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:23:59 2022] PUT /identity/v3/projects/7c567a72e16343c4b3ff36eac5b6ad1c/users/f56f9b4f65a94432a4c97350ed0ccbc6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:00.053256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113600f-29b9-4f2e-aa26-63d3f22f8c4f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:00.053564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113600f-29b9-4f2e-aa26-63d3f22f8c4f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:00.054730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113600f-29b9-4f2e-aa26-63d3f22f8c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:00.136818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1113600f-29b9-4f2e-aa26-63d3f22f8c4f None None] MFA Rules not processed for user `f56f9b4f65a94432a4c97350ed0ccbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:00.138912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1113600f-29b9-4f2e-aa26-63d3f22f8c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:00.275374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4af9a980a64d1e98c7d58fbdadcee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:00.289310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4af9a980a64d1e98c7d58fbdadcee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:00.293801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4af9a980a64d1e98c7d58fbdadcee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:00.295350 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 718/1441] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:00.302439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113600f-29b9-4f2e-aa26-63d3f22f8c4f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:00.309076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4af9a980a64d1e98c7d58fbdadcee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:00.336251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:00.389337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a096d7ff-622a-4fe1-b983-8b72cf76bd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4af9a980a64d1e98c7d58fbdadcee5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:00.393185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:00.403896 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 724/1442] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:23:59 2022] DELETE /identity/v3/users/7f4af9a980a64d1e98c7d58fbdadcee5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:00.404961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113600f-29b9-4f2e-aa26-63d3f22f8c4f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:00.406217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:00.406934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:00.407548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:00.891752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:00.891752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:00.897240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:00.897240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:00.897240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:00.897240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:00.900641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:00.903721 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 725/1443] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:00.903721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:00.903721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:00.904588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:00.904588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:00.904588 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 719/1444] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:00.905426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fd5c8-34b0-48d3-bd83-a958f274f2e2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:00.905426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac882b03-ee57-4dbc-a126-df96285022a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:00.905426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac882b03-ee57-4dbc-a126-df96285022a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:00.905426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac882b03-ee57-4dbc-a126-df96285022a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:00.910345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac882b03-ee57-4dbc-a126-df96285022a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:00.910345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac882b03-ee57-4dbc-a126-df96285022a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:00.910345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac882b03-ee57-4dbc-a126-df96285022a1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:00.910345 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 726/1445] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:00.911094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:00.911094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:00.911094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60886b30-fb80-4add-8bc3-6ac2fb1b1739 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:00.911673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:00.911673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:00.911673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:00.911673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] PATH_INFO: `/v3/users/2874de9adc2649f1bed54cbc7acc6565` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:00.912228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2874de9adc2649f1bed54cbc7acc6565)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:00.912228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:01.083835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2874de9adc2649f1bed54cbc7acc6565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:01.084565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2874de9adc2649f1bed54cbc7acc6565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:01.194554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2874de9adc2649f1bed54cbc7acc6565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:01.195239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2874de9adc2649f1bed54cbc7acc6565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:01.205017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2874de9adc2649f1bed54cbc7acc6565'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:01.299354 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 720/1446] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:00 2022] DELETE /identity/v3/users/2874de9adc2649f1bed54cbc7acc6565 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:01.303362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7143a-250a-4171-83b6-55d9d7b17727 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:01.303907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7143a-250a-4171-83b6-55d9d7b17727 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:01.303907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7143a-250a-4171-83b6-55d9d7b17727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:01.354988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-23f7143a-250a-4171-83b6-55d9d7b17727 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:01.356408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23f7143a-250a-4171-83b6-55d9d7b17727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:01.377091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:01.515699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:01.546171 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 727/1447] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:01.600177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:01.602845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:01.684803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b2455-4899-40f8-8808-db0fa3ce2b25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:01.688691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:01.689486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:01.690586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:01.690586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:01.710453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:01.712828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:01.727857 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 721/1448] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:01.763556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773787a-18c7-4d2c-a6f1-ee407c5368c7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:01.764073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773787a-18c7-4d2c-a6f1-ee407c5368c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:01.764878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773787a-18c7-4d2c-a6f1-ee407c5368c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:01.836408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d773787a-18c7-4d2c-a6f1-ee407c5368c7 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:01.838196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d773787a-18c7-4d2c-a6f1-ee407c5368c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:01.974519 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 728/1449] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:02.189519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:02.202276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:02.204031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:02.227364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71fa2f-3781-466e-bbf7-db48a1c01dc9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:02.245439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:02.246700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:02.247166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:02.248673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] PATH_INFO: `/v3/projects/fddd7c4776dd4f8dbb24e1389d48ca88` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:02.250155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddd7c4776dd4f8dbb24e1389d48ca88)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:02.253217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:02.257522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:02.400133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddd7c4776dd4f8dbb24e1389d48ca88', 'request_id': 'req-6c256255-3d6c-4a38-abad-6a89e025651a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:02.412601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddd7c4776dd4f8dbb24e1389d48ca88', 'request_id': 'req-6c256255-3d6c-4a38-abad-6a89e025651a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:02.449922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:02.449922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:02.449922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:02.486896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:02.489001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:02.524532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddd7c4776dd4f8dbb24e1389d48ca88', 'request_id': 'req-6c256255-3d6c-4a38-abad-6a89e025651a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:02.557030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] The token cache is being invalidate because project fddd7c4776dd4f8dbb24e1389d48ca88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:02.557697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:02.558693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:02.561122 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 722/1450] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:02 2022] DELETE /identity/v3/projects/fddd7c4776dd4f8dbb24e1389d48ca88 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:02.562475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:02.574003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:02.596582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 729/1451] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:24:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 18 13:24:02.598987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:02.600705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:02.764125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b75b1-c5b1-4f12-9186-906170b55164 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:02.776432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:02.777926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:02.779236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:02.780510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] PATH_INFO: `/v3/users/8c145e03fb9841048b03e29a0f061c3f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:02.785797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c145e03fb9841048b03e29a0f061c3f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:02.792525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:02.860467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c256255-3d6c-4a38-abad-6a89e025651a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:02.872636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:02.878632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:02.878632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:02.878632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:02.878632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:02.892123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:02.898139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:02.911888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 723/1452] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:02.913910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:02.935595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca1785-c445-48bf-b92f-49566ffae960 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:02.939655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:02.940566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:02.941364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:02.942207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:02.988230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:02.988230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:03.010684 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 724/1453] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:03.010954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:03.014430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:03.064706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495a8a2-57d7-4381-8f71-cb404bea315d service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:03.073492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c145e03fb9841048b03e29a0f061c3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.081065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:03.082896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:03.082896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:03.082896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] PATH_INFO: `/v3/projects/b17eaaeceb504f379c236f5ec5d997a8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:03.092168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17eaaeceb504f379c236f5ec5d997a8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:03.095954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:03.103308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c145e03fb9841048b03e29a0f061c3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.104471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c145e03fb9841048b03e29a0f061c3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.141124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c145e03fb9841048b03e29a0f061c3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.239228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c145e03fb9841048b03e29a0f061c3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.247523 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 730/1454] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:02 2022] DELETE /identity/v3/users/8c145e03fb9841048b03e29a0f061c3f => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:03.437690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17eaaeceb504f379c236f5ec5d997a8', 'request_id': 'req-1e2b777b-5216-4edb-87a6-2bea6f2fba78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.485659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17eaaeceb504f379c236f5ec5d997a8', 'request_id': 'req-1e2b777b-5216-4edb-87a6-2bea6f2fba78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.529164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:03.622912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17eaaeceb504f379c236f5ec5d997a8', 'request_id': 'req-1e2b777b-5216-4edb-87a6-2bea6f2fba78'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.637579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] The token cache is being invalidate because project b17eaaeceb504f379c236f5ec5d997a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:03.637951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.638768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:03.640688 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 725/1455] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:03 2022] DELETE /identity/v3/projects/b17eaaeceb504f379c236f5ec5d997a8 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:03.647089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:03.649487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:03.811372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb9ace-1640-4033-88f5-f51569047413 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:03.979364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:03.980038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:03.980323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:03.980603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] PATH_INFO: `/v3/users/f56f9b4f65a94432a4c97350ed0ccbc6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:03.986608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56f9b4f65a94432a4c97350ed0ccbc6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:03.988912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:03.995357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:04.537219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56f9b4f65a94432a4c97350ed0ccbc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:04.571319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56f9b4f65a94432a4c97350ed0ccbc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:04.577382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56f9b4f65a94432a4c97350ed0ccbc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:04.602913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56f9b4f65a94432a4c97350ed0ccbc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:04.690861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-132e1958-9d75-4a30-ab49-861a2a8d4348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56f9b4f65a94432a4c97350ed0ccbc6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:04.709684 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 731/1456] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:03 2022] DELETE /identity/v3/users/f56f9b4f65a94432a4c97350ed0ccbc6 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:04.862020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:05.400698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:06.384128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:06.385832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:06.406985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b777b-5216-4edb-87a6-2bea6f2fba78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:06.462620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:06.463193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:06.463193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:06.568801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:06.569482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:06.569768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:06.570077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] PATH_INFO: `/v3/projects/af41b86d99fa40c38ffc60c41d44d02f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:06.575531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:06.577534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:06.578860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af41b86d99fa40c38ffc60c41d44d02f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:06.583342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:06.602995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:06.743253 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 732/1457] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Oct 18 13:24:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:06.744414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:06.745920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:06.787901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba89356-0711-48ee-bab3-cf403bb88a38 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:06.799900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af41b86d99fa40c38ffc60c41d44d02f', 'request_id': 'req-d9444c1b-8cf4-48b6-928b-a9635215d1c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:06.842511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af41b86d99fa40c38ffc60c41d44d02f', 'request_id': 'req-d9444c1b-8cf4-48b6-928b-a9635215d1c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:06.941985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af41b86d99fa40c38ffc60c41d44d02f', 'request_id': 'req-d9444c1b-8cf4-48b6-928b-a9635215d1c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:06.975331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:06.976240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:06.976670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:06.977087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] PATH_INFO: `/v3/projects/7c567a72e16343c4b3ff36eac5b6ad1c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:06.982596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c567a72e16343c4b3ff36eac5b6ad1c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:06.984948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:06.993392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] The token cache is being invalidate because project af41b86d99fa40c38ffc60c41d44d02f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:06.993979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:06.998333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:07.007297 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 726/1458] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:06 2022] DELETE /identity/v3/projects/af41b86d99fa40c38ffc60c41d44d02f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:07.008608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:07.016453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:07.122460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:07.179350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9444c1b-8cf4-48b6-928b-a9635215d1c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:07.189172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c567a72e16343c4b3ff36eac5b6ad1c', 'request_id': 'req-cc3e90a4-24d9-488d-b187-9e1fedda0be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:07.207934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c567a72e16343c4b3ff36eac5b6ad1c', 'request_id': 'req-cc3e90a4-24d9-488d-b187-9e1fedda0be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:07.290446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c567a72e16343c4b3ff36eac5b6ad1c', 'request_id': 'req-cc3e90a4-24d9-488d-b187-9e1fedda0be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:07.336857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faad1e-8682-4702-95c4-252bc192446a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:07.337750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faad1e-8682-4702-95c4-252bc192446a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:07.342745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faad1e-8682-4702-95c4-252bc192446a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:07.342745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faad1e-8682-4702-95c4-252bc192446a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:07.343102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] The token cache is being invalidate because project 7c567a72e16343c4b3ff36eac5b6ad1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:07.345664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:07.350482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3e90a4-24d9-488d-b187-9e1fedda0be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:07.350892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9faad1e-8682-4702-95c4-252bc192446a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:07.389230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faad1e-8682-4702-95c4-252bc192446a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:07.396317 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 733/1459] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:06 2022] DELETE /identity/v3/projects/7c567a72e16343c4b3ff36eac5b6ad1c => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:07.396574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faad1e-8682-4702-95c4-252bc192446a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:07.407199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618039-d345-4da6-a944-6093e43f353e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:07.407492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618039-d345-4da6-a944-6093e43f353e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:07.411612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618039-d345-4da6-a944-6093e43f353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:07.427920 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 727/1460] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:07.439019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeffe5-57f1-4d62-83c2-8ebae046ae85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:07.441192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeffe5-57f1-4d62-83c2-8ebae046ae85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:07.441192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeffe5-57f1-4d62-83c2-8ebae046ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:07.489173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-23618039-d345-4da6-a944-6093e43f353e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:07.500419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23618039-d345-4da6-a944-6093e43f353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:07.539838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5fbeffe5-57f1-4d62-83c2-8ebae046ae85 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:07.541986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fbeffe5-57f1-4d62-83c2-8ebae046ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:07.675391 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 728/1461] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:07.677159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6817b-1fcf-4e17-a4f5-7ae6d873d56c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:07.677529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6817b-1fcf-4e17-a4f5-7ae6d873d56c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:07.677917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6817b-1fcf-4e17-a4f5-7ae6d873d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:07.728421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bda6817b-1fcf-4e17-a4f5-7ae6d873d56c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:07.729841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bda6817b-1fcf-4e17-a4f5-7ae6d873d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:07.755843 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 729/1462] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:07.757463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6817b-1fcf-4e17-a4f5-7ae6d873d56c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:07.781400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6817b-1fcf-4e17-a4f5-7ae6d873d56c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:07.792723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:07.793287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:07.793414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:07.800865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:07.800865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:07.800865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:07.800865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:07.802973 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 734/1463] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:07.805484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:07.809090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d177d2c-b1a8-47ce-9880-79aa1431b33c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:07.810623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d177d2c-b1a8-47ce-9880-79aa1431b33c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:07.812570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d177d2c-b1a8-47ce-9880-79aa1431b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:07.865059 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 730/1464] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:07.869043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:07.904629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e9ad0-cd7d-450a-b8a3-632f484bed7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:07.925084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:07.925796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:07.926047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:07.926346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:07.927143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:07.929444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:07.931963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2d177d2c-b1a8-47ce-9880-79aa1431b33c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:07.933243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2d177d2c-b1a8-47ce-9880-79aa1431b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:07.966979 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 735/1465] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:07.971155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d177d2c-b1a8-47ce-9880-79aa1431b33c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:07.996843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d177d2c-b1a8-47ce-9880-79aa1431b33c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.005052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.005694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.006281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.007092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.007894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:08.008210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.011288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:08.036688 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 736/1466] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:24:08.041037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.071651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a2ad-8fa3-4e03-a3af-5938cebead3a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.095664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.096531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.097363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.098296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.099648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.105504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:08.137055 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 731/1467] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:07 2022] POST /identity/v3/projects => generated 391 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:08.140534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.276254 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 737/1468] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:08 2022] POST /identity/v3/projects => generated 391 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:08.277981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.336045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:08.413701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829e64f-0b82-4c3c-a9df-bbf2a5b01d0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.468779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e563-0cd0-4c80-a0bf-164870385511 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.492284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.493645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.494140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.494566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.496907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.508062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:08.683227 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 738/1469] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:08 2022] POST /identity/v3/users => generated 296 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:08.684754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.686363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.687590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.689690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.690449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.691658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.697469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:08.705756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca38a43-b8f3-461a-80e3-1dfc95bbae94 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.713295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.714269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.714750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.715179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.716032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.721279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:08.738016 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 739/1470] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:08.742388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.782928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255b1c4-433a-4f4e-baa8-e5fbc4f88fa6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.797794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.799052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.801323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.801885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.804412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.808284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:08.839721 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 740/1471] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:24:08.845788 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 732/1472] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:08 2022] POST /identity/v3/users => generated 296 bytes in 705 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:08.845908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.847561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.884127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92903a5-a7d9-4245-8ba8-177ffad9c7a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.886312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b5d1a-bc20-4b71-a479-ee3f80009e65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:08.903462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.904446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fef7b-a8ff-49e9-b979-2cbc114f2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:08.906564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.906690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fef7b-a8ff-49e9-b979-2cbc114f2947 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:08.907419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fef7b-a8ff-49e9-b979-2cbc114f2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.908585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:08.908896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fef7b-a8ff-49e9-b979-2cbc114f2947 admin admin] PATH_INFO: `/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5/users/ba43223a52484c4b9391e6376f8a3e66/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.910705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:08.912266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.920720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:08.957523 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 733/1473] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:08.962560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fef7b-a8ff-49e9-b979-2cbc114f2947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ffcc468ee541168d57f0be0f0dacf5, user_id=ba43223a52484c4b9391e6376f8a3e66, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:08.969475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:08.973468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fef7b-a8ff-49e9-b979-2cbc114f2947 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:09.026176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344907b-052b-4efa-a1b8-19ef69a01697 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:09.084244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:09.084462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:09.084751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:09.085026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:09.086118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:09.087329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:09.092826 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 741/1474] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:08 2022] PUT /identity/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5/users/ba43223a52484c4b9391e6376f8a3e66/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:09.105738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14246-93b2-4232-b48d-e3ab8747a1de None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:09.106021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14246-93b2-4232-b48d-e3ab8747a1de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:09.106794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c14246-93b2-4232-b48d-e3ab8747a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:09.134948 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 734/1475] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:09.135933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:09.168991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf542db-9090-42a3-bba3-295925a6ccdc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:09.178523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-09c14246-93b2-4232-b48d-e3ab8747a1de None None] MFA Rules not processed for user `ba43223a52484c4b9391e6376f8a3e66`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:09.181351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09c14246-93b2-4232-b48d-e3ab8747a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:09.339181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:09.436298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b4490-6687-4f55-ad7a-43a168d1cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:09.438318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b4490-6687-4f55-ad7a-43a168d1cc1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:09.438714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b4490-6687-4f55-ad7a-43a168d1cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:09.443997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b4490-6687-4f55-ad7a-43a168d1cc1b admin admin] PATH_INFO: `/v3/projects/748ad38d438a464d8d73664f969a1962/users/09e3840ef0034fd9b5a1c7c7efc55f16/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:09.452202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 742/1476] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:09.462872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14246-93b2-4232-b48d-e3ab8747a1de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:09.509993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b4490-6687-4f55-ad7a-43a168d1cc1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=748ad38d438a464d8d73664f969a1962, user_id=09e3840ef0034fd9b5a1c7c7efc55f16, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:09.519920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c14246-93b2-4232-b48d-e3ab8747a1de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:09.520544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b4490-6687-4f55-ad7a-43a168d1cc1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:09.549560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc723bc-11c5-4a94-9bba-46e09cf2685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:09.551375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc723bc-11c5-4a94-9bba-46e09cf2685b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:09.555388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc723bc-11c5-4a94-9bba-46e09cf2685b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:09.556728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc723bc-11c5-4a94-9bba-46e09cf2685b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:09.559826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc723bc-11c5-4a94-9bba-46e09cf2685b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:09.564635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc723bc-11c5-4a94-9bba-46e09cf2685b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:09.634617 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 735/1477] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:09 2022] PUT /identity/v3/projects/748ad38d438a464d8d73664f969a1962/users/09e3840ef0034fd9b5a1c7c7efc55f16/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:09.636279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed1f4-f029-429c-84ac-45cc73bd9148 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:09.636667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed1f4-f029-429c-84ac-45cc73bd9148 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:09.636997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed1f4-f029-429c-84ac-45cc73bd9148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:09.729384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1eed1f4-f029-429c-84ac-45cc73bd9148 None None] MFA Rules not processed for user `6ea6c81b85374045be838535697eb2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:09.731831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1eed1f4-f029-429c-84ac-45cc73bd9148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:09.742125 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 743/1478] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:09 2022] POST /identity/v3/projects => generated 395 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:09.745741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c72f-ede5-483b-9005-79b79dbb2be4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:09.746269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c72f-ede5-483b-9005-79b79dbb2be4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:09.747357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c72f-ede5-483b-9005-79b79dbb2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:09.813824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:09.821360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-be33c72f-ede5-483b-9005-79b79dbb2be4 None None] MFA Rules not processed for user `09e3840ef0034fd9b5a1c7c7efc55f16`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:09.826286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be33c72f-ede5-483b-9005-79b79dbb2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:09.967820 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 736/1479] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:09.983521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eed1f4-f029-429c-84ac-45cc73bd9148 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:10.073359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 744/1480] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:10.075485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:10.075877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:10.076200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:10.104045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:10.105737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:10.117002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eed1f4-f029-429c-84ac-45cc73bd9148 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:10.198825 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 745/1481] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 18 13:24:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:10.200495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:10.207295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:10.260237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:10.261055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:10.261567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:10.262025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:10.263000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:10.265101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:10.331914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:10.353672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000f32-b016-4aea-b685-9e9960a4aa23 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:10.363390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:10.364739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:10.365813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:10.366305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:10.368791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:10.391577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 737/1482] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:09 2022] POST /identity/v3/users => generated 304 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:10.392968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:10.419938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681b3d-333c-4cb0-96a3-81857d8e57e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:10.436561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:10.437616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:10.437906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:10.441779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:10.443350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:10.452513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:10.539857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:10.541515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:10.574174 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 746/1483] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:10 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:10.575601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:10.600385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 738/1484] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:10 2022] POST /identity/v3/projects => generated 391 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:10.600385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:10.615551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255023b-7dbf-4ea4-a383-b9bd23998ad8 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:10.683514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:10.742929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb7df-34ca-4659-921f-80823016e252 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:10.760518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:10.762220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:10.762786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:10.763258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:10.766229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:10.766894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:10.767134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:10.767411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:10.768073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:10.769712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:10.777065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:10.780059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:10.783280 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 747/1485] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:10.784211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:10.798433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:10.893959 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 739/1486] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:10 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:10.898731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:10.931196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fb0b1-0844-4363-a25b-e519f976a6e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:10.970565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:10.971363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:10.971734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:10.972618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] PATH_INFO: `/v3/projects/9ee74c28e2f545aebde0db93c4427d3d/users/8c07b4e1493f4f90bf08b3add5b49497/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.022291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d80a6c-e54b-4133-ad79-abe6dce602ad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:11.025893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee74c28e2f545aebde0db93c4427d3d, user_id=8c07b4e1493f4f90bf08b3add5b49497, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:11.028717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:11.032960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:11.033770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:11.034197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:11.035111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.124020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:11.145607 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 740/1487] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:10 2022] PUT /identity/v3/projects/9ee74c28e2f545aebde0db93c4427d3d/users/8c07b4e1493f4f90bf08b3add5b49497/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:11.146551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:11.184130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:11.188844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:11.218098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 748/1488] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:10 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:11.225614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:11.252715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726d4f-05a6-4884-8332-22bdf292abca service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:11.387806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:11.388558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:11.389028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:11.389401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.390218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:11.392533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:11.429428 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 749/1489] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:11.429623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e6f24-bf35-4941-b587-23b800f831ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:11.430311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:11.439204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:11.439204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:11.439204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:11.439204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.439658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:11.439744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:11.440182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:11.502415 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 741/1490] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:11.507057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:11.545945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c64d9-27fc-4d46-9c80-0db3ae58bde5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:11.560415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:11.561112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:11.561396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:11.561674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] PATH_INFO: `/v3/projects/9ee74c28e2f545aebde0db93c4427d3d/users/8c07b4e1493f4f90bf08b3add5b49497/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.572159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee74c28e2f545aebde0db93c4427d3d, user_id=8c07b4e1493f4f90bf08b3add5b49497, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:11.576762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7681cf-1332-4784-8e22-c3b63d8496a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:11.577444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:11.580743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f365ce-07bf-422b-8419-fe0af186de5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:11.582453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f365ce-07bf-422b-8419-fe0af186de5b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:11.583251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f365ce-07bf-422b-8419-fe0af186de5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:11.584134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f365ce-07bf-422b-8419-fe0af186de5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.596050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f365ce-07bf-422b-8419-fe0af186de5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:11.598212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f365ce-07bf-422b-8419-fe0af186de5b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:11.605229 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 742/1491] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:11 2022] PUT /identity/v3/projects/9ee74c28e2f545aebde0db93c4427d3d/users/8c07b4e1493f4f90bf08b3add5b49497/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:11.606421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:11.613238 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 750/1492] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:11.618177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023715a2-b463-4984-b4a2-641f196b2905 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:11.618469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023715a2-b463-4984-b4a2-641f196b2905 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:11.618842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023715a2-b463-4984-b4a2-641f196b2905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.675902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-023715a2-b463-4984-b4a2-641f196b2905 None None] MFA Rules not processed for user `8c07b4e1493f4f90bf08b3add5b49497`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:11.683486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-023715a2-b463-4984-b4a2-641f196b2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:11.845162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec2215-2e1b-4b60-9df9-2db4e5343b89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:11.869825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e5a20-86bf-4b2a-bf6a-09103146e32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:11.870628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e5a20-86bf-4b2a-bf6a-09103146e32e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:11.870915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e5a20-86bf-4b2a-bf6a-09103146e32e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:11.874110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e5a20-86bf-4b2a-bf6a-09103146e32e admin admin] PATH_INFO: `/v3/projects/537cf3b6d17640568fbd1693b4df84ae/users/9a79b34ddcf644e8834892ff9e326fc1/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:11.950488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e5a20-86bf-4b2a-bf6a-09103146e32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=537cf3b6d17640568fbd1693b4df84ae, user_id=9a79b34ddcf644e8834892ff9e326fc1, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:11.959832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e5a20-86bf-4b2a-bf6a-09103146e32e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:11.978402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:12.027415 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 751/1493] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:12.055518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41bde1-5b9d-4579-a95b-7eb9e094686f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:12.055518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41bde1-5b9d-4579-a95b-7eb9e094686f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:12.055518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41bde1-5b9d-4579-a95b-7eb9e094686f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:12.055518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 752/1494] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:12.055518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41bde1-5b9d-4579-a95b-7eb9e094686f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:12.088844 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 743/1495] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:11 2022] PUT /identity/v3/projects/537cf3b6d17640568fbd1693b4df84ae/users/9a79b34ddcf644e8834892ff9e326fc1/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:12.092799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41bde1-5b9d-4579-a95b-7eb9e094686f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:12.095447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788c56e-9d7d-45d5-9553-839fb1dce7f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:12.095807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788c56e-9d7d-45d5-9553-839fb1dce7f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:12.098373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788c56e-9d7d-45d5-9553-839fb1dce7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:12.180595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b788c56e-9d7d-45d5-9553-839fb1dce7f3 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:12.191957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b788c56e-9d7d-45d5-9553-839fb1dce7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:12.233055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:12.300257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:12.305598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:12.306920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:12.309193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:12.311500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:12.315569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:12.461018 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 753/1496] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:12 2022] POST /identity/v3/projects => generated 393 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:12.462746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:12.506105 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 744/1497] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:12.508517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788c56e-9d7d-45d5-9553-839fb1dce7f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:12.592280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788c56e-9d7d-45d5-9553-839fb1dce7f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:12.781663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59541-6477-4419-9981-6f80d9749b3b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:12.790894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:12.793474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:12.793593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:12.793878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:12.794767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:12.799875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:12.802956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:12.803724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:12.804205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:12.804551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:12.805300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:12.809745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:12.825437 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 754/1498] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:12.829621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:12.907665 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 745/1499] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:12 2022] POST /identity/v3/users => generated 297 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:12.908778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:12.940386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c1760-f24c-4fc4-9ea1-8b945a8f2de2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:12.963733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:12.964680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:12.965109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:12.965531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] PATH_INFO: `/v3/projects/537cf3b6d17640568fbd1693b4df84ae/users/9a79b34ddcf644e8834892ff9e326fc1/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:12.973275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537cf3b6d17640568fbd1693b4df84ae, user_id=9a79b34ddcf644e8834892ff9e326fc1, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:12.976205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:13.002304 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 746/1500] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:12 2022] PUT /identity/v3/projects/537cf3b6d17640568fbd1693b4df84ae/users/9a79b34ddcf644e8834892ff9e326fc1/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:13.004701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:13.077045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5fd2-df73-4675-99b6-3be09932640c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:13.107752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:13.156297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28f6c6-dc9c-41a0-96c7-904f024bcc97 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:13.169924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0a075-3934-4730-9c4b-af5adcae407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:13.170847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a075-3934-4730-9c4b-af5adcae407f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:13.171137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a075-3934-4730-9c4b-af5adcae407f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:13.171473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a075-3934-4730-9c4b-af5adcae407f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:13.172656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0a075-3934-4730-9c4b-af5adcae407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:13.178501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0a075-3934-4730-9c4b-af5adcae407f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:13.201738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:13.202405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:13.202787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:13.203067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:13.208050 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 747/1501] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:13.211742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb968d-27ea-4dc2-a52a-b94f05e05abf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:13.212035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb968d-27ea-4dc2-a52a-b94f05e05abf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:13.212319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb968d-27ea-4dc2-a52a-b94f05e05abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:13.225186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:13.226728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:13.254575 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 755/1502] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:13.255658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:13.269811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c49f3d-18dc-4553-a548-1e497561dd66 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:13.276634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:13.277482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:13.277932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:13.278853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:13.281820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:13.283701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:13.284232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-64fb968d-27ea-4dc2-a52a-b94f05e05abf None None] MFA Rules not processed for user `9a79b34ddcf644e8834892ff9e326fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:13.285691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64fb968d-27ea-4dc2-a52a-b94f05e05abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:13.299487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:13.312995 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 756/1503] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:13.314309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:13.336306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197865a-a594-4c32-95fc-c6ad5146b0b9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:13.351453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:13.352418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:13.352845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:13.353455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] PATH_INFO: `/v3/projects/d63f7fb4c4ee4195ab078dd195dca65b/users/757ed02848b749c5b776177c11ad46b4/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:13.399628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63f7fb4c4ee4195ab078dd195dca65b, user_id=757ed02848b749c5b776177c11ad46b4, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:13.405599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:13.495183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 748/1504] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:13.516416 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 757/1505] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:13 2022] PUT /identity/v3/projects/d63f7fb4c4ee4195ab078dd195dca65b/users/757ed02848b749c5b776177c11ad46b4/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:13.533474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb30d6-96f5-42cb-b91e-6d6e12e647c8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:13.533673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb30d6-96f5-42cb-b91e-6d6e12e647c8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:13.533883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb30d6-96f5-42cb-b91e-6d6e12e647c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:13.610013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:13.664565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-baeb30d6-96f5-42cb-b91e-6d6e12e647c8 None None] MFA Rules not processed for user `757ed02848b749c5b776177c11ad46b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:13.679056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-baeb30d6-96f5-42cb-b91e-6d6e12e647c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:13.866537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304508f0-c767-47f0-aa9d-fa633e153e4b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:13.886166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b13629-ea69-4da9-a006-794582c4027e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:13.887128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b13629-ea69-4da9-a006-794582c4027e service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:13.887432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b13629-ea69-4da9-a006-794582c4027e service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:13.888257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b13629-ea69-4da9-a006-794582c4027e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:13.915766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 749/1506] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:14.084817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:14.089218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b13629-ea69-4da9-a006-794582c4027e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:14.091177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b13629-ea69-4da9-a006-794582c4027e service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:14.126164 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 758/1507] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:14.236014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb30d6-96f5-42cb-b91e-6d6e12e647c8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:14.256084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb30d6-96f5-42cb-b91e-6d6e12e647c8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:14.273477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:14.274583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:14.275034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:14.275473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:14.420059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:14.422092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:14.480442 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 750/1508] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:14 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:14.643423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3076-25bb-432c-97b0-9bb3de8d8873 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:14.644339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3076-25bb-432c-97b0-9bb3de8d8873 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:14.647438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3076-25bb-432c-97b0-9bb3de8d8873 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:14.647438 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 759/1509] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:14.663163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:24:14.683119 n-d-858383-13 devstack@keystone.service[82161]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 18 13:24:14.683427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:14.697747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba682f-f784-4f43-b0b0-e4a13b235ea8 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:14.704736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc93b8-5c2c-4985-b8b0-590da176f982 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c07b4e1493f4f90bf08b3add5b49497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee74c28e2f545aebde0db93c4427d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:14.705576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc93b8-5c2c-4985-b8b0-590da176f982 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:14.705872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc93b8-5c2c-4985-b8b0-590da176f982 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:14.708506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc93b8-5c2c-4985-b8b0-590da176f982 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] PATH_INFO: `/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:14.710432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc93b8-5c2c-4985-b8b0-590da176f982 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2ffcc468ee541168d57f0be0f0dacf5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:14.714527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc93b8-5c2c-4985-b8b0-590da176f982 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:14.732608 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 751/1510] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:24:14 2022] GET /identity/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5 => generated 391 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:14.843271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3076-25bb-432c-97b0-9bb3de8d8873 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:14.880977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3076-25bb-432c-97b0-9bb3de8d8873 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:14.899996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd4c53-82bd-417c-becf-f2bec51b4563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:14.902895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd4c53-82bd-417c-becf-f2bec51b4563 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:14.904318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd4c53-82bd-417c-becf-f2bec51b4563 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:14.905283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd4c53-82bd-417c-becf-f2bec51b4563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:15.021754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86aaf-840a-495c-b25e-8b59b2fb2b7b None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:15.022300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86aaf-840a-495c-b25e-8b59b2fb2b7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:15.022442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86aaf-840a-495c-b25e-8b59b2fb2b7b None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:15.024609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 752/1511] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:15.039544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86aaf-840a-495c-b25e-8b59b2fb2b7b None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:24:15.086490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86aaf-840a-495c-b25e-8b59b2fb2b7b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:15.129369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86aaf-840a-495c-b25e-8b59b2fb2b7b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:15.143189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd4c53-82bd-417c-becf-f2bec51b4563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:15.148989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c07b4e1493f4f90bf08b3add5b49497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee74c28e2f545aebde0db93c4427d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:15.151436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:15.151770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:15.152061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] PATH_INFO: `/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:15.153109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd4c53-82bd-417c-becf-f2bec51b4563 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:15.160086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2ffcc468ee541168d57f0be0f0dacf5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:15.162310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:15.192871 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 753/1512] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:24:15 2022] GET /identity/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5 => generated 391 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:15.217286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 760/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:15.236032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:15.250635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:15.319457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc481059-960c-430e-854f-fce85576a53c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:15.319783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc481059-960c-430e-854f-fce85576a53c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:15.320095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc481059-960c-430e-854f-fce85576a53c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:15.321635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 761/1514] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:24:15.330748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc481059-960c-430e-854f-fce85576a53c None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:24:15.391316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca390f-1ad5-4029-b5e5-a9f626a7d089 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:15.398122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:15.399069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:15.399875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:15.400316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] PATH_INFO: `/v3/users/09e3840ef0034fd9b5a1c7c7efc55f16` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:15.403264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e3840ef0034fd9b5a1c7c7efc55f16)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:15.405960 n-d-858383-13 devstack@keystone.service[82160]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-bc481059-960c-430e-854f-fce85576a53c None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 18 13:24:15.406417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc481059-960c-430e-854f-fce85576a53c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:15.407271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:15.459042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc481059-960c-430e-854f-fce85576a53c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:15.477411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0c671-5b54-4172-beaa-60f54a95b605 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c07b4e1493f4f90bf08b3add5b49497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee74c28e2f545aebde0db93c4427d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:15.478129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c671-5b54-4172-beaa-60f54a95b605 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:15.478431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c671-5b54-4172-beaa-60f54a95b605 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:15.478716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0c671-5b54-4172-beaa-60f54a95b605 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] PATH_INFO: `/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:15.484124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0c671-5b54-4172-beaa-60f54a95b605 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2ffcc468ee541168d57f0be0f0dacf5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:15.489685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0c671-5b54-4172-beaa-60f54a95b605 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:15.496756 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 762/1515] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:24:15 2022] GET /identity/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5 => generated 391 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:15.794376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e3840ef0034fd9b5a1c7c7efc55f16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:15.804699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e3840ef0034fd9b5a1c7c7efc55f16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:15.896524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e3840ef0034fd9b5a1c7c7efc55f16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:15.897233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e3840ef0034fd9b5a1c7c7efc55f16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:15.918823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e3840ef0034fd9b5a1c7c7efc55f16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:15.990139 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 754/1516] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:15 2022] DELETE /identity/v3/users/09e3840ef0034fd9b5a1c7c7efc55f16 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:15.994973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:15.996106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:15.996828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:16.054949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:16.054949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:16.289103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 763/1517] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:16.325257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:16.327435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:16.537677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a45395-2146-4f09-803e-598cd08bd590 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:16.542889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8248a98-3ebe-4d67-bd89-c4f0d1100a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:16.543644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248a98-3ebe-4d67-bd89-c4f0d1100a04 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:16.544013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248a98-3ebe-4d67-bd89-c4f0d1100a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:16.544362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248a98-3ebe-4d67-bd89-c4f0d1100a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:16.590761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8248a98-3ebe-4d67-bd89-c4f0d1100a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:16.598069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8248a98-3ebe-4d67-bd89-c4f0d1100a04 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:16.631113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 755/1518] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:16.871785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:16.872447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:17.145345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea5e75-c35c-4af7-a9f7-1f516ac8f196 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:17.169119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:17.172373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:17.172966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:17.172966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:17.178319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:17.250427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:17.311116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:17.313124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:17.366898 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 764/1519] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:17.945400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79e8ee-df72-4369-8630-296e7c4f34b0 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:17.945953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79e8ee-df72-4369-8630-296e7c4f34b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:17.946401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79e8ee-df72-4369-8630-296e7c4f34b0 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:17.948045 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 756/1520] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:17.956808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:24:17.958701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:18.002917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:18.013491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:18.102546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfb9-ca4e-466e-9ffd-b3d916583b6b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:18.103293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfb9-ca4e-466e-9ffd-b3d916583b6b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:18.103779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfb9-ca4e-466e-9ffd-b3d916583b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:18.171573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0aa6dfb9-ca4e-466e-9ffd-b3d916583b6b None None] MFA Rules not processed for user `fa4ca05a0c6a405f8fa014ee06dbcef4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:18.173049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0aa6dfb9-ca4e-466e-9ffd-b3d916583b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:18.229098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:18.253523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b22bd-ac50-4758-87cd-c0c9db32781a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:18.266697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c07b4e1493f4f90bf08b3add5b49497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee74c28e2f545aebde0db93c4427d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:18.267966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:18.268507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:18.270764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] PATH_INFO: `/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:18.274403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2ffcc468ee541168d57f0be0f0dacf5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:18.279863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:18.287138 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 765/1521] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:24:17 2022] GET /identity/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5 => generated 391 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:18.440355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:18.441276 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 757/1522] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:18.442736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:18.467527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7829e-19dd-4b7f-83a9-597c10742ad8 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:18.468152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7829e-19dd-4b7f-83a9-597c10742ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:18.469009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7829e-19dd-4b7f-83a9-597c10742ad8 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:18.470966 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 758/1523] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:18.478786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7829e-19dd-4b7f-83a9-597c10742ad8 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:24:18.485364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ff589-e47e-46e8-9077-9926de9863be tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:18.501214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c43062-4032-463a-a0ef-63553889cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:18.505595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43062-4032-463a-a0ef-63553889cc79 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:18.506046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43062-4032-463a-a0ef-63553889cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:18.506392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43062-4032-463a-a0ef-63553889cc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:18.506999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7829e-19dd-4b7f-83a9-597c10742ad8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:18.507679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c43062-4032-463a-a0ef-63553889cc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:18.518039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c43062-4032-463a-a0ef-63553889cc79 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:18.522615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7829e-19dd-4b7f-83a9-597c10742ad8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:18.527879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c07b4e1493f4f90bf08b3add5b49497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee74c28e2f545aebde0db93c4427d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:18.529286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:18.529991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:18.530759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] PATH_INFO: `/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:18.532702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2ffcc468ee541168d57f0be0f0dacf5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:18.535192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:18.539471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 759/1524] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:24:18 2022] GET /identity/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5 => generated 391 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:24:18.646474 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 766/1525] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:18 2022] POST /identity/v3/projects => generated 395 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:18.651167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:18.670275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85022e-b77f-4e92-8ce4-76905fb81df2 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:18.991206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c77a9-3c5d-4c6a-861f-0cf3e30951bf None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:18.991524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c77a9-3c5d-4c6a-861f-0cf3e30951bf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:18.991906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c77a9-3c5d-4c6a-861f-0cf3e30951bf None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:18.993860 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 767/1526] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:19.005946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c77a9-3c5d-4c6a-861f-0cf3e30951bf None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:24:19.170005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:19.172867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:19.173890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:19.174348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:19.176365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:19.181291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:19.187069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c77a9-3c5d-4c6a-861f-0cf3e30951bf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:19.271376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:19.295024 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 760/1527] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:18 2022] POST /identity/v3/users => generated 304 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:19.299440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:19.345562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80d8cc-ee80-43e5-8b3e-f10aa2c46b95 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:19.366554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:19.368293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:19.369947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:19.370384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:19.371227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:19.373767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c77a9-3c5d-4c6a-861f-0cf3e30951bf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:19.392246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:19.394980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c07b4e1493f4f90bf08b3add5b49497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ee74c28e2f545aebde0db93c4427d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:19.402256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:19.402256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:19.402256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] PATH_INFO: `/v3/projects/d63f7fb4c4ee4195ab078dd195dca65b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:19.402256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorizing `identity:get_project(project_id=d63f7fb4c4ee4195ab078dd195dca65b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:19.402758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:19.406761 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 768/1528] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:24:19 2022] GET /identity/v3/projects/d63f7fb4c4ee4195ab078dd195dca65b => generated 393 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:24:19.432023 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 761/1529] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:19.434462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:19.453624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc0e5-e5c5-4325-8b66-221c604f1b31 tempest-FlavorsAccessNegativeTestJSON-1641050148 tempest-FlavorsAccessNegativeTestJSON-1641050148-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:19.459076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:19.459868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:19.460243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:19.460797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] PATH_INFO: `/v3/projects/0db9f9b02869488dafd14b6d5c3e1ff7/users/7900e8079145470dbbac1334b0009f71/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:19.491354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:19.493860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:19.535955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db9f9b02869488dafd14b6d5c3e1ff7, user_id=7900e8079145470dbbac1334b0009f71, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:19.544576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92983-e75a-4150-89d9-48aa879b3c85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:19.552393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:19.567508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:19.568367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:19.568915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:19.574571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] PATH_INFO: `/v3/projects/748ad38d438a464d8d73664f969a1962` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:19.578385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748ad38d438a464d8d73664f969a1962)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:19.582466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:19.696414 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 769/1530] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:19 2022] PUT /identity/v3/projects/0db9f9b02869488dafd14b6d5c3e1ff7/users/7900e8079145470dbbac1334b0009f71/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:19.697516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:19.702980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:19.798288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748ad38d438a464d8d73664f969a1962', 'request_id': 'req-a542e193-a4a3-4f68-b273-11f3378ea731'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:19.814737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748ad38d438a464d8d73664f969a1962', 'request_id': 'req-a542e193-a4a3-4f68-b273-11f3378ea731'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:19.836061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614a34c-18c0-4edb-992a-fe6a57e12f2a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:19.901769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748ad38d438a464d8d73664f969a1962', 'request_id': 'req-a542e193-a4a3-4f68-b273-11f3378ea731'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:19.937601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] The token cache is being invalidate because project 748ad38d438a464d8d73664f969a1962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:19.937962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:19.940444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a542e193-a4a3-4f68-b273-11f3378ea731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:19.944400 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 762/1531] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:19 2022] DELETE /identity/v3/projects/748ad38d438a464d8d73664f969a1962 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:19.947967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:19.948252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:19.948530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:19.977325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:19.981431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:19.981970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:19.982586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] PATH_INFO: `/v3/users/ba43223a52484c4b9391e6376f8a3e66` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:19.986800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba43223a52484c4b9391e6376f8a3e66)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:19.991444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] MFA Rules not processed for user `d75623286dda46cfb4d8d70608655b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:19.993844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:19.994717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:20.005659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:20.088610 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 763/1532] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:20.089821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:20.099046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:20.115122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd599f6a-1852-44fb-bc3e-09e68d8a71d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:20.127438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:20.128035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:20.128314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:20.128605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:20.129267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:20.130900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:20.164472 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 764/1533] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:20.164472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:20.179029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:20.210700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf267c-0b25-4d2f-ad45-6f70122c1a2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:20.218461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:20.219544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:20.220545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:20.221172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] PATH_INFO: `/v3/users/9a79b34ddcf644e8834892ff9e326fc1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:20.224142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a79b34ddcf644e8834892ff9e326fc1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:20.227382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:20.261724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba43223a52484c4b9391e6376f8a3e66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.272326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba43223a52484c4b9391e6376f8a3e66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.273770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba43223a52484c4b9391e6376f8a3e66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.277888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:20.289746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba43223a52484c4b9391e6376f8a3e66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.373006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba43223a52484c4b9391e6376f8a3e66'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.388024 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 770/1534] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:19 2022] DELETE /identity/v3/users/ba43223a52484c4b9391e6376f8a3e66 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:20.388601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:20.391533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:20.454955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a79b34ddcf644e8834892ff9e326fc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.455943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a79b34ddcf644e8834892ff9e326fc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.526221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a79b34ddcf644e8834892ff9e326fc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.527470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a79b34ddcf644e8834892ff9e326fc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.543610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff5c4d2d-2b27-46a6-aa44-9eb954de2f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a79b34ddcf644e8834892ff9e326fc1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:20.547226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39da8c9-72f7-409f-8b4e-df740560ee10 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:20.555929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:20.556627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:20.556913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:20.557178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] PATH_INFO: `/v3/projects/0db9f9b02869488dafd14b6d5c3e1ff7/users/7900e8079145470dbbac1334b0009f71/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:20.563915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db9f9b02869488dafd14b6d5c3e1ff7, user_id=7900e8079145470dbbac1334b0009f71, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:20.580196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:20.606166 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 765/1535] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:20 2022] DELETE /identity/v3/users/9a79b34ddcf644e8834892ff9e326fc1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:20.606166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c8b1-bf6a-4969-b239-6beb8de3e5cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:20.606166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c8b1-bf6a-4969-b239-6beb8de3e5cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:20.606166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c8b1-bf6a-4969-b239-6beb8de3e5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:20.611495 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 771/1536] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:20 2022] PUT /identity/v3/projects/0db9f9b02869488dafd14b6d5c3e1ff7/users/7900e8079145470dbbac1334b0009f71/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:20.634222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57b4c8b1-bf6a-4969-b239-6beb8de3e5cf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:20.635480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57b4c8b1-bf6a-4969-b239-6beb8de3e5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:20.783839 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 766/1537] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:20.806643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:20.808512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:20.913973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:20.918109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:20.918109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:20.925590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02b6e-13e6-4302-a25d-ad07214792dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:20.963975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:20.965050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:21.007240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:21.021840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:21.023000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:21.023530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:21.023988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:21.038170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:21.041180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:21.063908 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 772/1538] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:21.105490 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 767/1539] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:24:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:21.127259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:21.145756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1237465-fc98-4c73-9d20-1e71b4f48398 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:21.158498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f8c84-e35b-4f66-8ac4-fcff0154785e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:21.158498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8c84-e35b-4f66-8ac4-fcff0154785e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:21.158498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8c84-e35b-4f66-8ac4-fcff0154785e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:21.158498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f8c84-e35b-4f66-8ac4-fcff0154785e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:21.184408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f8c84-e35b-4f66-8ac4-fcff0154785e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:21.192824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f8c84-e35b-4f66-8ac4-fcff0154785e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:21.216266 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 773/1540] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:21.754204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:21.756482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:21.792647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f5621-cfc3-4e93-a137-a77c82069607 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:21.811513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:21.812652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:21.814474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:21.815071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] PATH_INFO: `/v3/projects/537cf3b6d17640568fbd1693b4df84ae` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:21.817038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=537cf3b6d17640568fbd1693b4df84ae)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:21.820775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:22.028880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537cf3b6d17640568fbd1693b4df84ae', 'request_id': 'req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.054796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537cf3b6d17640568fbd1693b4df84ae', 'request_id': 'req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.204690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537cf3b6d17640568fbd1693b4df84ae', 'request_id': 'req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.243114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] The token cache is being invalidate because project 537cf3b6d17640568fbd1693b4df84ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:22.249376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.249376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.250728 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 768/1541] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:21 2022] DELETE /identity/v3/projects/537cf3b6d17640568fbd1693b4df84ae => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:22.257724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2ed59-d92c-4afc-aae3-d1112a479623 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:22.258184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2ed59-d92c-4afc-aae3-d1112a479623 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:22.258464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2ed59-d92c-4afc-aae3-d1112a479623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:22.281107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:22.282666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:22.303550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e5d2ed59-d92c-4afc-aae3-d1112a479623 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:22.306177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5d2ed59-d92c-4afc-aae3-d1112a479623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:22.344673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:22.503664 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 774/1542] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:22.506091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b8b71-782b-4532-a834-b5887811b29e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:22.506091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b8b71-782b-4532-a834-b5887811b29e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:22.506434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b8b71-782b-4532-a834-b5887811b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:22.555110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34428a4b-2d55-4f64-bb1a-7c4260e3da7b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:22.559285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e6b8b71-782b-4532-a834-b5887811b29e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:22.560565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e6b8b71-782b-4532-a834-b5887811b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:22.577023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:22.578966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:22.580542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:22.581357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] PATH_INFO: `/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:22.583162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ffcc468ee541168d57f0be0f0dacf5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:22.585628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:22.590194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 775/1543] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:22.590799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b8b71-782b-4532-a834-b5887811b29e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:22.613470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b8b71-782b-4532-a834-b5887811b29e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:22.630754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:22.631315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:22.631903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:22.632376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:22.633308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:22.633613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:22.635338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:22.666932 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 776/1544] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:22.671187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:22.684873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361de00-866b-45fa-8d4f-e8d53a0ed196 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:22.694923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:22.716935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:22.718213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:22.718585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:22.719266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:22.730245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:22.758926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ffcc468ee541168d57f0be0f0dacf5', 'request_id': 'req-cad53ef9-2d28-489f-b8a9-13a56a5765d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.760003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:22.768952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ffcc468ee541168d57f0be0f0dacf5', 'request_id': 'req-cad53ef9-2d28-489f-b8a9-13a56a5765d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.873934 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 777/1545] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:22 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:22.879442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:22.885849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ffcc468ee541168d57f0be0f0dacf5', 'request_id': 'req-cad53ef9-2d28-489f-b8a9-13a56a5765d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.911526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] The token cache is being invalidate because project a2ffcc468ee541168d57f0be0f0dacf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:22.915442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.917145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:22.919401 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 769/1546] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:22 2022] DELETE /identity/v3/projects/a2ffcc468ee541168d57f0be0f0dacf5 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:22.924218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:22.930156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:23.077144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad53ef9-2d28-489f-b8a9-13a56a5765d2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:23.084652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae87c8a-2431-4eb7-9741-cdd42be9ebad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:23.085052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:23.085746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:23.086160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:23.086610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] PATH_INFO: `/v3/users/8c07b4e1493f4f90bf08b3add5b49497` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:23.087930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c07b4e1493f4f90bf08b3add5b49497)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:23.090256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:23.107050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:23.110691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:23.110988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:23.111269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:23.111935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:23.114358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:23.209200 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 778/1547] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:22 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:23.210613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:23.231836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:23.265657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34832-afee-4b10-8533-0bcb5095d5e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:23.277458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:23.278283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:23.278391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:23.278662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:23.279306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:23.280937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:23.305988 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 779/1548] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:23.310393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:23.322481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0b0d6-45ba-4140-af0d-45c9f360b1a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:23.328632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:23.329316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:23.338733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:23.341415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:23.349947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:23.351803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:23.369280 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 780/1549] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:24:23.370761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:23.372115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c07b4e1493f4f90bf08b3add5b49497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:23.378601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c07b4e1493f4f90bf08b3add5b49497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:23.401860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a664-2b81-4892-b2c5-0c6ec79fb2f2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:23.416762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63ccbb-a62b-42c7-aa18-ff49e2d1e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:23.417462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ccbb-a62b-42c7-aa18-ff49e2d1e614 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:23.417741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ccbb-a62b-42c7-aa18-ff49e2d1e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:23.418013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63ccbb-a62b-42c7-aa18-ff49e2d1e614 admin admin] PATH_INFO: `/v3/projects/d9d8a78277cd451788a3199c919ff4c4/users/fb6df13bd2ce4713ac97f91b19421baf/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:23.443200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ccbb-a62b-42c7-aa18-ff49e2d1e614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d8a78277cd451788a3199c919ff4c4, user_id=fb6df13bd2ce4713ac97f91b19421baf, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:23.446722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63ccbb-a62b-42c7-aa18-ff49e2d1e614 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:23.479670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c07b4e1493f4f90bf08b3add5b49497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:23.480643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c07b4e1493f4f90bf08b3add5b49497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:23.493543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c07b4e1493f4f90bf08b3add5b49497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:23.546992 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 781/1550] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:23 2022] PUT /identity/v3/projects/d9d8a78277cd451788a3199c919ff4c4/users/fb6df13bd2ce4713ac97f91b19421baf/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:23.561369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:23.562962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:23.563396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:23.602382 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 770/1551] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:22 2022] DELETE /identity/v3/users/8c07b4e1493f4f90bf08b3add5b49497 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:23.724569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] MFA Rules not processed for user `fb6df13bd2ce4713ac97f91b19421baf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:23.726725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:23.733028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:23.884251 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 782/1552] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:23.899557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:23.901156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:24.115688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:24.182924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48647acf-4a2a-423b-aae2-aad1c671571e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:24.195217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd4793-07b7-4852-b87f-875232520c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:24.195918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd4793-07b7-4852-b87f-875232520c1b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:24.196226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd4793-07b7-4852-b87f-875232520c1b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:24.196706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd4793-07b7-4852-b87f-875232520c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:24.213494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd4793-07b7-4852-b87f-875232520c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:24.215977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd4793-07b7-4852-b87f-875232520c1b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:24.270175 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 771/1553] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:24.519016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:24.521011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:24.745714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:24.745714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:24.745714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:24.764937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6496b2-d311-4b1b-9ccd-7b727bab6522 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:24.776796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:24.779217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:24.779657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:24.780623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] PATH_INFO: `/v3/projects/9ee74c28e2f545aebde0db93c4427d3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:24.785842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee74c28e2f545aebde0db93c4427d3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:24.788283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:24.859935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:24.865445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:24.988445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee74c28e2f545aebde0db93c4427d3d', 'request_id': 'req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:25.010342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee74c28e2f545aebde0db93c4427d3d', 'request_id': 'req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:25.069729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 772/1554] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:25.069729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:25.069729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:25.223712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee74c28e2f545aebde0db93c4427d3d', 'request_id': 'req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:25.224721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183382b9-0302-4463-aa2c-88c101988c9a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:25.235907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] The token cache is being invalidate because project 9ee74c28e2f545aebde0db93c4427d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:25.238325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:25.242246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:25.248348 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 783/1555] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:24 2022] DELETE /identity/v3/projects/9ee74c28e2f545aebde0db93c4427d3d => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:25.254185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:25.259320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:25.372790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:25.476329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20dbcb-4bd2-456e-a6d2-a2897275bcdf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:25.492834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:25.493788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:25.494276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:25.494789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] PATH_INFO: `/v3/users/757ed02848b749c5b776177c11ad46b4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:25.496173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=757ed02848b749c5b776177c11ad46b4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:25.500844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:25.517235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1bce-a07e-4c43-869a-7c32a545d5ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:25.517893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1bce-a07e-4c43-869a-7c32a545d5ee service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:25.518156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1bce-a07e-4c43-869a-7c32a545d5ee service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:25.518478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1bce-a07e-4c43-869a-7c32a545d5ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:25.533210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6eb1bce-a07e-4c43-869a-7c32a545d5ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:25.679763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:26.126601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1bce-a07e-4c43-869a-7c32a545d5ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:26.137248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1bce-a07e-4c43-869a-7c32a545d5ee service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:26.144896 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 773/1556] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1088 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:24:26.617736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757ed02848b749c5b776177c11ad46b4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:26.631884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757ed02848b749c5b776177c11ad46b4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:26.633001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757ed02848b749c5b776177c11ad46b4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:26.647765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757ed02848b749c5b776177c11ad46b4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:26.738957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:26.739242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:26.739521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:26.765695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da6e1c58-d863-4d98-976e-5361ca3dbc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757ed02848b749c5b776177c11ad46b4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:26.782772 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 784/1557] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:25 2022] DELETE /identity/v3/users/757ed02848b749c5b776177c11ad46b4 => generated 0 bytes in 1524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:26.789074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] MFA Rules not processed for user `fb6df13bd2ce4713ac97f91b19421baf`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:26.790612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:26.839292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a788-7abf-46b1-9ca6-59cd637a3663 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:26.840857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a788-7abf-46b1-9ca6-59cd637a3663 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:26.841358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a788-7abf-46b1-9ca6-59cd637a3663 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:26.843913 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 785/1558] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:24:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:26.854814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2d3c-adab-4ce6-a167-0bd01ae4317a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:26.856074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2d3c-adab-4ce6-a167-0bd01ae4317a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:26.856615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e2d3c-adab-4ce6-a167-0bd01ae4317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:26.893222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cf6e2d3c-adab-4ce6-a167-0bd01ae4317a None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:26.898499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf6e2d3c-adab-4ce6-a167-0bd01ae4317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:26.926874 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 774/1559] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:27.005374 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 786/1560] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:27.356985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:27.359355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:27.392791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ec59b-4b7b-47de-9f53-c17838101f1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:27.404678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:27.407467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:27.407467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:27.407467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:27.440034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:27.442959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:27.443381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:27.443669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:27.444061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:27.474955 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 775/1561] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:27.563216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:27.563710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:27.564538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:27.565120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:27.667781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:27.689479 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 787/1562] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:27.712246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918d3ff-b597-4363-93e4-420c29140089 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:27.719405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:27.723782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:27.725780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:27.732169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:27.732454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:27.734088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] PATH_INFO: `/v3/projects/d63f7fb4c4ee4195ab078dd195dca65b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:27.744791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63f7fb4c4ee4195ab078dd195dca65b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:27.748477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:27.853767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5026a-978b-4409-ae60-7f5a9254016f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:27.860307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318370d-703b-40c5-95fe-2b6376c823dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:27.861673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318370d-703b-40c5-95fe-2b6376c823dd service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:27.862146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318370d-703b-40c5-95fe-2b6376c823dd service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:27.863207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318370d-703b-40c5-95fe-2b6376c823dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:27.874348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318370d-703b-40c5-95fe-2b6376c823dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:27.879003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318370d-703b-40c5-95fe-2b6376c823dd service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:27.886980 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 788/1563] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:24:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:27.896094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63f7fb4c4ee4195ab078dd195dca65b', 'request_id': 'req-960489d1-7e9c-49cc-9d33-cc03ef96d619'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:27.940481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63f7fb4c4ee4195ab078dd195dca65b', 'request_id': 'req-960489d1-7e9c-49cc-9d33-cc03ef96d619'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.060982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63f7fb4c4ee4195ab078dd195dca65b', 'request_id': 'req-960489d1-7e9c-49cc-9d33-cc03ef96d619'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.069684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:28.083305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] The token cache is being invalidate because project d63f7fb4c4ee4195ab078dd195dca65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:28.084104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.084885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-960489d1-7e9c-49cc-9d33-cc03ef96d619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.090108 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 776/1564] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:27 2022] DELETE /identity/v3/projects/d63f7fb4c4ee4195ab078dd195dca65b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:28.092859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb337-0eb2-4869-90eb-3c5b829cf1fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.093146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb337-0eb2-4869-90eb-3c5b829cf1fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.093425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb337-0eb2-4869-90eb-3c5b829cf1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.116694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6cafb337-0eb2-4869-90eb-3c5b829cf1fe None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:28.118838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6cafb337-0eb2-4869-90eb-3c5b829cf1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:28.195205 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 789/1565] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:28.197333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334caf8f-0ede-45db-b44e-462915e5d175 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.197679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334caf8f-0ede-45db-b44e-462915e5d175 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.197960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334caf8f-0ede-45db-b44e-462915e5d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.220748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-334caf8f-0ede-45db-b44e-462915e5d175 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:28.222903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-334caf8f-0ede-45db-b44e-462915e5d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:28.236479 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 777/1566] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:28.238692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafb337-0eb2-4869-90eb-3c5b829cf1fe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:28.260948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafb337-0eb2-4869-90eb-3c5b829cf1fe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:28.266608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:28.267231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.267828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.267828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.268408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:28.269311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:28.271092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:28.284839 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 790/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:28.289445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334caf8f-0ede-45db-b44e-462915e5d175 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:28.300107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334caf8f-0ede-45db-b44e-462915e5d175 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:28.304924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:28.305650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.306010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.306385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.307104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:28.309068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:28.384918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:28.388152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:28.416903 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 778/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:28 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:28.418756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:28.419139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1914fb-eb27-4441-b1f9-02a700cc9d7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:28.501770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:28.502505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.508365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.508365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] PATH_INFO: `/v3/users/fb6df13bd2ce4713ac97f91b19421baf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.508365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6df13bd2ce4713ac97f91b19421baf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:28.508365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:28.515218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469cde1-e993-4b82-98a2-396bd3f892fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:28.521230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:28.521947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.522201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.522503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.523281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:28.525588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:28.526716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:28.753847 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 779/1569] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:28 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:28.758261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:28.773704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6df13bd2ce4713ac97f91b19421baf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.788586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196331d1-247e-439d-bd68-41479e57fc4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:28.792602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6df13bd2ce4713ac97f91b19421baf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.793895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6df13bd2ce4713ac97f91b19421baf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.801500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:28.802093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.802357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.802632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.803282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:28.804873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:28.810998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6df13bd2ce4713ac97f91b19421baf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.821006 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 780/1570] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:28.825120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:28.828024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:28.843938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeca476-bc3b-4716-bb7e-f7699d163e0a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:28.850491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:28.854517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.858539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.858539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.858539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:28.858539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:28.869617 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 781/1571] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:28.873873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:28.877779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1afd1b9e-fe0b-4cd0-9574-1a107397dbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6df13bd2ce4713ac97f91b19421baf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:28.888276 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 791/1572] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:28 2022] DELETE /identity/v3/users/fb6df13bd2ce4713ac97f91b19421baf => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:28.892470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:28.892763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:28.893044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:28.895991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ede9-29fc-4264-b285-17f8183456d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:28.929714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:28.931102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:29.014986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d085de6-860e-46d9-bff2-787b36185746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:29.016122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085de6-860e-46d9-bff2-787b36185746 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:29.016526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085de6-860e-46d9-bff2-787b36185746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:29.016755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d085de6-860e-46d9-bff2-787b36185746 admin admin] PATH_INFO: `/v3/projects/faf91b919e94465e8f4aefe9a57a604d/users/af6da3b86311401c8354488af250626e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:29.044843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d085de6-860e-46d9-bff2-787b36185746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf91b919e94465e8f4aefe9a57a604d, user_id=af6da3b86311401c8354488af250626e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:29.048525 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 792/1573] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:29.048665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d085de6-860e-46d9-bff2-787b36185746 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:29.060339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:29.062844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:29.157002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26693c1b-2a85-45ff-9237-55d3746dd8d2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:29.161185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:29.161819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:29.162193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:29.162473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:29.180750 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 782/1574] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:28 2022] PUT /identity/v3/projects/faf91b919e94465e8f4aefe9a57a604d/users/af6da3b86311401c8354488af250626e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:29.194182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b411-95f8-429c-9df2-c82808bda1b0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:29.194507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b411-95f8-429c-9df2-c82808bda1b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:29.194738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b411-95f8-429c-9df2-c82808bda1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:29.197860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:29.199330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:29.212210 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 793/1575] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:29.254502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d7a0b411-95f8-429c-9df2-c82808bda1b0 None None] MFA Rules not processed for user `af6da3b86311401c8354488af250626e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:29.255956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7a0b411-95f8-429c-9df2-c82808bda1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:29.263829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:29.398122 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 783/1576] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:29.399839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:29.416472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6de8c-a139-4230-b3a2-9b16976247c4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:29.517724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:29.617378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:29.619117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:29.620970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:29.621601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:29.622446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:29.630589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:29.762522 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 794/1577] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:29 2022] POST /identity/v3/projects => generated 373 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:29.766041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b411-95f8-429c-9df2-c82808bda1b0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:29.783702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b411-95f8-429c-9df2-c82808bda1b0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:29.891783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:29.894932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:29.894932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:29.894932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:29.894932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:29.898432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:30.036048 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 784/1578] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:29 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:30.041321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:30.055918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c248ecd-595c-4453-9830-01ed15de912b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:30.061508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:30.062373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:30.062814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:30.063276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:30.064174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:30.066172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:30.083821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:30.091393 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 795/1579] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:30.096764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789acad6-715e-47e4-b7da-a476ffc53d45 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:30.104255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:30.105158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:30.105588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:30.106003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] PATH_INFO: `/v3/projects/f8be41fe8e694c4ebcbe70dae3cdd786/users/7c3243092a7a418ca7a5693b4beb0d24/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:30.128935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8be41fe8e694c4ebcbe70dae3cdd786, user_id=7c3243092a7a418ca7a5693b4beb0d24, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:30.132379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:30.211891 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 785/1580] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:30 2022] PUT /identity/v3/projects/f8be41fe8e694c4ebcbe70dae3cdd786/users/7c3243092a7a418ca7a5693b4beb0d24/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:30.216204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:30.263479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6519d-08b0-476f-b274-b7233e7c3736 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:30.357734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:30.360213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:30.366964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:30.367850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:30.368435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:30.368859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:30.369899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:30.371934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:30.377429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d607c5-3ddc-4227-99db-4ae375f59041 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:30.388855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:30.389509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:30.389785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:30.390071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] PATH_INFO: `/v3/projects/d9d8a78277cd451788a3199c919ff4c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:30.391443 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 796/1581] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:30.392850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:30.393158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d8a78277cd451788a3199c919ff4c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:30.401536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:30.430042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e22722-04db-4bf1-9a32-3eb3abc31eba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:30.430042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6f7c4-d087-459e-8beb-27feeb0d8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:30.430042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f7c4-d087-459e-8beb-27feeb0d8ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:30.430727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f7c4-d087-459e-8beb-27feeb0d8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:30.430727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f7c4-d087-459e-8beb-27feeb0d8ecd admin admin] PATH_INFO: `/v3/projects/f8be41fe8e694c4ebcbe70dae3cdd786/users/7c3243092a7a418ca7a5693b4beb0d24/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:30.432730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6f7c4-d087-459e-8beb-27feeb0d8ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8be41fe8e694c4ebcbe70dae3cdd786, user_id=7c3243092a7a418ca7a5693b4beb0d24, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:30.439048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6f7c4-d087-459e-8beb-27feeb0d8ecd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:30.487804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 797/1582] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:30 2022] PUT /identity/v3/projects/f8be41fe8e694c4ebcbe70dae3cdd786/users/7c3243092a7a418ca7a5693b4beb0d24/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:30.490353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:30.490714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:30.491060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:30.526436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] MFA Rules not processed for user `7c3243092a7a418ca7a5693b4beb0d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:30.529407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:30.654412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d8a78277cd451788a3199c919ff4c4', 'request_id': 'req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:30.665721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d8a78277cd451788a3199c919ff4c4', 'request_id': 'req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:30.703320 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 798/1583] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:30.718439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:30.719937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:30.757093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:30.772083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d8a78277cd451788a3199c919ff4c4', 'request_id': 'req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:30.783094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:30.804292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] The token cache is being invalidate because project d9d8a78277cd451788a3199c919ff4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:30.808101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:30.808708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4eff65d5-4aaf-4c78-a7c3-1d127e7d1887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:30.813125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 786/1584] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:30 2022] DELETE /identity/v3/projects/d9d8a78277cd451788a3199c919ff4c4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:30.820255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafea3c-c6b7-4fca-9a90-c2a4d550ce05 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:30.820774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafea3c-c6b7-4fca-9a90-c2a4d550ce05 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:30.821250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafea3c-c6b7-4fca-9a90-c2a4d550ce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:30.877615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ccafea3c-c6b7-4fca-9a90-c2a4d550ce05 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:30.880102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccafea3c-c6b7-4fca-9a90-c2a4d550ce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:30.897287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe20c95-7356-4b95-8f18-a97514631ec1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.009560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 787/1585] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:31.018733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f500-689a-4ec6-812e-6f69c9560fb7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.019032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f500-689a-4ec6-812e-6f69c9560fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.019466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f500-689a-4ec6-812e-6f69c9560fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.050711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61d7f500-689a-4ec6-812e-6f69c9560fb7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:31.051961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61d7f500-689a-4ec6-812e-6f69c9560fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:31.063861 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 788/1586] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:31.070703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7f500-689a-4ec6-812e-6f69c9560fb7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:31.083199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7f500-689a-4ec6-812e-6f69c9560fb7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.104127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.104780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.105061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.105336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.106085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:31.106404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.108973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.138100 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 789/1587] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:31.139789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:31.144824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.147585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.148292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.149195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.149541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390df9-5661-4e26-b86d-56b736096344 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.154703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:31.182711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.183344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.183623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.183899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.184546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.190694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.255924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.255924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.280218 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 799/1588] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:31.317202 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 790/1589] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:31 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:31.321140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:31.342151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ab52-f63e-4862-ba11-4502d34565ae service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.434110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:31.449630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.450575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.451006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.451428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.452593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.455745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.559294 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 800/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:31 2022] POST /identity/v3/users => generated 282 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:31.560745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:31.579388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:31.581795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:31.593202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015a31-5560-4d00-8333-e1c50656c622 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.612164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.613203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.613694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.614095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.615368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.618402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.634520 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 791/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:31.652898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:31.681225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efc579-b3c8-4e2f-9828-afab8fdbb3ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.696405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.697502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.699026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.699911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.701190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.703426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.749260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54523d7-1cf6-418d-8675-e8550fc97573 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.765518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.766460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.766748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.767028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.772855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:31.774152 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 792/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:31.778286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:31.812924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe64c7-50d5-4f43-b2c4-ba8520653198 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:31.831168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0fdd8-3194-4cbf-947d-97250e6cc96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:31.833507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fdd8-3194-4cbf-947d-97250e6cc96d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:31.833866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fdd8-3194-4cbf-947d-97250e6cc96d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:31.834235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fdd8-3194-4cbf-947d-97250e6cc96d admin admin] PATH_INFO: `/v3/projects/a2b1a51ccc344c649308631c71afd5b7/users/356ffdf6f40b4d71a7f39c414c008491/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:31.870039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0fdd8-3194-4cbf-947d-97250e6cc96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b1a51ccc344c649308631c71afd5b7, user_id=356ffdf6f40b4d71a7f39c414c008491, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.880337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0fdd8-3194-4cbf-947d-97250e6cc96d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.910138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:31.915601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:31.947167 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 801/1593] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:31.989343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:32.024683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb56f-9c3d-4bf3-b72b-0b20f0c7e101 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:32.039039 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 793/1594] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:31 2022] PUT /identity/v3/projects/a2b1a51ccc344c649308631c71afd5b7/users/356ffdf6f40b4d71a7f39c414c008491/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:32.040796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393ccf7-7955-420e-9e58-0af6f099b139 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:32.041220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393ccf7-7955-420e-9e58-0af6f099b139 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:32.041588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393ccf7-7955-420e-9e58-0af6f099b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:32.085066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2393ccf7-7955-420e-9e58-0af6f099b139 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:32.086745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2393ccf7-7955-420e-9e58-0af6f099b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:32.164821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:32.165696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:32.177890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:32.177890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:32.177890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:32.186110 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 794/1595] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:32.187765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2d7b-6b89-4ef5-87ce-61b68182e0b6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:32.188195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2d7b-6b89-4ef5-87ce-61b68182e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:32.188627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2d7b-6b89-4ef5-87ce-61b68182e0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:32.198430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:32.231378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:32.250898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5fa2d7b-6b89-4ef5-87ce-61b68182e0b6 None None] MFA Rules not processed for user `7900e8079145470dbbac1334b0009f71`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:32.252934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5fa2d7b-6b89-4ef5-87ce-61b68182e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:32.274856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:32.279375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:32.293146 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 802/1596] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:32.294190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:32.296027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:32.350863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 795/1597] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:32.365863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:32.367461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:32.368536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:32.401868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] MFA Rules not processed for user `fa4ca05a0c6a405f8fa014ee06dbcef4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:32.403278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:32.423627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba674c-9ef9-4a0d-8325-12bf9eb62570 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:32.431950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:32.432579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:32.432857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:32.433131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:32.470563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:32.472262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:32.497832 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 803/1598] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:32.548680 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 796/1599] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:32.615381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:32.616867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:32.633313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e718bf-5ff2-4096-8382-2c2268415ef9 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:32.639304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4bb33-7051-44c7-b08a-d2dcb53462ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:32.639904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4bb33-7051-44c7-b08a-d2dcb53462ab service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:32.640180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4bb33-7051-44c7-b08a-d2dcb53462ab service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:32.640448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4bb33-7051-44c7-b08a-d2dcb53462ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:32.642206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ca4bb33-7051-44c7-b08a-d2dcb53462ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:32.653265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4bb33-7051-44c7-b08a-d2dcb53462ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:32.654814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4bb33-7051-44c7-b08a-d2dcb53462ab service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:32.663555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 804/1600] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:33.561159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:33.563800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:33.582245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c185838-0ab1-4c8f-8138-c75877ba9bc8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:33.603623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:33.604680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:33.605183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:33.605860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] PATH_INFO: `/v3/users/af6da3b86311401c8354488af250626e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:33.609202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6da3b86311401c8354488af250626e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:33.612858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:33.883476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6da3b86311401c8354488af250626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:33.884410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6da3b86311401c8354488af250626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:33.947984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6da3b86311401c8354488af250626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:33.948731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6da3b86311401c8354488af250626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:33.957428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6da3b86311401c8354488af250626e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:33.975097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 797/1601] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:33 2022] DELETE /identity/v3/users/af6da3b86311401c8354488af250626e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:33.979596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:33.980108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:33.980227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:33.999382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:34.002407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:34.070518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 805/1602] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:34.080760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:34.083720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:34.099196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:34.155205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797b491-811c-4c22-aa19-08c3352549a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:34.169326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:34.169326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:34.169326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:34.169326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:34.189707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:34.193187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:34.229367 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 798/1603] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:34.779033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:34.787126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:34.802541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcae25-eb84-4414-b714-9c843760f534 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:34.807369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:34.808021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:34.808303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:34.808578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] PATH_INFO: `/v3/projects/faf91b919e94465e8f4aefe9a57a604d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:34.809810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf91b919e94465e8f4aefe9a57a604d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:34.811803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:34.896121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:34.930819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf91b919e94465e8f4aefe9a57a604d', 'request_id': 'req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:34.940647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf91b919e94465e8f4aefe9a57a604d', 'request_id': 'req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.046426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf91b919e94465e8f4aefe9a57a604d', 'request_id': 'req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.064623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] The token cache is being invalidate because project faf91b919e94465e8f4aefe9a57a604d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:35.065416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.066462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.068518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 806/1604] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:34 2022] DELETE /identity/v3/projects/faf91b919e94465e8f4aefe9a57a604d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:35.078394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:35.089771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ba5b9-e993-40fe-9a3d-e582b3fc68c4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:35.179605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:35.180304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:35.180585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:35.182746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] PATH_INFO: `/v3/users/7c3243092a7a418ca7a5693b4beb0d24` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:35.182746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3243092a7a418ca7a5693b4beb0d24)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:35.185206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:35.440745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3243092a7a418ca7a5693b4beb0d24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.443296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3243092a7a418ca7a5693b4beb0d24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.557230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3243092a7a418ca7a5693b4beb0d24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.558215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3243092a7a418ca7a5693b4beb0d24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.572165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6529268e-ea87-4f8a-b3e0-2ffd1cadbb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3243092a7a418ca7a5693b4beb0d24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:35.603542 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 799/1605] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:35 2022] DELETE /identity/v3/users/7c3243092a7a418ca7a5693b4beb0d24 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:36.698547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:36.703712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:36.731627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1cf2f-4bcc-4cde-bf54-7c511500b480 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:36.848676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:36.852026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:36.852340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:36.852620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] PATH_INFO: `/v3/projects/f8be41fe8e694c4ebcbe70dae3cdd786` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:36.853953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8be41fe8e694c4ebcbe70dae3cdd786)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:36.855956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:37.012639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8be41fe8e694c4ebcbe70dae3cdd786', 'request_id': 'req-f427c048-8540-43ca-95ae-450cdc0a6c89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:37.031937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8be41fe8e694c4ebcbe70dae3cdd786', 'request_id': 'req-f427c048-8540-43ca-95ae-450cdc0a6c89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:37.149359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8be41fe8e694c4ebcbe70dae3cdd786', 'request_id': 'req-f427c048-8540-43ca-95ae-450cdc0a6c89'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:37.166390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] The token cache is being invalidate because project f8be41fe8e694c4ebcbe70dae3cdd786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:37.167609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:37.168513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f427c048-8540-43ca-95ae-450cdc0a6c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:37.175869 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 807/1606] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:36 2022] DELETE /identity/v3/projects/f8be41fe8e694c4ebcbe70dae3cdd786 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:37.176569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf330bd-a63e-4f7c-b03d-897bf306b4f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:37.177056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf330bd-a63e-4f7c-b03d-897bf306b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:37.177129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf330bd-a63e-4f7c-b03d-897bf306b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:37.199062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0bf330bd-a63e-4f7c-b03d-897bf306b4f8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:37.201277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0bf330bd-a63e-4f7c-b03d-897bf306b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:37.273127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:37.342043 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 800/1607] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:37.343990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd29e85-1c1b-48e4-9be0-fdeb1186dd5d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:37.344290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd29e85-1c1b-48e4-9be0-fdeb1186dd5d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:37.344560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd29e85-1c1b-48e4-9be0-fdeb1186dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:37.371615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bfd29e85-1c1b-48e4-9be0-fdeb1186dd5d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:37.374654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bfd29e85-1c1b-48e4-9be0-fdeb1186dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:37.390602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 808/1608] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:37.395152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf330bd-a63e-4f7c-b03d-897bf306b4f8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:37.408702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf330bd-a63e-4f7c-b03d-897bf306b4f8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:37.428006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:37.428698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:37.428987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:37.429264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:37.429923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:37.430255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:37.432001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:37.455659 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 801/1609] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:37.460409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd29e85-1c1b-48e4-9be0-fdeb1186dd5d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:37.477525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd29e85-1c1b-48e4-9be0-fdeb1186dd5d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:37.493869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:37.494676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:37.495053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:37.499348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:37.501180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:37.503425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:37.679314 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 809/1610] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:37 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:37.683637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:37.694733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2da131-7f62-44be-bb94-1318ee7e7364 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:37.786902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:37.787584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:37.787873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:37.788152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:37.788845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:37.791337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:37.944439 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 802/1611] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:37 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:37.948367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:37.961396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15214386-9412-4a0e-bf7d-4f24c7375ec7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:37.969813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:37.973003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:37.973003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:37.973432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:37.974969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:37.977210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:37.998708 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 810/1612] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:37.999938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:38.024508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e06e59-8c1c-4214-824f-b1a05b2edc87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:38.037854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ace3c8-7f0f-4032-b530-084a97d863f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:38.039375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ace3c8-7f0f-4032-b530-084a97d863f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:38.039375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ace3c8-7f0f-4032-b530-084a97d863f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:38.039647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ace3c8-7f0f-4032-b530-084a97d863f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:38.040296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ace3c8-7f0f-4032-b530-084a97d863f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:38.042544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ace3c8-7f0f-4032-b530-084a97d863f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:38.062952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 803/1613] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:38.068044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:38.079602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b8ab6-138c-48f7-9390-96e161021d6e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:38.088718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:38.088718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:38.088718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:38.088718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] PATH_INFO: `/v3/projects/b9dc24eea6d04d899499a52dee5d08c0/users/a920c59341934de6bd0d3d23d0929227/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:38.093373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:38.105870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9dc24eea6d04d899499a52dee5d08c0, user_id=a920c59341934de6bd0d3d23d0929227, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:38.108682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:38.241277 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 811/1614] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:38 2022] PUT /identity/v3/projects/b9dc24eea6d04d899499a52dee5d08c0/users/a920c59341934de6bd0d3d23d0929227/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:38.257475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052c0e-71e4-4982-862a-be238921ad7d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:38.258401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052c0e-71e4-4982-862a-be238921ad7d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:38.259261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052c0e-71e4-4982-862a-be238921ad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:38.338928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-11052c0e-71e4-4982-862a-be238921ad7d None None] MFA Rules not processed for user `a920c59341934de6bd0d3d23d0929227`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:38.340195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11052c0e-71e4-4982-862a-be238921ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:38.468558 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 804/1615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:38.468756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:38.547095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a3564-105b-4c18-b11b-ee8bd183e347 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:38.552445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:38.553751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:38.554167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:38.554546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:38.555325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:38.557364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:38.765181 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 812/1616] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:38 2022] POST /identity/v3/projects => generated 379 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:38.770485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11052c0e-71e4-4982-862a-be238921ad7d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:38.795249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11052c0e-71e4-4982-862a-be238921ad7d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:38.932760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:38.933935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:38.934325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:38.934671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:38.935410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:38.938140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:38.995433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:39.110424 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 805/1617] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:38 2022] POST /identity/v3/users => generated 296 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:39.112933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:39.125237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e3750-aef5-444e-abba-090d72185b5c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:39.131001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:39.131723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:39.134092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:39.134092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:39.134092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:39.135347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:39.147383 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 813/1618] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:39.151473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:39.163225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a59be-46f7-49f9-9405-d0603aa60c92 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:39.168130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:39.168737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:39.169010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:39.169358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] PATH_INFO: `/v3/projects/13b08f46938743d4a697e68ba0e29839/users/b4dfba889f924ca285c752cd0c8b56bf/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:39.188389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b08f46938743d4a697e68ba0e29839, user_id=b4dfba889f924ca285c752cd0c8b56bf, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:39.191254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:39.267019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 806/1619] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:39 2022] PUT /identity/v3/projects/13b08f46938743d4a697e68ba0e29839/users/b4dfba889f924ca285c752cd0c8b56bf/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:39.272320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:39.284414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0eb62-a370-480e-a48d-da0363232c57 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:39.373044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1e85b-bdf6-4537-85db-b430e56e7195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:39.374018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e85b-bdf6-4537-85db-b430e56e7195 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:39.374461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e85b-bdf6-4537-85db-b430e56e7195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:39.374871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1e85b-bdf6-4537-85db-b430e56e7195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:39.375879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1e85b-bdf6-4537-85db-b430e56e7195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:39.378288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1e85b-bdf6-4537-85db-b430e56e7195 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:39.398238 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 814/1620] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:24:39.405426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:39.441313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ecc3-0919-4570-95b9-2b3f868c9dda admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:39.462775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd5e17-9b06-4597-83ff-2a8b6c5103d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:39.463725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd5e17-9b06-4597-83ff-2a8b6c5103d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:39.464192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd5e17-9b06-4597-83ff-2a8b6c5103d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:39.464606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd5e17-9b06-4597-83ff-2a8b6c5103d3 admin admin] PATH_INFO: `/v3/projects/13b08f46938743d4a697e68ba0e29839/users/b4dfba889f924ca285c752cd0c8b56bf/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:39.466773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd5e17-9b06-4597-83ff-2a8b6c5103d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b08f46938743d4a697e68ba0e29839, user_id=b4dfba889f924ca285c752cd0c8b56bf, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:39.469553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd5e17-9b06-4597-83ff-2a8b6c5103d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:39.483083 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 807/1621] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:39 2022] PUT /identity/v3/projects/13b08f46938743d4a697e68ba0e29839/users/b4dfba889f924ca285c752cd0c8b56bf/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:39.493508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:39.493981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:39.505808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:39.563408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] MFA Rules not processed for user `b4dfba889f924ca285c752cd0c8b56bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:39.568155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:39.703131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2adc-e972-4853-9da5-fdfc1944d15a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:39.706453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2adc-e972-4853-9da5-fdfc1944d15a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:39.706453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2adc-e972-4853-9da5-fdfc1944d15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:39.724900 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 815/1622] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:39.736460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:39.739754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:39.740943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4f9c2adc-e972-4853-9da5-fdfc1944d15a None None] MFA Rules not processed for user `31f765d197374f1cb5bdfa5890d74f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:39.742282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f9c2adc-e972-4853-9da5-fdfc1944d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:39.869865 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 808/1623] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:39.918095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e0034-e0ae-45ac-82a5-d2e9787027ab None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:39.924091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e53a3f-2240-421e-af65-0471ba441190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:39.925329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a3f-2240-421e-af65-0471ba441190 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:39.925608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a3f-2240-421e-af65-0471ba441190 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:39.925976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e53a3f-2240-421e-af65-0471ba441190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:39.937441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53a3f-2240-421e-af65-0471ba441190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:39.939237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e53a3f-2240-421e-af65-0471ba441190 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:39.953520 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 816/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:39.982475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:41.106313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2adc-e972-4853-9da5-fdfc1944d15a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:41.152200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e084-dd23-4759-9252-d83afacbb820 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:41.153053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e084-dd23-4759-9252-d83afacbb820 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:41.153483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e084-dd23-4759-9252-d83afacbb820 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:41.160353 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 817/1625] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:24:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:41.187269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea781-b221-4d5f-8405-edf818fda11e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:41.187833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea781-b221-4d5f-8405-edf818fda11e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:41.188250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea781-b221-4d5f-8405-edf818fda11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:41.238465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-84aea781-b221-4d5f-8405-edf818fda11e None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:41.240082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84aea781-b221-4d5f-8405-edf818fda11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:41.264651 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 818/1626] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:41.280634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aea781-b221-4d5f-8405-edf818fda11e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:41.286105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2adc-e972-4853-9da5-fdfc1944d15a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:41.292541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:41.292778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aea781-b221-4d5f-8405-edf818fda11e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:41.293405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:41.293834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:41.294396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] PATH_INFO: `/v3/users/a920c59341934de6bd0d3d23d0929227` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:41.301496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a920c59341934de6bd0d3d23d0929227)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:41.303827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:41.314854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b829c-c849-401a-a1c0-23d691a60de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:41.316066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b829c-c849-401a-a1c0-23d691a60de6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:41.316344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b829c-c849-401a-a1c0-23d691a60de6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:41.316720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b829c-c849-401a-a1c0-23d691a60de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:41.329708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b829c-c849-401a-a1c0-23d691a60de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:41.332921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b829c-c849-401a-a1c0-23d691a60de6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:41.347758 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 819/1627] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:41.423812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:41.551924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a920c59341934de6bd0d3d23d0929227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:41.555084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a920c59341934de6bd0d3d23d0929227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:41.668372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a920c59341934de6bd0d3d23d0929227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:41.669028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a920c59341934de6bd0d3d23d0929227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:41.680372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a920c59341934de6bd0d3d23d0929227'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:41.726712 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 809/1628] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:41 2022] DELETE /identity/v3/users/a920c59341934de6bd0d3d23d0929227 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:41.735705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:41.735999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:41.736461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:41.775984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:41.777163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:41.935449 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 820/1629] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:42.009597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:42.012413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:42.114242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edc15b-551b-4cbb-90bf-6b43cdec70e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:42.118423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:42.119061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:42.119342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:42.119615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:42.152913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:42.154410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:42.177533 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 810/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:43.229725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:43.232297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:43.248293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88dc11-242c-4251-8a58-b6e0e97c3bac None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:43.261159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:43.261825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:43.262140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:43.263088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] PATH_INFO: `/v3/projects/b9dc24eea6d04d899499a52dee5d08c0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:43.264653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9dc24eea6d04d899499a52dee5d08c0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:43.267547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:43.405412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:43.421541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dc24eea6d04d899499a52dee5d08c0', 'request_id': 'req-ccee691a-0b2a-4151-9d83-502d5d9c2238'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:43.445747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dc24eea6d04d899499a52dee5d08c0', 'request_id': 'req-ccee691a-0b2a-4151-9d83-502d5d9c2238'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:43.537888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dc24eea6d04d899499a52dee5d08c0', 'request_id': 'req-ccee691a-0b2a-4151-9d83-502d5d9c2238'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:43.556873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] The token cache is being invalidate because project b9dc24eea6d04d899499a52dee5d08c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:43.557512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:43.558516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ccee691a-0b2a-4151-9d83-502d5d9c2238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:43.563678 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 821/1631] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:43 2022] DELETE /identity/v3/projects/b9dc24eea6d04d899499a52dee5d08c0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:43.566091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:43.577479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082f0a-5929-47f4-870e-f4ebd26ee87e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:43.656293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:43.657434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:43.657928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:43.658288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] PATH_INFO: `/v3/users/b4dfba889f924ca285c752cd0c8b56bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:43.660226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dfba889f924ca285c752cd0c8b56bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:43.662352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:43.967515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dfba889f924ca285c752cd0c8b56bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:43.968189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dfba889f924ca285c752cd0c8b56bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:43.973635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:44.076500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dfba889f924ca285c752cd0c8b56bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:44.077359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dfba889f924ca285c752cd0c8b56bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:44.089390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fec9089a-1231-4835-a52d-54bb76f8b6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dfba889f924ca285c752cd0c8b56bf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:44.119773 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 811/1632] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:43 2022] DELETE /identity/v3/users/b4dfba889f924ca285c752cd0c8b56bf => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:44.168182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:44.168483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:44.168752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:44.226243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] MFA Rules not processed for user `356ffdf6f40b4d71a7f39c414c008491`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:44.227480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:44.326932 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 822/1633] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:44.333811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482bc4-b3fb-4caf-a6fe-4497599f3052 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:44.334169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482bc4-b3fb-4caf-a6fe-4497599f3052 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:44.334453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482bc4-b3fb-4caf-a6fe-4497599f3052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:44.355292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43482bc4-b3fb-4caf-a6fe-4497599f3052 None None] MFA Rules not processed for user `356ffdf6f40b4d71a7f39c414c008491`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:44.356522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43482bc4-b3fb-4caf-a6fe-4497599f3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:44.392339 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 812/1634] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:44.652180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:44.654963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:44.744515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c2002-f9eb-47f4-90d1-5368d56a5133 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:44.755135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409e5a8-3ff7-40ee-9ff6-91865bc7496a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:44.756093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e5a8-3ff7-40ee-9ff6-91865bc7496a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:44.756448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e5a8-3ff7-40ee-9ff6-91865bc7496a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:44.756826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409e5a8-3ff7-40ee-9ff6-91865bc7496a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:44.767699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e5a8-3ff7-40ee-9ff6-91865bc7496a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:44.770598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409e5a8-3ff7-40ee-9ff6-91865bc7496a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:44.783293 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 823/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:44.807842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317a1a-fe3a-4461-bdc9-a92ad142f0a1 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:44.808419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317a1a-fe3a-4461-bdc9-a92ad142f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:44.809039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317a1a-fe3a-4461-bdc9-a92ad142f0a1 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:44.811097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 813/1636] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:44.824689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:44.824689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:44.825451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:44.849978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:44.851309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:44.905663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:44.945232 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 824/1637] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:24:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:44.966449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49317a1a-fe3a-4461-bdc9-a92ad142f0a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:44.969033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49317a1a-fe3a-4461-bdc9-a92ad142f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:44.999727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49317a1a-fe3a-4461-bdc9-a92ad142f0a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:45.011168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828579-1c60-4f59-b38c-9077b9142cb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:45.011813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828579-1c60-4f59-b38c-9077b9142cb8 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:45.012092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828579-1c60-4f59-b38c-9077b9142cb8 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:45.016900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828579-1c60-4f59-b38c-9077b9142cb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:45.043263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828579-1c60-4f59-b38c-9077b9142cb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:45.063654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828579-1c60-4f59-b38c-9077b9142cb8 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:45.110039 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 814/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:45.194837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:45.196885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:45.370489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ede03-a8da-4e6e-a2ad-bc8a24e7c5ac None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:45.383928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:45.387894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:45.388613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:45.389137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] PATH_INFO: `/v3/projects/13b08f46938743d4a697e68ba0e29839` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:45.392818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b08f46938743d4a697e68ba0e29839)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:45.399411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:45.577716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b08f46938743d4a697e68ba0e29839', 'request_id': 'req-3705fd79-80de-472e-91f8-239b354c99af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:45.625286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b08f46938743d4a697e68ba0e29839', 'request_id': 'req-3705fd79-80de-472e-91f8-239b354c99af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:45.724926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b08f46938743d4a697e68ba0e29839', 'request_id': 'req-3705fd79-80de-472e-91f8-239b354c99af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:45.742287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] The token cache is being invalidate because project 13b08f46938743d4a697e68ba0e29839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:45.742530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:45.744382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3705fd79-80de-472e-91f8-239b354c99af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:45.748173 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 825/1639] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:45 2022] DELETE /identity/v3/projects/13b08f46938743d4a697e68ba0e29839 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:45.754522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4d6a8-bcef-41bb-b4cc-d0590777d406 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:45.760533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4d6a8-bcef-41bb-b4cc-d0590777d406 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:45.760533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4d6a8-bcef-41bb-b4cc-d0590777d406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:45.785242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-28e4d6a8-bcef-41bb-b4cc-d0590777d406 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:45.786645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28e4d6a8-bcef-41bb-b4cc-d0590777d406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:45.888390 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 815/1640] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:45.896854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaabe1-fd06-4c4d-8c1c-b48029ec0279 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:45.897671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaabe1-fd06-4c4d-8c1c-b48029ec0279 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:45.898397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaabe1-fd06-4c4d-8c1c-b48029ec0279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:45.953900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fbeaabe1-fd06-4c4d-8c1c-b48029ec0279 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:45.955218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fbeaabe1-fd06-4c4d-8c1c-b48029ec0279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:45.983519 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 826/1641] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:45.985282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4d6a8-bcef-41bb-b4cc-d0590777d406 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:46.000557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4d6a8-bcef-41bb-b4cc-d0590777d406 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:46.017734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:46.017734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:46.017734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:46.017734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:46.018004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:46.018004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:46.023311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:46.048790 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 816/1642] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:46.055768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaabe1-fd06-4c4d-8c1c-b48029ec0279 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:46.066712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaabe1-fd06-4c4d-8c1c-b48029ec0279 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:46.078727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:46.079359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:46.080540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:46.080894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:46.082997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:46.086887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:46.204185 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 827/1643] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:46 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:46.208115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:46.220783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d9f7c-0f76-419f-9849-f38aa9ec73ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:46.312184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:46.312981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:46.324692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:46.325347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:46.327026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:46.332843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:46.477215 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 817/1644] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:46 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:46.478615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:46.492791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dbaa6-18f1-4fb9-8d14-81b54943f628 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:46.501009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:46.502611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:46.502611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:46.503413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:46.504365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:46.507182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:46.522967 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 828/1645] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:46.526646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:46.544832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc118-10d0-499d-9182-b39d208d3fab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:46.551862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a934d-006d-4e91-a019-8783e33b8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:46.552740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a934d-006d-4e91-a019-8783e33b8699 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:46.553322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a934d-006d-4e91-a019-8783e33b8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:46.553794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a934d-006d-4e91-a019-8783e33b8699 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:46.554778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a934d-006d-4e91-a019-8783e33b8699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:46.556672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a934d-006d-4e91-a019-8783e33b8699 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:46.585502 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 818/1646] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:24:46.585691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:46.592792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe68f6-e4a1-463b-8624-b99ecda0ada5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:46.601333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:46.602497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:46.603467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:46.603905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] PATH_INFO: `/v3/projects/585e27ca2dd143b9bb193fbebb8400e5/users/8f04d39830d04cf99527919cbccf46e7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:46.640263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=585e27ca2dd143b9bb193fbebb8400e5, user_id=8f04d39830d04cf99527919cbccf46e7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:46.642993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:46.742332 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 829/1647] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:46 2022] PUT /identity/v3/projects/585e27ca2dd143b9bb193fbebb8400e5/users/8f04d39830d04cf99527919cbccf46e7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:46.745900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98e0d-412a-43bc-9c79-bc0565597e75 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:46.746842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98e0d-412a-43bc-9c79-bc0565597e75 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:46.747036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c98e0d-412a-43bc-9c79-bc0565597e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:46.785449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:46.790074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-07c98e0d-412a-43bc-9c79-bc0565597e75 None None] MFA Rules not processed for user `8f04d39830d04cf99527919cbccf46e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:46.792099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07c98e0d-412a-43bc-9c79-bc0565597e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:46.925061 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 819/1648] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:46.929594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:46.940516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:47.074433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db200bb-bf29-43ec-ae3a-6318f98871eb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:47.116279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:47.119044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:47.121398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:47.121836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:47.125237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:47.133049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:47.248165 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 830/1649] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:46 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:47.251908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c98e0d-412a-43bc-9c79-bc0565597e75 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:47.269850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c98e0d-412a-43bc-9c79-bc0565597e75 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:47.412473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:47.413252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:47.413696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:47.414295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:47.415853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:47.418254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:47.581560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 820/1650] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:47 2022] POST /identity/v3/users => generated 294 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:47.583219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:47.601513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329189f0-3444-4808-9390-c1caca73dd37 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:47.613316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:47.613953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:47.614265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:47.617969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:47.619111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:47.624501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:47.646160 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 831/1651] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:47.650124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:47.667508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c6421-212c-4ecf-b63b-8902a4d09861 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:47.673010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:47.673842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:47.674267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:47.674623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] PATH_INFO: `/v3/projects/fc2010cd6b3c4a14b4c879e7fb8bc78e/users/f4ce8c47d08346cb977f84d401fd2b5d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:47.696565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2010cd6b3c4a14b4c879e7fb8bc78e, user_id=f4ce8c47d08346cb977f84d401fd2b5d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:47.699600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:47.817902 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 821/1652] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:47 2022] PUT /identity/v3/projects/fc2010cd6b3c4a14b4c879e7fb8bc78e/users/f4ce8c47d08346cb977f84d401fd2b5d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:47.818014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:47.827861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26afe3-2eb3-4a63-98f3-74ced3cb8a71 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:47.922015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ca59f-6d84-414e-aff1-60e868f2c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:47.923299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca59f-6d84-414e-aff1-60e868f2c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:47.923856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca59f-6d84-414e-aff1-60e868f2c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:47.923966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca59f-6d84-414e-aff1-60e868f2c6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:47.925251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ca59f-6d84-414e-aff1-60e868f2c6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:47.938079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ca59f-6d84-414e-aff1-60e868f2c6e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:47.940745 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 832/1653] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:47.944644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:47.966508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb649a5f-4fc5-4c8e-a5bf-3fd32e9a8a99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:47.981130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa51f41-19b9-4ecc-a4ac-05f54cd354f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:47.982201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f41-19b9-4ecc-a4ac-05f54cd354f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:47.982736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f41-19b9-4ecc-a4ac-05f54cd354f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:47.983189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f41-19b9-4ecc-a4ac-05f54cd354f1 admin admin] PATH_INFO: `/v3/projects/fc2010cd6b3c4a14b4c879e7fb8bc78e/users/f4ce8c47d08346cb977f84d401fd2b5d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:47.986466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa51f41-19b9-4ecc-a4ac-05f54cd354f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2010cd6b3c4a14b4c879e7fb8bc78e, user_id=f4ce8c47d08346cb977f84d401fd2b5d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:47.990163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa51f41-19b9-4ecc-a4ac-05f54cd354f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:48.013361 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 822/1654] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:47 2022] PUT /identity/v3/projects/fc2010cd6b3c4a14b4c879e7fb8bc78e/users/f4ce8c47d08346cb977f84d401fd2b5d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:48.024702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:48.025171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:48.025558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:48.077684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] MFA Rules not processed for user `f4ce8c47d08346cb977f84d401fd2b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:48.079637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:48.161849 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 833/1655] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:48.173926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabad95-0c27-45a5-8d21-f74f82c5784f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:48.175194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabad95-0c27-45a5-8d21-f74f82c5784f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:48.175480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabad95-0c27-45a5-8d21-f74f82c5784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:48.219546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5eabad95-0c27-45a5-8d21-f74f82c5784f None None] MFA Rules not processed for user `8f04d39830d04cf99527919cbccf46e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:48.222413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5eabad95-0c27-45a5-8d21-f74f82c5784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:48.312882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:48.322811 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 823/1656] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:48.335030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:48.336974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:48.440560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:48.474250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3b596-091a-4ba2-924f-adb9740d149a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:48.480346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:48.480980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:48.481264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:48.481538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:48.491622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:48.493291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:48.503081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 834/1657] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:50.554563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabad95-0c27-45a5-8d21-f74f82c5784f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:50.570072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabad95-0c27-45a5-8d21-f74f82c5784f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:50.580222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af35718-604d-48ef-8c84-0876a1bf0ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:50.581670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af35718-604d-48ef-8c84-0876a1bf0ced service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:50.582154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af35718-604d-48ef-8c84-0876a1bf0ced service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:50.582567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af35718-604d-48ef-8c84-0876a1bf0ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:50.584489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3af35718-604d-48ef-8c84-0876a1bf0ced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:50.670406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af35718-604d-48ef-8c84-0876a1bf0ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:50.672034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af35718-604d-48ef-8c84-0876a1bf0ced service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:50.684440 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 824/1658] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:50.793328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:50.794856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:50.895042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e96aa-2a4b-4458-b3f3-109e0672ae24 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:50.900228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:50.900878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:50.901156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:50.901427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] PATH_INFO: `/v3/users/3f8997c458e94218bb419010a334f836` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:50.902768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8997c458e94218bb419010a334f836)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:50.904743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:51.074505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8997c458e94218bb419010a334f836'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:51.083226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8997c458e94218bb419010a334f836'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:51.084243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8997c458e94218bb419010a334f836'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:51.101372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8997c458e94218bb419010a334f836'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:51.159671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8997c458e94218bb419010a334f836'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:51.166602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 835/1659] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:50 2022] DELETE /identity/v3/users/3f8997c458e94218bb419010a334f836 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:51.172560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438904c-3ddd-4b58-a1f0-d546d9f5c381 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:51.177553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438904c-3ddd-4b58-a1f0-d546d9f5c381 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:51.178374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438904c-3ddd-4b58-a1f0-d546d9f5c381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:51.240207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b438904c-3ddd-4b58-a1f0-d546d9f5c381 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:51.241585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b438904c-3ddd-4b58-a1f0-d546d9f5c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:51.384876 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 825/1660] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:51.412187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:51.414123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:51.428077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:51.559941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6d3be-acca-4fb0-99b7-39b67063be1d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:51.565617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:51.566366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:51.566707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:51.567512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:51.603778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:51.605305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:51.631932 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 836/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:52.355735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df7ae-492b-468a-9cce-0cb7f63ed613 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:52.360507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df7ae-492b-468a-9cce-0cb7f63ed613 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:52.360507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078df7ae-492b-468a-9cce-0cb7f63ed613 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:52.360746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:52.361206 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 826/1662] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:52.361294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:52.367744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb2781-df18-40fb-baf8-508ec0928763 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:52.368108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb2781-df18-40fb-baf8-508ec0928763 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:52.368389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb2781-df18-40fb-baf8-508ec0928763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:52.382122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33257b-e9cf-4976-a187-cfc1b4c2c711 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:52.388000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:52.388846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:52.389374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:52.389756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] PATH_INFO: `/v3/projects/3f754303ccaf4d1caee2638de0df1657` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:52.391771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f754303ccaf4d1caee2638de0df1657)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:52.394847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:52.396783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dffb2781-df18-40fb-baf8-508ec0928763 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:52.398174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dffb2781-df18-40fb-baf8-508ec0928763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:52.421700 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 827/1663] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:52.435889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb2781-df18-40fb-baf8-508ec0928763 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:52.448798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb2781-df18-40fb-baf8-508ec0928763 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:52.452916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:52.453534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:52.453812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:52.454365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:52.469206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:52.471309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:52.481723 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 828/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:52.617124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f754303ccaf4d1caee2638de0df1657', 'request_id': 'req-32c20820-e102-4323-8d72-1591f2a2e4ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:52.624799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f754303ccaf4d1caee2638de0df1657', 'request_id': 'req-32c20820-e102-4323-8d72-1591f2a2e4ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:52.728030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f754303ccaf4d1caee2638de0df1657', 'request_id': 'req-32c20820-e102-4323-8d72-1591f2a2e4ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:52.748245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] The token cache is being invalidate because project 3f754303ccaf4d1caee2638de0df1657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:52.748614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:52.749588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:52.754930 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 837/1665] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:52 2022] DELETE /identity/v3/projects/3f754303ccaf4d1caee2638de0df1657 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:52.756235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:52.769135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e308-a0b6-4cdd-afcf-667cc846b377 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:52.850710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:52.851358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:52.851643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:52.851921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] PATH_INFO: `/v3/users/806ea593b98b4dcd9bdef662fa920a8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:52.854102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806ea593b98b4dcd9bdef662fa920a8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:52.855027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:52.872931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:53.065236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806ea593b98b4dcd9bdef662fa920a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:53.065973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806ea593b98b4dcd9bdef662fa920a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:53.135588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806ea593b98b4dcd9bdef662fa920a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:53.136518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806ea593b98b4dcd9bdef662fa920a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:53.139562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:53.144726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:53.154625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806ea593b98b4dcd9bdef662fa920a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:53.188749 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 829/1666] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:52 2022] DELETE /identity/v3/users/806ea593b98b4dcd9bdef662fa920a8e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:53.257527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c20820-e102-4323-8d72-1591f2a2e4ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:53.305560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:53.373227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:53.373938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:53.375489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:53.379771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:53.379771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:53.396824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:53.399854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:53.413178 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 838/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:53.478518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:53.480649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:53.611437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ac6bc-f4c2-4dda-aab4-790a9c198334 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:53.618569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b7a7e-3aef-43d4-949c-161fbd3c2bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:53.619232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b7a7e-3aef-43d4-949c-161fbd3c2bc1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:53.619515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b7a7e-3aef-43d4-949c-161fbd3c2bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:53.620294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b7a7e-3aef-43d4-949c-161fbd3c2bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:53.621861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c85b7a7e-3aef-43d4-949c-161fbd3c2bc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:53.715936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b7a7e-3aef-43d4-949c-161fbd3c2bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:53.717658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b7a7e-3aef-43d4-949c-161fbd3c2bc1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:53.727540 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 830/1668] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:53.775150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:53.775150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:53.914648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4dc31-f196-499e-a9f4-f41eebff35c2 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:53.923195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:53.923851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:53.924660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:53.924984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] PATH_INFO: `/v3/projects/81046bafc52c4d0ca3567d4be3c7cc02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:53.926179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81046bafc52c4d0ca3567d4be3c7cc02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:53.928119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:54.086089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81046bafc52c4d0ca3567d4be3c7cc02', 'request_id': 'req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.094201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81046bafc52c4d0ca3567d4be3c7cc02', 'request_id': 'req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.168212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81046bafc52c4d0ca3567d4be3c7cc02', 'request_id': 'req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.184915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] The token cache is being invalidate because project 81046bafc52c4d0ca3567d4be3c7cc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:54.185215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.186450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.187951 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 839/1669] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:53 2022] DELETE /identity/v3/projects/81046bafc52c4d0ca3567d4be3c7cc02 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:54.192933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4bfc-d5dd-4cbd-82fd-3908e8dcb62f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.193223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4bfc-d5dd-4cbd-82fd-3908e8dcb62f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.193498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4bfc-d5dd-4cbd-82fd-3908e8dcb62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.212426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:54.215642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:54.216970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c4ef4bfc-d5dd-4cbd-82fd-3908e8dcb62f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:54.218295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4ef4bfc-d5dd-4cbd-82fd-3908e8dcb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:54.274087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:54.319026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dba6d-569a-4c42-bf8a-d6b70756c9f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:54.322871 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 831/1670] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:54.325742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:54.326531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.327052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.327396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] PATH_INFO: `/v3/users/a448bc53c0d343f2bbc87667c88cbd0d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.328972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337b49-4b03-4179-bedd-2d7252b5e617 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.329331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337b49-4b03-4179-bedd-2d7252b5e617 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.329602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337b49-4b03-4179-bedd-2d7252b5e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.331501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a448bc53c0d343f2bbc87667c88cbd0d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:54.333624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:54.353165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea337b49-4b03-4179-bedd-2d7252b5e617 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:54.354506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea337b49-4b03-4179-bedd-2d7252b5e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:54.364432 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 832/1671] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:54.368758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea337b49-4b03-4179-bedd-2d7252b5e617 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:54.378917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea337b49-4b03-4179-bedd-2d7252b5e617 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:54.384479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:54.385101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.385388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.390526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.390526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:54.390526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:54.390526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:54.400773 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 833/1672] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:54.405636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:54.424865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882fdc-6f89-41f9-986b-8a16910d9bdd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:54.430486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:54.431237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.431815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.432097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.432779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:54.436312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:54.479919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:54.562066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a448bc53c0d343f2bbc87667c88cbd0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.570130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a448bc53c0d343f2bbc87667c88cbd0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.570853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a448bc53c0d343f2bbc87667c88cbd0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.584660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a448bc53c0d343f2bbc87667c88cbd0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.594802 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 834/1673] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:54 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:54.595800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:54.602020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:54.689933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c49a0a-75ec-44ed-8dc5-1de728a37f9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:54.696597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:54.697459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.697744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.698017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.698755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:54.700942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:54.701806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b79561f4-99e1-4d52-80f1-140eec9cc49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a448bc53c0d343f2bbc87667c88cbd0d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:54.709999 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 840/1674] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:54 2022] DELETE /identity/v3/users/a448bc53c0d343f2bbc87667c88cbd0d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:54.714148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229b175-ad86-4e1b-a636-0b6208fef0a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.714417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229b175-ad86-4e1b-a636-0b6208fef0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.715687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229b175-ad86-4e1b-a636-0b6208fef0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.747684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2229b175-ad86-4e1b-a636-0b6208fef0a4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:54.749203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2229b175-ad86-4e1b-a636-0b6208fef0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:54.825599 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 835/1675] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:54 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:54.827131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:54.833739 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 841/1676] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:54.838581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7795b-8e7f-4664-992d-8150477571c4 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.839128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7795b-8e7f-4664-992d-8150477571c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.840389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7795b-8e7f-4664-992d-8150477571c4 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.840870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ffce-1739-4be1-8d27-9a1b9184a589 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:54.842698 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 842/1677] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:24:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:54.847204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:54.847905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.848236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.848694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.849944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:54.850886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.851097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.851367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.852212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:54.868402 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 836/1678] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:54.872752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:54.884011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0d9e-e522-444c-b57e-8c3da0274b6d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:54.884193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:54.885317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:54.888569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:54.889173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.889450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.889774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:54.890758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:54.892400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:54.905637 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 837/1679] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:54.910724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:54.912306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:54.987936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfe199-a80f-4235-a3a8-2fdade0effd6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:54.992092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a504-e660-471b-8228-92412986657b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:54.992739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a504-e660-471b-8228-92412986657b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:54.993025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a504-e660-471b-8228-92412986657b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:54.993354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a504-e660-471b-8228-92412986657b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.004479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497a504-e660-471b-8228-92412986657b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.005935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497a504-e660-471b-8228-92412986657b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.017909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 838/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:55.019296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a504-e660-471b-8228-92412986657b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.035747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a504-e660-471b-8228-92412986657b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:55.040973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1dcb-a95b-4e74-a1dc-13c29647bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:55.041667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1dcb-a95b-4e74-a1dc-13c29647bca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.042741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1dcb-a95b-4e74-a1dc-13c29647bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.042741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1dcb-a95b-4e74-a1dc-13c29647bca3 admin admin] PATH_INFO: `/v3/projects/6831c9593f4b48eb9b27fb79a88bb541/users/33bb5e69875d42c78c81b0082c195e46/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.076172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc1dcb-a95b-4e74-a1dc-13c29647bca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6831c9593f4b48eb9b27fb79a88bb541, user_id=33bb5e69875d42c78c81b0082c195e46, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.081996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc1dcb-a95b-4e74-a1dc-13c29647bca3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.147109 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 843/1681] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:55.171994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.173531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.181533 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 839/1682] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:55 2022] PUT /identity/v3/projects/6831c9593f4b48eb9b27fb79a88bb541/users/33bb5e69875d42c78c81b0082c195e46/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:55.189950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6f3e-3910-48f7-89cf-c59add87fc51 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:55.191904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361f14-e9b3-4725-9ae3-1c682dd05dc0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.192800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361f14-e9b3-4725-9ae3-1c682dd05dc0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.193091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6361f14-e9b3-4725-9ae3-1c682dd05dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.238848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a6361f14-e9b3-4725-9ae3-1c682dd05dc0 None None] MFA Rules not processed for user `33bb5e69875d42c78c81b0082c195e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:55.240220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6361f14-e9b3-4725-9ae3-1c682dd05dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.242110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:55.267090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:55.271659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.271659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.271659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.327411 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 840/1683] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:55.332534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361f14-e9b3-4725-9ae3-1c682dd05dc0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.362619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.364385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.386090 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 844/1684] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:55.386090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.386090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.437943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6361f14-e9b3-4725-9ae3-1c682dd05dc0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:55.442911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001792ee-4ac9-4b4b-b26a-c5ed44b18263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:55.443644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001792ee-4ac9-4b4b-b26a-c5ed44b18263 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.449829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001792ee-4ac9-4b4b-b26a-c5ed44b18263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.449829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001792ee-4ac9-4b4b-b26a-c5ed44b18263 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.449829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001792ee-4ac9-4b4b-b26a-c5ed44b18263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.449829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001792ee-4ac9-4b4b-b26a-c5ed44b18263 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.466618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957243-d265-4008-bdae-c48ca37a8e76 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:55.474389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:55.475092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.475494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.475633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] PATH_INFO: `/v3/projects/36b87172368b42f4b089504ac3b545a8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.477110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b87172368b42f4b089504ac3b545a8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.480409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.538397 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 841/1685] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:55 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:55.538397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1683c-5abd-4f5b-8460-1270164ba81f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.538397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1683c-5abd-4f5b-8460-1270164ba81f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.538397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1683c-5abd-4f5b-8460-1270164ba81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.540416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:55.557924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61c1683c-5abd-4f5b-8460-1270164ba81f None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:55.557924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61c1683c-5abd-4f5b-8460-1270164ba81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.618939 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 842/1686] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:55.620032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1683c-5abd-4f5b-8460-1270164ba81f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.632247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b87172368b42f4b089504ac3b545a8', 'request_id': 'req-9418b632-4ae4-4580-a0f7-1a89d522801d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:55.639178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b87172368b42f4b089504ac3b545a8', 'request_id': 'req-9418b632-4ae4-4580-a0f7-1a89d522801d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:55.694971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1683c-5abd-4f5b-8460-1270164ba81f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:55.702000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b87172368b42f4b089504ac3b545a8', 'request_id': 'req-9418b632-4ae4-4580-a0f7-1a89d522801d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:55.702233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:55.727859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] The token cache is being invalidate because project 36b87172368b42f4b089504ac3b545a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:55.728185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:55.729817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:55.736752 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 845/1687] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:55 2022] DELETE /identity/v3/projects/36b87172368b42f4b089504ac3b545a8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:55.738248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.739864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.788787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:55.789474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.789762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.790268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.790923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.793412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.829979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b632-4ae4-4580-a0f7-1a89d522801d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:55.835751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:55.836537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.836921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.837261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] PATH_INFO: `/v3/users/6f7b9527ab624cae898a2046f25cf4d8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.838515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7b9527ab624cae898a2046f25cf4d8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.840522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.890838 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 843/1688] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:55 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:55.891696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.894226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.955143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779799-9383-4254-8201-364cecfcff02 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:55.959815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:55.960514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:55.960803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:55.961081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:55.962980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.984600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:55.984600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:55.984600 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 844/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:55.985382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:55.989384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:55.993318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:56.006416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1bda1-185e-4160-ad7f-a5737ad4112b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:56.010549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:56.011169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:56.015548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:56.015548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:56.015548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:56.015548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:56.029184 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 845/1690] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:56.033515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:56.046828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b35205-5669-4193-a9b6-96eb04020198 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:56.052605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:56.053926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:56.054300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:56.054587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] PATH_INFO: `/v3/projects/6192f10625ed48d99b1856bf5e5753cb/users/abb13f07a871493da6c3b3afea617770/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:56.074570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6192f10625ed48d99b1856bf5e5753cb, user_id=abb13f07a871493da6c3b3afea617770, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:56.077335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:56.103968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7b9527ab624cae898a2046f25cf4d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:56.111281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7b9527ab624cae898a2046f25cf4d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:56.113483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7b9527ab624cae898a2046f25cf4d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:56.152553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7b9527ab624cae898a2046f25cf4d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:56.192758 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 846/1691] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:56 2022] PUT /identity/v3/projects/6192f10625ed48d99b1856bf5e5753cb/users/abb13f07a871493da6c3b3afea617770/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:56.196769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:56.200547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:56.207271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:56.249159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7b9527ab624cae898a2046f25cf4d8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:56.261405 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 846/1692] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:55 2022] DELETE /identity/v3/users/6f7b9527ab624cae898a2046f25cf4d8 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:56.285075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5d22b-a108-40be-b578-1c146821d5af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:56.354614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd4660-ada2-46de-8371-18144940348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:56.355627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4660-ada2-46de-8371-18144940348c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:56.355765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4660-ada2-46de-8371-18144940348c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:56.356129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4660-ada2-46de-8371-18144940348c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:56.356827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd4660-ada2-46de-8371-18144940348c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:56.359002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd4660-ada2-46de-8371-18144940348c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:56.376618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 847/1693] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:56.378403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:56.392346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0d1e-ba9d-4c0c-a5ec-1963f0ae67fb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:56.400346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:56.401267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:56.401632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:56.402528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] PATH_INFO: `/v3/projects/6192f10625ed48d99b1856bf5e5753cb/users/abb13f07a871493da6c3b3afea617770/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:56.404664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6192f10625ed48d99b1856bf5e5753cb, user_id=abb13f07a871493da6c3b3afea617770, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:56.407693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:56.420438 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 847/1694] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:56 2022] PUT /identity/v3/projects/6192f10625ed48d99b1856bf5e5753cb/users/abb13f07a871493da6c3b3afea617770/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:24:56.435092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:56.436212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:56.437190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:56.494122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] MFA Rules not processed for user `abb13f07a871493da6c3b3afea617770`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:56.495383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:56.586585 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 848/1695] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:56.682341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:56.684222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:56.753092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:56.776632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920d7e-9910-4007-b9b7-36e9395562da admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:56.782194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:56.782840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:56.784094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:56.784094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] PATH_INFO: `/v3/projects/8e8a2ab3d1d341e89321eb0daa775f15` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:56.785282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8a2ab3d1d341e89321eb0daa775f15)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:56.787244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:56.821653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:56.823163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:56.860575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:56.899609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6885-b949-4e4d-8469-aabd2355d010 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:56.905522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60109-ca52-4252-aa7e-50aeee3c980f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:56.906254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60109-ca52-4252-aa7e-50aeee3c980f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:56.906540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60109-ca52-4252-aa7e-50aeee3c980f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:56.906843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60109-ca52-4252-aa7e-50aeee3c980f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:56.916158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce60109-ca52-4252-aa7e-50aeee3c980f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:56.917855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce60109-ca52-4252-aa7e-50aeee3c980f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:56.929353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 849/1696] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:56.965801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8a2ab3d1d341e89321eb0daa775f15', 'request_id': 'req-674d22df-0557-4512-8bb0-633588049e3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:56.972564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8a2ab3d1d341e89321eb0daa775f15', 'request_id': 'req-674d22df-0557-4512-8bb0-633588049e3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:57.409725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8a2ab3d1d341e89321eb0daa775f15', 'request_id': 'req-674d22df-0557-4512-8bb0-633588049e3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:57.420888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] The token cache is being invalidate because project 8e8a2ab3d1d341e89321eb0daa775f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:24:57.421100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:57.421713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-674d22df-0557-4512-8bb0-633588049e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:57.423209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 848/1697] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:56 2022] DELETE /identity/v3/projects/8e8a2ab3d1d341e89321eb0daa775f15 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:57.428860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee3be-7a58-4244-b7d7-b2aa87c25668 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:57.429257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee3be-7a58-4244-b7d7-b2aa87c25668 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:57.429522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ee3be-7a58-4244-b7d7-b2aa87c25668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:57.449541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-924ee3be-7a58-4244-b7d7-b2aa87c25668 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:57.450789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-924ee3be-7a58-4244-b7d7-b2aa87c25668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:57.522231 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 850/1698] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:57.531891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761375bd-9b54-4ec9-a4e9-028a88ff2814 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:57.532714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761375bd-9b54-4ec9-a4e9-028a88ff2814 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:57.534504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761375bd-9b54-4ec9-a4e9-028a88ff2814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:57.570673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-761375bd-9b54-4ec9-a4e9-028a88ff2814 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:57.572629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-761375bd-9b54-4ec9-a4e9-028a88ff2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:57.584493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 849/1699] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:57.588892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee3be-7a58-4244-b7d7-b2aa87c25668 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:57.601328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ee3be-7a58-4244-b7d7-b2aa87c25668 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:57.605997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:57.606695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:57.606952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:57.607222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:57.607873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:24:57.608172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:57.609796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:57.624109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 851/1700] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:24:57.628625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761375bd-9b54-4ec9-a4e9-028a88ff2814 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:57.637764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761375bd-9b54-4ec9-a4e9-028a88ff2814 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:57.644084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:57.645304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:57.645587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:57.645862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:57.646631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:57.648429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:57.778227 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 850/1701] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:57 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:57.778987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:57.790481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876afbb5-4acb-4273-a2d4-eadf9a312161 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:57.868792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:57.870249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:57.870603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:57.870946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:57.871710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:57.874910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:58.008785 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 852/1702] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:57 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:24:58.010041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.025794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3c5a-8576-4813-8ef3-01a2bdfe8551 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:58.064271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:58.066078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.066532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.067564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.068107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:58.069845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:58.091590 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 851/1703] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:58.099356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.108572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582be9-5b21-46a6-8d6f-e3a337037291 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:58.114080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a4ba7-9ecb-4c19-b843-cc5feca92f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:58.114816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ba7-9ecb-4c19-b843-cc5feca92f9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.115101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ba7-9ecb-4c19-b843-cc5feca92f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.115543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a4ba7-9ecb-4c19-b843-cc5feca92f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.116397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a4ba7-9ecb-4c19-b843-cc5feca92f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:58.136899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a4ba7-9ecb-4c19-b843-cc5feca92f9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:58.140946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.143619 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 853/1704] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:58.153061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66080fc-4296-4c7d-9a7a-e9084dfd595a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:58.158925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:58.159623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.159954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.160239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] PATH_INFO: `/v3/projects/80b5300549ff4e7c991dccae8a42a33d/users/28044da761a74f80811e1ecb5bdb9a29/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.178859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b5300549ff4e7c991dccae8a42a33d, user_id=28044da761a74f80811e1ecb5bdb9a29, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:58.182017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:58.255282 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 852/1705] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:58 2022] PUT /identity/v3/projects/80b5300549ff4e7c991dccae8a42a33d/users/28044da761a74f80811e1ecb5bdb9a29/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:58.265880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20525-e23b-499b-8f22-21b31619257c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.266099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20525-e23b-499b-8f22-21b31619257c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.266329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20525-e23b-499b-8f22-21b31619257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.331257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0d20525-e23b-499b-8f22-21b31619257c None None] MFA Rules not processed for user `28044da761a74f80811e1ecb5bdb9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:58.332497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0d20525-e23b-499b-8f22-21b31619257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:58.348324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:58.409974 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 854/1706] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:58.414261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.555693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec363f86-e69c-4288-8daf-7cc24aa49598 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:58.580002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:58.581072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.581830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.582349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.583401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:58.586937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:58.617569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:58.709025 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 853/1707] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:24:58 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:58.713465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d20525-e23b-499b-8f22-21b31619257c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.724368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d20525-e23b-499b-8f22-21b31619257c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:58.798209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:58.798946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.799982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.800345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.801446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:58.803598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:58.905072 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 855/1708] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:24:58 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:24:58.906829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.917595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f6ffb-368f-4f7c-aacf-ece43f482323 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:58.927419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:58.928374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.928892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.929321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.930534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:58.936779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:58.946682 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 854/1709] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:24:58.951093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.961578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28e299-67c2-4835-949b-2c814596d2ff admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:58.971918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:58.971918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:58.971918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:58.971918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] PATH_INFO: `/v3/projects/6fc88a7b2efc468b9e53b5d44d31a9b1/users/a36cec64f228401d9c1e8e34f08543fa/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:58.981117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:58.983356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:58.996822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc88a7b2efc468b9e53b5d44d31a9b1, user_id=a36cec64f228401d9c1e8e34f08543fa, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:59.001988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:59.005548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd3df7-2751-4445-a70f-5ad5e139e884 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:59.012139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:59.012931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.013216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.013506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] PATH_INFO: `/v3/users/33bb5e69875d42c78c81b0082c195e46` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.014801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bb5e69875d42c78c81b0082c195e46)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:59.019054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:59.079690 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 856/1710] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:58 2022] PUT /identity/v3/projects/6fc88a7b2efc468b9e53b5d44d31a9b1/users/a36cec64f228401d9c1e8e34f08543fa/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:59.085139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:59.157379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e22b6-c920-41c7-ad3f-6740bea25fb9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:59.163559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:59.164240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.164525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.164797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.165594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:59.167280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:59.178014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 857/1711] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:24:59.182020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:59.193059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7255358-2b2b-4966-a60b-7eb3ad0b26f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:59.200397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4224b7-de15-4dc9-b779-3c99e1bfbb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:59.201093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4224b7-de15-4dc9-b779-3c99e1bfbb24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.201376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4224b7-de15-4dc9-b779-3c99e1bfbb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.201648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4224b7-de15-4dc9-b779-3c99e1bfbb24 admin admin] PATH_INFO: `/v3/projects/6fc88a7b2efc468b9e53b5d44d31a9b1/users/a36cec64f228401d9c1e8e34f08543fa/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.203976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4224b7-de15-4dc9-b779-3c99e1bfbb24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc88a7b2efc468b9e53b5d44d31a9b1, user_id=a36cec64f228401d9c1e8e34f08543fa, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:59.207212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4224b7-de15-4dc9-b779-3c99e1bfbb24 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:59.218228 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 858/1712] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:24:59 2022] PUT /identity/v3/projects/6fc88a7b2efc468b9e53b5d44d31a9b1/users/a36cec64f228401d9c1e8e34f08543fa/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:59.238757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ddb33-4e13-435c-a07c-22ea44440b10 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.239046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ddb33-4e13-435c-a07c-22ea44440b10 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.239326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ddb33-4e13-435c-a07c-22ea44440b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.246903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:59.264890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bb5e69875d42c78c81b0082c195e46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:59.269190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e1ddb33-4e13-435c-a07c-22ea44440b10 None None] MFA Rules not processed for user `a36cec64f228401d9c1e8e34f08543fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:59.270448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e1ddb33-4e13-435c-a07c-22ea44440b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:59.273460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bb5e69875d42c78c81b0082c195e46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:59.274291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bb5e69875d42c78c81b0082c195e46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:59.291410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bb5e69875d42c78c81b0082c195e46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:59.353795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 859/1713] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:24:59.404375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bb5e69875d42c78c81b0082c195e46'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:24:59.416706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 855/1714] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:24:58 2022] DELETE /identity/v3/users/33bb5e69875d42c78c81b0082c195e46 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:24:59.423193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.423482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.423760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.457519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:24:59.458662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:59.540630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:59.542017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:59.552829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 860/1715] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:24:59.562798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:59.564335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:24:59.629740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c3ef-b701-4303-bddf-3be28f4be51b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:59.633557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e965a5f-d397-4eda-95d1-896f7e1481e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:59.634213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e965a5f-d397-4eda-95d1-896f7e1481e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.634497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e965a5f-d397-4eda-95d1-896f7e1481e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.634775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e965a5f-d397-4eda-95d1-896f7e1481e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.648357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e965a5f-d397-4eda-95d1-896f7e1481e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:59.648357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e965a5f-d397-4eda-95d1-896f7e1481e9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:59.672882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a977-533f-483e-b908-6aeabadd08b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:59.679939 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 861/1716] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:59.684979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:24:59.686236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.687175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.687662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.768793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:59.790838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:24:59.793779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:24:59.805828 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 856/1717] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:24:59.955703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1daec54-7916-43d8-8cb7-5f5c4f8e2341 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:24:59.956676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1daec54-7916-43d8-8cb7-5f5c4f8e2341 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:24:59.957162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1daec54-7916-43d8-8cb7-5f5c4f8e2341 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:24:59.959549 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 862/1718] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:24:59.965935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:24:59.979015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:24:59.989420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93263e5f-ea47-4e91-bc59-a853724a63b3 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:24:59.995282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36cec64f228401d9c1e8e34f08543fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc88a7b2efc468b9e53b5d44d31a9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:00.000027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:00.000325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:00.001051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] PATH_INFO: `/v3/projects/80b5300549ff4e7c991dccae8a42a33d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:00.003964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] RBAC: Authorizing `identity:get_project(project_id=80b5300549ff4e7c991dccae8a42a33d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:00.006456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:00.009147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 857/1719] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:24:59 2022] GET /identity/v3/projects/80b5300549ff4e7c991dccae8a42a33d => generated 379 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:00.153494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1daec54-7916-43d8-8cb7-5f5c4f8e2341 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:00.155476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1daec54-7916-43d8-8cb7-5f5c4f8e2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:00.188022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1daec54-7916-43d8-8cb7-5f5c4f8e2341 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:00.209517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:00.212140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:00.212661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:00.213135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:00.215764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:00.264305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:00.300857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:00.304721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:00.368744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2d0d9-91d9-4b4d-a2c4-6581b7a89f66 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:00.388001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:00.391475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:00.395691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:00.397632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] PATH_INFO: `/v3/projects/6831c9593f4b48eb9b27fb79a88bb541` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:00.400173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:00.402769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6831c9593f4b48eb9b27fb79a88bb541)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:00.402904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:00.407305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:00.413228 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 863/1720] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:00.662301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6831c9593f4b48eb9b27fb79a88bb541', 'request_id': 'req-80198058-f772-4734-a864-9e0f240c2cf3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:00.680204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6831c9593f4b48eb9b27fb79a88bb541', 'request_id': 'req-80198058-f772-4734-a864-9e0f240c2cf3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:00.752939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6831c9593f4b48eb9b27fb79a88bb541', 'request_id': 'req-80198058-f772-4734-a864-9e0f240c2cf3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:00.768264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] The token cache is being invalidate because project 6831c9593f4b48eb9b27fb79a88bb541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:00.768812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:00.769511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-80198058-f772-4734-a864-9e0f240c2cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:00.771611 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 858/1721] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:00 2022] DELETE /identity/v3/projects/6831c9593f4b48eb9b27fb79a88bb541 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:00.775788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:00.792765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f0e2c-9f61-4961-88fe-3baeb1e94b79 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:00.857771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:00.858682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:00.859213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:00.862144 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 859/1722] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:25:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:25:00.869594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:25:00.874321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:00.894755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:00.895729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:00.896310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:00.896718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] PATH_INFO: `/v3/users/abb13f07a871493da6c3b3afea617770` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:00.897956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb13f07a871493da6c3b3afea617770)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:00.901513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:00.987392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:00.989283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:01.067835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:01.073384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edda632-00be-408a-b768-b2a2e11a1210 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:01.078552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a36cec64f228401d9c1e8e34f08543fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fc88a7b2efc468b9e53b5d44d31a9b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:01.079323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:01.079716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:01.080149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] PATH_INFO: `/v3/projects/80b5300549ff4e7c991dccae8a42a33d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:01.082021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] RBAC: Authorizing `identity:get_project(project_id=80b5300549ff4e7c991dccae8a42a33d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:01.087691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:01.098926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb13f07a871493da6c3b3afea617770'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.100331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb13f07a871493da6c3b3afea617770'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.105714 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 860/1723] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:25:00 2022] GET /identity/v3/projects/80b5300549ff4e7c991dccae8a42a33d => generated 379 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:01.204161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb13f07a871493da6c3b3afea617770'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.205115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb13f07a871493da6c3b3afea617770'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.218606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb13f07a871493da6c3b3afea617770'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.278132 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 864/1724] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:00 2022] DELETE /identity/v3/users/abb13f07a871493da6c3b3afea617770 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:01.506617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:01.508801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:01.527503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fe35a-9a11-4a39-bada-68d20d41d5c1 tempest-FlavorsAccessTestJSON-827571319 tempest-FlavorsAccessTestJSON-827571319-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:01.604016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:01.605375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:01.605736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:01.606018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] PATH_INFO: `/v3/users/fd0b7dc4bfe34473a0ed4d8af2677692` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:01.607763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0b7dc4bfe34473a0ed4d8af2677692)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:01.626219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:01.950909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0b7dc4bfe34473a0ed4d8af2677692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.959065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0b7dc4bfe34473a0ed4d8af2677692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.959801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0b7dc4bfe34473a0ed4d8af2677692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:01.977291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0b7dc4bfe34473a0ed4d8af2677692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.030217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.032028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.050196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62b9d12d-66ee-4076-8fde-ce21d947088a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0b7dc4bfe34473a0ed4d8af2677692'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.053165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf51470-2472-4d4e-8947-9371c829ed2d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.058558 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 861/1725] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:01 2022] DELETE /identity/v3/users/fd0b7dc4bfe34473a0ed4d8af2677692 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:02.067533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.067830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.068082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.070647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.071964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.072272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.072547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] PATH_INFO: `/v3/projects/6192f10625ed48d99b1856bf5e5753cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.073771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6192f10625ed48d99b1856bf5e5753cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.075963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.111137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:02.112596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.200400 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 862/1726] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:02.203776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.206615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.221578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016ff21-3745-4db7-9659-0d1f96579740 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.243668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:02.251523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6192f10625ed48d99b1856bf5e5753cb', 'request_id': 'req-af75cf03-1ba4-40ec-88e1-a5b69da8f229'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.261600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6192f10625ed48d99b1856bf5e5753cb', 'request_id': 'req-af75cf03-1ba4-40ec-88e1-a5b69da8f229'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.298930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.299602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.300520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.300814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] PATH_INFO: `/v3/users/28044da761a74f80811e1ecb5bdb9a29` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.302006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28044da761a74f80811e1ecb5bdb9a29)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.304290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.335999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6192f10625ed48d99b1856bf5e5753cb', 'request_id': 'req-af75cf03-1ba4-40ec-88e1-a5b69da8f229'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.350652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] The token cache is being invalidate because project 6192f10625ed48d99b1856bf5e5753cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:02.350950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.351610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.353162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 865/1727] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:02 2022] DELETE /identity/v3/projects/6192f10625ed48d99b1856bf5e5753cb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:02.354279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.355804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.414859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cf03-1ba4-40ec-88e1-a5b69da8f229 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.418594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add640-84cc-4efb-b6cb-5ea8464ebba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.419206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add640-84cc-4efb-b6cb-5ea8464ebba8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.419489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add640-84cc-4efb-b6cb-5ea8464ebba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.419799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add640-84cc-4efb-b6cb-5ea8464ebba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.421507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13add640-84cc-4efb-b6cb-5ea8464ebba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.433405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add640-84cc-4efb-b6cb-5ea8464ebba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.435303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add640-84cc-4efb-b6cb-5ea8464ebba8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.446087 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 866/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:02.447131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e936b-413f-4677-9968-bc2cde83eb76 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.447418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e936b-413f-4677-9968-bc2cde83eb76 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.447691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e936b-413f-4677-9968-bc2cde83eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.448261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28044da761a74f80811e1ecb5bdb9a29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.462970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28044da761a74f80811e1ecb5bdb9a29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.466582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28044da761a74f80811e1ecb5bdb9a29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.473141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d59e936b-413f-4677-9968-bc2cde83eb76 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:02.474453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d59e936b-413f-4677-9968-bc2cde83eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.483555 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 867/1729] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:02.486883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28044da761a74f80811e1ecb5bdb9a29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.493569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22d1f9-104e-45f0-ae56-746c28cba43d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.493860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22d1f9-104e-45f0-ae56-746c28cba43d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.494224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22d1f9-104e-45f0-ae56-746c28cba43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.515608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f22d1f9-104e-45f0-ae56-746c28cba43d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:02.516902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f22d1f9-104e-45f0-ae56-746c28cba43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.525917 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 868/1730] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:02.529857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22d1f9-104e-45f0-ae56-746c28cba43d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.540174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22d1f9-104e-45f0-ae56-746c28cba43d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.545807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.546479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.546754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.547194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.547995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:02.548447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.550267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.565290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 869/1731] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:25:02.570575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.581605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc134132-4e62-49e6-bd09-0c73c4b570f5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.586275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.586967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.587251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.587526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.588191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.590112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.604715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6d29ce58-ab03-4794-96dd-8dace1c8bb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28044da761a74f80811e1ecb5bdb9a29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:02.612072 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 863/1732] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:02 2022] DELETE /identity/v3/users/28044da761a74f80811e1ecb5bdb9a29 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:02.616747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.617100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.617405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.637019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:02.638274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.700137 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 864/1733] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:02.709351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.711413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.722886 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 870/1734] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:02 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:02.725480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.778838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3ffca-ff24-4af0-83fd-2f5588149ce1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.803123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b27a7f-3900-487f-a493-85921cad8526 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.809193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.810436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.810436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.810584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.811169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.813354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.855172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.855909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.856303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.856687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.868974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.870587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.881801 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 865/1735] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:02.891254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 871/1736] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:02 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:02.895266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.908088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:02.911706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803d5a9-47e4-4456-8900-22827c97e5f1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.918572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.919769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.920450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.920575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.921050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.922195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.922616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:02.925187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.940334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77517b4c-6061-4239-b555-4bd3cbbefd3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.945465 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 866/1737] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:02.950409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:02.960416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.961181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.962769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653a174-172b-4a6f-b2bd-3f8ebe1afdaf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:02.964030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.964796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] PATH_INFO: `/v3/projects/e8aa3924a629405ca8d4940315576ba1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.971963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8aa3924a629405ca8d4940315576ba1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.972377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:02.972377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:02.972592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.972703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:02.972703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:02.972703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:02.973731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:02.990171 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 867/1738] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:02.994218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:03.009443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf033-7a8b-4e93-a45a-085593475634 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:03.015685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b88b9-a4e6-4b28-8237-d534f123815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:03.016353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b88b9-a4e6-4b28-8237-d534f123815f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:03.016634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b88b9-a4e6-4b28-8237-d534f123815f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:03.016911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b88b9-a4e6-4b28-8237-d534f123815f admin admin] PATH_INFO: `/v3/projects/9bac90d929784944bcd6154168cfca34/users/31cb47723a564ec4804151531e91509d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:03.045256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b88b9-a4e6-4b28-8237-d534f123815f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bac90d929784944bcd6154168cfca34, user_id=31cb47723a564ec4804151531e91509d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:03.048049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b88b9-a4e6-4b28-8237-d534f123815f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:03.115105 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 868/1739] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:02 2022] PUT /identity/v3/projects/9bac90d929784944bcd6154168cfca34/users/31cb47723a564ec4804151531e91509d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:03.124408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8aa3924a629405ca8d4940315576ba1', 'request_id': 'req-808b4acd-7cf6-4c19-bd7d-90578fb2381b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.127010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:03.127010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:03.127010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:03.132334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8aa3924a629405ca8d4940315576ba1', 'request_id': 'req-808b4acd-7cf6-4c19-bd7d-90578fb2381b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.156329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] MFA Rules not processed for user `31cb47723a564ec4804151531e91509d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:03.157553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:03.238008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8aa3924a629405ca8d4940315576ba1', 'request_id': 'req-808b4acd-7cf6-4c19-bd7d-90578fb2381b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.254698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] The token cache is being invalidate because project e8aa3924a629405ca8d4940315576ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:03.254698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.254698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.257726 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 872/1740] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:02 2022] DELETE /identity/v3/projects/e8aa3924a629405ca8d4940315576ba1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:03.261987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:03.266900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:03.306706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 869/1741] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:03.318009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:03.319489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:03.368168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4acd-7cf6-4c19-bd7d-90578fb2381b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:03.472561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:03.473308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:03.473599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:03.473888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] PATH_INFO: `/v3/users/ae2e7efa9ee249ea9d14f124fac8235c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:03.479419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2e7efa9ee249ea9d14f124fac8235c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:03.481655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:03.481916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372405c-fdc4-42a7-9e57-9b982958ff35 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:03.489920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:03.490763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:03.491115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:03.491461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:03.492217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:03.494648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:03.621729 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 870/1742] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:03 2022] POST /identity/v3/projects => generated 389 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:25:03.623098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:03.624999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:03.707522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5508a1-2b61-4505-bfec-213a253d78e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:03.713464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:03.714311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:03.714671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:03.715020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] PATH_INFO: `/v3/projects/80b5300549ff4e7c991dccae8a42a33d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:03.716340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b5300549ff4e7c991dccae8a42a33d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:03.718391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:03.741120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2e7efa9ee249ea9d14f124fac8235c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.741980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2e7efa9ee249ea9d14f124fac8235c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.840912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2e7efa9ee249ea9d14f124fac8235c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.843997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2e7efa9ee249ea9d14f124fac8235c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.853631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2e7efa9ee249ea9d14f124fac8235c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.865487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b5300549ff4e7c991dccae8a42a33d', 'request_id': 'req-52efb36a-547c-47d8-b53d-9325aed12f82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.876191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b5300549ff4e7c991dccae8a42a33d', 'request_id': 'req-52efb36a-547c-47d8-b53d-9325aed12f82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.905785 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 873/1743] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:03 2022] DELETE /identity/v3/users/ae2e7efa9ee249ea9d14f124fac8235c => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:03.906421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:03.907938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:03.953756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b5300549ff4e7c991dccae8a42a33d', 'request_id': 'req-52efb36a-547c-47d8-b53d-9325aed12f82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.982654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] The token cache is being invalidate because project 80b5300549ff4e7c991dccae8a42a33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:03.983657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.984588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:03.990115 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 871/1744] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:03 2022] DELETE /identity/v3/projects/80b5300549ff4e7c991dccae8a42a33d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:03.991540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:03.993111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.007378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657a219-d3eb-4611-977e-2a6e9b9dbad3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.015619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.016472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.016904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.017324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.018730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.020873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.089552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efb36a-547c-47d8-b53d-9325aed12f82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.096291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.096965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.097249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.097529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] PATH_INFO: `/v3/users/31f765d197374f1cb5bdfa5890d74f7d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.098782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f765d197374f1cb5bdfa5890d74f7d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.104606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.147471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 874/1745] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:03 2022] POST /identity/v3/users => generated 301 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:04.148603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:04.150537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.163622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f392e-0c1d-4993-9f7e-8cfca894f483 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.168900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.169567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.170928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.170928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] PATH_INFO: `/v3/users/a36cec64f228401d9c1e8e34f08543fa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.171330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36cec64f228401d9c1e8e34f08543fa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.173295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.283437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f765d197374f1cb5bdfa5890d74f7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.292292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f765d197374f1cb5bdfa5890d74f7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.293166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f765d197374f1cb5bdfa5890d74f7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.307514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f765d197374f1cb5bdfa5890d74f7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.356893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36cec64f228401d9c1e8e34f08543fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.357671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36cec64f228401d9c1e8e34f08543fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.364344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f765d197374f1cb5bdfa5890d74f7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.373916 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 872/1746] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:03 2022] DELETE /identity/v3/users/31f765d197374f1cb5bdfa5890d74f7d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:04.375510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:04.377841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.464180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0ba0c-bf34-41eb-afc6-df40a4c202ce admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.467447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36cec64f228401d9c1e8e34f08543fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.468396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36cec64f228401d9c1e8e34f08543fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.470456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.471447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.471776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.472066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.472727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.474368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.476822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e1030dc8-0f1a-4802-bdef-c8011f63dfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36cec64f228401d9c1e8e34f08543fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.484438 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 873/1747] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:04.485303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:04.487468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.497142 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 875/1748] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:04 2022] DELETE /identity/v3/users/a36cec64f228401d9c1e8e34f08543fa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:04.498723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.499011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.499286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.502627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2275ab-f48c-454d-a8bd-d842d9945bdf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.519348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:04.524450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:04.525845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.568861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.569514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.569799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.570111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] PATH_INFO: `/v3/projects/4293f61372d04f46807f3062c7e192c6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.571279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4293f61372d04f46807f3062c7e192c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.573201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.591946 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 876/1749] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:04.592734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:04.594005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.665637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329d0b-7232-43f9-b60f-624d8f74da03 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.671086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.671691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.671968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.672238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.674533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.701595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4293f61372d04f46807f3062c7e192c6', 'request_id': 'req-a2013d93-e35d-44d8-a26f-b1f48655c842'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.712592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4293f61372d04f46807f3062c7e192c6', 'request_id': 'req-a2013d93-e35d-44d8-a26f-b1f48655c842'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.743204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.744861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.755038 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 877/1750] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:04.755849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:04.757256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.771868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99d8a-2129-40bb-ba71-e85059182f07 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.781221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4293f61372d04f46807f3062c7e192c6', 'request_id': 'req-a2013d93-e35d-44d8-a26f-b1f48655c842'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.805638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] The token cache is being invalidate because project 4293f61372d04f46807f3062c7e192c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:04.806225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.807096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:04.808904 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 874/1751] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:04 2022] DELETE /identity/v3/projects/4293f61372d04f46807f3062c7e192c6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:04.809862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:04.815172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.888742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abe924-1abb-4f59-a9c4-a57fe8fa4c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.888742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abe924-1abb-4f59-a9c4-a57fe8fa4c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.888742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abe924-1abb-4f59-a9c4-a57fe8fa4c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.888742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abe924-1abb-4f59-a9c4-a57fe8fa4c3a admin admin] PATH_INFO: `/v3/projects/6b191d72d6de46fabafb1e3a18588e4e/users/e71ec1619af54eea87ab3c3d9c063dc2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.909573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abe924-1abb-4f59-a9c4-a57fe8fa4c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b191d72d6de46fabafb1e3a18588e4e, user_id=e71ec1619af54eea87ab3c3d9c063dc2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.913605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abe924-1abb-4f59-a9c4-a57fe8fa4c3a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.925972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2013d93-e35d-44d8-a26f-b1f48655c842 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:04.930156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f18b5-afd2-460e-8afa-6db459812e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:04.930871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f18b5-afd2-460e-8afa-6db459812e2d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.931251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f18b5-afd2-460e-8afa-6db459812e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.931954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f18b5-afd2-460e-8afa-6db459812e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:04.933291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a19f18b5-afd2-460e-8afa-6db459812e2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:04.948329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f18b5-afd2-460e-8afa-6db459812e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:04.949971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f18b5-afd2-460e-8afa-6db459812e2d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:04.964905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 875/1752] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:04.966567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:04.966824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:04.967093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.000503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:05.000503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.009928 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 876/1753] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:05.010782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.015648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.030782 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 878/1754] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:04 2022] PUT /identity/v3/projects/6b191d72d6de46fabafb1e3a18588e4e/users/e71ec1619af54eea87ab3c3d9c063dc2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:05.032608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.033056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.034109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.035704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c104146-f435-44d0-8bc3-a22be2cb3e7f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.067568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:05.069210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.129939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.131174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.131890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.132350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] PATH_INFO: `/v3/projects/6fc88a7b2efc468b9e53b5d44d31a9b1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.133762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc88a7b2efc468b9e53b5d44d31a9b1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.135945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.150670 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 879/1755] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:05.151895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.153398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.171237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06fa06-421f-4f3e-a65b-38755ad0dc1d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.177011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.178394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.178394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.178394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.178857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.180537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.191808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 880/1756] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:05.192728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.202736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddb224-771b-4255-b63e-8a98a693b747 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.208455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.208960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.209240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.209514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.210195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:05.210500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.212373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.225085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:05.225443 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 881/1757] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:05.226393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.235854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb366338-6804-4731-ab80-6629eb0348c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.240668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.241297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.241574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.241847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] PATH_INFO: `/v3/projects/6b191d72d6de46fabafb1e3a18588e4e/users/e71ec1619af54eea87ab3c3d9c063dc2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.244430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b191d72d6de46fabafb1e3a18588e4e, user_id=e71ec1619af54eea87ab3c3d9c063dc2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.246571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.256768 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 882/1758] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:05 2022] PUT /identity/v3/projects/6b191d72d6de46fabafb1e3a18588e4e/users/e71ec1619af54eea87ab3c3d9c063dc2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:05.257610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.268579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc88a7b2efc468b9e53b5d44d31a9b1', 'request_id': 'req-b0bfaa89-809f-44cf-bd8a-7f62fd967068'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.276468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc88a7b2efc468b9e53b5d44d31a9b1', 'request_id': 'req-b0bfaa89-809f-44cf-bd8a-7f62fd967068'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.318043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3580-da86-4524-9132-712e303334d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.322875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.323251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.323531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.323803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.324424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.326344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.347987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc88a7b2efc468b9e53b5d44d31a9b1', 'request_id': 'req-b0bfaa89-809f-44cf-bd8a-7f62fd967068'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.359699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] The token cache is being invalidate because project 6fc88a7b2efc468b9e53b5d44d31a9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:05.359997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.360695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b0bfaa89-809f-44cf-bd8a-7f62fd967068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.367634 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 877/1759] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:05 2022] DELETE /identity/v3/projects/6fc88a7b2efc468b9e53b5d44d31a9b1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:05.367634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e10f-358e-47b3-aabc-0e842726aaa5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.367634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e10f-358e-47b3-aabc-0e842726aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.367634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e10f-358e-47b3-aabc-0e842726aaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.393547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0a95e10f-358e-47b3-aabc-0e842726aaa5 None None] MFA Rules not processed for user `e71ec1619af54eea87ab3c3d9c063dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:05.394843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a95e10f-358e-47b3-aabc-0e842726aaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.441203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 883/1760] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:05 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:05.442219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.444248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.471565 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 878/1761] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:05.472954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.473269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.473538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.496639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:05.497141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.530904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b315d-b40a-45c4-9ddb-f60e6af7e9fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.536123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.537047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.537435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.537692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] PATH_INFO: `/v3/projects/3a90038712264f0a852d014124619cfc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.538974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a90038712264f0a852d014124619cfc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.541036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.570419 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 879/1762] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:05.571328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.572610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.585749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68004754-ea17-4680-8f1c-c2c61a046b81 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.590397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.591032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.591308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.591578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.592208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.594233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.656753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a90038712264f0a852d014124619cfc', 'request_id': 'req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.663013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a90038712264f0a852d014124619cfc', 'request_id': 'req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.673572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 880/1763] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:05 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:05.674828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.676644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.748548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd14db-2176-47b7-93cf-aa441b41d6ae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.757981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a90038712264f0a852d014124619cfc', 'request_id': 'req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.769466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] The token cache is being invalidate because project 3a90038712264f0a852d014124619cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:05.769757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.770438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3dcaf34e-e1f0-4f59-bc65-119a3dbfca93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:05.771983 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 884/1764] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:05 2022] DELETE /identity/v3/projects/3a90038712264f0a852d014124619cfc => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:05.773292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.773582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.773859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.793251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:05.794489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.813303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.813951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.814263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.815182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.817162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.854748 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 885/1765] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:05.855603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.862036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.873870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c5e7-0a08-4412-8984-3f5f43aa7e6e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.881563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.882253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.882253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.882253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.883855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.886256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.888158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.889791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.899719 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 886/1766] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:05.899719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.899719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:05.902243 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 881/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:05.902243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.911199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043bcba-52fc-4997-9733-1a4fdb9fd1bb service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.912559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8561fb-df17-406b-956c-a670057eae4d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.916267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.917180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.919391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.919391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.919569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.919672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:05.919672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.919844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.919844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.919844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] PATH_INFO: `/v3/users/7a18ccd1e2e249de86d05ac26a551711` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.920441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.921400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a18ccd1e2e249de86d05ac26a551711)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.923487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.933428 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 882/1768] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:05.937142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.945299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0f55-d4bd-46b0-a05b-b69d0da4f532 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.950502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.951434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.951670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.951954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.952598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.954365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:05.965388 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 883/1769] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:05.966425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:05.971615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:05.978413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b42e-4f62-430f-aa97-3367b0053151 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:05.983088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:05.983685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:05.983973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:05.984331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:05.984964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:05.987447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.068739 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 884/1770] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:05 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:06.069883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.072923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:06.130123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a18ccd1e2e249de86d05ac26a551711'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:06.130830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a18ccd1e2e249de86d05ac26a551711'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:06.172422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940a41e-d4e1-4032-95fa-8153965bece0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.180274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.180888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.181170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.181443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.183459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:06.222207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a18ccd1e2e249de86d05ac26a551711'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:06.223366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a18ccd1e2e249de86d05ac26a551711'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:06.232451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a18ccd1e2e249de86d05ac26a551711'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:06.253200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.253769 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 887/1771] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:05 2022] DELETE /identity/v3/users/7a18ccd1e2e249de86d05ac26a551711 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:06.254560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.255427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.255976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:06.265572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 885/1772] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:06.266430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.268166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:06.378612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c82d7-d4ad-45bd-99ee-21132f206898 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.384050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:06.390786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885ad67-3554-400b-ac5e-0ee190bc78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.391957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885ad67-3554-400b-ac5e-0ee190bc78bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.392387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885ad67-3554-400b-ac5e-0ee190bc78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.392811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885ad67-3554-400b-ac5e-0ee190bc78bd admin admin] PATH_INFO: `/v3/projects/022f553b903d498381fe3344f594cbe0/users/203747b0aac14d62ac5fc0bea5a97df9/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.433808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2e2c-064b-4d24-ae95-8328067ffb24 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.439771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885ad67-3554-400b-ac5e-0ee190bc78bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=022f553b903d498381fe3344f594cbe0, user_id=203747b0aac14d62ac5fc0bea5a97df9, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.442908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885ad67-3554-400b-ac5e-0ee190bc78bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.443472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.444226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.444556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.444885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.445921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.449971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.519680 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 888/1773] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:06 2022] PUT /identity/v3/projects/022f553b903d498381fe3344f594cbe0/users/203747b0aac14d62ac5fc0bea5a97df9/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:06.537080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.537378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.537656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.572202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 886/1774] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:06 2022] POST /identity/v3/users => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:06.577023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.583760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] MFA Rules not processed for user `203747b0aac14d62ac5fc0bea5a97df9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:06.586181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:06.610505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdf62e-0991-43ee-819a-a83704070969 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.650544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=5,keystone:DELETE=13,keystone:SELECT=82 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:06.704831 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 889/1775] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:06.711575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.714963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:06.715549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:06.726017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.726924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.727390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.727642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.728596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.730359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.747355 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 887/1776] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:06.747355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.759209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52169ed7-615f-4083-8437-9b219338d912 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.766901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.768321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.768833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.769114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.770251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.772767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.797537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982f345-53b4-4c53-bfe6-7784d09afa44 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.802719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.803633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.803913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.804182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] PATH_INFO: `/v3/users/31cb47723a564ec4804151531e91509d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.805524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cb47723a564ec4804151531e91509d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.807456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.883261 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 888/1777] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:06 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:06.883261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.947470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f999e9c-1457-4a89-90fb-7a1a78e61e51 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.952484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.953097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.953377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.953650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.954340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.956543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:06.966606 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 889/1778] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:06.967414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:06.970878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:06.983712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b5da-83c6-4f7c-8c05-7d0e840fb6dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:06.988818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:06.989444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:06.989725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:06.989999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] PATH_INFO: `/v3/projects/ccb7dff11ce2406393358f6af4d1dd5d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:06.991443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb7dff11ce2406393358f6af4d1dd5d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:06.993699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.039352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cb47723a564ec4804151531e91509d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.040010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cb47723a564ec4804151531e91509d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.110545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb7dff11ce2406393358f6af4d1dd5d', 'request_id': 'req-a41532b7-9618-43e5-97a2-b10ae6236b76'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.118721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cb47723a564ec4804151531e91509d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.119366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cb47723a564ec4804151531e91509d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.123629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb7dff11ce2406393358f6af4d1dd5d', 'request_id': 'req-a41532b7-9618-43e5-97a2-b10ae6236b76'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.130325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cb47723a564ec4804151531e91509d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.153399 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 890/1779] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:06 2022] DELETE /identity/v3/users/31cb47723a564ec4804151531e91509d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:07.154315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.158511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.198900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb7dff11ce2406393358f6af4d1dd5d', 'request_id': 'req-a41532b7-9618-43e5-97a2-b10ae6236b76'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.199123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:07.214602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] The token cache is being invalidate because project ccb7dff11ce2406393358f6af4d1dd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:07.214905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.215706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:07.221745 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 890/1780] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:06 2022] DELETE /identity/v3/projects/ccb7dff11ce2406393358f6af4d1dd5d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:07.221745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.226170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.244801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165bfa-55ce-4f4f-84e3-4d31a7b119ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:07.250568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcafd5c-1468-4e7e-86dd-5117ec2f5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:07.251369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcafd5c-1468-4e7e-86dd-5117ec2f5378 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.251768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcafd5c-1468-4e7e-86dd-5117ec2f5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.252901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcafd5c-1468-4e7e-86dd-5117ec2f5378 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.253717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcafd5c-1468-4e7e-86dd-5117ec2f5378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:07.260898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcafd5c-1468-4e7e-86dd-5117ec2f5378 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.306540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41532b7-9618-43e5-97a2-b10ae6236b76 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:07.311337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640f5fb-e9ac-4226-ad1c-2f7b7ebc0ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:07.312015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f5fb-e9ac-4226-ad1c-2f7b7ebc0ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.312303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f5fb-e9ac-4226-ad1c-2f7b7ebc0ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.312584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f5fb-e9ac-4226-ad1c-2f7b7ebc0ad1 admin admin] PATH_INFO: `/v3/projects/5aad7c28c1aa4a4295bd6f77766155a2/users/c3b51f06c5844e30ace768840e1ad51a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.329347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640f5fb-e9ac-4226-ad1c-2f7b7ebc0ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aad7c28c1aa4a4295bd6f77766155a2, user_id=c3b51f06c5844e30ace768840e1ad51a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:07.332092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640f5fb-e9ac-4226-ad1c-2f7b7ebc0ad1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.341667 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 891/1781] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:07 2022] POST /identity/v3/users => generated 309 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:07.343160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e56b-3997-445a-9b94-50e196b48efe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.343445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e56b-3997-445a-9b94-50e196b48efe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.346791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e56b-3997-445a-9b94-50e196b48efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.346910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:07.364899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b9f5e56b-3997-445a-9b94-50e196b48efe None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:07.366203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9f5e56b-3997-445a-9b94-50e196b48efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.398372 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 891/1782] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:07 2022] PUT /identity/v3/projects/5aad7c28c1aa4a4295bd6f77766155a2/users/c3b51f06c5844e30ace768840e1ad51a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:07.400151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.400498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.400959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.418704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:07.421858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:07.423095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.436459 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 892/1783] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:07.437813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.438146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.438428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.483004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:07.484345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.499287 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 892/1784] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:07.500219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.503727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.517294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f3a8f-03ea-496d-a2f5-f400305a9ce9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:07.522533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1c6b2-b468-426e-8ba8-4cac3a732a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:07.523145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c6b2-b468-426e-8ba8-4cac3a732a1c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.523422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c6b2-b468-426e-8ba8-4cac3a732a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.524092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c6b2-b468-426e-8ba8-4cac3a732a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.524335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1c6b2-b468-426e-8ba8-4cac3a732a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:07.525941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1c6b2-b468-426e-8ba8-4cac3a732a1c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.536937 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 893/1785] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:07.538642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.538931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.539238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.572906 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 893/1786] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:07.572906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.572906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.583313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] MFA Rules not processed for user `c3b51f06c5844e30ace768840e1ad51a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:07.584661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.646150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e5072-57c2-4410-94ff-1b3b35362809 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:07.654829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:07.655478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.655758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.656034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.658723 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 894/1787] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:07.659926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.663170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.724270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ab089-9eef-4f30-92f6-549a79a27427 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:07.727532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:07.728819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81180f0-c24e-4dcf-bf83-89c288c95882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:07.729150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.729853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81180f0-c24e-4dcf-bf83-89c288c95882 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.730354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81180f0-c24e-4dcf-bf83-89c288c95882 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.730809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81180f0-c24e-4dcf-bf83-89c288c95882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.738759 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 894/1788] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:07.739643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.743859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81180f0-c24e-4dcf-bf83-89c288c95882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:07.746367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81180f0-c24e-4dcf-bf83-89c288c95882 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.750270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346d433-313c-43af-99a2-829f12a83f27 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:07.755712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:07.756690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.757174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.757551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] PATH_INFO: `/v3/projects/5dd65effabff48d2b449eefb2fc24e93/users/31e90bd7e03d4db38ba01eff1556d223/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.759092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 895/1789] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:07.762201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba2e9-71c7-4562-868a-0f3e34a581c6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.762495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba2e9-71c7-4562-868a-0f3e34a581c6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.768553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba2e9-71c7-4562-868a-0f3e34a581c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.776690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd65effabff48d2b449eefb2fc24e93, user_id=31e90bd7e03d4db38ba01eff1556d223, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:07.781844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.794466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6a8ba2e9-71c7-4562-868a-0f3e34a581c6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:07.795767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a8ba2e9-71c7-4562-868a-0f3e34a581c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:07.810323 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 896/1790] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:07.811487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ba2e9-71c7-4562-868a-0f3e34a581c6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.821464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:07.827284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ba2e9-71c7-4562-868a-0f3e34a581c6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:07.835639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:07.837782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:07.837782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:07.837782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:07.840585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:07.844798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:07.855823 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 895/1791] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:07 2022] PUT /identity/v3/projects/5dd65effabff48d2b449eefb2fc24e93/users/31e90bd7e03d4db38ba01eff1556d223/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:07.855823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.982394 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 897/1792] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:07 2022] POST /identity/v3/projects => generated 399 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:07.983585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:07.986104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436585f-adeb-4dac-9297-f8ecca0bb6f7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.074956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:08.149605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f01ca-c795-403d-9375-820b07fa0fa8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.179806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.180385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.180669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.180947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.181717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.184427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.184737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.185383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.185663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.185993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.189737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:08.190111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.195248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.213075 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 898/1793] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:08.213899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:08.229830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470488fd-ee68-459d-8fa8-36ae03f84d17 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.240960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328a68-831f-4e78-b787-0596bc2a8aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.244872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328a68-831f-4e78-b787-0596bc2a8aea admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.245279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328a68-831f-4e78-b787-0596bc2a8aea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.245798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328a68-831f-4e78-b787-0596bc2a8aea admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.252777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68328a68-831f-4e78-b787-0596bc2a8aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.253335 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 896/1794] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:08.256284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68328a68-831f-4e78-b787-0596bc2a8aea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.256812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:08.278566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca820fd-f713-48de-8f2e-b2a10547dfcc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.288196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.288196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.288196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.288718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] PATH_INFO: `/v3/projects/5dd65effabff48d2b449eefb2fc24e93/users/31e90bd7e03d4db38ba01eff1556d223/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.290847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd65effabff48d2b449eefb2fc24e93, user_id=31e90bd7e03d4db38ba01eff1556d223, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.293860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.328633 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 897/1795] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:08 2022] PUT /identity/v3/projects/5dd65effabff48d2b449eefb2fc24e93/users/31e90bd7e03d4db38ba01eff1556d223/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:08.329330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:08.388131 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 899/1796] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:08 2022] POST /identity/v3/users => generated 306 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:08.389621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c4a3-4cb2-4b70-96d2-d669204ea629 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.390132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c4a3-4cb2-4b70-96d2-d669204ea629 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.390590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c4a3-4cb2-4b70-96d2-d669204ea629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.457702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e806c4a3-4cb2-4b70-96d2-d669204ea629 None None] MFA Rules not processed for user `31e90bd7e03d4db38ba01eff1556d223`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:08.460662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e806c4a3-4cb2-4b70-96d2-d669204ea629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:08.492218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8057-8270-4a53-a548-5d92618e267c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.504112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.504754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.505036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.505310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.505956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.507904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.606359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 900/1797] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:08 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:08.612264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c4a3-4cb2-4b70-96d2-d669204ea629 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:08.625761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c4a3-4cb2-4b70-96d2-d669204ea629 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.631586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.634981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.634981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.634981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.634981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.636176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.655588 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 901/1798] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:08.656612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:08.664577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 898/1799] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:08 2022] POST /identity/v3/projects => generated 375 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:08.668208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:08.698466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3dab-8062-41b2-84f6-8695254ab45b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.847751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3c5bc-6bc2-41fe-94d3-b6f8bf49c52d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:08.869043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.870548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.872594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.873121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.874895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.881194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:08.881879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:08.883004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:08.883749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] PATH_INFO: `/v3/projects/79e4766e145e433487f95a83f4de3891/users/f1346367474a47bc8bcaebcf6cfa1476/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:08.885300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.918284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e4766e145e433487f95a83f4de3891, user_id=f1346367474a47bc8bcaebcf6cfa1476, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:08.921005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:08.984959 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 899/1800] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:08 2022] POST /identity/v3/users => generated 288 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:08.984959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:08.988354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:09.133771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848dcc1-8ca4-4188-9056-87d2d3abb081 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.139960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.140813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.141299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.141760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.163075 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 902/1801] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:08 2022] PUT /identity/v3/projects/79e4766e145e433487f95a83f4de3891/users/f1346367474a47bc8bcaebcf6cfa1476/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:09.166762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.167429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:09.255860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.257894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.271706 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 900/1802] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:08 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:09.273301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.286376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002ec4-77b3-481a-bd66-3debd345d095 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.291989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.293024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.293604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.294091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.294950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.308955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.310560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fbf95-b87d-4f5e-8c52-ad1ea1a8834b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.320248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.320904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.321189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.321469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] PATH_INFO: `/v3/projects/9bac90d929784944bcd6154168cfca34` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.324108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bac90d929784944bcd6154168cfca34)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.328417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.338785 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 901/1803] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:09.340448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.358459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a842a-d739-4d9b-bcf1-72ceb982bb4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.364968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.369299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.369299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.369299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.369299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.370950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.394582 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 902/1804] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:09.394582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.407573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e049c-235c-4b93-aafb-5e751536d2d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.414081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.414622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.414992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.415376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.416038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.418542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.438002 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 903/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:09.438002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.450839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2d6b5-3abb-407f-a4a0-35192c3f97f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.457452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.458210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.458493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.458827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] PATH_INFO: `/v3/projects/79e4766e145e433487f95a83f4de3891/users/f1346367474a47bc8bcaebcf6cfa1476/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.461161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e4766e145e433487f95a83f4de3891, user_id=f1346367474a47bc8bcaebcf6cfa1476, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.468133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.478906 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 904/1806] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:09 2022] PUT /identity/v3/projects/79e4766e145e433487f95a83f4de3891/users/f1346367474a47bc8bcaebcf6cfa1476/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:09.479807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.491845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bac90d929784944bcd6154168cfca34', 'request_id': 'req-a321c5b1-d8db-4233-b170-b60b4b650e3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:09.512197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bac90d929784944bcd6154168cfca34', 'request_id': 'req-a321c5b1-d8db-4233-b170-b60b4b650e3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:09.609993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bac90d929784944bcd6154168cfca34', 'request_id': 'req-a321c5b1-d8db-4233-b170-b60b4b650e3f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:09.618204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b5726-122c-4d00-b92a-52fdadc79a63 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.624644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff327-813e-48a2-8e99-e35457efdba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.625444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff327-813e-48a2-8e99-e35457efdba0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.625824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff327-813e-48a2-8e99-e35457efdba0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.626238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff327-813e-48a2-8e99-e35457efdba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.628747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-936ff327-813e-48a2-8e99-e35457efdba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:09.635660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] The token cache is being invalidate because project 9bac90d929784944bcd6154168cfca34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:09.636324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:09.637066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:09.642017 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 903/1807] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:09 2022] DELETE /identity/v3/projects/9bac90d929784944bcd6154168cfca34 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:09.642017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.646731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:09.721557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff327-813e-48a2-8e99-e35457efdba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.728259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff327-813e-48a2-8e99-e35457efdba0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.744638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:09.748089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 905/1808] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:09.748089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.748089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.748089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.794619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] MFA Rules not processed for user `f1346367474a47bc8bcaebcf6cfa1476`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:09.796531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:09.810356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321c5b1-d8db-4233-b170-b60b4b650e3f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.880033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:09.931996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.933160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.933680 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 906/1809] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:09.935927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:09.936354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.937384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] PATH_INFO: `/v3/projects/c4f48cdf69404af3abe024e41fc47658/users/ec8eeb514304488eb80bcaae352b2a03/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.937801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:09.970046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7037be-04c2-4b79-b770-d9630442f829 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:09.978176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:09.979499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:09.980000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:09.980486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] PATH_INFO: `/v3/users/e71ec1619af54eea87ab3c3d9c063dc2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:09.981902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71ec1619af54eea87ab3c3d9c063dc2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.984309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:09.984580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f48cdf69404af3abe024e41fc47658, user_id=ec8eeb514304488eb80bcaae352b2a03, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:09.989716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:10.116547 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 904/1810] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:09 2022] PUT /identity/v3/projects/c4f48cdf69404af3abe024e41fc47658/users/ec8eeb514304488eb80bcaae352b2a03/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:10.117974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:10.120085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:10.212695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71ec1619af54eea87ab3c3d9c063dc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.217026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71ec1619af54eea87ab3c3d9c063dc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.242722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0238b6-8ad7-41cc-bfa3-0a743c033079 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:10.255556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf9f54-daa4-4b51-a071-65a49c9b4b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:10.257410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf9f54-daa4-4b51-a071-65a49c9b4b85 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:10.257410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf9f54-daa4-4b51-a071-65a49c9b4b85 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:10.257410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf9f54-daa4-4b51-a071-65a49c9b4b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:10.258780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4adf9f54-daa4-4b51-a071-65a49c9b4b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:10.273761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71ec1619af54eea87ab3c3d9c063dc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.274448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71ec1619af54eea87ab3c3d9c063dc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.287674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71ec1619af54eea87ab3c3d9c063dc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.316198 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 907/1811] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:09 2022] DELETE /identity/v3/users/e71ec1619af54eea87ab3c3d9c063dc2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:10.317142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:10.318804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:10.382241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf9f54-daa4-4b51-a071-65a49c9b4b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:10.384272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf9f54-daa4-4b51-a071-65a49c9b4b85 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:10.403724 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 905/1812] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:10.405803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:10.406131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:10.411042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:10.474392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903c349-dafc-4767-8b2d-99c45da7ad90 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:10.484222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] MFA Rules not processed for user `ec8eeb514304488eb80bcaae352b2a03`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:10.485666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:10.492057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:10.492057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:10.492057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:10.492057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] PATH_INFO: `/v3/users/203747b0aac14d62ac5fc0bea5a97df9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:10.492459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=203747b0aac14d62ac5fc0bea5a97df9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:10.494398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:10.612636 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 906/1813] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:10.614893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:10.617066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:10.621910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:10.641601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c3ec2-8b7e-43ed-a18e-724a287f1dba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:10.648750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:10.648750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:10.648750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:10.649521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] PATH_INFO: `/v3/users/8f04d39830d04cf99527919cbccf46e7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:10.650905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f04d39830d04cf99527919cbccf46e7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:10.653042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:10.695767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:10.748589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203747b0aac14d62ac5fc0bea5a97df9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.753257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203747b0aac14d62ac5fc0bea5a97df9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.843964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203747b0aac14d62ac5fc0bea5a97df9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.844592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203747b0aac14d62ac5fc0bea5a97df9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.858021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203747b0aac14d62ac5fc0bea5a97df9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.878548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f04d39830d04cf99527919cbccf46e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.885510 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 908/1814] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:10 2022] DELETE /identity/v3/users/203747b0aac14d62ac5fc0bea5a97df9 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:10.887002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:10.888739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:10.889281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f04d39830d04cf99527919cbccf46e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.890027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f04d39830d04cf99527919cbccf46e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:10.933235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f04d39830d04cf99527919cbccf46e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:11.000466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f04d39830d04cf99527919cbccf46e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:11.016804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 907/1815] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:10 2022] DELETE /identity/v3/users/8f04d39830d04cf99527919cbccf46e7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:11.021651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:11.024526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:11.110518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da66cfa-bbbb-4491-8454-237dbbac4afa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:11.133438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169114f-8ecd-4e4e-b013-54fcbf0f9748 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:11.138554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58002b-14e2-4ad6-8a4b-1ef9aab98893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:11.139393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58002b-14e2-4ad6-8a4b-1ef9aab98893 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:11.139522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58002b-14e2-4ad6-8a4b-1ef9aab98893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:11.139756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58002b-14e2-4ad6-8a4b-1ef9aab98893 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:11.140646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58002b-14e2-4ad6-8a4b-1ef9aab98893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:11.143210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58002b-14e2-4ad6-8a4b-1ef9aab98893 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:11.206834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:11.207494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:11.207771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:11.208290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:11.209892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:11.265253 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 908/1816] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:11 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:11.271996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943f5c-a774-4421-b964-43bd110384b1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:11.276978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943f5c-a774-4421-b964-43bd110384b1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:11.276978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943f5c-a774-4421-b964-43bd110384b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:11.291804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:11.294179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:11.318203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 909/1817] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:11.320360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:11.320841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a3943f5c-a774-4421-b964-43bd110384b1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:11.322456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:11.330881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3943f5c-a774-4421-b964-43bd110384b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:11.339444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:11.357420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950a79-4811-45df-9bde-be76f3d6f586 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:11.443649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:11.520415 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 909/1818] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:11.523745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cc6e-12a1-46be-9d21-4e050354685e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:11.524034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cc6e-12a1-46be-9d21-4e050354685e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:11.524229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365cc6e-12a1-46be-9d21-4e050354685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:11.557371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:11.558037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:11.558358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:11.558683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] PATH_INFO: `/v3/projects/6b191d72d6de46fabafb1e3a18588e4e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:11.560551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b191d72d6de46fabafb1e3a18588e4e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:11.569636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:11.594454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f365cc6e-12a1-46be-9d21-4e050354685e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:11.601731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f365cc6e-12a1-46be-9d21-4e050354685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:11.622194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 910/1819] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:11.622194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365cc6e-12a1-46be-9d21-4e050354685e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:11.655063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365cc6e-12a1-46be-9d21-4e050354685e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:11.669127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:11.670225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:11.671783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:11.672216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:11.672979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:11.678729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:11.702892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:11.742148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b191d72d6de46fabafb1e3a18588e4e', 'request_id': 'req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:11.756449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b191d72d6de46fabafb1e3a18588e4e', 'request_id': 'req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:11.772649 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 911/1820] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:11 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:11.773536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:11.777442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:11.847867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:11.881805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b191d72d6de46fabafb1e3a18588e4e', 'request_id': 'req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:11.903287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] The token cache is being invalidate because project 6b191d72d6de46fabafb1e3a18588e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:11.903557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04e20b-a819-4d82-9049-265c9fdb188b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:11.903649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:11.907740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:11.918157 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 910/1821] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:11 2022] DELETE /identity/v3/projects/6b191d72d6de46fabafb1e3a18588e4e => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:11.919197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:11.920732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.009963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe84566-d44c-4a0c-9fcb-ba723e6e411f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:12.010701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe84566-d44c-4a0c-9fcb-ba723e6e411f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.010886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe84566-d44c-4a0c-9fcb-ba723e6e411f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.011313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe84566-d44c-4a0c-9fcb-ba723e6e411f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.014942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fbe84566-d44c-4a0c-9fcb-ba723e6e411f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.051215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881005e5-4f1b-4a58-a7a9-2aefa362ed7d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:12.058394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:12.059266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.059555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.059879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.062182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.143666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:12.171623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:12.172823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:12.175030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:12.177045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe84566-d44c-4a0c-9fcb-ba723e6e411f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:12.178919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe84566-d44c-4a0c-9fcb-ba723e6e411f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:12.186555 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 911/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:12.187548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:12.188981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.204772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716572b-5a1a-43ba-be45-85ac7d534f7b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:12.208390 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 912/1823] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:12.209644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed269a0-0ede-4a79-821c-94d5635c3c6e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.209942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed269a0-0ede-4a79-821c-94d5635c3c6e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.210631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed269a0-0ede-4a79-821c-94d5635c3c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.212255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:12.213126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.213619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.214719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.215699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:12.218276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:12.233662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 912/1824] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:12.234888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:12.238732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.255281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63977f79-2908-44bd-a632-c4e15c09d11e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:12.262268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6ed269a0-0ede-4a79-821c-94d5635c3c6e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:12.264047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ed269a0-0ede-4a79-821c-94d5635c3c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.265617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:12.268171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.268467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.268748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] PATH_INFO: `/v3/users/c3b51f06c5844e30ace768840e1ad51a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.271648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b51f06c5844e30ace768840e1ad51a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:12.274163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:12.296416 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 913/1825] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:12.298525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3f16-217d-4810-969c-60f52af3c09d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.299544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3f16-217d-4810-969c-60f52af3c09d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.299979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3f16-217d-4810-969c-60f52af3c09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.325640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ad3f3f16-217d-4810-969c-60f52af3c09d None None] MFA Rules not processed for user `fa4ca05a0c6a405f8fa014ee06dbcef4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:12.328114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad3f3f16-217d-4810-969c-60f52af3c09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.364917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:12.403576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 914/1826] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:12.404694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f3f16-217d-4810-969c-60f52af3c09d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:12.415566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:12.444279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f3f16-217d-4810-969c-60f52af3c09d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:12.462169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd461e4-2516-4800-a065-aed3cc50e1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:12.469089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd461e4-2516-4800-a065-aed3cc50e1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.469089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd461e4-2516-4800-a065-aed3cc50e1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.469363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd461e4-2516-4800-a065-aed3cc50e1eb admin admin] PATH_INFO: `/v3/projects/f83e55287b974fa2a7c2e74e37b74b1f/users/8693d5f2dab04d6abfee0e725545519f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.486980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd461e4-2516-4800-a065-aed3cc50e1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83e55287b974fa2a7c2e74e37b74b1f, user_id=8693d5f2dab04d6abfee0e725545519f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:12.490336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd461e4-2516-4800-a065-aed3cc50e1eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:12.531138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b51f06c5844e30ace768840e1ad51a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:12.531865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b51f06c5844e30ace768840e1ad51a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:12.617397 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 915/1827] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:12 2022] PUT /identity/v3/projects/f83e55287b974fa2a7c2e74e37b74b1f/users/8693d5f2dab04d6abfee0e725545519f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:12.617397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.617397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.617397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.621527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:12.623618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.659619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b51f06c5844e30ace768840e1ad51a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:12.661667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b51f06c5844e30ace768840e1ad51a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:12.690044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b51f06c5844e30ace768840e1ad51a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:12.790213 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 913/1828] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:12 2022] DELETE /identity/v3/users/c3b51f06c5844e30ace768840e1ad51a => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:12.791834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:12.797319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.807358 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 916/1829] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:12.807358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:12.815544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.837080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:12.844087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd7f40-8726-4fc0-bd61-21ca9e3ea9c5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:12.887496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a5bfc-8b0e-4867-980a-d957b7e6fd4c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:12.893821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:12.894614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.894889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.895158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] PATH_INFO: `/v3/projects/585e27ca2dd143b9bb193fbebb8400e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.896374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585e27ca2dd143b9bb193fbebb8400e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:12.898364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:12.935160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28e4e3-8c72-4ec6-9017-beaa65f0099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:12.935778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28e4e3-8c72-4ec6-9017-beaa65f0099b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.936054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28e4e3-8c72-4ec6-9017-beaa65f0099b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.936324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28e4e3-8c72-4ec6-9017-beaa65f0099b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.936971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28e4e3-8c72-4ec6-9017-beaa65f0099b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:12.938625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28e4e3-8c72-4ec6-9017-beaa65f0099b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:12.948903 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 917/1830] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:12.950115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5197-c024-478f-8f4e-e73bf0030b1f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:12.950403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5197-c024-478f-8f4e-e73bf0030b1f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:12.950860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5197-c024-478f-8f4e-e73bf0030b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:12.977721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3f3b5197-c024-478f-8f4e-e73bf0030b1f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:12.980661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f3b5197-c024-478f-8f4e-e73bf0030b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:12.995723 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 918/1831] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:12.996560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5197-c024-478f-8f4e-e73bf0030b1f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:13.006710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5197-c024-478f-8f4e-e73bf0030b1f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:13.012047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:13.012654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:13.012931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:13.013204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:13.013852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:13.014258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:13.015890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:13.028162 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 919/1832] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:13.029025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:13.038943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba0269-4dc7-46e3-b863-26dfc87ad4f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:13.044045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:13.044688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:13.044955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:13.045215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] PATH_INFO: `/v3/projects/f83e55287b974fa2a7c2e74e37b74b1f/users/8693d5f2dab04d6abfee0e725545519f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:13.047343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83e55287b974fa2a7c2e74e37b74b1f, user_id=8693d5f2dab04d6abfee0e725545519f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:13.050035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:13.061252 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 920/1833] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:13 2022] PUT /identity/v3/projects/f83e55287b974fa2a7c2e74e37b74b1f/users/8693d5f2dab04d6abfee0e725545519f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:13.061990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:13.063776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:13.126606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05031d2-b561-4bea-a101-8f6f9361d131 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:13.130955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:13.131575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:13.131854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:13.132133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:13.142997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:13.211536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585e27ca2dd143b9bb193fbebb8400e5', 'request_id': 'req-8880065b-c2c7-4c20-b223-cd4a4c3c6345'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.220200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585e27ca2dd143b9bb193fbebb8400e5', 'request_id': 'req-8880065b-c2c7-4c20-b223-cd4a4c3c6345'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.221500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:13.223027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:13.236346 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 921/1834] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:13.236346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:13.244657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfd28d-279d-4abc-9861-77947b023f3a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:13.301147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585e27ca2dd143b9bb193fbebb8400e5', 'request_id': 'req-8880065b-c2c7-4c20-b223-cd4a4c3c6345'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.318276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] The token cache is being invalidate because project 585e27ca2dd143b9bb193fbebb8400e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:13.318537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.319165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:13.319684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8880065b-c2c7-4c20-b223-cd4a4c3c6345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.320621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:13.321391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:13.321391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:13.322611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:13.323248 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 914/1835] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:12 2022] DELETE /identity/v3/projects/585e27ca2dd143b9bb193fbebb8400e5 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:13.324862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:13.325390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:13.325868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:13.328674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:13.384298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] MFA Rules not processed for user `8693d5f2dab04d6abfee0e725545519f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:13.388473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:13.457205 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 922/1836] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:13 2022] POST /identity/v3/projects => generated 391 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:13.458941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:13.476369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:13.543394 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 915/1837] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:13.544031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:13.546344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:13.566661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038db6cc-ab3e-4c8c-9a8d-29374fec6a0b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:13.641263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303662b-5529-4c00-9be1-246c8893e24b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:13.650341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:13.651008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:13.654188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:13.654188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] PATH_INFO: `/v3/projects/022f553b903d498381fe3344f594cbe0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:13.654188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022f553b903d498381fe3344f594cbe0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:13.655009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:13.655738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:13.656967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:13.657778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:13.658754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] PATH_INFO: `/v3/users/f4ce8c47d08346cb977f84d401fd2b5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:13.660588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ce8c47d08346cb977f84d401fd2b5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:13.662729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:13.784163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:13.798580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022f553b903d498381fe3344f594cbe0', 'request_id': 'req-adc54ee1-67f6-4686-879c-461ea8cf72c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.806530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022f553b903d498381fe3344f594cbe0', 'request_id': 'req-adc54ee1-67f6-4686-879c-461ea8cf72c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.889935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ce8c47d08346cb977f84d401fd2b5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.891033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ce8c47d08346cb977f84d401fd2b5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.932615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022f553b903d498381fe3344f594cbe0', 'request_id': 'req-adc54ee1-67f6-4686-879c-461ea8cf72c1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.941750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] The token cache is being invalidate because project 022f553b903d498381fe3344f594cbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:13.943323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.943926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:13.948996 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 923/1838] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:13 2022] DELETE /identity/v3/projects/022f553b903d498381fe3344f594cbe0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:13.950033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:13.951811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.008864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ce8c47d08346cb977f84d401fd2b5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.009491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ce8c47d08346cb977f84d401fd2b5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.019125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ce8c47d08346cb977f84d401fd2b5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.037886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:14.041347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc54ee1-67f6-4686-879c-461ea8cf72c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:14.042701 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 916/1839] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:13 2022] DELETE /identity/v3/users/f4ce8c47d08346cb977f84d401fd2b5d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:14.043881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:14.046006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.145115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:14.146344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:14.146947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:14.147419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:14.148281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:14.150872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:14.163896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dce07-9d1d-4b36-8a58-591efd104c93 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:14.173428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:14.174701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:14.175224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:14.175714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:14.177797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.233705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:14.241644 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 924/1840] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:13 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:14.242697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:14.247393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.265224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26083e-6ddb-43e9-9b1e-e4825e6118cc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:14.272841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:14.274565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:14.277245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:14.278671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:14.279053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:14.279467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] PATH_INFO: `/v3/projects/5aad7c28c1aa4a4295bd6f77766155a2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:14.280834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aad7c28c1aa4a4295bd6f77766155a2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:14.283790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:14.287277 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 917/1841] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:14.288684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:14.290509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.306221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec721b-ae65-49fa-bb25-d2f3f17befd7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:14.311685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:14.312332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:14.312609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:14.312882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] PATH_INFO: `/v3/users/31e90bd7e03d4db38ba01eff1556d223` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:14.314036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e90bd7e03d4db38ba01eff1556d223)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:14.316186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:14.588539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aad7c28c1aa4a4295bd6f77766155a2', 'request_id': 'req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.594596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e90bd7e03d4db38ba01eff1556d223'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.595387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e90bd7e03d4db38ba01eff1556d223'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.596757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aad7c28c1aa4a4295bd6f77766155a2', 'request_id': 'req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.695734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aad7c28c1aa4a4295bd6f77766155a2', 'request_id': 'req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.708199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] The token cache is being invalidate because project 5aad7c28c1aa4a4295bd6f77766155a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:14.708457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.709228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.710886 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 925/1842] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:14 2022] DELETE /identity/v3/projects/5aad7c28c1aa4a4295bd6f77766155a2 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:14.712339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:14.714654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.782021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e90bd7e03d4db38ba01eff1556d223'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.782737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e90bd7e03d4db38ba01eff1556d223'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.791665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e90bd7e03d4db38ba01eff1556d223'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:14.820751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4955e4-8c30-4e8c-8cb8-91d608bad5b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:14.820751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:14.820751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:14.820751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:14.821174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:14.821174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:14.831834 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 918/1843] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:14 2022] DELETE /identity/v3/users/31e90bd7e03d4db38ba01eff1556d223 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:14.831834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:14.832368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.842364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:14.876474 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 926/1844] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:14.876474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:14.884751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:14.906383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e78244-3cea-47f5-b488-1381e34c67de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:14.947833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee9cd2-8a8e-4917-bd07-97d8d4a1493e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:14.955521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:14.956182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:14.956607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:14.956933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] PATH_INFO: `/v3/projects/fc2010cd6b3c4a14b4c879e7fb8bc78e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:14.960799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2010cd6b3c4a14b4c879e7fb8bc78e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:14.962945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:15.040109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:15.046876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:15.048396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:15.049426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:15.049884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] PATH_INFO: `/v3/users/f1346367474a47bc8bcaebcf6cfa1476` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:15.052157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1346367474a47bc8bcaebcf6cfa1476)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:15.055284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:15.135647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2010cd6b3c4a14b4c879e7fb8bc78e', 'request_id': 'req-b0ef8ec0-3294-42b5-8141-6f8351d6f746'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.147679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2010cd6b3c4a14b4c879e7fb8bc78e', 'request_id': 'req-b0ef8ec0-3294-42b5-8141-6f8351d6f746'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.263442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2010cd6b3c4a14b4c879e7fb8bc78e', 'request_id': 'req-b0ef8ec0-3294-42b5-8141-6f8351d6f746'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.289210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] The token cache is being invalidate because project fc2010cd6b3c4a14b4c879e7fb8bc78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:15.289210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.289210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.289210 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 919/1845] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:14 2022] DELETE /identity/v3/projects/fc2010cd6b3c4a14b4c879e7fb8bc78e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:15.289210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:15.289786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:15.294941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1346367474a47bc8bcaebcf6cfa1476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.313040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1346367474a47bc8bcaebcf6cfa1476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.313678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1346367474a47bc8bcaebcf6cfa1476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.328823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1346367474a47bc8bcaebcf6cfa1476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.405071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc4b9ead-616e-48a6-9f96-36532ec6aeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1346367474a47bc8bcaebcf6cfa1476'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.413326 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 927/1846] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:14 2022] DELETE /identity/v3/users/f1346367474a47bc8bcaebcf6cfa1476 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:15.417757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:15.418094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:15.418350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:15.444926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef8ec0-3294-42b5-8141-6f8351d6f746 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:15.457072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:15.458347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:15.545717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:15.546579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:15.546865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:15.547907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:15.548609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:15.551534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:15.577559 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 920/1847] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:15.577559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:15.583348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:15.593702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac906ceb-f766-4145-a6f4-75bdb9957615 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:15.606200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:15.618934 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 928/1848] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:15.619979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:15.620800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:15.621082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:15.621399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] PATH_INFO: `/v3/projects/5dd65effabff48d2b449eefb2fc24e93` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:15.623189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:15.625123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd65effabff48d2b449eefb2fc24e93)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:15.627174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:15.645917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:15.648831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53875ab3-a134-4964-a463-5d5f7410463b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:15.657016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d8f15-94d8-4d3c-a901-ca4529abffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:15.658670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d8f15-94d8-4d3c-a901-ca4529abffb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:15.658954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d8f15-94d8-4d3c-a901-ca4529abffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:15.659269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d8f15-94d8-4d3c-a901-ca4529abffb3 admin admin] PATH_INFO: `/v3/projects/fe238b25ea074231a99238a2b2df98ff/users/e163a7471ff84f4d99975228b20718ac/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:15.683921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d8f15-94d8-4d3c-a901-ca4529abffb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe238b25ea074231a99238a2b2df98ff, user_id=e163a7471ff84f4d99975228b20718ac, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:15.691631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d8f15-94d8-4d3c-a901-ca4529abffb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:15.811458 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 929/1849] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:15 2022] PUT /identity/v3/projects/fe238b25ea074231a99238a2b2df98ff/users/e163a7471ff84f4d99975228b20718ac/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:15.816338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8aa76-559b-4eb2-a8c4-bf562c27cfc9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:15.816338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8aa76-559b-4eb2-a8c4-bf562c27cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:15.816338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8aa76-559b-4eb2-a8c4-bf562c27cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:15.856063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2c8aa76-559b-4eb2-a8c4-bf562c27cfc9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:15.856063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2c8aa76-559b-4eb2-a8c4-bf562c27cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:15.856372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd65effabff48d2b449eefb2fc24e93', 'request_id': 'req-b6509c50-8ed8-4971-89cf-4c637f99ad79'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.865172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd65effabff48d2b449eefb2fc24e93', 'request_id': 'req-b6509c50-8ed8-4971-89cf-4c637f99ad79'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.953763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd65effabff48d2b449eefb2fc24e93', 'request_id': 'req-b6509c50-8ed8-4971-89cf-4c637f99ad79'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.981414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] The token cache is being invalidate because project 5dd65effabff48d2b449eefb2fc24e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:15.981703 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 930/1850] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:15.981930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.984611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:15.989857 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 921/1851] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:15 2022] DELETE /identity/v3/projects/5dd65effabff48d2b449eefb2fc24e93 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:15.990670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:15.993087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa0fa6-544c-487a-b055-cba84b6ea90d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:15.994044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa0fa6-544c-487a-b055-cba84b6ea90d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:15.994352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa0fa6-544c-487a-b055-cba84b6ea90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:15.995076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.050980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a7aa0fa6-544c-487a-b055-cba84b6ea90d None None] MFA Rules not processed for user `e163a7471ff84f4d99975228b20718ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:16.053207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7aa0fa6-544c-487a-b055-cba84b6ea90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.069005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6509c50-8ed8-4971-89cf-4c637f99ad79 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:16.093676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f88b4-5963-43be-b08e-9fc8d6d137d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:16.094861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f88b4-5963-43be-b08e-9fc8d6d137d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.095158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f88b4-5963-43be-b08e-9fc8d6d137d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.095469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f88b4-5963-43be-b08e-9fc8d6d137d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.096205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f88b4-5963-43be-b08e-9fc8d6d137d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:16.096519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f88b4-5963-43be-b08e-9fc8d6d137d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:16.098241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f88b4-5963-43be-b08e-9fc8d6d137d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:16.124475 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 922/1852] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:16.126114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9242ef-d5aa-4284-9fa2-727119c5430a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.126524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9242ef-d5aa-4284-9fa2-727119c5430a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.128148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9242ef-d5aa-4284-9fa2-727119c5430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.160721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab9242ef-d5aa-4284-9fa2-727119c5430a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:16.162168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab9242ef-d5aa-4284-9fa2-727119c5430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.176433 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 923/1853] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:16.177537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9242ef-d5aa-4284-9fa2-727119c5430a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:16.211084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9242ef-d5aa-4284-9fa2-727119c5430a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:16.213719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 931/1854] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:16.214009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.214381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.214582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.221010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:16.222008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:16.222240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.223299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.223807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.224724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:16.227246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:16.250015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:16.252765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.264017 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 932/1855] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:16.269278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:16.277762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.300967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142498ca-c4f5-4860-b920-bd767b2d74de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:16.306336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:16.307272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.310389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.315327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.315327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:16.315531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:16.412975 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 924/1856] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:16 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:16.417333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:16.419383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.467294 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 933/1857] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:16 2022] POST /identity/v3/projects => generated 391 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:16.467294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:16.578552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a04b-0b76-4a25-b621-df20d9363af2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:16.583278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8743c9-b6c0-4fea-a24f-624058ab822a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:16.586099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:16.587040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.587490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.587774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] PATH_INFO: `/v3/projects/79e4766e145e433487f95a83f4de3891` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.590468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e4766e145e433487f95a83f4de3891)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:16.592624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:16.594163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:16.594902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.595279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.596215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.597364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:16.597872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:16.599929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:16.618920 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 934/1858] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:16.618920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:16.618920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.650492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:16.745099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301383d-34d4-4b75-a2ab-0a3fda5bd230 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:16.754923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:16.755567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:16.755892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:16.756645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:16.759351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.787812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e4766e145e433487f95a83f4de3891', 'request_id': 'req-adfeae40-36b2-409b-9372-d0ab33bf5ccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:16.802984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e4766e145e433487f95a83f4de3891', 'request_id': 'req-adfeae40-36b2-409b-9372-d0ab33bf5ccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:16.816291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:16.859810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:16.862359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:16.901973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e4766e145e433487f95a83f4de3891', 'request_id': 'req-adfeae40-36b2-409b-9372-d0ab33bf5ccb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:16.910144 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 935/1859] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:16.911131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:16.926991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] The token cache is being invalidate because project 79e4766e145e433487f95a83f4de3891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:16.927530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:16.928490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:16.931601 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 925/1860] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:16 2022] DELETE /identity/v3/projects/79e4766e145e433487f95a83f4de3891 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:16.935469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:16.941213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:16.947493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17bcb-be3c-413d-b709-9345dabe3815 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.066138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.066817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.067106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.067377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.067887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeae40-36b2-409b-9372-d0ab33bf5ccb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.068330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.070818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:17.073605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63aaea-c2f5-4b7d-98c6-3213a9a144aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.078041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63aaea-c2f5-4b7d-98c6-3213a9a144aa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.078041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63aaea-c2f5-4b7d-98c6-3213a9a144aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.078041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63aaea-c2f5-4b7d-98c6-3213a9a144aa admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.078041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63aaea-c2f5-4b7d-98c6-3213a9a144aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.078041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63aaea-c2f5-4b7d-98c6-3213a9a144aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:17.202251 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 936/1861] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:16 2022] POST /identity/v3/users => generated 287 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:17.203465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:17.208074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:17.239852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd1b3-b265-421d-9d9f-f82226719c30 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.245781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.249604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:17.249604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.249604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.250643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.250840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.253662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:17.254152 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 926/1862] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:16 2022] POST /identity/v3/users => generated 302 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:17.259326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.260468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.263079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.317179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:17.318619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:17.331057 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 927/1863] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:17.335668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:17.335668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:17.349986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570851d5-1dd0-457a-87d9-4e86deb7c161 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.354935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49952969-aa95-4fc9-9e81-ec8f1965a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.355638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49952969-aa95-4fc9-9e81-ec8f1965a646 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.358456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49952969-aa95-4fc9-9e81-ec8f1965a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.358456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49952969-aa95-4fc9-9e81-ec8f1965a646 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.358456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49952969-aa95-4fc9-9e81-ec8f1965a646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.359065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 937/1864] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:17 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:17.364201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:17.367286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49952969-aa95-4fc9-9e81-ec8f1965a646 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:17.374103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:17.393614 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 928/1865] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:17.395520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd321-4644-447c-ac97-7bf446195c89 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.396094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd321-4644-447c-ac97-7bf446195c89 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.396433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dd321-4644-447c-ac97-7bf446195c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.419113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd5dd321-4644-447c-ac97-7bf446195c89 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:17.420685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd5dd321-4644-447c-ac97-7bf446195c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:17.504131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d234ec-3d8c-4aa5-8d64-f7723ca02c82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.525421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.534653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.534653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.534653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.534653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.534653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:17.550451 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 938/1866] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:17.551424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:17.576009 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 929/1867] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:17.580498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dd321-4644-447c-ac97-7bf446195c89 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:17.580683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380faac-7446-4962-8209-419e1798f6df admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.605457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.606187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.607224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.607224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.607455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.609287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:17.615255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dd321-4644-447c-ac97-7bf446195c89 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.630042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.643790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.643790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.643790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.643790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.643790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:17.645859 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 930/1868] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:17.646776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:17.661448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11467d9-71e4-42ec-9cc6-e6c65160437d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:17.668350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:17.669199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:17.669518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:17.669795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] PATH_INFO: `/v3/projects/711f8bdc79fa4c6eababdacc7338635a/users/e90ddc18678d45cf8681c4c0e5db9be9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:17.687278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711f8bdc79fa4c6eababdacc7338635a, user_id=e90ddc18678d45cf8681c4c0e5db9be9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:17.690489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:18.175236 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 931/1869] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:17 2022] PUT /identity/v3/projects/711f8bdc79fa4c6eababdacc7338635a/users/e90ddc18678d45cf8681c4c0e5db9be9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:18.179470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:18.186450 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 939/1870] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:17 2022] POST /identity/v3/users => generated 288 bytes in 635 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:18.187312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:18.213200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118133ac-450c-413e-8370-a3a30f35321f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:18.333925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:18.334816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.345093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:18.345093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.345093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] PATH_INFO: `/v3/projects/9bfb3b3d56c842739d5dfa14d1067a69/users/c4ea23677e724670ad407d00c39fdd0b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.368373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a0c21-8ad6-4156-82de-913e4ca5b833 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:18.375117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:18.375747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.379432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.379432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.379432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:18.379432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:18.380900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:18.381917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfb3b3d56c842739d5dfa14d1067a69, user_id=c4ea23677e724670ad407d00c39fdd0b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:18.384661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:18.399222 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 932/1871] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:18.399222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:18.432700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e167e-45ff-42a9-9ca0-e4f6b354e602 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:18.453033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:18.453676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.453957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.455358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.458507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:18.460697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:18.479716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 933/1872] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:18.480975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:18.503259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab96d1f-a225-4880-8659-45d35d59b72a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:18.524418 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 940/1873] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:18 2022] PUT /identity/v3/projects/9bfb3b3d56c842739d5dfa14d1067a69/users/c4ea23677e724670ad407d00c39fdd0b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:18.524592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:18.524702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:18.524985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.525953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.526641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.529195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:18.534706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:18.574571 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 934/1874] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:18.574571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:18.589416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c375a-3052-436d-b31f-513b73c52a1b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:18.671464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8843a9-b420-46f8-babe-140dfb44dcc7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:18.687317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:18.688329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.688937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.689965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.691738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:18.694530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:18.740812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b2a7-55d8-4d82-a16e-c84e65e0c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:18.741521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b2a7-55d8-4d82-a16e-c84e65e0c886 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.742691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b2a7-55d8-4d82-a16e-c84e65e0c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.742983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b2a7-55d8-4d82-a16e-c84e65e0c886 admin admin] PATH_INFO: `/v3/projects/711f8bdc79fa4c6eababdacc7338635a/users/e90ddc18678d45cf8681c4c0e5db9be9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.745865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136b2a7-55d8-4d82-a16e-c84e65e0c886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711f8bdc79fa4c6eababdacc7338635a, user_id=e90ddc18678d45cf8681c4c0e5db9be9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:18.749637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136b2a7-55d8-4d82-a16e-c84e65e0c886 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:18.786109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 935/1875] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:18 2022] PUT /identity/v3/projects/711f8bdc79fa4c6eababdacc7338635a/users/e90ddc18678d45cf8681c4c0e5db9be9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:18.798091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4bf0-ea34-4e8d-a3ca-94c9d84d85ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.798091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4bf0-ea34-4e8d-a3ca-94c9d84d85ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.798091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f4bf0-ea34-4e8d-a3ca-94c9d84d85ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.825567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 941/1876] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:18 2022] POST /identity/v3/projects => generated 375 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:18.826418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:18.839351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:18.842767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d58f4bf0-ea34-4e8d-a3ca-94c9d84d85ec None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:18.844247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d58f4bf0-ea34-4e8d-a3ca-94c9d84d85ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:18.966227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae3945-4580-47ac-b57a-6211a1b69459 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:18.973058 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 936/1877] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:18.973058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.973058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.973405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.981027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:18.983895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:18.984223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:18.984718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:18.987338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:18.990738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.006777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 942/1878] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:19.006777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.010167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] MFA Rules not processed for user `e90ddc18678d45cf8681c4c0e5db9be9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:19.011441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:19.036079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873fb3-f989-43d6-93cb-c9b1f0bc1e54 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.046878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.048092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.048379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.049374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.050202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.052580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.096511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:19.125520 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 937/1879] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:19.126743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.128902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:19.175694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 943/1880] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:19 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:19.177342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.190010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771c404-25fc-48f5-9c3b-008a6ca169e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.198252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.202255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.202255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.202255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] PATH_INFO: `/v3/projects/41d29c076c7d4bb288da6f42ddee05fb/users/6c1cd81ee6174cee97e384cae58a2e6a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.222284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744327d9-26cc-48e5-94d3-ebce5ea97627 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.227575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.228302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.228643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.230380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.231231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d29c076c7d4bb288da6f42ddee05fb, user_id=6c1cd81ee6174cee97e384cae58a2e6a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.237185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.243344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.247171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.261263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 938/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:19.263589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.266571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:19.331194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 944/1882] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:19 2022] PUT /identity/v3/projects/41d29c076c7d4bb288da6f42ddee05fb/users/6c1cd81ee6174cee97e384cae58a2e6a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:19.331194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.461971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38ec3-6116-47c3-bce3-2317e73d4dfb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.479417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:19.503146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad354-49d1-4827-a1b1-f3e7cf08b5a7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.508831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40efe7-5fd0-4e9c-854b-a939bc5433bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.509530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40efe7-5fd0-4e9c-854b-a939bc5433bf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.509817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40efe7-5fd0-4e9c-854b-a939bc5433bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.510113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40efe7-5fd0-4e9c-854b-a939bc5433bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.511358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40efe7-5fd0-4e9c-854b-a939bc5433bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.513428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40efe7-5fd0-4e9c-854b-a939bc5433bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.528717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 945/1883] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:19.528717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1adc-f073-4719-acd9-88c51bd8168d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.528717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1adc-f073-4719-acd9-88c51bd8168d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.529082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1adc-f073-4719-acd9-88c51bd8168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.566176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-900c1adc-f073-4719-acd9-88c51bd8168d None None] MFA Rules not processed for user `6c1cd81ee6174cee97e384cae58a2e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:19.567847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-900c1adc-f073-4719-acd9-88c51bd8168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:19.676264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.676492 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 946/1884] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:19.677625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1adc-f073-4719-acd9-88c51bd8168d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.678440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.679878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.680378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.706905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1adc-f073-4719-acd9-88c51bd8168d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.722775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.723214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.723496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.723772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.724434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.726047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.743930 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 947/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:19.744986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.780689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3721151-194e-4bba-94c0-4b5df5f674ac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.794646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.796400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.798679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.799976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.801346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:19.802330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.804364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.851055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.854886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:19.885152 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 939/1886] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:19.886134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.903167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb469c6-f987-4375-9ae4-276f6938c996 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:19.924940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4947a-eac5-4a2e-bc41-e941456ada5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:19.925630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4947a-eac5-4a2e-bc41-e941456ada5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:19.925913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4947a-eac5-4a2e-bc41-e941456ada5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:19.926217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4947a-eac5-4a2e-bc41-e941456ada5f admin admin] PATH_INFO: `/v3/projects/c0a09a005f284bfd91792e5b8d98c5c5/users/ea63df722cd44f3aa56577ecd6bc0b07/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:19.948746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4947a-eac5-4a2e-bc41-e941456ada5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a09a005f284bfd91792e5b8d98c5c5, user_id=ea63df722cd44f3aa56577ecd6bc0b07, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:19.953511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 948/1887] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:19 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:19.955281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:19.958137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4947a-eac5-4a2e-bc41-e941456ada5f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:20.086144 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 940/1888] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:19 2022] PUT /identity/v3/projects/c0a09a005f284bfd91792e5b8d98c5c5/users/ea63df722cd44f3aa56577ecd6bc0b07/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:20.087745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4b35-a1de-40d6-83ef-f329130c1fe5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:20.088040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4b35-a1de-40d6-83ef-f329130c1fe5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:20.088318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4b35-a1de-40d6-83ef-f329130c1fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:20.142609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce2c4b35-a1de-40d6-83ef-f329130c1fe5 None None] MFA Rules not processed for user `ea63df722cd44f3aa56577ecd6bc0b07`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:20.143891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce2c4b35-a1de-40d6-83ef-f329130c1fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:20.160667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:20.180619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb98c9-ea60-47e8-a1c7-4e1ab6aa73e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:20.331762 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 941/1889] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:20.338894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4b35-a1de-40d6-83ef-f329130c1fe5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:20.340587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:20.363987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:20.364617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:20.364900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:20.365174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:20.365864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:20.368158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:20.475498 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 949/1890] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:19 2022] POST /identity/v3/users => generated 294 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:20.477611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:20.506921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c85d7-e2ab-4e03-b942-fb90bdc58bc6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:20.514356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:20.515289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:20.515675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:20.516090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] PATH_INFO: `/v3/users/e163a7471ff84f4d99975228b20718ac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:20.517767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e163a7471ff84f4d99975228b20718ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:20.521586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:20.524121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4b35-a1de-40d6-83ef-f329130c1fe5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:20.533735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:20.534624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:20.536988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:20.536988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:20.536988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:20.538915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:20.588041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:20.732222 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 942/1891] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:20 2022] POST /identity/v3/projects => generated 373 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:20.733147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:20.792627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:20.849313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e163a7471ff84f4d99975228b20718ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:20.867888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e163a7471ff84f4d99975228b20718ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:20.870513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e163a7471ff84f4d99975228b20718ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:20.901045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4a9f1-601f-4a19-be3c-a33a46bab27c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:20.909587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e163a7471ff84f4d99975228b20718ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:20.913056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:20.913692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:20.914038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:20.915528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:20.916206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:20.919636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:20.941183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 943/1892] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:20.941183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:20.941183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:20.959667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b72e44-882b-4af5-b4a9-893abf59602c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:20.966220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:20.968881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:20.968881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:20.968881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] PATH_INFO: `/v3/users/ec8eeb514304488eb80bcaae352b2a03` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:20.969313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8eeb514304488eb80bcaae352b2a03)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:20.973030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:20.987164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e163a7471ff84f4d99975228b20718ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:20.993866 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 950/1893] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:20 2022] DELETE /identity/v3/users/e163a7471ff84f4d99975228b20718ac => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:20.995326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:20.998993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:21.085010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095541ce-5367-4817-85aa-b553f165730c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.091113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.091741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.092028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.092304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.093001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.095041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.216711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8eeb514304488eb80bcaae352b2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:21.219799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8eeb514304488eb80bcaae352b2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:21.232753 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 951/1894] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:20 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:21.236685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.237769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:21.253302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9af4-a947-41ec-b143-7859a194d055 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.258169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.258830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.259111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.259381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] PATH_INFO: `/v3/projects/dd3aea217bc34d51b6816c2f220d1c5e/users/c8ff684c96ea4fc9beee82ff1c825ee4/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.276854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3aea217bc34d51b6816c2f220d1c5e, user_id=c8ff684c96ea4fc9beee82ff1c825ee4, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.280228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.312611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:21.313715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8eeb514304488eb80bcaae352b2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:21.314615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8eeb514304488eb80bcaae352b2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:21.323463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2e6de258-a1c2-4435-94af-a9e8a24f6292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8eeb514304488eb80bcaae352b2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:21.343678 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 944/1895] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:20 2022] DELETE /identity/v3/users/ec8eeb514304488eb80bcaae352b2a03 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:21.344785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b9b70-6cff-46ba-b348-5d5d512297f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.345065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b9b70-6cff-46ba-b348-5d5d512297f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.345940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b9b70-6cff-46ba-b348-5d5d512297f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.370553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-265b9b70-6cff-46ba-b348-5d5d512297f9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:21.371788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-265b9b70-6cff-46ba-b348-5d5d512297f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:21.380547 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 952/1896] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:21 2022] PUT /identity/v3/projects/dd3aea217bc34d51b6816c2f220d1c5e/users/c8ff684c96ea4fc9beee82ff1c825ee4/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:21.381585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.384362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:21.467518 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 945/1897] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:21.476273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:21.483538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa57b3c-6313-4aef-af90-baa6102e2486 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.484511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa57b3c-6313-4aef-af90-baa6102e2486 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.485570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa57b3c-6313-4aef-af90-baa6102e2486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.515134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc8c41-7d16-4bd1-b7dd-447386653d59 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.528528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.529239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.529588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.529927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.530664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.533882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.534739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6aa57b3c-6313-4aef-af90-baa6102e2486 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:21.537508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aa57b3c-6313-4aef-af90-baa6102e2486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:21.562876 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 946/1899] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:21.564481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa57b3c-6313-4aef-af90-baa6102e2486 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.565240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 953/1899] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:21.570015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.574667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:21.581341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa57b3c-6313-4aef-af90-baa6102e2486 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.588396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.590292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.590786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.591274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.592189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.594707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.609504 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 947/1900] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:21.610751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.631148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaecc2-fee5-41c6-9033-d603de8576f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.660412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.662220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.662721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.669648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] PATH_INFO: `/v3/projects/8b0c4234bc964d13a55bf8437bb851e1/users/5759fdfe9edb4bcfa184c8ddc5af7b43/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.690681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0c4234bc964d13a55bf8437bb851e1, user_id=5759fdfe9edb4bcfa184c8ddc5af7b43, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.695672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.697905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1b8c4-f202-458b-838b-83194e3db36d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.712168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.714091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.714401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.714687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.736927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.738617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.747631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:21.757058 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 954/1901] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:21.757947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.759354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:21.772436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27a51-e364-482b-becd-9b7c2f8d4993 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.777088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.778012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.778335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.778784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.792098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 948/1902] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:21 2022] PUT /identity/v3/projects/8b0c4234bc964d13a55bf8437bb851e1/users/5759fdfe9edb4bcfa184c8ddc5af7b43/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:21.792932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.794444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.795845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.812671 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 955/1903] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:21.813613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.827718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4fbf3-c056-40a6-8ea6-72bc04fd0aa5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.911309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.912384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.912384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.912586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.913270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.915152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:21.928973 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 956/1904] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:21.932740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:21.956229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cdbf1-914a-4b76-90f4-3c0f006cb951 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.967360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de1c5-3bf8-4b96-83b2-70effdc81b4c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:21.983338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54afcd4-6598-4271-be70-7fc2a68301cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.989290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54afcd4-6598-4271-be70-7fc2a68301cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.989290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54afcd4-6598-4271-be70-7fc2a68301cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.989555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930e5fd-7246-47d9-a1d2-fd67a79b2f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:21.989675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e5fd-7246-47d9-a1d2-fd67a79b2f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:21.989859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e5fd-7246-47d9-a1d2-fd67a79b2f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:21.990087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54afcd4-6598-4271-be70-7fc2a68301cc admin admin] PATH_INFO: `/v3/projects/8b0c4234bc964d13a55bf8437bb851e1/users/5759fdfe9edb4bcfa184c8ddc5af7b43/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.991839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e5fd-7246-47d9-a1d2-fd67a79b2f05 admin admin] PATH_INFO: `/v3/projects/dd3aea217bc34d51b6816c2f220d1c5e/users/c8ff684c96ea4fc9beee82ff1c825ee4/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:21.995717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930e5fd-7246-47d9-a1d2-fd67a79b2f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3aea217bc34d51b6816c2f220d1c5e, user_id=c8ff684c96ea4fc9beee82ff1c825ee4, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.998849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54afcd4-6598-4271-be70-7fc2a68301cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0c4234bc964d13a55bf8437bb851e1, user_id=5759fdfe9edb4bcfa184c8ddc5af7b43, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:21.999004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930e5fd-7246-47d9-a1d2-fd67a79b2f05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:22.009481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54afcd4-6598-4271-be70-7fc2a68301cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:22.045093 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 949/1905] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:21 2022] PUT /identity/v3/projects/dd3aea217bc34d51b6816c2f220d1c5e/users/c8ff684c96ea4fc9beee82ff1c825ee4/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:22.046532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19bc7-c023-41a4-aa65-47b440f5dbfd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:22.058596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19bc7-c023-41a4-aa65-47b440f5dbfd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:22.058741 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 957/1906] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:21 2022] PUT /identity/v3/projects/8b0c4234bc964d13a55bf8437bb851e1/users/5759fdfe9edb4bcfa184c8ddc5af7b43/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:22.058830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19bc7-c023-41a4-aa65-47b440f5dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:22.067733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f821-47b6-41c2-b789-c508ca84a774 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:22.068488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f821-47b6-41c2-b789-c508ca84a774 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:22.069093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f821-47b6-41c2-b789-c508ca84a774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:22.115119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09d19bc7-c023-41a4-aa65-47b440f5dbfd None None] MFA Rules not processed for user `d75623286dda46cfb4d8d70608655b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:22.116364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09d19bc7-c023-41a4-aa65-47b440f5dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:22.144706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8620f821-47b6-41c2-b789-c508ca84a774 None None] MFA Rules not processed for user `5759fdfe9edb4bcfa184c8ddc5af7b43`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:22.148525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8620f821-47b6-41c2-b789-c508ca84a774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:22.198434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:22.275669 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 950/1907] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:22.278174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:22.278174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:22.279653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:22.334863 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 958/1908] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:22.359080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:22.371118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] MFA Rules not processed for user `c8ff684c96ea4fc9beee82ff1c825ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:22.372351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:22.530405 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 951/1909] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:22.543797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:22.544949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:22.546419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:22.588725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] MFA Rules not processed for user `6c1cd81ee6174cee97e384cae58a2e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:22.590528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:22.673595 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 959/1910] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:22.753162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:22.756506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:22.763755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:22.765345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:22.775700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:22.995288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277e290-5c2d-48b0-a7c9-e40e352e44cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:23.004528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:23.005188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:23.010449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:23.010449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] PATH_INFO: `/v3/projects/c4f48cdf69404af3abe024e41fc47658` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:23.010449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f48cdf69404af3abe024e41fc47658)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:23.010449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:23.073903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e26aee-09e4-4692-9f0a-fbb66c98ef5d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:23.087824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:23.088498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:23.088895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:23.089177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:23.109980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:23.111898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:23.135102 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 960/1911] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:25:23.159754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:23.172914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f48cdf69404af3abe024e41fc47658', 'request_id': 'req-02a04583-2ada-4401-a00f-f778f93f2fe3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:23.185477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f48cdf69404af3abe024e41fc47658', 'request_id': 'req-02a04583-2ada-4401-a00f-f778f93f2fe3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:23.284881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:23.287292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f48cdf69404af3abe024e41fc47658', 'request_id': 'req-02a04583-2ada-4401-a00f-f778f93f2fe3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:23.318587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] The token cache is being invalidate because project c4f48cdf69404af3abe024e41fc47658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:23.319069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:23.322254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313f051-d91e-485f-a996-c6a47d0dd2b4 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:23.328361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:23.335051 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 952/1912] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:22 2022] DELETE /identity/v3/projects/c4f48cdf69404af3abe024e41fc47658 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:23.360243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:23.362090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:23.533608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:23.537025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:23.537547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:23.538660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:23.543580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:23.596050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04583-2ada-4401-a00f-f778f93f2fe3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:23.608497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:23.609530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:23.610405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:23.610927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] PATH_INFO: `/v3/users/8693d5f2dab04d6abfee0e725545519f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:23.613818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8693d5f2dab04d6abfee0e725545519f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:23.617828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:23.661950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:23.671740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:23.689844 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 961/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:24.170148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:24.191711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8693d5f2dab04d6abfee0e725545519f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:24.193794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8693d5f2dab04d6abfee0e725545519f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:24.232929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:24.239852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:24.269532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae862f-26f0-43f0-af1b-8c6d15a46cbf service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:24.276129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:24.276976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:24.277403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:24.277850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:24.279898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:24.289448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8693d5f2dab04d6abfee0e725545519f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:24.290366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8693d5f2dab04d6abfee0e725545519f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:24.301706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8693d5f2dab04d6abfee0e725545519f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:24.347065 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 953/1914] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:23 2022] DELETE /identity/v3/users/8693d5f2dab04d6abfee0e725545519f => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:24.409847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:24.411495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:24.433788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 962/1915] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:24.502694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:24.504174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:24.661104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b3c-7330-4f85-a307-6d0eb48f3e00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:24.679763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:24.681233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:24.681927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:24.682268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] PATH_INFO: `/v3/projects/fe238b25ea074231a99238a2b2df98ff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:24.683710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe238b25ea074231a99238a2b2df98ff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:24.685790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:24.875589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe238b25ea074231a99238a2b2df98ff', 'request_id': 'req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:24.896317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:24.898320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe238b25ea074231a99238a2b2df98ff', 'request_id': 'req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:24.997630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe238b25ea074231a99238a2b2df98ff', 'request_id': 'req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.021055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] The token cache is being invalidate because project fe238b25ea074231a99238a2b2df98ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:25.022411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.023275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.031523 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 954/1916] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:24 2022] DELETE /identity/v3/projects/fe238b25ea074231a99238a2b2df98ff => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:25.035481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:25.055091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c14ae5-569a-4eac-8286-85738c6e5099 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:25.241167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:25.242131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:25.258408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:25.258717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] PATH_INFO: `/v3/users/e90ddc18678d45cf8681c4c0e5db9be9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:25.269286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90ddc18678d45cf8681c4c0e5db9be9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:25.271295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:25.688770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90ddc18678d45cf8681c4c0e5db9be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.697363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90ddc18678d45cf8681c4c0e5db9be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.698287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90ddc18678d45cf8681c4c0e5db9be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.714374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90ddc18678d45cf8681c4c0e5db9be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.924881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90ddc18678d45cf8681c4c0e5db9be9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:25.940925 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 963/1917] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:25 2022] DELETE /identity/v3/users/e90ddc18678d45cf8681c4c0e5db9be9 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:26.064321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:26.078813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:26.120821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:26.122775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:26.138860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f26c-8a0e-41ab-95fc-6ff5f68b4aba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:26.334404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:26.335448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:26.336153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:26.336653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] PATH_INFO: `/v3/users/ea63df722cd44f3aa56577ecd6bc0b07` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:26.339365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea63df722cd44f3aa56577ecd6bc0b07)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:26.343264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:26.398658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07b5c8-1aaf-41fc-bec8-3655bc056d5e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:26.418289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:26.419796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:26.420247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:26.427471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] PATH_INFO: `/v3/projects/f83e55287b974fa2a7c2e74e37b74b1f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:26.447527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83e55287b974fa2a7c2e74e37b74b1f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:26.450032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:26.623046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea63df722cd44f3aa56577ecd6bc0b07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.623991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea63df722cd44f3aa56577ecd6bc0b07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.656277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83e55287b974fa2a7c2e74e37b74b1f', 'request_id': 'req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.670031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83e55287b974fa2a7c2e74e37b74b1f', 'request_id': 'req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.728924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea63df722cd44f3aa56577ecd6bc0b07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.729616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea63df722cd44f3aa56577ecd6bc0b07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.747136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8f703f9c-2f42-46c7-864b-3757d4f21ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea63df722cd44f3aa56577ecd6bc0b07'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.775097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 955/1918] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:26 2022] DELETE /identity/v3/users/ea63df722cd44f3aa56577ecd6bc0b07 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:26.781762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:26.782289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:26.783303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:26.786828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83e55287b974fa2a7c2e74e37b74b1f', 'request_id': 'req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.804798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] The token cache is being invalidate because project f83e55287b974fa2a7c2e74e37b74b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:26.805478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.806727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc57db5d-b34f-4ec1-9df2-91f87b9cf24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:26.811510 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 964/1919] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:26 2022] DELETE /identity/v3/projects/f83e55287b974fa2a7c2e74e37b74b1f => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:26.818173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cded4f-b84b-4aeb-a07e-9237ce80e072 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:26.819687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cded4f-b84b-4aeb-a07e-9237ce80e072 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:26.820776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cded4f-b84b-4aeb-a07e-9237ce80e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:26.830709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:26.832256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:26.925733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e5cded4f-b84b-4aeb-a07e-9237ce80e072 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:26.928739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5cded4f-b84b-4aeb-a07e-9237ce80e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:27.012435 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 956/1920] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:27.020374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:27.021863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:27.181507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:27.183006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 965/1921] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:27.184397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e93e5-b8ae-433f-baa2-2b2ed9df02a3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.184677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e93e5-b8ae-433f-baa2-2b2ed9df02a3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.184953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e93e5-b8ae-433f-baa2-2b2ed9df02a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.198757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85150ff2-2a40-4eb9-8732-18ac2d913b1b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:27.211034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd42d2-5308-4efa-9ed3-a20080a4b95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:27.211959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd42d2-5308-4efa-9ed3-a20080a4b95c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.212390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd42d2-5308-4efa-9ed3-a20080a4b95c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.212882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd42d2-5308-4efa-9ed3-a20080a4b95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.231931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f84e93e5-b8ae-433f-baa2-2b2ed9df02a3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:27.233175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f84e93e5-b8ae-433f-baa2-2b2ed9df02a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:27.262133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd42d2-5308-4efa-9ed3-a20080a4b95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:27.269066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd42d2-5308-4efa-9ed3-a20080a4b95c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:27.277235 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 966/1922] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:27.282235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e93e5-b8ae-433f-baa2-2b2ed9df02a3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:27.294435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e93e5-b8ae-433f-baa2-2b2ed9df02a3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:27.307077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:27.307783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.309106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.309407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.310123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:27.310423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:27.315368 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 957/1923] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:25:27.317850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:27.348555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 967/1924] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:27.350322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:27.351092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.351613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.352030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.374186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdaa43-e527-48be-bddb-ef58219fcee5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:27.408764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:27.412886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:27.421682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:27.421945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.424182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.424676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.426021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:27.435947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:27.549808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 958/1925] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:25:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:27.566190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:27.568943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:27.588569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 968/1926] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:27.600144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:27.707832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002976c-6d7b-4f68-b941-50a006c9ab0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:27.729441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b546d17-efe3-488b-bd6a-e8890dbfe7a9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:27.754312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:27.755168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.755616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.756038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.756888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:27.761357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:27.787468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:27.788415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.789072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.789183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.856275 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 969/1927] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:27 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:25:27.857421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:27.860682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:27.889740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e658e1e-1e78-4dec-ab33-59bffbacd541 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:27.902414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:27.915289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:27.916792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:27.917399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] PATH_INFO: `/v3/projects/711f8bdc79fa4c6eababdacc7338635a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:27.923850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] RBAC: Authorizing `identity:delete_project(project_id=711f8bdc79fa4c6eababdacc7338635a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:27.929887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:27.985795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:27.990923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:27.999461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:28.007401 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 959/1928] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:25:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:25:28.009476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:28.030822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493e1c-d82a-44bd-965c-19e7ff59f59d service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:28.037810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:28.038753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.039176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.039459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.040476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:28.050552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:28.067766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 960/1929] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:28.068791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:28.112645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803e66-2c1b-4774-b5bc-f189eddea311 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:28.147110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:28.147765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.148186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.149733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.150448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:28.163144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:28.193705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711f8bdc79fa4c6eababdacc7338635a', 'request_id': 'req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:28.194192 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 961/1930] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:28.195475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:28.212902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711f8bdc79fa4c6eababdacc7338635a', 'request_id': 'req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:28.234244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b6815-9c8a-4541-8534-48f0d86ff465 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:28.369799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711f8bdc79fa4c6eababdacc7338635a', 'request_id': 'req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:28.389747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] The token cache is being invalidate because project 711f8bdc79fa4c6eababdacc7338635a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:28.390569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:28.394917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecea9afc-5374-4e95-9c9e-fbfcf1d6070c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:28.399729 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 970/1931] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:27 2022] DELETE /identity/v3/projects/711f8bdc79fa4c6eababdacc7338635a => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:28.405788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072d533-39d1-499e-99df-f359539b5556 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.406975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072d533-39d1-499e-99df-f359539b5556 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.407466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072d533-39d1-499e-99df-f359539b5556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.428686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2d869-bb96-44e4-9dd7-b19acdee78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:28.431955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d869-bb96-44e4-9dd7-b19acdee78bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.432249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d869-bb96-44e4-9dd7-b19acdee78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.432520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d869-bb96-44e4-9dd7-b19acdee78bd admin admin] PATH_INFO: `/v3/projects/94227cb311344970a78b9cb9fc7857aa/users/b81559f73f574dfe9e916117cbfcbf27/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.482730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2d869-bb96-44e4-9dd7-b19acdee78bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=94227cb311344970a78b9cb9fc7857aa, user_id=b81559f73f574dfe9e916117cbfcbf27, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:28.486417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2d869-bb96-44e4-9dd7-b19acdee78bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:28.506530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4072d533-39d1-499e-99df-f359539b5556 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:28.508148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4072d533-39d1-499e-99df-f359539b5556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:28.527512 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 971/1932] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:28.536408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d6a0b-4717-4064-8b32-990754a31eff None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.537344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d6a0b-4717-4064-8b32-990754a31eff None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.537837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d6a0b-4717-4064-8b32-990754a31eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.589132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2f3d6a0b-4717-4064-8b32-990754a31eff None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:28.589391 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 962/1933] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:28 2022] PUT /identity/v3/projects/94227cb311344970a78b9cb9fc7857aa/users/b81559f73f574dfe9e916117cbfcbf27/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:28.600703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f3d6a0b-4717-4064-8b32-990754a31eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:28.602077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.602385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.602809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.710521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] MFA Rules not processed for user `b81559f73f574dfe9e916117cbfcbf27`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:28.713507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:28.778596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 972/1934] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:28.779704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d6a0b-4717-4064-8b32-990754a31eff None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:28.802226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d6a0b-4717-4064-8b32-990754a31eff None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:28.820290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:28.820933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.821210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.821483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.822556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:28.822556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:28.824699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:28.856804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 973/1935] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:28.858793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:28.875108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040846c-2507-48fd-9196-f4fe63543cc5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:28.880867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:28.881663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.882023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.883389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.884087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:28.887261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:28.906756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 963/1936] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:28.914548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:28.916526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:28.935412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a42c2-f38c-42f5-b2ad-a642aa93ca0e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:28.954960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:28.955792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:28.956167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:28.956540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:28.957285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:28.959593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.030987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:29.032211 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 974/1937] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:28 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:29.034568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.037062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:29.077702 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 964/1938] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:28 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:29.078674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.216561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c0017-fd5b-4b81-91de-677bcb3cb64f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.227480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.228475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.228475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.229175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:29.231253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:29.233625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.246595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1963a-def3-4608-9463-1116b194f66f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.257558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.260741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.261053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.261369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] PATH_INFO: `/v3/projects/c0a09a005f284bfd91792e5b8d98c5c5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:29.264340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a09a005f284bfd91792e5b8d98c5c5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:29.271620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.382538 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 965/1939] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:29 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:29.383363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.396364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547a67e-4653-4163-87e8-885984c28caf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.401482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.408161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.408161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.408161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:29.408161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:29.408161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.436726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a09a005f284bfd91792e5b8d98c5c5', 'request_id': 'req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:29.471177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a09a005f284bfd91792e5b8d98c5c5', 'request_id': 'req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:29.515912 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 966/1940] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:29 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:29.515912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.528746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4928-d35e-42a7-a21a-ea1ee2e1cea5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.569492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a09a005f284bfd91792e5b8d98c5c5', 'request_id': 'req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:29.586874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] The token cache is being invalidate because project c0a09a005f284bfd91792e5b8d98c5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:29.587418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:29.588624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:29.593349 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 975/1941] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:29 2022] DELETE /identity/v3/projects/c0a09a005f284bfd91792e5b8d98c5c5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:29.595568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.603554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:29.687225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.689343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.689822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.690414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:29.692449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:29.695414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.734138 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 967/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:29.738538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.746150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:29.785833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af30c-0cad-45ad-b317-5d234a1a5f32 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.792035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.792740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.793023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.793449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] PATH_INFO: `/v3/users/5759fdfe9edb4bcfa184c8ddc5af7b43` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:29.794830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5759fdfe9edb4bcfa184c8ddc5af7b43)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:29.797563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.804853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012f84-ad84-42bd-80ca-6bbdf1e10f1b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.811465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.812098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.812381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.812656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:29.814886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:29.816888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.834360 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 976/1943] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:29.863780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.865696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:29.869842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:29.911161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff658-57be-4545-aca2-c0394a383398 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.926623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.927553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.927553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.927861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:29.928534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:29.930207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:29.951040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 977/1944] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:29.952547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:29.973196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a471d-b709-4c4c-9f0d-472883b4eb77 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:29.976887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:29.978691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:29.980023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:29.980894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] PATH_INFO: `/v3/projects/2ff47eff51a744b4a92c84a0b4a23f0f/users/12b4daf685274bdc9907b4fee40ea874/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.026898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff47eff51a744b4a92c84a0b4a23f0f, user_id=12b4daf685274bdc9907b4fee40ea874, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:30.030527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:30.093210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5759fdfe9edb4bcfa184c8ddc5af7b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:30.094198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5759fdfe9edb4bcfa184c8ddc5af7b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:30.119741 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 978/1945] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:29 2022] PUT /identity/v3/projects/2ff47eff51a744b4a92c84a0b4a23f0f/users/12b4daf685274bdc9907b4fee40ea874/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:30.124943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:30.132233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:30.235463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adde29-89ee-43b6-a3ae-5bb6e073c47b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:30.243659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:30.244525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:30.244986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:30.245273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] PATH_INFO: `/v3/projects/4e1855b01b724eefb99994625cc414c8/users/e3d195b4ef374907b6dced181c30612f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.249758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5759fdfe9edb4bcfa184c8ddc5af7b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:30.251456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5759fdfe9edb4bcfa184c8ddc5af7b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:30.268675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ece36464-2c4f-45a9-8645-784296b4f53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5759fdfe9edb4bcfa184c8ddc5af7b43'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:30.274137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1855b01b724eefb99994625cc414c8, user_id=e3d195b4ef374907b6dced181c30612f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:30.279100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:30.300329 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 968/1946] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:29 2022] DELETE /identity/v3/users/5759fdfe9edb4bcfa184c8ddc5af7b43 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:30.301748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303a210-c28c-4892-a338-a5d6f7f40bb7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:30.302037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303a210-c28c-4892-a338-a5d6f7f40bb7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:30.302343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303a210-c28c-4892-a338-a5d6f7f40bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.323714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1303a210-c28c-4892-a338-a5d6f7f40bb7 None None] MFA Rules not processed for user `356ffdf6f40b4d71a7f39c414c008491`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:30.324989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1303a210-c28c-4892-a338-a5d6f7f40bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:30.381338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 979/1947] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:30 2022] PUT /identity/v3/projects/4e1855b01b724eefb99994625cc414c8/users/e3d195b4ef374907b6dced181c30612f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:30.381338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:30.381338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:30.433804 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 969/1948] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:30.438865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19390e12-9c96-4863-9ae2-42b0b989d0ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:30.438865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19390e12-9c96-4863-9ae2-42b0b989d0ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:30.439191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19390e12-9c96-4863-9ae2-42b0b989d0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.500288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:30.542400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-19390e12-9c96-4863-9ae2-42b0b989d0ec None None] MFA Rules not processed for user `e3d195b4ef374907b6dced181c30612f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:30.544838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-19390e12-9c96-4863-9ae2-42b0b989d0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:30.599129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e43ca-9f2a-48fe-841e-4ba61c8682a4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:30.612502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:30.613560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:30.613947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:30.614468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.615330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:30.617234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:30.641035 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 980/1949] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:30.643271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:30.662267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86501246-408f-46fa-a912-f829072e9398 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:30.676996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c409e4-6b99-4aa2-89a6-19e6cfefd29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:30.676996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c409e4-6b99-4aa2-89a6-19e6cfefd29b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:30.676996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c409e4-6b99-4aa2-89a6-19e6cfefd29b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:30.676996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c409e4-6b99-4aa2-89a6-19e6cfefd29b admin admin] PATH_INFO: `/v3/projects/2ff47eff51a744b4a92c84a0b4a23f0f/users/12b4daf685274bdc9907b4fee40ea874/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.679151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c409e4-6b99-4aa2-89a6-19e6cfefd29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff47eff51a744b4a92c84a0b4a23f0f, user_id=12b4daf685274bdc9907b4fee40ea874, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:30.682403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c409e4-6b99-4aa2-89a6-19e6cfefd29b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:30.707274 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 970/1950] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:30.718329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19390e12-9c96-4863-9ae2-42b0b989d0ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:30.728561 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 981/1951] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:30 2022] PUT /identity/v3/projects/2ff47eff51a744b4a92c84a0b4a23f0f/users/12b4daf685274bdc9907b4fee40ea874/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:30.730442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36ba3-a6f7-4b14-ae13-00460b2be55d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:30.730963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36ba3-a6f7-4b14-ae13-00460b2be55d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:30.731455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f36ba3-a6f7-4b14-ae13-00460b2be55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.742557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19390e12-9c96-4863-9ae2-42b0b989d0ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:30.773061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-78f36ba3-a6f7-4b14-ae13-00460b2be55d None None] MFA Rules not processed for user `12b4daf685274bdc9907b4fee40ea874`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:30.775491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78f36ba3-a6f7-4b14-ae13-00460b2be55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:30.862386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:30.865721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:30.866153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:30.867780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:30.868568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:30.880398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:30.912373 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 982/1952] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:31.016551 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 971/1953] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:30 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:31.021995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f36ba3-a6f7-4b14-ae13-00460b2be55d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:31.039615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f36ba3-a6f7-4b14-ae13-00460b2be55d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:31.131358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:31.132133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.132511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.133120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.133862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:31.138190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:31.265610 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 983/1954] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:31 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:31.269930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:31.285413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870824-42e5-4613-adcc-c8b71b362ad6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:31.303587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:31.304221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.304499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.304770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.305923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:31.307038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:31.340446 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 972/1955] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:31.340588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:31.356608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab2ed3-344b-4dc2-be1a-25f6a11f8b66 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:31.365548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:31.366363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.366708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.366989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] PATH_INFO: `/v3/projects/3d6e3d615d3f4877bbad43bc95efccfb/users/9cd2c0e2bc124548ad019607c0ac90c8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.392150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e3d615d3f4877bbad43bc95efccfb, user_id=9cd2c0e2bc124548ad019607c0ac90c8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:31.395463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:31.415790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:31.424218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:31.434450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702874d-c9b0-48d2-a0c5-08f2405cd2e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:31.440245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:31.441104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.441466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.441739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] PATH_INFO: `/v3/projects/8b0c4234bc964d13a55bf8437bb851e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.442934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0c4234bc964d13a55bf8437bb851e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:31.444911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:31.490353 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 984/1956] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:31 2022] PUT /identity/v3/projects/3d6e3d615d3f4877bbad43bc95efccfb/users/9cd2c0e2bc124548ad019607c0ac90c8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:31.491279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:31.495094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:31.628514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fba221-cf0f-4963-b39b-7667b0bd5458 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:31.639130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0c4234bc964d13a55bf8437bb851e1', 'request_id': 'req-0155b744-7a11-41f2-913a-672fbca003b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:31.646222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0c4234bc964d13a55bf8437bb851e1', 'request_id': 'req-0155b744-7a11-41f2-913a-672fbca003b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:31.711564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be62e3-f219-4170-946c-b5f58dd7c1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:31.712413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be62e3-f219-4170-946c-b5f58dd7c1f4 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.712532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be62e3-f219-4170-946c-b5f58dd7c1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.712720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be62e3-f219-4170-946c-b5f58dd7c1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.746533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0c4234bc964d13a55bf8437bb851e1', 'request_id': 'req-0155b744-7a11-41f2-913a-672fbca003b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:31.761152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] The token cache is being invalidate because project 8b0c4234bc964d13a55bf8437bb851e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:31.763644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:31.764835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:31.785546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 973/1957] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:31 2022] DELETE /identity/v3/projects/8b0c4234bc964d13a55bf8437bb851e1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:31.786418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:31.790896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:31.823859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be62e3-f219-4170-946c-b5f58dd7c1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:31.825661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be62e3-f219-4170-946c-b5f58dd7c1f4 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:31.839691 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 985/1958] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:31.841582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbec2-bc7c-4b43-bb4f-b44284076aa8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.841877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbec2-bc7c-4b43-bb4f-b44284076aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.842257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bbec2-bc7c-4b43-bb4f-b44284076aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.850472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:31.892274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-842bbec2-bc7c-4b43-bb4f-b44284076aa8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:31.893973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-842bbec2-bc7c-4b43-bb4f-b44284076aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:31.916004 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 986/1959] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:31.916513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b744-7a11-41f2-913a-672fbca003b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:31.924978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a7e30-2e95-4a29-a533-f274e4e65c89 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.925316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a7e30-2e95-4a29-a533-f274e4e65c89 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.925634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a7e30-2e95-4a29-a533-f274e4e65c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.930046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:31.934469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:31.934469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:31.934469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:31.935351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:31.938635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:31.991724 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 974/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:31.991724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:31.996511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-db8a7e30-2e95-4a29-a533-f274e4e65c89 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:32.000362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db8a7e30-2e95-4a29-a533-f274e4e65c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:32.020455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348be876-ee49-4481-b262-e1940824ef7f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:32.025086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 987/1961] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:32.026885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a7e30-2e95-4a29-a533-f274e4e65c89 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:32.036875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f80ae-a86a-4f8e-b54b-c09953f0a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:32.037555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f80ae-a86a-4f8e-b54b-c09953f0a226 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:32.037835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f80ae-a86a-4f8e-b54b-c09953f0a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:32.038127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f80ae-a86a-4f8e-b54b-c09953f0a226 admin admin] PATH_INFO: `/v3/projects/3d6e3d615d3f4877bbad43bc95efccfb/users/9cd2c0e2bc124548ad019607c0ac90c8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:32.049131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f80ae-a86a-4f8e-b54b-c09953f0a226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6e3d615d3f4877bbad43bc95efccfb, user_id=9cd2c0e2bc124548ad019607c0ac90c8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:32.049534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a7e30-2e95-4a29-a533-f274e4e65c89 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:32.050396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f80ae-a86a-4f8e-b54b-c09953f0a226 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:32.062676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:32.063317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:32.064295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:32.064295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:32.069263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:32.070667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:32.074076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:32.080263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 975/1962] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:31 2022] PUT /identity/v3/projects/3d6e3d615d3f4877bbad43bc95efccfb/users/9cd2c0e2bc124548ad019607c0ac90c8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:32.091026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff957bf-0348-4574-b916-b669431ec51b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:32.091333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff957bf-0348-4574-b916-b669431ec51b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:32.091682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff957bf-0348-4574-b916-b669431ec51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:32.119776 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 988/1963] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:32.136050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:32.162707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc03cb-96f0-4c5d-bf67-fcd257cb0b6a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:32.188919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ff957bf-0348-4574-b916-b669431ec51b None None] MFA Rules not processed for user `9cd2c0e2bc124548ad019607c0ac90c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:32.194105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ff957bf-0348-4574-b916-b669431ec51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:32.238244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:32.348978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:32.349709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:32.349995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:32.351102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:32.354485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:32.354485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:32.414531 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 976/1964] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:32.481069 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 989/1965] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:32 2022] POST /identity/v3/projects => generated 393 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:32.485198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff957bf-0348-4574-b916-b669431ec51b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:32.502495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff957bf-0348-4574-b916-b669431ec51b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:32.633446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:32.692231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:32.695031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:32.695459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:32.695929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:32.697747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:32.702339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:32.848740 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 977/1966] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:32 2022] POST /identity/v3/users => generated 297 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:32.851383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:32.871539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7c21-a716-4156-a26f-5730382c2274 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:32.892418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:32.893094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:32.893330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:32.899923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:32.899923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:32.899923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:32.942194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 990/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:32.946393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:32.960384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356d08-9107-4712-a5d3-19b72b095bfc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:32.987482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b590e-7014-4668-8ede-9ca4f4721e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:32.991614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b590e-7014-4668-8ede-9ca4f4721e7e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:32.991614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b590e-7014-4668-8ede-9ca4f4721e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:32.991614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b590e-7014-4668-8ede-9ca4f4721e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:32.997445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b590e-7014-4668-8ede-9ca4f4721e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:32.999339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b590e-7014-4668-8ede-9ca4f4721e7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:33.016240 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 978/1968] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:33.016913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:33.030251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b457a7-5a98-4b60-a7ae-5618c8a83660 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:33.044489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:33.064802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:33.065753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:33.065753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:33.066459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] PATH_INFO: `/v3/projects/cf906474fe8e4747a30df079229201fb/users/65586f503c3b4c5eb44d791c22b1b990/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:33.083163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986d2a-cc4d-44a3-aefb-4db396a04918 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:33.084234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986d2a-cc4d-44a3-aefb-4db396a04918 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:33.084579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986d2a-cc4d-44a3-aefb-4db396a04918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:33.114170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf906474fe8e4747a30df079229201fb, user_id=65586f503c3b4c5eb44d791c22b1b990, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:33.116894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:33.136741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-91986d2a-cc4d-44a3-aefb-4db396a04918 None None] MFA Rules not processed for user `c4ea23677e724670ad407d00c39fdd0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:33.138310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91986d2a-cc4d-44a3-aefb-4db396a04918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:33.224925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 979/1969] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:33.238728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:33.257778 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 991/1970] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:33 2022] PUT /identity/v3/projects/cf906474fe8e4747a30df079229201fb/users/65586f503c3b4c5eb44d791c22b1b990/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:33.259540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02c69-8a98-4fa4-adf3-87839cb3261b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:33.259830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02c69-8a98-4fa4-adf3-87839cb3261b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:33.260312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02c69-8a98-4fa4-adf3-87839cb3261b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:33.261395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:33.263289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:33.298113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-18b02c69-8a98-4fa4-adf3-87839cb3261b None None] MFA Rules not processed for user `65586f503c3b4c5eb44d791c22b1b990`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:33.300564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18b02c69-8a98-4fa4-adf3-87839cb3261b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:33.358201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7015a-9a6d-4e6c-9630-1663de230b0d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:33.366486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:33.367194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:33.367716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:33.368243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:33.456811 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 980/1971] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:33.461277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02c69-8a98-4fa4-adf3-87839cb3261b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:33.512273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:33.513953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:33.530999 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 992/1972] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:33.586940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02c69-8a98-4fa4-adf3-87839cb3261b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:33.600906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:33.601956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:33.602400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:33.602818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:33.603983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:33.617894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:33.733551 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 981/1973] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:33 2022] POST /identity/v3/projects => generated 393 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:33.738877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:33.748046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b0167-b2a3-4af7-b4d9-7995a3c0ca6f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:33.819301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:33.875006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:33.877437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:33.877935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:33.878395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:33.880460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:33.883012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:34.010614 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 993/1974] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:33 2022] POST /identity/v3/users => generated 303 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:34.012986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:34.037451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406398-f4af-4ca1-9dd5-5b389c8ae92b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:34.041245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489d562-8349-4f99-af7f-9732892b2c2e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:34.045591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:34.045591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:34.046092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:34.046399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:34.047125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:34.049405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:34.061887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:34.062238 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 994/1975] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:34.062569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:34.062851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:34.063131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:34.066543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:34.082046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd24098-d85b-42c9-9938-b38f60d5b6a6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:34.116071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:34.116771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:34.117054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:34.117389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] PATH_INFO: `/v3/projects/a54d555f71934e8593c4a7fc618de489/users/498be5f7a5e346d79fc9910d241bc8bb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:34.167475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54d555f71934e8593c4a7fc618de489, user_id=498be5f7a5e346d79fc9910d241bc8bb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:34.172744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:34.179454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:34.184096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:34.203643 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 982/1976] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:34.286020 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 995/1977] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:34 2022] PUT /identity/v3/projects/a54d555f71934e8593c4a7fc618de489/users/498be5f7a5e346d79fc9910d241bc8bb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:34.289850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:34.301189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40270ed6-753f-4159-9525-d4676c93f96f service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:34.404831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6926dc-4fcc-46b4-95ea-2d0993d2e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:34.405802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6926dc-4fcc-46b4-95ea-2d0993d2e205 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:34.406219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6926dc-4fcc-46b4-95ea-2d0993d2e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:34.406589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6926dc-4fcc-46b4-95ea-2d0993d2e205 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:34.407340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6926dc-4fcc-46b4-95ea-2d0993d2e205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:34.411060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6926dc-4fcc-46b4-95ea-2d0993d2e205 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:34.433254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 983/1978] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:34.436609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:34.467533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0863e-df80-4b89-871f-d87c14955ed1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:34.486392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:34.488336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:34.488781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:34.489252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] PATH_INFO: `/v3/projects/a54d555f71934e8593c4a7fc618de489/users/498be5f7a5e346d79fc9910d241bc8bb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:34.491783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54d555f71934e8593c4a7fc618de489, user_id=498be5f7a5e346d79fc9910d241bc8bb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:34.495629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:34.514179 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 996/1979] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:34 2022] PUT /identity/v3/projects/a54d555f71934e8593c4a7fc618de489/users/498be5f7a5e346d79fc9910d241bc8bb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:34.526704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7e22-3c07-4c43-aa33-b4db1d1e687e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:34.527121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7e22-3c07-4c43-aa33-b4db1d1e687e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:34.527608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7e22-3c07-4c43-aa33-b4db1d1e687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:34.587377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cbed7e22-3c07-4c43-aa33-b4db1d1e687e None None] MFA Rules not processed for user `498be5f7a5e346d79fc9910d241bc8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:34.589169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbed7e22-3c07-4c43-aa33-b4db1d1e687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:34.703834 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 984/1980] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:34.735103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:35.055303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:35.463921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:35.467771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:35.597182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acb483-851a-4a59-bb8b-8b0610179582 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:35.602459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:35.603141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:35.603485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:35.603821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] PATH_INFO: `/v3/users/b81559f73f574dfe9e916117cbfcbf27` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:35.607951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81559f73f574dfe9e916117cbfcbf27)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:35.610169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:35.710172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7e22-3c07-4c43-aa33-b4db1d1e687e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:35.722905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed7e22-3c07-4c43-aa33-b4db1d1e687e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:35.738563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:35.740649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:35.740649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:35.740649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] PATH_INFO: `/v3/users/65586f503c3b4c5eb44d791c22b1b990` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:35.741602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65586f503c3b4c5eb44d791c22b1b990)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:35.743749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:35.822674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81559f73f574dfe9e916117cbfcbf27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:35.842675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81559f73f574dfe9e916117cbfcbf27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:35.844087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81559f73f574dfe9e916117cbfcbf27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:35.875435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81559f73f574dfe9e916117cbfcbf27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:35.966754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9cb2f62-d199-491b-a31b-247afecc65dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81559f73f574dfe9e916117cbfcbf27'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:35.974707 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 997/1981] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:35 2022] DELETE /identity/v3/users/b81559f73f574dfe9e916117cbfcbf27 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:35.978994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:35.980220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:35.980711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:35.990044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65586f503c3b4c5eb44d791c22b1b990'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:35.991027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65586f503c3b4c5eb44d791c22b1b990'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:36.003969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:36.005846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:36.078194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 998/1982] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:36.083621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65586f503c3b4c5eb44d791c22b1b990'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:36.085006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65586f503c3b4c5eb44d791c22b1b990'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:36.092851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:36.093697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:36.096826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2278a899-5650-4ecb-8655-fce6219420c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65586f503c3b4c5eb44d791c22b1b990'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:36.141982 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 985/1983] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:35 2022] DELETE /identity/v3/users/65586f503c3b4c5eb44d791c22b1b990 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:36.143215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:36.143492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:36.143765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:36.173862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:36.175256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:36.236114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e65135-4e0e-4596-94ad-680a7c239fa2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:36.282848 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 986/1984] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:36.311211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:36.311901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:36.312176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:36.312448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:36.323995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:36.325666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:36.337807 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 999/1985] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:36.355240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:36.357725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:36.386239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c79d46-ee2b-45eb-aa63-65e655765fcf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:36.394775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:36.398403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:36.398403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:36.398403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:36.410683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:36.421399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:36.457343 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 987/1986] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:36.867175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:37.164251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:37.165905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:37.184064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:37.185619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:37.203219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b3cb-16d8-44bd-9c29-d60ab1f69d05 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:37.212022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:37.212910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:37.213638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:37.214177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] PATH_INFO: `/v3/projects/cf906474fe8e4747a30df079229201fb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:37.215709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf906474fe8e4747a30df079229201fb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:37.218508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccee457-6826-41d7-957f-5f381db0ca50 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:37.225639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:37.240032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:37.240724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:37.241000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:37.241270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] PATH_INFO: `/v3/projects/94227cb311344970a78b9cb9fc7857aa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:37.243089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94227cb311344970a78b9cb9fc7857aa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:37.248501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:37.384598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94227cb311344970a78b9cb9fc7857aa', 'request_id': 'req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.394712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94227cb311344970a78b9cb9fc7857aa', 'request_id': 'req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.419167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf906474fe8e4747a30df079229201fb', 'request_id': 'req-37c971cc-86c2-433c-ab01-d7a47bf55ae8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.427075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf906474fe8e4747a30df079229201fb', 'request_id': 'req-37c971cc-86c2-433c-ab01-d7a47bf55ae8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.506425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94227cb311344970a78b9cb9fc7857aa', 'request_id': 'req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.524169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] The token cache is being invalidate because project 94227cb311344970a78b9cb9fc7857aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:37.524462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.525362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.531950 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1000/1987] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:37 2022] DELETE /identity/v3/projects/94227cb311344970a78b9cb9fc7857aa => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:37.533660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:37.534381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:37.535548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:37.609891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf906474fe8e4747a30df079229201fb', 'request_id': 'req-37c971cc-86c2-433c-ab01-d7a47bf55ae8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.634589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] The token cache is being invalidate because project cf906474fe8e4747a30df079229201fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:37.634959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.635735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.637578 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 988/1988] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:37 2022] DELETE /identity/v3/projects/cf906474fe8e4747a30df079229201fb => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:37.638643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:37.640148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:37.662440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5f4c-8d75-4bdc-a429-05a6fd6ee4e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:37.753701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c971cc-86c2-433c-ab01-d7a47bf55ae8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:37.764649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:37.765456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:37.765742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:37.766019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] PATH_INFO: `/v3/users/12b4daf685274bdc9907b4fee40ea874` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:37.768497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b4daf685274bdc9907b4fee40ea874)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:37.773693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:37.790326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:37.791734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:37.792251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:37.792742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] PATH_INFO: `/v3/users/e3d195b4ef374907b6dced181c30612f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:37.796183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d195b4ef374907b6dced181c30612f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:37.799505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:37.989618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b4daf685274bdc9907b4fee40ea874'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:37.994977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b4daf685274bdc9907b4fee40ea874'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.029763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d195b4ef374907b6dced181c30612f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.056736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d195b4ef374907b6dced181c30612f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.057770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d195b4ef374907b6dced181c30612f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.060665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b4daf685274bdc9907b4fee40ea874'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.061597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b4daf685274bdc9907b4fee40ea874'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.073934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b4daf685274bdc9907b4fee40ea874'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.097932 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 989/1989] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:37 2022] DELETE /identity/v3/users/12b4daf685274bdc9907b4fee40ea874 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:38.099360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:38.102870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d195b4ef374907b6dced181c30612f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.103158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:38.211817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66cf0c18-03ed-4cbd-9e4b-7414bb83b3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d195b4ef374907b6dced181c30612f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.234431 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1001/1990] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:37 2022] DELETE /identity/v3/users/e3d195b4ef374907b6dced181c30612f => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:38.244711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c43f5e-c676-40c9-b459-5a807a8ef694 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:38.245885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:38.247308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:38.247934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:38.291596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:38.296478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:38.436813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:38.441809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:38.442477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:38.442988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] PATH_INFO: `/v3/users/498be5f7a5e346d79fc9910d241bc8bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:38.447026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498be5f7a5e346d79fc9910d241bc8bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:38.454827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:38.526434 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1002/1991] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:38.545942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:38.550389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:38.647631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:38.732440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcb7f4-1864-44b0-95a2-b407e5cf4bb0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:38.742745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:38.744001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:38.745026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:38.759681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:38.806500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:38.815357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:38.817587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498be5f7a5e346d79fc9910d241bc8bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.819936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498be5f7a5e346d79fc9910d241bc8bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.848753 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1003/1992] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:38.852107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:38.855940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:38.883319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede8efa-0453-4160-85de-5f48b075c846 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:38.890233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:38.890973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:38.891238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:38.892298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] PATH_INFO: `/v3/projects/2ff47eff51a744b4a92c84a0b4a23f0f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:38.900372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff47eff51a744b4a92c84a0b4a23f0f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:38.909134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:38.940874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498be5f7a5e346d79fc9910d241bc8bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.941585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498be5f7a5e346d79fc9910d241bc8bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:38.955372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8870d591-ba21-42ea-8a25-7443b211fae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498be5f7a5e346d79fc9910d241bc8bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.017524 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 990/1993] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:38 2022] DELETE /identity/v3/users/498be5f7a5e346d79fc9910d241bc8bb => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:39.155488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff47eff51a744b4a92c84a0b4a23f0f', 'request_id': 'req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.168267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff47eff51a744b4a92c84a0b4a23f0f', 'request_id': 'req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.274516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879004bc-ee95-461c-8361-c30699e5d98d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.275349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879004bc-ee95-461c-8361-c30699e5d98d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.276492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879004bc-ee95-461c-8361-c30699e5d98d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.277839 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 991/1994] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:25:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:25:39.283101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ef41-7971-4e93-bf5c-3da2c879c46e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.283455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ef41-7971-4e93-bf5c-3da2c879c46e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.283808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7ef41-7971-4e93-bf5c-3da2c879c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.289062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff47eff51a744b4a92c84a0b4a23f0f', 'request_id': 'req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.305409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] The token cache is being invalidate because project 2ff47eff51a744b4a92c84a0b4a23f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:39.305799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.310834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-02383cf5-f0e2-4f07-a9fb-2f988a70a9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.312920 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1004/1995] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:38 2022] DELETE /identity/v3/projects/2ff47eff51a744b4a92c84a0b4a23f0f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:39.318199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e91aaf-eebc-49a2-8492-1d3f9a6255db None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.318582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e91aaf-eebc-49a2-8492-1d3f9a6255db None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.318919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e91aaf-eebc-49a2-8492-1d3f9a6255db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.322794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eca7ef41-7971-4e93-bf5c-3da2c879c46e None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:39.326298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eca7ef41-7971-4e93-bf5c-3da2c879c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:39.358881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-34e91aaf-eebc-49a2-8492-1d3f9a6255db None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:39.360612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34e91aaf-eebc-49a2-8492-1d3f9a6255db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:39.515514 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1005/1996] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:39.523860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.524151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.525091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.552574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:39.553766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:39.571666 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1006/1997] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:39.572766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:39.574378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:39.578197 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 992/1998] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:25:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:39.581336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7ef41-7971-4e93-bf5c-3da2c879c46e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:39.591963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee1a40-354f-4716-abd3-4505c110fd57 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:39.597333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:39.597963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.598293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.598567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] PATH_INFO: `/v3/projects/4e1855b01b724eefb99994625cc414c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.599837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1855b01b724eefb99994625cc414c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:39.601721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:39.610963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7ef41-7971-4e93-bf5c-3da2c879c46e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:39.629074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:39.633234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.633234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.633234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.633234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:39.633234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:39.633234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:39.659647 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 993/1999] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:39.660598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:39.665738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:39.735121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1855b01b724eefb99994625cc414c8', 'request_id': 'req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.739021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7066a-cdfb-409e-95b1-c2f9fce0d170 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:39.744530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1855b01b724eefb99994625cc414c8', 'request_id': 'req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.791166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:39.791778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.792056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.792325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.809309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1855b01b724eefb99994625cc414c8', 'request_id': 'req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.822426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] The token cache is being invalidate because project 4e1855b01b724eefb99994625cc414c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:39.822868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.823623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:39.828495 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1007/2000] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:39 2022] DELETE /identity/v3/projects/4e1855b01b724eefb99994625cc414c8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:39.829599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:39.831028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:39.879361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:39.881204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:39.906610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:39.913538 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 994/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:39.913538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:39.925275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46a85e-1791-4629-acc7-d7dc90057d89 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:39.928383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa83ad4-34bb-477a-aea1-2cffa7ffc9c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:39.934357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:39.935026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:39.935411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.936037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.936396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.936840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:39.937273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:39.938396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] PATH_INFO: `/v3/projects/a54d555f71934e8593c4a7fc618de489` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:39.939702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:39.940657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54d555f71934e8593c4a7fc618de489)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:39.943139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:39.946625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:40.554761 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 995/2002] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:39 2022] POST /identity/v3/projects => generated 383 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:40.556416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:40.558567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:40.605857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54d555f71934e8593c4a7fc618de489', 'request_id': 'req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:40.620011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54d555f71934e8593c4a7fc618de489', 'request_id': 'req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:40.644190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59461-0e27-48b6-a54d-726f8cfb9ce5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:40.667379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54d555f71934e8593c4a7fc618de489', 'request_id': 'req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:40.689534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] The token cache is being invalidate because project a54d555f71934e8593c4a7fc618de489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:40.690011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:40.691198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-389c0f49-cb0b-401a-8ad1-335ce19c6c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:40.693092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1008/2003] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:39 2022] DELETE /identity/v3/projects/a54d555f71934e8593c4a7fc618de489 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:40.700766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:40.701075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:40.701321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:40.725676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:40.727550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:40.742013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:40.748122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:40.748122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:40.748122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] PATH_INFO: `/v3/users/9cd2c0e2bc124548ad019607c0ac90c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:40.748122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd2c0e2bc124548ad019607c0ac90c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:40.749662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:40.796535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1009/2004] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:25:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:40.797435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:40.798862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:40.814912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc648a1e-38bf-4789-abad-689545ebf638 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:40.820709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a60563-8a04-402b-8018-22bdfd3fe62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:40.822220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60563-8a04-402b-8018-22bdfd3fe62f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:40.822504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60563-8a04-402b-8018-22bdfd3fe62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:40.822797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60563-8a04-402b-8018-22bdfd3fe62f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:40.823470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a60563-8a04-402b-8018-22bdfd3fe62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:40.825469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a60563-8a04-402b-8018-22bdfd3fe62f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:40.883593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:40.941941 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1010/2005] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:40 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:40.943503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:40.943793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:40.944340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:40.961474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd2c0e2bc124548ad019607c0ac90c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:40.962311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd2c0e2bc124548ad019607c0ac90c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:40.968700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:40.969902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:40.978002 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1011/2006] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:40.978924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:40.980159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:40.992223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cb17d-5b43-4e68-8531-62e3c6be65d2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:40.995888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.001695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.001695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.001695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.001695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:41.008588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.010008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.019357 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1012/2007] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:41.020104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.021528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:41.038405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99aac-6f1d-4bb5-8ce8-5fd390e39241 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.042927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd2c0e2bc124548ad019607c0ac90c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:41.043639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd2c0e2bc124548ad019607c0ac90c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:41.044352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3524ac-9dce-4a07-a1f6-41edd89f17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.045183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3524ac-9dce-4a07-a1f6-41edd89f17f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.046094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3524ac-9dce-4a07-a1f6-41edd89f17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.048454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3524ac-9dce-4a07-a1f6-41edd89f17f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.048454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3524ac-9dce-4a07-a1f6-41edd89f17f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.049715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3524ac-9dce-4a07-a1f6-41edd89f17f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.052998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd2c0e2bc124548ad019607c0ac90c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:41.061748 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1013/2008] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:41.064150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fbdb-c039-48d6-8d55-aec53b08d9a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.064444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fbdb-c039-48d6-8d55-aec53b08d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.064710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985fbdb-c039-48d6-8d55-aec53b08d9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.080407 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 996/2009] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:40 2022] DELETE /identity/v3/users/9cd2c0e2bc124548ad019607c0ac90c8 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:41.081037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.095220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e985fbdb-c039-48d6-8d55-aec53b08d9a4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:41.096473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e985fbdb-c039-48d6-8d55-aec53b08d9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:41.158901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712ccf8-65b3-471e-a24c-5634950f13df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.166395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.167292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.167806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.168232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.169179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.169693 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1014/2010] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:41.171460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.175608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985fbdb-c039-48d6-8d55-aec53b08d9a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.185046 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 997/2011] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:41.188511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.189593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985fbdb-c039-48d6-8d55-aec53b08d9a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.198776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.199747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.200043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.200324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.200995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:41.201307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.203108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.203805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a709f36-ade2-4323-b2bf-1981441da717 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.209478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36080-7752-41f3-87b3-482da694b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.211769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36080-7752-41f3-87b3-482da694b95a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.212354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36080-7752-41f3-87b3-482da694b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.213061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36080-7752-41f3-87b3-482da694b95a admin admin] PATH_INFO: `/v3/projects/bb4a30e588c14976abc02690c64928a8/users/9c76bed504414abf8d80abfab70fbefd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.220228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1015/2012] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:41.226158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.235952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36080-7752-41f3-87b3-482da694b95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4a30e588c14976abc02690c64928a8, user_id=9c76bed504414abf8d80abfab70fbefd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.251867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc2ab1-7f48-4cac-9e83-c72e1e3bc63f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.251997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36080-7752-41f3-87b3-482da694b95a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.252090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.252090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.252090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.252324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.252792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.254734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.324366 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 998/2013] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:41 2022] PUT /identity/v3/projects/bb4a30e588c14976abc02690c64928a8/users/9c76bed504414abf8d80abfab70fbefd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:41.334827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0d16c-9257-4cb6-b0ef-a862240aae8e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.335416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0d16c-9257-4cb6-b0ef-a862240aae8e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.335910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0d16c-9257-4cb6-b0ef-a862240aae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.355770 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1016/2014] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:41 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:41.360125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.379218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7af0d16c-9257-4cb6-b0ef-a862240aae8e None None] MFA Rules not processed for user `9c76bed504414abf8d80abfab70fbefd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:41.380953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7af0d16c-9257-4cb6-b0ef-a862240aae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:41.482167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a9eb-8a51-4e44-9256-2eb2123b83f4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.482736 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 999/2015] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:41.484252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0d16c-9257-4cb6-b0ef-a862240aae8e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.491190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.491397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.491761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.492138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.493341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.495825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.503719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0d16c-9257-4cb6-b0ef-a862240aae8e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.515220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.515220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.515220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.515220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.515772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.515772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.609419 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1017/2016] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:41 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:25:41.614274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.623811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56585-54da-4ef1-884d-227ebc71dfa6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.629356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.629842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.630184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.630465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.631154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.632817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.643019 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1018/2017] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:25:41.646837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.658461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27eafb-d69b-4bb0-876e-e8326ccbb769 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.664279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.664963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.665306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.665647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.666404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.669544 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1000/2018] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:41 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:41.670012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.675241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.681181 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1019/2019] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:25:41.685315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.713916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2ad31-2313-43f1-93e7-305916cb779f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.764964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1fd8-3388-4331-9140-af7df96d4d4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.772300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.772917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.773406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.773755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.774590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.779215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.787139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.787948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.788333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.788714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] PATH_INFO: `/v3/projects/c10d6a12523d4accbe81b6ff71fe2f98/users/31625024dc904f0d800a974dc90e00d2/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.815463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10d6a12523d4accbe81b6ff71fe2f98, user_id=31625024dc904f0d800a974dc90e00d2, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.818618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:41.891158 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1001/2020] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:41 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:25:41.895976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.896484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:41.909752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df035d5-289b-4f8f-bd48-d07ff5efb5d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:41.913618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:41.931080 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1020/2021] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:41 2022] PUT /identity/v3/projects/c10d6a12523d4accbe81b6ff71fe2f98/users/31625024dc904f0d800a974dc90e00d2/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:41.931080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:41.931762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:41.931762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:41.931762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:41.931762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] PATH_INFO: `/v3/projects/3d6e3d615d3f4877bbad43bc95efccfb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:41.932158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6e3d615d3f4877bbad43bc95efccfb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:41.935009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.017971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfce040-39c8-49df-94d0-366c61db3e43 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:42.023570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df38d43-12b4-4c66-acd2-2a58eb419c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:42.024187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38d43-12b4-4c66-acd2-2a58eb419c1d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.024605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38d43-12b4-4c66-acd2-2a58eb419c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.024747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df38d43-12b4-4c66-acd2-2a58eb419c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.025441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df38d43-12b4-4c66-acd2-2a58eb419c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:42.027195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df38d43-12b4-4c66-acd2-2a58eb419c1d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.043514 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1021/2022] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:42.050713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30167-c380-4772-a157-703119ed94ed None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.050713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30167-c380-4772-a157-703119ed94ed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.050713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30167-c380-4772-a157-703119ed94ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.075595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-81e30167-c380-4772-a157-703119ed94ed None None] MFA Rules not processed for user `31625024dc904f0d800a974dc90e00d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:42.076947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81e30167-c380-4772-a157-703119ed94ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:42.118999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6e3d615d3f4877bbad43bc95efccfb', 'request_id': 'req-8c84b431-a171-4a30-9787-d5c11761d3c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:42.140556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6e3d615d3f4877bbad43bc95efccfb', 'request_id': 'req-8c84b431-a171-4a30-9787-d5c11761d3c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:42.201670 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1022/2023] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:42.201670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30167-c380-4772-a157-703119ed94ed None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:42.214301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6e3d615d3f4877bbad43bc95efccfb', 'request_id': 'req-8c84b431-a171-4a30-9787-d5c11761d3c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:42.222193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30167-c380-4772-a157-703119ed94ed None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:42.230767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] The token cache is being invalidate because project 3d6e3d615d3f4877bbad43bc95efccfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:42.231080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:42.235871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:42.237815 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1002/2024] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:41 2022] DELETE /identity/v3/projects/3d6e3d615d3f4877bbad43bc95efccfb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:42.242402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:42.247612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:42.276545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:42.369227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c379c-1514-44ca-9955-44316defe007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:42.369931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c379c-1514-44ca-9955-44316defe007 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.370238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c379c-1514-44ca-9955-44316defe007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.372309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c379c-1514-44ca-9955-44316defe007 admin admin] PATH_INFO: `/v3/projects/d3c4c49db2ca4967b300bc206f55363b/users/0a91906cc6904225b1a75c50c211a1d1/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.409814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c379c-1514-44ca-9955-44316defe007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c4c49db2ca4967b300bc206f55363b, user_id=0a91906cc6904225b1a75c50c211a1d1, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:42.412870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c379c-1514-44ca-9955-44316defe007 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.419276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b431-a171-4a30-9787-d5c11761d3c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:42.425915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:42.426766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.427318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.428026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.430014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:42.432945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.486304 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1023/2025] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:42 2022] PUT /identity/v3/projects/d3c4c49db2ca4967b300bc206f55363b/users/0a91906cc6904225b1a75c50c211a1d1/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:42.488159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb52e8b-3d26-4cf8-9434-83332f5ad92e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.488479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb52e8b-3d26-4cf8-9434-83332f5ad92e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.488803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb52e8b-3d26-4cf8-9434-83332f5ad92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.531567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4fb52e8b-3d26-4cf8-9434-83332f5ad92e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:42.536763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4fb52e8b-3d26-4cf8-9434-83332f5ad92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:42.547228 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1003/2026] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:42 2022] POST /identity/v3/projects => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:42.549036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:42.553872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:42.692815 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1024/2027] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:42.694079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb52e8b-3d26-4cf8-9434-83332f5ad92e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:42.699073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0c7e2-89df-4902-b11b-8d2cb6bdd552 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:42.713309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb52e8b-3d26-4cf8-9434-83332f5ad92e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:42.713712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9293884-c97b-4016-a8f4-1f43b9b3b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:42.713712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293884-c97b-4016-a8f4-1f43b9b3b460 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.713712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293884-c97b-4016-a8f4-1f43b9b3b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.713712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293884-c97b-4016-a8f4-1f43b9b3b460 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.714213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9293884-c97b-4016-a8f4-1f43b9b3b460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:42.714297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:42.715285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.715935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.716264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.716906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:42.719201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.724137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9293884-c97b-4016-a8f4-1f43b9b3b460 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.746596 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1004/2028] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:42.748152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12b0d8-e284-43df-8624-ebe48e262fb1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.748597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12b0d8-e284-43df-8624-ebe48e262fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.749028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12b0d8-e284-43df-8624-ebe48e262fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.778990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0c12b0d8-e284-43df-8624-ebe48e262fb1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:42.781269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c12b0d8-e284-43df-8624-ebe48e262fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:42.793815 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1005/2029] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:42.793815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12b0d8-e284-43df-8624-ebe48e262fb1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:42.825038 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1025/2030] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:42 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:42.827519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:42.828171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12b0d8-e284-43df-8624-ebe48e262fb1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:42.854198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:42.854973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.855503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.855993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] PATH_INFO: `/v3/projects/d3c4c49db2ca4967b300bc206f55363b/users/0a91906cc6904225b1a75c50c211a1d1/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.858276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c4c49db2ca4967b300bc206f55363b, user_id=0a91906cc6904225b1a75c50c211a1d1, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:42.865917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.866095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a172ab-76bf-4295-af56-077ec2b5e267 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:42.881701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9dff0-ea17-4de6-8891-25f698bf535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:42.882363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9dff0-ea17-4de6-8891-25f698bf535b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.882645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9dff0-ea17-4de6-8891-25f698bf535b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.887257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9dff0-ea17-4de6-8891-25f698bf535b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:42.888014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9dff0-ea17-4de6-8891-25f698bf535b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:42.889458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9dff0-ea17-4de6-8891-25f698bf535b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:42.889879 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1006/2031] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:42 2022] PUT /identity/v3/projects/d3c4c49db2ca4967b300bc206f55363b/users/0a91906cc6904225b1a75c50c211a1d1/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:42.890975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:42.893213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9dff0-ea17-4de6-8891-25f698bf535b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:42.933301 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1026/2032] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:42.943544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76d475-5785-4a76-b766-31a39f14c572 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:42.943544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76d475-5785-4a76-b766-31a39f14c572 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:42.943882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76d475-5785-4a76-b766-31a39f14c572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.022972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1f76d475-5785-4a76-b766-31a39f14c572 None None] MFA Rules not processed for user `0a91906cc6904225b1a75c50c211a1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:43.025409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f76d475-5785-4a76-b766-31a39f14c572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:43.041756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124ce7b-7357-493e-93c5-d1c290955470 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.057730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.059228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.059521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.060414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.061599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.063874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.075994 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1007/2033] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:43.081295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.107825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b765d-1742-4083-8f44-4360a50ebe08 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.123055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.124730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.125030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.125311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.126011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.137069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.198307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:43.207240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1027/2034] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:43.208757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76d475-5785-4a76-b766-31a39f14c572 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.227048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76d475-5785-4a76-b766-31a39f14c572 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.230184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.231157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.231540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.231956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] PATH_INFO: `/v3/projects/a74d22ef85bf4ef9b154320e193b3134/users/e3e7c95aa3eb4912961ef3e8bd395047/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.260152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74d22ef85bf4ef9b154320e193b3134, user_id=e3e7c95aa3eb4912961ef3e8bd395047, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.263760 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1008/2035] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:43 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:43.264446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.269079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.379323 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1028/2036] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:43 2022] PUT /identity/v3/projects/a74d22ef85bf4ef9b154320e193b3134/users/e3e7c95aa3eb4912961ef3e8bd395047/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:43.386893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.411175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ca8d1-96a2-4a43-bf06-e7400f43c187 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.486221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c6f46-a9bd-43cd-9a8c-6a65aa8be30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.487494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c6f46-a9bd-43cd-9a8c-6a65aa8be30b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.488203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c6f46-a9bd-43cd-9a8c-6a65aa8be30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.488650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c6f46-a9bd-43cd-9a8c-6a65aa8be30b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.489447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c6f46-a9bd-43cd-9a8c-6a65aa8be30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.493856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c6f46-a9bd-43cd-9a8c-6a65aa8be30b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.499356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec13426-1b97-4c82-8a80-8ef42ffeeec4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.505519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.506237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.506522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.506799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.507910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.510765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.525702 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1029/2037] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:43.526838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.541946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc875-0f12-4bfb-a7cb-2a7b0a22cfc1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.552596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:43.555637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.556758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.556949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.557295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] PATH_INFO: `/v3/projects/a74d22ef85bf4ef9b154320e193b3134/users/e3e7c95aa3eb4912961ef3e8bd395047/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.559671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74d22ef85bf4ef9b154320e193b3134, user_id=e3e7c95aa3eb4912961ef3e8bd395047, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.564103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.574324 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1030/2038] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:43 2022] PUT /identity/v3/projects/a74d22ef85bf4ef9b154320e193b3134/users/e3e7c95aa3eb4912961ef3e8bd395047/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:43.575158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.576884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:43.595469 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1009/2039] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:43 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:25:43.599560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa35de-739f-4333-b72d-84fc4db9a2f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.600145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa35de-739f-4333-b72d-84fc4db9a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.600541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa35de-739f-4333-b72d-84fc4db9a2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.636402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1aa35de-739f-4333-b72d-84fc4db9a2f9 None None] MFA Rules not processed for user `e3e7c95aa3eb4912961ef3e8bd395047`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:43.637959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1aa35de-739f-4333-b72d-84fc4db9a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:43.667483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61770a4-d8ca-4398-bf37-f25b60369e1f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.675239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.677102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.677102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.677102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.738482 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1010/2040] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:43.738482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa35de-739f-4333-b72d-84fc4db9a2f9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.780804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.783999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.794314 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1031/2041] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:43.811908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa35de-739f-4333-b72d-84fc4db9a2f9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.817591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.818640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.818953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.819222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.819840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.821439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.836327 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1011/2042] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:43.837881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.849673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc63b5c-97f4-429a-bb65-4dde923dd957 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.856991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22967a5-8e03-4069-a54e-35f61ba1c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.866628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22967a5-8e03-4069-a54e-35f61ba1c4bf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.866628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22967a5-8e03-4069-a54e-35f61ba1c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.866628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22967a5-8e03-4069-a54e-35f61ba1c4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.866628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22967a5-8e03-4069-a54e-35f61ba1c4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.866628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22967a5-8e03-4069-a54e-35f61ba1c4bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.875494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1032/2043] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:25:43.878931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:43.890011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe976-fa9a-4586-b8f1-91323c063bce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:43.896099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:43.900481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:43.900481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:43.900481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] PATH_INFO: `/v3/projects/b5d51b245e2c4ca0b1a6cfe1ec4dfcf5/users/8df877fab7bc497fb3486f4caa934b5d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:43.920025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d51b245e2c4ca0b1a6cfe1ec4dfcf5, user_id=8df877fab7bc497fb3486f4caa934b5d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:43.923715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:43.998718 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1012/2044] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:43 2022] PUT /identity/v3/projects/b5d51b245e2c4ca0b1a6cfe1ec4dfcf5/users/8df877fab7bc497fb3486f4caa934b5d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:44.005223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9992b-3bd8-4c54-8bc5-261328c16e6b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:44.005696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9992b-3bd8-4c54-8bc5-261328c16e6b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:44.006086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9992b-3bd8-4c54-8bc5-261328c16e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:44.040344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02e9992b-3bd8-4c54-8bc5-261328c16e6b None None] MFA Rules not processed for user `8df877fab7bc497fb3486f4caa934b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:44.042292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02e9992b-3bd8-4c54-8bc5-261328c16e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:44.076850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:44.153436 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1033/2045] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:44.158304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9992b-3bd8-4c54-8bc5-261328c16e6b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:44.178223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2cfd6-e66c-4ea7-bd9a-59d0b1d6eec1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:44.186107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:44.186657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:44.186940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:44.187214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:44.240964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9992b-3bd8-4c54-8bc5-261328c16e6b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:44.247532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:44.248161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:44.248444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:44.249284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:44.249547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:44.252114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:44.289995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:44.291647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:44.304095 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1013/2046] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:25:44.388228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1034/2047] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:44 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:44.389380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:44.403474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb760-fef1-4f06-8a0b-08f96bb0dbc5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:44.513484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:44.514020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:44.514342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:44.514619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:44.515267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:44.519080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:44.689583 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1014/2048] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:44 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:44.690879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:44.703479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacae3b-f2d7-4ddc-8306-9a6754471bf3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:44.708969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:44.709586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:44.709865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:44.710284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:44.711284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:44.713205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:44.738656 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1035/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:44.742556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:44.755753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce992f-3525-4ffc-9a6a-e92981176c90 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:44.762452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:44.764019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:44.764019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:44.764600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] PATH_INFO: `/v3/projects/a4b7720e24864ef4acda521de7084c9a/users/20e1e7e14fa94b7eac11996c448edd0f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:44.784929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b7720e24864ef4acda521de7084c9a, user_id=20e1e7e14fa94b7eac11996c448edd0f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:44.792294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:44.873076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:44.882142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654d16-0119-4c48-8e5f-068505f3c187 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:44.897808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:44.899126 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1015/2050] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:44 2022] PUT /identity/v3/projects/a4b7720e24864ef4acda521de7084c9a/users/20e1e7e14fa94b7eac11996c448edd0f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:44.901935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:44.902355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:44.902725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:44.902857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] PATH_INFO: `/v3/users/31625024dc904f0d800a974dc90e00d2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:44.904362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31625024dc904f0d800a974dc90e00d2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:44.906794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:45.004833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3898c3c-435b-4548-adf1-81107f2d6960 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:45.010937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:45.011565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:45.011846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:45.012124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:45.012812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:45.014510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:45.026354 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1016/2051] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:45.030304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:45.043558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed6b0-cb53-41e2-be34-984537759b81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:45.048678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e6f1-81de-4d02-a025-8dd561e6a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:45.049446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e6f1-81de-4d02-a025-8dd561e6a7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:45.049825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e6f1-81de-4d02-a025-8dd561e6a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:45.050208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e6f1-81de-4d02-a025-8dd561e6a7b5 admin admin] PATH_INFO: `/v3/projects/a4b7720e24864ef4acda521de7084c9a/users/20e1e7e14fa94b7eac11996c448edd0f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:45.052247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e6f1-81de-4d02-a025-8dd561e6a7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b7720e24864ef4acda521de7084c9a, user_id=20e1e7e14fa94b7eac11996c448edd0f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:45.055061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e6f1-81de-4d02-a025-8dd561e6a7b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:45.067833 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1017/2052] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:45 2022] PUT /identity/v3/projects/a4b7720e24864ef4acda521de7084c9a/users/20e1e7e14fa94b7eac11996c448edd0f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:45.078697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bd686-f4df-4ee8-96b5-9ff09aeae62b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:45.080019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bd686-f4df-4ee8-96b5-9ff09aeae62b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:45.080379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bd686-f4df-4ee8-96b5-9ff09aeae62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:45.113383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c19bd686-f4df-4ee8-96b5-9ff09aeae62b None None] MFA Rules not processed for user `20e1e7e14fa94b7eac11996c448edd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:45.115022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c19bd686-f4df-4ee8-96b5-9ff09aeae62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:45.144113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31625024dc904f0d800a974dc90e00d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:45.155480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31625024dc904f0d800a974dc90e00d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:45.156827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31625024dc904f0d800a974dc90e00d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:45.176396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31625024dc904f0d800a974dc90e00d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:45.267795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31625024dc904f0d800a974dc90e00d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:45.274241 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1018/2053] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:45.280411 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1036/2054] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:44 2022] DELETE /identity/v3/users/31625024dc904f0d800a974dc90e00d2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:45.281868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:45.282993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:45.282993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:45.343623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:45.345037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:45.432897 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1019/2055] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:45.448971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:45.451084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:45.538097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e7fef-0c85-4f38-9229-d4bef4311dd6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:45.562910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:45.564123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:45.564410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:45.574382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:45.579226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:45.580431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:45.581723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:45.581948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:45.601467 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1037/2056] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:45.670990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ae023-bc22-4a27-8322-e1c59780e537 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:45.683342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:45.684344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:45.684553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:45.685496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:45.756632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:45.758479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:45.768907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1020/2057] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:45.775120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:46.003120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:46.211779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:46.213347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:46.229391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab5465-fc90-4ee0-bf10-5844f933f950 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:46.253135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:46.253135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:46.253135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:46.253135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] PATH_INFO: `/v3/projects/c10d6a12523d4accbe81b6ff71fe2f98` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:46.253818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10d6a12523d4accbe81b6ff71fe2f98)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:46.260899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:46.432071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10d6a12523d4accbe81b6ff71fe2f98', 'request_id': 'req-b421a041-ca5b-4c02-91bf-294422259b83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.438479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10d6a12523d4accbe81b6ff71fe2f98', 'request_id': 'req-b421a041-ca5b-4c02-91bf-294422259b83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.510781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10d6a12523d4accbe81b6ff71fe2f98', 'request_id': 'req-b421a041-ca5b-4c02-91bf-294422259b83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.520701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:46.531875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3999d65-d666-4503-959e-4602d15b3e91 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:46.534907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] The token cache is being invalidate because project c10d6a12523d4accbe81b6ff71fe2f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:46.535202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.535899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.537365 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1038/2058] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:46 2022] DELETE /identity/v3/projects/c10d6a12523d4accbe81b6ff71fe2f98 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:46.541122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:46.542479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:46.605467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:46.606650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:46.606937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:46.607307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a041-ca5b-4c02-91bf-294422259b83 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:46.607454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:46.609099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:46.612491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:46.613376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:46.613658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:46.614073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] PATH_INFO: `/v3/users/e3e7c95aa3eb4912961ef3e8bd395047` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:46.615233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e7c95aa3eb4912961ef3e8bd395047)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:46.617164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:46.677428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:46.679101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:46.689567 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1021/2059] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:25:46.761324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e7c95aa3eb4912961ef3e8bd395047'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.769610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e7c95aa3eb4912961ef3e8bd395047'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.771062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e7c95aa3eb4912961ef3e8bd395047'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.787792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e7c95aa3eb4912961ef3e8bd395047'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.871716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e7c95aa3eb4912961ef3e8bd395047'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:46.878250 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1039/2060] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:46 2022] DELETE /identity/v3/users/e3e7c95aa3eb4912961ef3e8bd395047 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:47.364943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:47.395311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9a96d-8bd4-4722-9ecb-1b9170bdcd6e service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:47.458973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:47.460849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:47.478104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:47.481210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:47.481210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:47.481210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] PATH_INFO: `/v3/projects/a74d22ef85bf4ef9b154320e193b3134` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:47.482319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74d22ef85bf4ef9b154320e193b3134)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:47.484967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:47.543457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0735d-41e0-405f-a896-2d7fd0d6c218 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:47.548327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:47.548966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:47.549271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:47.549546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] PATH_INFO: `/v3/users/9c76bed504414abf8d80abfab70fbefd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:47.550680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c76bed504414abf8d80abfab70fbefd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:47.552687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:47.597025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74d22ef85bf4ef9b154320e193b3134', 'request_id': 'req-01548626-e933-4c8f-ae53-5bd569bd81d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.605804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74d22ef85bf4ef9b154320e193b3134', 'request_id': 'req-01548626-e933-4c8f-ae53-5bd569bd81d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.674469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74d22ef85bf4ef9b154320e193b3134', 'request_id': 'req-01548626-e933-4c8f-ae53-5bd569bd81d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.715929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] The token cache is being invalidate because project a74d22ef85bf4ef9b154320e193b3134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:47.716520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.718650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-01548626-e933-4c8f-ae53-5bd569bd81d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.724026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1022/2061] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:47 2022] DELETE /identity/v3/projects/a74d22ef85bf4ef9b154320e193b3134 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:47.737332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c76bed504414abf8d80abfab70fbefd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.740529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1f58-f27b-496c-8522-3930a14c66d4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:47.743078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1f58-f27b-496c-8522-3930a14c66d4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:47.743510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1f58-f27b-496c-8522-3930a14c66d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:47.747004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c76bed504414abf8d80abfab70fbefd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.748765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c76bed504414abf8d80abfab70fbefd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.768094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c76bed504414abf8d80abfab70fbefd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.774026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a59d1f58-f27b-496c-8522-3930a14c66d4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:47.775675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a59d1f58-f27b-496c-8522-3930a14c66d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:47.832281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e86517b6-6dd1-41e4-b000-d64f0ad7d511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c76bed504414abf8d80abfab70fbefd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:47.845448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1040/2062] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:47 2022] DELETE /identity/v3/users/9c76bed504414abf8d80abfab70fbefd => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:47.845670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:47.849004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3285c9-fceb-49f8-a1d3-b1db0bf184c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:47.849553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3285c9-fceb-49f8-a1d3-b1db0bf184c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:47.849984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3285c9-fceb-49f8-a1d3-b1db0bf184c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:47.876605 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1023/2063] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:47.885660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-db3285c9-fceb-49f8-a1d3-b1db0bf184c9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:47.887387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db3285c9-fceb-49f8-a1d3-b1db0bf184c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:47.895227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:47.895655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:47.895792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:47.924144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:47.932284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:47.934360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:48.037253 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1041/2064] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:48.038481 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1024/2065] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:48.038731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3285c9-fceb-49f8-a1d3-b1db0bf184c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.052171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3285c9-fceb-49f8-a1d3-b1db0bf184c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.057610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.059267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:48.064718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.066018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.068122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.068412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.069806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:48.070366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.082696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.096525 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1042/2066] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:48.101542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.117695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53674a-0a24-4b18-9e45-0f5e458c39a6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.129184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05619f-5406-4565-9914-b99447fff6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.130164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05619f-5406-4565-9914-b99447fff6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.130629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05619f-5406-4565-9914-b99447fff6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.130962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05619f-5406-4565-9914-b99447fff6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.132169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05619f-5406-4565-9914-b99447fff6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.134624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05619f-5406-4565-9914-b99447fff6d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.153619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6cd59-6bc7-416f-90aa-2f496391d83f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.158458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.159502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.159789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.160067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.170725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.173445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.183529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1025/2067] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:48.252373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.258154 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1043/2068] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:48 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:48.263083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221e5ca-f679-4495-8400-12def0db802a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.331085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.331833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.332207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.332602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.333527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.335677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.379919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771190-f20a-46c6-b19d-52f9a856a4cb None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.380205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771190-f20a-46c6-b19d-52f9a856a4cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.380479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771190-f20a-46c6-b19d-52f9a856a4cb None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.381971 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1044/2069] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:25:48.391957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be166c-0b06-4cf7-809e-9da633c51d66 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.391957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be166c-0b06-4cf7-809e-9da633c51d66 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.391957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be166c-0b06-4cf7-809e-9da633c51d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.418849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-09be166c-0b06-4cf7-809e-9da633c51d66 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:48.419881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09be166c-0b06-4cf7-809e-9da633c51d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:48.493639 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1026/2070] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:48 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:48.498214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.520198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769a6d-bcdb-4869-907a-bb663c745ea1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.530387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1045/2071] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:25:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:48.537855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.537855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.537855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.537855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.538675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.544071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.562996 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1027/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:48.569424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.572501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be166c-0b06-4cf7-809e-9da633c51d66 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.614881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be166c-0b06-4cf7-809e-9da633c51d66 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.620151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.622106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.622106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.622320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.622844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.624880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.636425 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1046/2073] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:48.640608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.651928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e0d9-965d-43ca-8b25-93d6119211a6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.655822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6143d-cd60-4b9b-a40c-b1a2798134a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.656856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3248-19a4-4592-821d-750084eec7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.658385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3248-19a4-4592-821d-750084eec7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.658503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3248-19a4-4592-821d-750084eec7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.658804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3248-19a4-4592-821d-750084eec7a8 admin admin] PATH_INFO: `/v3/projects/abf776197bd64688ac923bd448d27060/users/3e8fea04d2ab4fa8954d5454ad1cf87a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.660317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.660954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.661233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.662155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.675339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.675530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3248-19a4-4592-821d-750084eec7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf776197bd64688ac923bd448d27060, user_id=3e8fea04d2ab4fa8954d5454ad1cf87a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.676879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.678237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3248-19a4-4592-821d-750084eec7a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.689159 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1028/2074] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:48.765918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.768163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:48.786176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd8b0-6c88-47b5-ab08-90145c9e3cd9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.786607 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1047/2075] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:48 2022] PUT /identity/v3/projects/abf776197bd64688ac923bd448d27060/users/3e8fea04d2ab4fa8954d5454ad1cf87a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:48.788500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2aba-b486-42bb-86c0-87c3c959dd49 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.788799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2aba-b486-42bb-86c0-87c3c959dd49 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.789081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2aba-b486-42bb-86c0-87c3c959dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.831711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ffbb2aba-b486-42bb-86c0-87c3c959dd49 None None] MFA Rules not processed for user `3e8fea04d2ab4fa8954d5454ad1cf87a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:48.833087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ffbb2aba-b486-42bb-86c0-87c3c959dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:48.932272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.933044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.933406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.933759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] PATH_INFO: `/v3/projects/bb4a30e588c14976abc02690c64928a8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.935202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4a30e588c14976abc02690c64928a8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:48.937267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:48.967830 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1048/2076] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:48.968809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb2aba-b486-42bb-86c0-87c3c959dd49 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:48.989863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb2aba-b486-42bb-86c0-87c3c959dd49 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:48.995532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:48.999405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:48.999405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:48.999405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:48.999405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:49.003754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:49.113594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4a30e588c14976abc02690c64928a8', 'request_id': 'req-147ab93a-3d31-4c41-bde8-161feadd14dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.121216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4a30e588c14976abc02690c64928a8', 'request_id': 'req-147ab93a-3d31-4c41-bde8-161feadd14dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.161296 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1049/2077] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:48 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:49.165316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:49.220058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4a30e588c14976abc02690c64928a8', 'request_id': 'req-147ab93a-3d31-4c41-bde8-161feadd14dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.240757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] The token cache is being invalidate because project bb4a30e588c14976abc02690c64928a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:49.241112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.241947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.248440 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1029/2078] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:48 2022] DELETE /identity/v3/projects/bb4a30e588c14976abc02690c64928a8 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:49.254096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:49.257248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:49.271698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe084-4b6c-4ac0-94a6-e5d72b565e41 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:49.284638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:49.286512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:49.288139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:49.288443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:49.291268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:49.295214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:49.366013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab93a-3d31-4c41-bde8-161feadd14dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:49.373142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:49.373142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:49.373142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:49.373142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] PATH_INFO: `/v3/users/0a91906cc6904225b1a75c50c211a1d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:49.374240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a91906cc6904225b1a75c50c211a1d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:49.377054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:49.465138 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1050/2079] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:49 2022] POST /identity/v3/users => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:25:49.466112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:49.469215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:49.485876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00b691-3523-4b32-9d04-557e0a12254c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:49.492216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554287-8018-4338-9883-58375460909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:49.492985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554287-8018-4338-9883-58375460909f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:49.493267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554287-8018-4338-9883-58375460909f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:49.493542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554287-8018-4338-9883-58375460909f admin admin] PATH_INFO: `/v3/users/8df877fab7bc497fb3486f4caa934b5d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:49.494788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f554287-8018-4338-9883-58375460909f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df877fab7bc497fb3486f4caa934b5d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:49.496784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f554287-8018-4338-9883-58375460909f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:49.660861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a91906cc6904225b1a75c50c211a1d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.661576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a91906cc6904225b1a75c50c211a1d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.760180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a91906cc6904225b1a75c50c211a1d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.761772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a91906cc6904225b1a75c50c211a1d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.777108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a91906cc6904225b1a75c50c211a1d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.797690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f554287-8018-4338-9883-58375460909f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df877fab7bc497fb3486f4caa934b5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.822709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f554287-8018-4338-9883-58375460909f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df877fab7bc497fb3486f4caa934b5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.824489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f554287-8018-4338-9883-58375460909f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df877fab7bc497fb3486f4caa934b5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.833711 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1030/2080] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:49 2022] DELETE /identity/v3/users/0a91906cc6904225b1a75c50c211a1d1 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:49.834615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:49.857419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:49.857419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:49.857614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f554287-8018-4338-9883-58375460909f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df877fab7bc497fb3486f4caa934b5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.965660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f554287-8018-4338-9883-58375460909f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df877fab7bc497fb3486f4caa934b5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:49.978376 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1051/2081] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:49 2022] DELETE /identity/v3/users/8df877fab7bc497fb3486f4caa934b5d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:49.983586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:49.984000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:49.984375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:50.005597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e814e-8410-4145-966a-c7778106c1ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:50.040161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:50.041713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:50.159348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:50.180969 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1052/2082] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:50.197379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:50.199298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:50.199806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:50.200289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:50.201809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:50.218144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:50.232887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:50.234333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:50.246641 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1031/2083] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:50.248134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:50.251635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:50.289363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5a003-6dfd-4736-b486-b8b95b10c63c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:50.299435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:50.300225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:50.300582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:50.300938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] PATH_INFO: `/v3/projects/39e4a84c03a840aa9126c56fb2c79e9b/users/70c5df4a8019436aaeeafb716d3f8fac/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:50.330360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e4a84c03a840aa9126c56fb2c79e9b, user_id=70c5df4a8019436aaeeafb716d3f8fac, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:50.334303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:50.352656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e626f-30d4-459c-a26d-6426a20e4012 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:50.356386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:50.357009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:50.357284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:50.357555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:50.376825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:50.378223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:50.392476 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1053/2084] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:25:50.401707 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1032/2085] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:50 2022] PUT /identity/v3/projects/39e4a84c03a840aa9126c56fb2c79e9b/users/70c5df4a8019436aaeeafb716d3f8fac/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:50.405296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:50.419178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e260e-6812-493f-a310-e4c4b8b977f5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:50.528896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa32513-6d3b-4193-bdca-38024c643396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:50.529581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32513-6d3b-4193-bdca-38024c643396 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:50.529930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32513-6d3b-4193-bdca-38024c643396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:50.530244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32513-6d3b-4193-bdca-38024c643396 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:50.531041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa32513-6d3b-4193-bdca-38024c643396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:50.534539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa32513-6d3b-4193-bdca-38024c643396 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:50.551609 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1054/2086] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:50.555969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:50.575053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45d475-ac74-4553-a0d4-1f4175e488f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:50.589031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:50.589031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:50.589411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:50.589788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] PATH_INFO: `/v3/projects/39e4a84c03a840aa9126c56fb2c79e9b/users/70c5df4a8019436aaeeafb716d3f8fac/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:50.594125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e4a84c03a840aa9126c56fb2c79e9b, user_id=70c5df4a8019436aaeeafb716d3f8fac, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:50.599643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:50.624294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:50.624838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:50.625242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:50.628637 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1033/2087] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:50 2022] PUT /identity/v3/projects/39e4a84c03a840aa9126c56fb2c79e9b/users/70c5df4a8019436aaeeafb716d3f8fac/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:50.662515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] MFA Rules not processed for user `70c5df4a8019436aaeeafb716d3f8fac`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:50.662877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:50.794142 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1055/2088] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:50.983267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:50.998687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:51.007180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:51.008767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:51.211469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824d46-beb4-46b0-8023-01e5697c5865 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:51.226506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:51.229371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:51.230096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:51.230503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:51.239518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827df64-b6ba-4851-a3f0-48b7fe6f420a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:51.247926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:51.250025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:51.250488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:51.251506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] PATH_INFO: `/v3/projects/d3c4c49db2ca4967b300bc206f55363b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:51.253421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c4c49db2ca4967b300bc206f55363b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:51.255367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:51.256453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:51.259652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:51.305430 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1034/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:51.323429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:51.503492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c4c49db2ca4967b300bc206f55363b', 'request_id': 'req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:51.515289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c4c49db2ca4967b300bc206f55363b', 'request_id': 'req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:51.583292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:51.648871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c4c49db2ca4967b300bc206f55363b', 'request_id': 'req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:51.664822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:51.666281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:51.676833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] The token cache is being invalidate because project d3c4c49db2ca4967b300bc206f55363b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:51.677140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:51.680355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec7e1e5b-7e32-4efe-8136-14ec111ecc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:51.682539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69f94-6e85-443a-bd45-27d37e7afb7c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:51.687582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1056/2090] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:51 2022] DELETE /identity/v3/projects/d3c4c49db2ca4967b300bc206f55363b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:51.690014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087320-c7ef-4ced-9785-e8579c28f38e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:51.691318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087320-c7ef-4ced-9785-e8579c28f38e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:51.691509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087320-c7ef-4ced-9785-e8579c28f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:51.732668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a2087320-c7ef-4ced-9785-e8579c28f38e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:51.736601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a2087320-c7ef-4ced-9785-e8579c28f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:51.815599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:51.816339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:51.816571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:51.816901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] PATH_INFO: `/v3/projects/b5d51b245e2c4ca0b1a6cfe1ec4dfcf5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:51.819238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d51b245e2c4ca0b1a6cfe1ec4dfcf5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:51.824004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:51.892916 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1057/2091] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:51.895554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9040-5095-4191-bb33-3692e859406d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:51.895850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9040-5095-4191-bb33-3692e859406d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:51.896126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9040-5095-4191-bb33-3692e859406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:51.931632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-53fe9040-5095-4191-bb33-3692e859406d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:51.931632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53fe9040-5095-4191-bb33-3692e859406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:51.942221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1058/2092] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:51.943580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9040-5095-4191-bb33-3692e859406d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:51.957683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9040-5095-4191-bb33-3692e859406d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:51.965865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:51.966909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:51.967687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:51.968203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:51.969126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:51.970297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:51.973340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:52.023623 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1059/2093] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:52.024623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:52.024885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d51b245e2c4ca0b1a6cfe1ec4dfcf5', 'request_id': 'req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.037452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d51b245e2c4ca0b1a6cfe1ec4dfcf5', 'request_id': 'req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.041489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364ed48-cca2-4db5-b8c7-f312fa406940 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:52.164326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:52.165230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:52.165942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:52.166773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:52.167643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:52.170733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:52.180768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d51b245e2c4ca0b1a6cfe1ec4dfcf5', 'request_id': 'req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.199952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] The token cache is being invalidate because project b5d51b245e2c4ca0b1a6cfe1ec4dfcf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:52.200488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.201455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.207118 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1035/2094] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:51 2022] DELETE /identity/v3/projects/b5d51b245e2c4ca0b1a6cfe1ec4dfcf5 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:52.208803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:52.213441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:52.238885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75c0c2-11cc-4d4c-a6de-4914a97e4d50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:52.254279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:52.254957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:52.255284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:52.255501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] PATH_INFO: `/v3/users/20e1e7e14fa94b7eac11996c448edd0f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:52.256996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e1e7e14fa94b7eac11996c448edd0f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:52.258669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:52.297385 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1060/2095] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:52 2022] POST /identity/v3/projects => generated 409 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:52.298724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:52.301219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:52.302279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:52.473035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0f8f-dd1d-4d5e-880c-01a6dc8aca3d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:52.487619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:52.488579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:52.488860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:52.489125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:52.489851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:52.491790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:52.529282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e1e7e14fa94b7eac11996c448edd0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.530339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e1e7e14fa94b7eac11996c448edd0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.624615 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1061/2096] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:52 2022] POST /identity/v3/users => generated 305 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:52.624615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:52.626197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:52.650905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919d5bb-bc61-4f04-9b8f-808efa23c067 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:52.663198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:52.664943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:52.666778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:52.669358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] PATH_INFO: `/v3/users/3e8fea04d2ab4fa8954d5454ad1cf87a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:52.669914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e1e7e14fa94b7eac11996c448edd0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.670861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e1e7e14fa94b7eac11996c448edd0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.671098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8fea04d2ab4fa8954d5454ad1cf87a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:52.680005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:52.683109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e1e7e14fa94b7eac11996c448edd0f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.718243 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1036/2097] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:52 2022] DELETE /identity/v3/users/20e1e7e14fa94b7eac11996c448edd0f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:52.721892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:52.721892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:52.828068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96f4eb-588c-4d32-affd-afda6716a023 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:52.833587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:52.834592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:52.834950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:52.835511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:52.836328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:52.837950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:52.853167 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1037/2098] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:52.854642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:52.867800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa921a-29a9-4a42-8b78-953d728cf705 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:52.874579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:52.876175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:52.876905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:52.877412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:52.878311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:52.880233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:52.897741 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1038/2099] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:52.899761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:52.902411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8fea04d2ab4fa8954d5454ad1cf87a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.911151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8fea04d2ab4fa8954d5454ad1cf87a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.921187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8fea04d2ab4fa8954d5454ad1cf87a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.922754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4273a-b7d7-41d1-b41e-b7e25663d4cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:52.929667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab4fb7-fec0-42cc-b490-02257a09b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:52.930544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab4fb7-fec0-42cc-b490-02257a09b3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:52.930841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab4fb7-fec0-42cc-b490-02257a09b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:52.931102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab4fb7-fec0-42cc-b490-02257a09b3b2 admin admin] PATH_INFO: `/v3/projects/efb17fad956b42feb001a45797d841f0/users/78ce866c78554f638f9f2976c3f7198b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:52.939706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8fea04d2ab4fa8954d5454ad1cf87a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:52.951638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab4fb7-fec0-42cc-b490-02257a09b3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb17fad956b42feb001a45797d841f0, user_id=78ce866c78554f638f9f2976c3f7198b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:52.954981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab4fb7-fec0-42cc-b490-02257a09b3b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:53.020567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e3e1f45-afa9-4478-9d59-5408e0760df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8fea04d2ab4fa8954d5454ad1cf87a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:53.030227 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1062/2100] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:52 2022] DELETE /identity/v3/users/3e8fea04d2ab4fa8954d5454ad1cf87a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:53.035285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:53.036430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:53.036952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:53.068916 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1039/2101] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:52 2022] PUT /identity/v3/projects/efb17fad956b42feb001a45797d841f0/users/78ce866c78554f638f9f2976c3f7198b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:53.069367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:53.069367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:53.070298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:53.070588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:53.070860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:53.134984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] MFA Rules not processed for user `78ce866c78554f638f9f2976c3f7198b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:53.138634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:53.190228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1063/2102] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:53.212606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:53.214031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:53.227743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:53.300187 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1040/2103] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:53 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:25:53.303564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:53.306825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:53.325470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056872e1-89e7-466d-b10e-b97865b96714 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:53.333325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:53.334048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:53.334436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:53.334783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:53.335496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:53.338015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:53.344319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc1615-5fd7-4c95-b1e8-a00ad84ef624 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:53.350748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:53.351867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:53.352361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:53.352802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:53.375548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:53.378881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:53.393987 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1064/2104] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:25:53.464682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1041/2105] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:53 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:53.472339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:53.481302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e698e9-d073-4554-b048-51083c0faeb9 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:53.574876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:53.576189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:53.577033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:53.577526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:53.578372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:53.580827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:53.686496 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1065/2106] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:53 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:53.687713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:53.699869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154ea78-6b40-4a60-a240-fd4cedffa749 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:53.705191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:53.706247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:53.706953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:53.707438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:53.708464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:53.711058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:53.726902 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1042/2107] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:53.730882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:53.757642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e5bce-884d-49cf-84a0-cc19cf70f59a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:53.763304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:53.764122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:53.764547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:53.764971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] PATH_INFO: `/v3/projects/6c63004901a04191afd52d03a34e64e8/users/e648357a89244413bee18c4483a44202/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:53.791224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c63004901a04191afd52d03a34e64e8, user_id=e648357a89244413bee18c4483a44202, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:53.794083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:53.901060 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1066/2108] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:53 2022] PUT /identity/v3/projects/6c63004901a04191afd52d03a34e64e8/users/e648357a89244413bee18c4483a44202/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:53.906294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:53.911905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:53.919874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450a76-ac54-4db3-be66-e1ed5e4d89ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:53.929692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.030820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:54.032540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.032540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.032540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.045406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:54.051152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:54.058411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcd83f-3de7-42a2-9dd1-0628eb60fc2c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:54.064670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:54.065327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.065609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.065884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] PATH_INFO: `/v3/projects/a4b7720e24864ef4acda521de7084c9a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.067199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b7720e24864ef4acda521de7084c9a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:54.069198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:54.074093 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1043/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:54.078185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:54.095676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:54.099571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d8f09-ad8c-4e5a-9647-6ba221aac1f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:54.117821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:54.118573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.118909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.119189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] PATH_INFO: `/v3/projects/6c63004901a04191afd52d03a34e64e8/users/e648357a89244413bee18c4483a44202/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.122409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c63004901a04191afd52d03a34e64e8, user_id=e648357a89244413bee18c4483a44202, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:54.125655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:54.138954 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1044/2110] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:54 2022] PUT /identity/v3/projects/6c63004901a04191afd52d03a34e64e8/users/e648357a89244413bee18c4483a44202/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:54.149815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:54.160910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.236643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b7720e24864ef4acda521de7084c9a', 'request_id': 'req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.243261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b7720e24864ef4acda521de7084c9a', 'request_id': 'req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.248153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3af8e4-5c79-4636-b14d-915451c60929 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:54.306336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:54.306982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.307257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.307530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] PATH_INFO: `/v3/projects/abf776197bd64688ac923bd448d27060` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.308662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf776197bd64688ac923bd448d27060)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:54.311591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:54.311742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b7720e24864ef4acda521de7084c9a', 'request_id': 'req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.315627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:54.326803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] The token cache is being invalidate because project a4b7720e24864ef4acda521de7084c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:54.327160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.327765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13ba08e7-239c-42eb-a0e0-2c5ca81e2f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.329301 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1067/2111] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:53 2022] DELETE /identity/v3/projects/a4b7720e24864ef4acda521de7084c9a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:54.330529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39a5a-1936-4791-95b5-52b7d4125f45 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.330807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39a5a-1936-4791-95b5-52b7d4125f45 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.331078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d39a5a-1936-4791-95b5-52b7d4125f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.366548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-01d39a5a-1936-4791-95b5-52b7d4125f45 None None] MFA Rules not processed for user `e648357a89244413bee18c4483a44202`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:54.367911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01d39a5a-1936-4791-95b5-52b7d4125f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.434604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf776197bd64688ac923bd448d27060', 'request_id': 'req-fb316cde-b65f-4904-9326-4ddd9b340be0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.479649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf776197bd64688ac923bd448d27060', 'request_id': 'req-fb316cde-b65f-4904-9326-4ddd9b340be0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.479868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1068/2112] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:54 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:54.481159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.481476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.481828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.517735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:54.519144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.590192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf776197bd64688ac923bd448d27060', 'request_id': 'req-fb316cde-b65f-4904-9326-4ddd9b340be0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.605090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] The token cache is being invalidate because project abf776197bd64688ac923bd448d27060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:54.605090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.605090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.605789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1069/2113] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:54.605872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1045/2114] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:54 2022] DELETE /identity/v3/projects/abf776197bd64688ac923bd448d27060 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:54.606950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:54.609113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:54.612698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.612819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.628685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb316cde-b65f-4904-9326-4ddd9b340be0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:54.635699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:54.636330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.636704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.637055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] PATH_INFO: `/v3/users/70c5df4a8019436aaeeafb716d3f8fac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.638317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c5df4a8019436aaeeafb716d3f8fac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:54.640318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:54.704744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d174f-82ee-43f8-b23d-c208e50d641e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:54.710583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6833cc-c155-4139-824d-e5e25549243d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:54.711197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6833cc-c155-4139-824d-e5e25549243d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.711481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6833cc-c155-4139-824d-e5e25549243d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.711760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6833cc-c155-4139-824d-e5e25549243d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.713729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5a6833cc-c155-4139-824d-e5e25549243d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.785741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c5df4a8019436aaeeafb716d3f8fac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.787261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c5df4a8019436aaeeafb716d3f8fac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.801780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6833cc-c155-4139-824d-e5e25549243d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:54.803551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6833cc-c155-4139-824d-e5e25549243d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:54.815449 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1070/2115] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:54 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:54.817206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.817498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.817774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.846252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:54.847825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.848967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c5df4a8019436aaeeafb716d3f8fac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.849603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c5df4a8019436aaeeafb716d3f8fac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.860519 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1071/2116] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:54.861837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:54.862593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c5df4a8019436aaeeafb716d3f8fac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:54.863644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.885198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b76c-538b-4711-87a7-0f4abfcc0537 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:54.889755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:54.890931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:54.892075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:54.892436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:54.896988 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1046/2117] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:54 2022] DELETE /identity/v3/users/70c5df4a8019436aaeeafb716d3f8fac => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:54.897815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:54.898244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:54.958940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:54.992446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:55.008201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.009849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.032776 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1072/2118] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:54 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:55.065773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d1e0b-b71d-4110-9a6b-7d33808a08fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.076640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.078590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:55.091659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.092289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.092838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.093117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.093778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:55.094096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.096087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.101040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f4862-0465-4d75-83e4-99466391e7e4 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.114747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.114747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.114747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.114747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] PATH_INFO: `/v3/users/78ce866c78554f638f9f2976c3f7198b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.116018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ce866c78554f638f9f2976c3f7198b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.118750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.126314 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1047/2119] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:55.127394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.138948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ec08-cbd9-4a17-9666-0885d4ac5204 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.148636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.150088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.150752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.151029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.151865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.154905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.258696 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1048/2120] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:55 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:25:55.262656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.359875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd136-7a1d-4bf9-b241-18d3cf6a245a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.368284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.370923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.372038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.372854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.374047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.377638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.392339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ce866c78554f638f9f2976c3f7198b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:55.404120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ce866c78554f638f9f2976c3f7198b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:55.405237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ce866c78554f638f9f2976c3f7198b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:55.432203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ce866c78554f638f9f2976c3f7198b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:55.472068 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1049/2121] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:55 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:55.476400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.478469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:55.499858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e76777-1e87-480d-824b-a3f98dbf42f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.506793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.507429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.507763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.508232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.508800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.511006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.539193 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1050/2122] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:25:55.540001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.541736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:55.546860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ce866c78554f638f9f2976c3f7198b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:55.565081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1073/2123] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:55 2022] DELETE /identity/v3/users/78ce866c78554f638f9f2976c3f7198b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:25:55.566938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.573824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d81890-bae7-4e8e-a7b8-62df96ea5fbd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.703417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.704314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.705593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.706622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] PATH_INFO: `/v3/projects/39e4a84c03a840aa9126c56fb2c79e9b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.711602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e4a84c03a840aa9126c56fb2c79e9b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.714810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.715334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79b24a-cee6-4776-9e14-75d9109e36f9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.730595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ff8c2-a0ff-4648-abe5-cceb3083ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.731604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff8c2-a0ff-4648-abe5-cceb3083ee27 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.732721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff8c2-a0ff-4648-abe5-cceb3083ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.733188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff8c2-a0ff-4648-abe5-cceb3083ee27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.734496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ff8c2-a0ff-4648-abe5-cceb3083ee27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.736955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ff8c2-a0ff-4648-abe5-cceb3083ee27 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.756357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:55.774694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1074/2124] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:55.774694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d149de-5a43-4db8-8a25-379a6d75e7b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.775553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d149de-5a43-4db8-8a25-379a6d75e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.775835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d149de-5a43-4db8-8a25-379a6d75e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.797519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:55.799393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-44d149de-5a43-4db8-8a25-379a6d75e7b4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:55.800597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44d149de-5a43-4db8-8a25-379a6d75e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:55.808964 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1075/2125] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:55.809918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d149de-5a43-4db8-8a25-379a6d75e7b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.820467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d149de-5a43-4db8-8a25-379a6d75e7b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:55.825436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:55.826146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:55.830909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:55.830909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] PATH_INFO: `/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd/users/d67dfe438ffa49a58fbe69705a6f4bba/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:55.843770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ebe6bccec0417c8e57d59162dad1cd, user_id=d67dfe438ffa49a58fbe69705a6f4bba, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:55.847227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:55.984304 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1076/2126] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:55 2022] PUT /identity/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd/users/d67dfe438ffa49a58fbe69705a6f4bba/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:55.984304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:55.984304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.001085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e4a84c03a840aa9126c56fb2c79e9b', 'request_id': 'req-eecde083-59a6-4c06-9877-77921677285f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.010137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e4a84c03a840aa9126c56fb2c79e9b', 'request_id': 'req-eecde083-59a6-4c06-9877-77921677285f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.064983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc523f-cdd6-4a40-b0eb-8431c2ad2109 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.100066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e4a84c03a840aa9126c56fb2c79e9b', 'request_id': 'req-eecde083-59a6-4c06-9877-77921677285f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.114552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] The token cache is being invalidate because project 39e4a84c03a840aa9126c56fb2c79e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:56.116013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.117339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eecde083-59a6-4c06-9877-77921677285f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.119534 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1051/2127] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:55 2022] DELETE /identity/v3/projects/39e4a84c03a840aa9126c56fb2c79e9b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:56.120774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281417-2730-4c91-95fc-d405d222947f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.121259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281417-2730-4c91-95fc-d405d222947f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.121690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281417-2730-4c91-95fc-d405d222947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.128603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd633313-191c-4abf-a2f0-8ae19126cd9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.129214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633313-191c-4abf-a2f0-8ae19126cd9e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.137490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633313-191c-4abf-a2f0-8ae19126cd9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.137490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd633313-191c-4abf-a2f0-8ae19126cd9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.137490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd633313-191c-4abf-a2f0-8ae19126cd9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.158620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3c281417-2730-4c91-95fc-d405d222947f None None] MFA Rules not processed for user `d67dfe438ffa49a58fbe69705a6f4bba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:56.159836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c281417-2730-4c91-95fc-d405d222947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.208361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd633313-191c-4abf-a2f0-8ae19126cd9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.209950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd633313-191c-4abf-a2f0-8ae19126cd9e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.220572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1077/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:56.221931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489abad4-da99-4242-a587-1bfea3f73913 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.222263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489abad4-da99-4242-a587-1bfea3f73913 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.222541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489abad4-da99-4242-a587-1bfea3f73913 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.225738 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1078/2129] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:25:56.225738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.225738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.225738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.238515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1052/2130] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:56.240079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba622-be5e-4f01-a50e-de9bbe867633 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.240512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba622-be5e-4f01-a50e-de9bbe867633 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.241005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba622-be5e-4f01-a50e-de9bbe867633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.254411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:56.255718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.262001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c7cba622-be5e-4f01-a50e-de9bbe867633 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:56.263209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7cba622-be5e-4f01-a50e-de9bbe867633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.265771 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1079/2131] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:56.266723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.268094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.281986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e8c8-6a68-40b8-a0b1-85e228d99493 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.289006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.290009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.290460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.290941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.292130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.294722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.347336 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1053/2132] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:56.352233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.352233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.352233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.371018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:56.372214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.385548 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1054/2133] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:56.386417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.387686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.400364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141c036-4693-483f-9944-f48f278a4a03 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.405373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.407375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.407375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.407375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] PATH_INFO: `/v3/users/c4ea23677e724670ad407d00c39fdd0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.408795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ea23677e724670ad407d00c39fdd0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.410911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.433815 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1080/2134] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:56 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:56.434688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.436261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.520687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3553f9-9563-4d65-b17a-07eda1c6e52d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.527598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.528873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.529214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.529550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.540043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.541766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.556456 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1081/2135] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:56.557446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.612707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ea23677e724670ad407d00c39fdd0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.614179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ea23677e724670ad407d00c39fdd0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.644058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a8275-bea6-485e-a0a5-3374190ba7e4 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.648915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.649520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.649799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.650103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.650753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:56.651059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.652743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.664996 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1082/2136] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:56.667025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.668924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.682071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010db7-e2de-4380-a7d9-bfe4527420b5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.686672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.687271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.687537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.687809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.688453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.690404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.729225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ea23677e724670ad407d00c39fdd0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.730675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ea23677e724670ad407d00c39fdd0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.743672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ea23677e724670ad407d00c39fdd0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:56.752371 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1083/2137] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:56 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:56.753661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.756867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.771389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef83a92-80a2-4b73-9e65-ab62f178f14e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.777325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.778072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.778430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.778770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.779751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.780925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1055/2138] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:56 2022] DELETE /identity/v3/users/c4ea23677e724670ad407d00c39fdd0b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:56.782764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.783469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.785810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:56.816569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:56.899984 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1084/2139] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:56 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:56.901109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:56.903227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:56.912862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965a25d-6b8b-4b8e-8b38-3a3c9574511d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.983633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:56.984846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:56.985318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:56.985743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] PATH_INFO: `/v3/projects/efb17fad956b42feb001a45797d841f0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:56.987141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb17fad956b42feb001a45797d841f0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:56.987762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff954df-ca14-49ec-a760-6f8693989205 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:56.989327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:56.998088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.002671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.002671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.002671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.002671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.002671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.013083 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1085/2140] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:57.014284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.026437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6faee5-8ae3-4bc8-ade7-b624fd1d839a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.032620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.033298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.033611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.034022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.034704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.036637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.133555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1086/2141] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:57 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:57.133555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.153854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a24d0-dd2a-4e70-b0ff-a4646329b06b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.157499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb17fad956b42feb001a45797d841f0', 'request_id': 'req-8118778e-d665-4d69-8575-5fc0ae8c7a53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.166631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb17fad956b42feb001a45797d841f0', 'request_id': 'req-8118778e-d665-4d69-8575-5fc0ae8c7a53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.230261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.230937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.231337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.231483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] PATH_INFO: `/v3/projects/9b44bdcfbad945fcb82e46cc17a472e3/users/5f0c80fbc6b646d88ea08af1f9567bc7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.237201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb17fad956b42feb001a45797d841f0', 'request_id': 'req-8118778e-d665-4d69-8575-5fc0ae8c7a53'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.247206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b44bdcfbad945fcb82e46cc17a472e3, user_id=5f0c80fbc6b646d88ea08af1f9567bc7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.250347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.254428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] The token cache is being invalidate because project efb17fad956b42feb001a45797d841f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:57.254827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.255643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.257670 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1056/2142] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:56 2022] DELETE /identity/v3/projects/efb17fad956b42feb001a45797d841f0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:57.258964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.260502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:57.274340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118778e-d665-4d69-8575-5fc0ae8c7a53 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.280112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.280836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.281274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.281563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] PATH_INFO: `/v3/projects/9bfb3b3d56c842739d5dfa14d1067a69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.282829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfb3b3d56c842739d5dfa14d1067a69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.284970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.318788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:57.335275 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1087/2143] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:57 2022] PUT /identity/v3/projects/9b44bdcfbad945fcb82e46cc17a472e3/users/5f0c80fbc6b646d88ea08af1f9567bc7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:57.336114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.339322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:57.398953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfb3b3d56c842739d5dfa14d1067a69', 'request_id': 'req-ffd582b4-51eb-434c-895e-eda0c90c93fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.404339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b8d8f-0fe8-4172-b5b8-81b20f5fdc7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.406830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfb3b3d56c842739d5dfa14d1067a69', 'request_id': 'req-ffd582b4-51eb-434c-895e-eda0c90c93fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.462689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.463313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.463979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.463979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.464554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.466204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.472145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfb3b3d56c842739d5dfa14d1067a69', 'request_id': 'req-ffd582b4-51eb-434c-895e-eda0c90c93fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.477284 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1088/2144] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:57.477979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.479707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:57.492705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4101a4-07e0-40a3-be4b-1841b521dc75 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.494416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] The token cache is being invalidate because project 9bfb3b3d56c842739d5dfa14d1067a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:57.494925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.495762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.498292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.498934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.503712 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1057/2145] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:57 2022] DELETE /identity/v3/projects/9bfb3b3d56c842739d5dfa14d1067a69 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:57.504096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.504096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] PATH_INFO: `/v3/users/e648357a89244413bee18c4483a44202` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.504262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.504262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:57.504395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e648357a89244413bee18c4483a44202)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.504579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.518077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd582b4-51eb-434c-895e-eda0c90c93fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.527175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.527175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.527175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.527175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.527622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.527622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.538091 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1058/2146] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:57.538960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.540645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:57.554224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dad20d-a7e5-43c6-aeb4-690426f4f318 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.559323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9c0d7-c0f4-4fd1-b0d5-ce85362a8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.559914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c0d7-c0f4-4fd1-b0d5-ce85362a8c2a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.560302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c0d7-c0f4-4fd1-b0d5-ce85362a8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.560581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c0d7-c0f4-4fd1-b0d5-ce85362a8c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.561219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9c0d7-c0f4-4fd1-b0d5-ce85362a8c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.562856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9c0d7-c0f4-4fd1-b0d5-ce85362a8c2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.575080 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1059/2147] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:57.576280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca8a5-2f7e-484b-b9b5-19e52055ca86 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.576600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca8a5-2f7e-484b-b9b5-19e52055ca86 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.590887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca8a5-2f7e-484b-b9b5-19e52055ca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.596759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-424ca8a5-2f7e-484b-b9b5-19e52055ca86 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:57.597969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-424ca8a5-2f7e-484b-b9b5-19e52055ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:57.606259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1060/2148] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:57.606994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ca8a5-2f7e-484b-b9b5-19e52055ca86 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.617478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ca8a5-2f7e-484b-b9b5-19e52055ca86 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.622672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.623480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.624083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.624455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] PATH_INFO: `/v3/projects/9b44bdcfbad945fcb82e46cc17a472e3/users/5f0c80fbc6b646d88ea08af1f9567bc7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.630681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b44bdcfbad945fcb82e46cc17a472e3, user_id=5f0c80fbc6b646d88ea08af1f9567bc7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.633355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.645909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1061/2149] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:57 2022] PUT /identity/v3/projects/9b44bdcfbad945fcb82e46cc17a472e3/users/5f0c80fbc6b646d88ea08af1f9567bc7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:57.646922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:57.716624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0de3b-8959-4c4e-a1c4-120e9e3ae26d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:57.721533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b35c4d-a812-4fb0-a2f1-bcda0796217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:57.725905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b35c4d-a812-4fb0-a2f1-bcda0796217f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.725905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b35c4d-a812-4fb0-a2f1-bcda0796217f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.725905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b35c4d-a812-4fb0-a2f1-bcda0796217f admin admin] PATH_INFO: `/v3/projects/4b5d86b9c96f46808d1965cee5b380c1/users/66210c012bc3404583b9e2acc5cb4014/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.778999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b35c4d-a812-4fb0-a2f1-bcda0796217f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5d86b9c96f46808d1965cee5b380c1, user_id=66210c012bc3404583b9e2acc5cb4014, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:57.781680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b35c4d-a812-4fb0-a2f1-bcda0796217f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:57.834460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e648357a89244413bee18c4483a44202'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.842826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e648357a89244413bee18c4483a44202'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.843518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e648357a89244413bee18c4483a44202'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.855295 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1062/2150] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:57 2022] PUT /identity/v3/projects/4b5d86b9c96f46808d1965cee5b380c1/users/66210c012bc3404583b9e2acc5cb4014/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:57.860540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be2d7e-a2ec-48da-9046-4a6418b6e6d9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.860540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be2d7e-a2ec-48da-9046-4a6418b6e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.860540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be2d7e-a2ec-48da-9046-4a6418b6e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.868451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e648357a89244413bee18c4483a44202'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.880147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80be2d7e-a2ec-48da-9046-4a6418b6e6d9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:57.881503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80be2d7e-a2ec-48da-9046-4a6418b6e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:57.945966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66239882-3801-4ff6-a1c7-5b7d2c93281c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e648357a89244413bee18c4483a44202'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:57.947068 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1063/2151] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:57.948156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cefd9-71c6-4726-8780-e089083c36c3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.948445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cefd9-71c6-4726-8780-e089083c36c3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.948722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cefd9-71c6-4726-8780-e089083c36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.967018 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1089/2152] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:25:57 2022] DELETE /identity/v3/users/e648357a89244413bee18c4483a44202 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:57.968229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9225db2-8774-4a85-ac13-8e8ed37d59f9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:57.968679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9225db2-8774-4a85-ac13-8e8ed37d59f9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:57.968965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9225db2-8774-4a85-ac13-8e8ed37d59f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:57.985733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce4cefd9-71c6-4726-8780-e089083c36c3 None None] MFA Rules not processed for user `5f0c80fbc6b646d88ea08af1f9567bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:57.987060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce4cefd9-71c6-4726-8780-e089083c36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:58.001973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e9225db2-8774-4a85-ac13-8e8ed37d59f9 None None] MFA Rules not processed for user `66210c012bc3404583b9e2acc5cb4014`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:58.003349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9225db2-8774-4a85-ac13-8e8ed37d59f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:58.076885 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1064/2153] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:58.078048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cefd9-71c6-4726-8780-e089083c36c3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.086398 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1090/2154] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:58.087347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9225db2-8774-4a85-ac13-8e8ed37d59f9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.101784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9225db2-8774-4a85-ac13-8e8ed37d59f9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.107411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.108327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.108620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.108907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.109567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:58.109940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.112150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.125543 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1091/2155] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:58.126630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.130207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:58.156653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cefd9-71c6-4726-8780-e089083c36c3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.162308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.163222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.164607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:58.165074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.165423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.166385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:58.166741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.169864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.182786 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1065/2156] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:58.183992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.195759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21423e2c-99d1-4416-a4c7-bb9c152a71dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.201446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.202219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.202616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.202999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.203945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.206006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.208208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721eed-6ebb-475f-a09c-1b1323945056 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.213160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.213916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.214311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.215035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.215240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.217471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.307329 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1066/2157] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:58 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:58.308502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.342792 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1092/2158] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:58 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:58.343750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.411761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16f1bf-698a-4d4d-b832-60bc20f92c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.443922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17023640-47c9-453b-ba11-91cd25793017 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.459047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.459766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.460684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.461423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.461688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:58.462006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.464676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.487133 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1093/2159] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:58.487133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.532796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.533676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.533989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.534301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.534947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.537061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.569250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb1aaa-2da0-4f02-a3b2-c33b0660f014 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.574462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.575082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.575365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.575640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.576274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.578908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.638964 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1067/2160] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:58 2022] POST /identity/v3/projects => generated 379 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:58.639780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.641350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:58.705168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78af7-0d12-4021-9e38-669e121090e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.710011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.715970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.715970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.715970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] PATH_INFO: `/v3/projects/6c63004901a04191afd52d03a34e64e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.715970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c63004901a04191afd52d03a34e64e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.715970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.717896 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1094/2161] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:58 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:58.718670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.720792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:58.797171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf07f-13ec-46f0-a4db-e593c19f564f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.814878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c63004901a04191afd52d03a34e64e8', 'request_id': 'req-411f6aa3-a09e-47d6-9e53-e49a73fb4849'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:58.827121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c63004901a04191afd52d03a34e64e8', 'request_id': 'req-411f6aa3-a09e-47d6-9e53-e49a73fb4849'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:58.864635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.865330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.865619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.866008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.882920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c63004901a04191afd52d03a34e64e8', 'request_id': 'req-411f6aa3-a09e-47d6-9e53-e49a73fb4849'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:58.895803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] The token cache is being invalidate because project 6c63004901a04191afd52d03a34e64e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:25:58.896229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:58.896929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:25:58.898518 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1068/2162] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:58 2022] DELETE /identity/v3/projects/6c63004901a04191afd52d03a34e64e8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:58.899346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.900819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:58.935344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.936959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:58.949813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1095/2163] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:25:58.950741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:58.983441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6aa3-a09e-47d6-9e53-e49a73fb4849 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:58.989847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f5f54-9d63-40d7-9922-a1b21c6c253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:58.991748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f5f54-9d63-40d7-9922-a1b21c6c253a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:58.992028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f5f54-9d63-40d7-9922-a1b21c6c253a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:58.992297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f5f54-9d63-40d7-9922-a1b21c6c253a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:58.992942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f5f54-9d63-40d7-9922-a1b21c6c253a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:58.994969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f5f54-9d63-40d7-9922-a1b21c6c253a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.020827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:59.023690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd1682-5128-4d16-9c64-585fdd4c2c47 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.028988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce548a5-4500-4b04-9ee4-9a4ee280048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.029807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce548a5-4500-4b04-9ee4-9a4ee280048b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.030110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce548a5-4500-4b04-9ee4-9a4ee280048b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.030385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce548a5-4500-4b04-9ee4-9a4ee280048b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.031103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce548a5-4500-4b04-9ee4-9a4ee280048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.033269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce548a5-4500-4b04-9ee4-9a4ee280048b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.046766 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1096/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:59.046766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.046766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.046766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.065248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:59.066476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.079789 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1069/2165] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:58 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:59.080187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0593-4a3b-4692-a90f-2b5df2c22e73 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.080859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0593-4a3b-4692-a90f-2b5df2c22e73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.080859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc0593-4a3b-4692-a90f-2b5df2c22e73 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.083180 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1097/2166] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:59.083180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.084172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.087167 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1070/2167] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:25:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:25:59.088337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706920a-1c3f-48fd-8909-a19471de5a22 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.088688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706920a-1c3f-48fd-8909-a19471de5a22 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.089034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706920a-1c3f-48fd-8909-a19471de5a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.097032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d6ba0-252c-4b65-a952-f25263aa093a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.101139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:59.103574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.104422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.104422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.104422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] PATH_INFO: `/v3/projects/c0db162b992a445aa39fa0be90db1666/users/a3eb2115e91e4dd0a8dd73b5c31d908b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.114306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c706920a-1c3f-48fd-8909-a19471de5a22 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:59.116127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c706920a-1c3f-48fd-8909-a19471de5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.121413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0db162b992a445aa39fa0be90db1666, user_id=a3eb2115e91e4dd0a8dd73b5c31d908b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.124499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.125042 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1071/2168] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:59.128399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706920a-1c3f-48fd-8909-a19471de5a22 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.137856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706920a-1c3f-48fd-8909-a19471de5a22 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.143299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.143917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.144200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.144479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.145132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.146779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.157683 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1072/2169] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:59.158570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:25:59.160390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.176424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.177738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.192811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e883f-9736-42fb-9a87-79cdafa8954b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.193286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1098/2170] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:59 2022] PUT /identity/v3/projects/c0db162b992a445aa39fa0be90db1666/users/a3eb2115e91e4dd0a8dd73b5c31d908b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:59.194069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.258365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.259020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.259307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.259585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/0091fb2495fa441a83a4fb57049457be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.260735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=0091fb2495fa441a83a4fb57049457be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.263050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.263664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aa3d6-a7c9-4dbe-b9f9-80929d137205 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.264870 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1073/2171] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/projects/0091fb2495fa441a83a4fb57049457be => generated 371 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:59.265599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.273495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.274353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.278155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.278155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.278155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:25:59.278155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.278155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.283681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049cbb7-eec0-49b0-9a1a-b56c4ee406ce tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.289387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.290692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.291077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.291889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.293288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.295107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.298934 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1099/2172] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:59.298934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.320121 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1074/2173] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:59.320510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1217-058b-4437-8683-a4d8cb418687 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.321372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.326633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.327538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.327903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.330035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.330863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.332618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.332737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae431724-daa6-471c-9c4c-96c10e8b38b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.338079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632c03c-c8c5-40e8-a815-3b713c49441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.339265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c03c-c8c5-40e8-a815-3b713c49441b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.339555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c03c-c8c5-40e8-a815-3b713c49441b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.339836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632c03c-c8c5-40e8-a815-3b713c49441b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.340843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632c03c-c8c5-40e8-a815-3b713c49441b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.342952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632c03c-c8c5-40e8-a815-3b713c49441b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.347332 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1100/2174] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:59.348489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.364231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c085f3-9ae5-43e3-a218-bd4683e09a12 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.370144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.370981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.371271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.371546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] PATH_INFO: `/v3/projects/66130c964c634dab874f3cacc09c5db6/users/19343438b3424ea0afd623dfab43f5d5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.388516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66130c964c634dab874f3cacc09c5db6, user_id=19343438b3424ea0afd623dfab43f5d5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.391810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.425893 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1075/2175] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:25:59 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:59.425893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d4db1-1ace-483b-a76a-75c5ce0c0195 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.425893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d4db1-1ace-483b-a76a-75c5ce0c0195 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.425893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d4db1-1ace-483b-a76a-75c5ce0c0195 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.429197 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1076/2176] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:25:59.429849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d4db1-1ace-483b-a76a-75c5ce0c0195 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.492293 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1101/2177] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:59 2022] PUT /identity/v3/projects/66130c964c634dab874f3cacc09c5db6/users/19343438b3424ea0afd623dfab43f5d5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:59.502690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.507499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:59.579817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d4db1-1ace-483b-a76a-75c5ce0c0195 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.586198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.586641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520c1e8-2eb4-45d7-9acc-fbd904a2735c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.586885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.587200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.587453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] PATH_INFO: `/v3/projects/c0db162b992a445aa39fa0be90db1666/users/a3eb2115e91e4dd0a8dd73b5c31d908b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.589564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0db162b992a445aa39fa0be90db1666, user_id=a3eb2115e91e4dd0a8dd73b5c31d908b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.592111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2d7c7-0529-45aa-b233-ac518a4aa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.592257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.593625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2d7c7-0529-45aa-b233-ac518a4aa465 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.594624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2d7c7-0529-45aa-b233-ac518a4aa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.594999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2d7c7-0529-45aa-b233-ac518a4aa465 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.595905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2d7c7-0529-45aa-b233-ac518a4aa465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.607426 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1077/2178] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:25:59 2022] PUT /identity/v3/projects/c0db162b992a445aa39fa0be90db1666/users/a3eb2115e91e4dd0a8dd73b5c31d908b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:25:59.608498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:25:59.610403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.611352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2d7c7-0529-45aa-b233-ac518a4aa465 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.704232 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1102/2179] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:25:59 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:25:59.704232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe98d9-d4bf-4506-84f1-2fb020089893 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.704232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe98d9-d4bf-4506-84f1-2fb020089893 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.704232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe98d9-d4bf-4506-84f1-2fb020089893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.711242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.763888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-30fe98d9-d4bf-4506-84f1-2fb020089893 None None] MFA Rules not processed for user `19343438b3424ea0afd623dfab43f5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:59.765677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30fe98d9-d4bf-4506-84f1-2fb020089893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.806084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504415-35d8-401c-b764-2cf4d7e245b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.811396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcea266-7ecc-4366-a75b-89c19f4eb77f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.812263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea266-7ecc-4366-a75b-89c19f4eb77f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.812711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea266-7ecc-4366-a75b-89c19f4eb77f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.813676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcea266-7ecc-4366-a75b-89c19f4eb77f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/0091fb2495fa441a83a4fb57049457be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.814886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcea266-7ecc-4366-a75b-89c19f4eb77f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=0091fb2495fa441a83a4fb57049457be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.816949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcea266-7ecc-4366-a75b-89c19f4eb77f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.818670 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1078/2180] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/projects/0091fb2495fa441a83a4fb57049457be => generated 371 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:25:59.820046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.820333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.820607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.845596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1103/2181] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:59.846722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe98d9-d4bf-4506-84f1-2fb020089893 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.852566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] MFA Rules not processed for user `a3eb2115e91e4dd0a8dd73b5c31d908b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:25:59.854137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.917381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe98d9-d4bf-4506-84f1-2fb020089893 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.922153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.923329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.923611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.923885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.924561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.926984 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1079/2182] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:25:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:25:59.927180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:25:59.931051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.932520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:25:59.947110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1104/2183] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:25:59.947761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:25:59.975859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2f7f3-0236-4ca1-9dac-3d3ac5a440c2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:25:59.983677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:25:59.984617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:25:59.985580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:25:59.986006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:25:59.996683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:25:59.998367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:00.021242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9d7b-cfac-4800-8a7c-0f6dbc31fd90 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:00.025942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26702c68-8f63-44fc-ac72-598db19ea6cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:00.026843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26702c68-8f63-44fc-ac72-598db19ea6cc service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.026939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26702c68-8f63-44fc-ac72-598db19ea6cc service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.027374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26702c68-8f63-44fc-ac72-598db19ea6cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.029830 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1105/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:00.034240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:00.047240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86479ab3-5734-42b0-9d33-22beb8add04d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:00.053059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:00.062005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.062005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.062005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.062005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:00.062005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:00.062435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26702c68-8f63-44fc-ac72-598db19ea6cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:00.062435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26702c68-8f63-44fc-ac72-598db19ea6cc service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:00.070082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1106/2185] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:00.074073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:00.075278 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1080/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:25:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:00.087501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3363b2-812b-4655-a8dc-804528f02a00 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:00.094304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71dff2-bc9e-40cf-a3f3-53b64632b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:00.095146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71dff2-bc9e-40cf-a3f3-53b64632b4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.095723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71dff2-bc9e-40cf-a3f3-53b64632b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.096147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71dff2-bc9e-40cf-a3f3-53b64632b4bd admin admin] PATH_INFO: `/v3/projects/e374527f6eda4730aa116c71d01dfd4b/users/5c053ac77b3c479da2f3145adb4dfc21/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.128372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afa04-bcbb-426b-935b-d345bfb75ceb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.128618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afa04-bcbb-426b-935b-d345bfb75ceb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.128956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afa04-bcbb-426b-935b-d345bfb75ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.130555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71dff2-bc9e-40cf-a3f3-53b64632b4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e374527f6eda4730aa116c71d01dfd4b, user_id=5c053ac77b3c479da2f3145adb4dfc21, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:00.134169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71dff2-bc9e-40cf-a3f3-53b64632b4bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:00.151420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ff0afa04-bcbb-426b-935b-d345bfb75ceb None None] MFA Rules not processed for user `fa4ca05a0c6a405f8fa014ee06dbcef4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:00.153202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff0afa04-bcbb-426b-935b-d345bfb75ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:00.241565 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1107/2187] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:00 2022] PUT /identity/v3/projects/e374527f6eda4730aa116c71d01dfd4b/users/5c053ac77b3c479da2f3145adb4dfc21/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:00.243252 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1081/2188] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:00.248631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46bb2-6b1e-4a2d-af23-c5b61bc9c768 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.250134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46bb2-6b1e-4a2d-af23-c5b61bc9c768 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.251345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46bb2-6b1e-4a2d-af23-c5b61bc9c768 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.253108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491472d-2af1-45af-a50c-0ea7df225297 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.253580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491472d-2af1-45af-a50c-0ea7df225297 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.254017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491472d-2af1-45af-a50c-0ea7df225297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.256619 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1108/2189] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:26:00.261775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46bb2-6b1e-4a2d-af23-c5b61bc9c768 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:00.296304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b491472d-2af1-45af-a50c-0ea7df225297 None None] MFA Rules not processed for user `5c053ac77b3c479da2f3145adb4dfc21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:00.297811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b491472d-2af1-45af-a50c-0ea7df225297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:00.373485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46bb2-6b1e-4a2d-af23-c5b61bc9c768 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:00.416554 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1082/2190] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:00.421482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb3f2-ddc8-439e-91a1-7cbf6ec25f9a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.421974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb3f2-ddc8-439e-91a1-7cbf6ec25f9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.422458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb3f2-ddc8-439e-91a1-7cbf6ec25f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.445485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4badb3f2-ddc8-439e-91a1-7cbf6ec25f9a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:00.447259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4badb3f2-ddc8-439e-91a1-7cbf6ec25f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:00.470369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:00.478326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46bb2-6b1e-4a2d-af23-c5b61bc9c768 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:00.485094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:00.485748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.486037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.486369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/0091fb2495fa441a83a4fb57049457be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.487598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=0091fb2495fa441a83a4fb57049457be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:00.490366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:00.497480 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1109/2191] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:00 2022] GET /identity/v3/projects/0091fb2495fa441a83a4fb57049457be => generated 371 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:00.498635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:00.579826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1083/2192] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:26:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:00.584320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57211da6-15ee-4f80-a3a7-5491ca21b8f9 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:00.591245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:00.596663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.596663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.596663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.596663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:00.596663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:00.597215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badb3f2-ddc8-439e-91a1-7cbf6ec25f9a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:00.623948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badb3f2-ddc8-439e-91a1-7cbf6ec25f9a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:00.633220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:00.633865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.634181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.634459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/0091fb2495fa441a83a4fb57049457be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.635601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0091fb2495fa441a83a4fb57049457be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:00.637508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:00.701743 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1110/2193] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:00 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:00.702939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:00.705574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:00.798504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0091fb2495fa441a83a4fb57049457be', 'request_id': 'req-47ed613a-aaff-4cdd-9c1d-8330e922cf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:00.805667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0091fb2495fa441a83a4fb57049457be', 'request_id': 'req-47ed613a-aaff-4cdd-9c1d-8330e922cf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:00.824007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869d767-8bfc-4bec-a226-1b4283221e5f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:00.877739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0091fb2495fa441a83a4fb57049457be', 'request_id': 'req-47ed613a-aaff-4cdd-9c1d-8330e922cf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:00.891161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] The token cache is being invalidate because project 0091fb2495fa441a83a4fb57049457be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:00.891653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:00.892601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:00.901554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf40b92-2dac-405b-90b8-ace1104ddb5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:00.901794 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1084/2194] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:00 2022] DELETE /identity/v3/projects/0091fb2495fa441a83a4fb57049457be => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:00.902351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf40b92-2dac-405b-90b8-ace1104ddb5f service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:00.902687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf40b92-2dac-405b-90b8-ace1104ddb5f service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:00.902796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:00.902970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf40b92-2dac-405b-90b8-ace1104ddb5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:00.909339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:00.909475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5bf40b92-2dac-405b-90b8-ace1104ddb5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:00.999681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf40b92-2dac-405b-90b8-ace1104ddb5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.001775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf40b92-2dac-405b-90b8-ace1104ddb5f service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.003970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed613a-aaff-4cdd-9c1d-8330e922cf75 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.009370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.010302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.010507 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1111/2195] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:01.010748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.011094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.011813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.014325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.069501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.069910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.070226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.071594 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1112/2196] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:26:01.076429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:01.078509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:01.083095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:01.125108 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1085/2197] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:00 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:01.128691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.145020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42bd6e-571e-4731-a960-81520b9d7466 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.150312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.151044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.151472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.152225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.152695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.154570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.168113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1086/2198] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:26:01.168584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.169868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:01.171931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.182357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20bd4-7397-49da-ade3-cf442125ecd7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.187092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.187731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.188043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.188317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] PATH_INFO: `/v3/projects/b25d3a45355e49bbad1b29ce5ffe0200/users/77e60de7885e4927bffa684043f7d19c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.205242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25d3a45355e49bbad1b29ce5ffe0200, user_id=77e60de7885e4927bffa684043f7d19c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.207933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.244087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e951f7-9e77-4aed-b4ae-5ff139b856b0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.249229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.249944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.250419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.250984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.253044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2ebe6bccec0417c8e57d59162dad1cd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.255292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.257052 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1113/2199] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:01 2022] GET /identity/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd => generated 373 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:01.276920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.289276 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1087/2200] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:01 2022] PUT /identity/v3/projects/b25d3a45355e49bbad1b29ce5ffe0200/users/77e60de7885e4927bffa684043f7d19c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:26:01.293147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.299511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72c7b7-795c-4892-ab85-23cfb4192052 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.379899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.381958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.385421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.386099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.386396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:01.386711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.388478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.403434 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1114/2201] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:01.405286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ea75e-e73d-4d10-b6a4-900bf89896c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.408141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.427679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eea33-ff0e-42d3-af80-06521e8c8c82 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.433132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.433833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.434239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.434594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.435478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.437340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.438757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.439398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.440068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.440068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.440581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.447669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.467619 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1088/2202] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:01.473594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.493702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed047ae7-ee5d-4a8e-be85-8ca5ff4f4b0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.493702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a1a11-81e2-4ee5-b60c-c20c26fd6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.493702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1a11-81e2-4ee5-b60c-c20c26fd6ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.493702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1a11-81e2-4ee5-b60c-c20c26fd6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.494527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1a11-81e2-4ee5-b60c-c20c26fd6ea8 admin admin] PATH_INFO: `/v3/projects/b25d3a45355e49bbad1b29ce5ffe0200/users/77e60de7885e4927bffa684043f7d19c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.497178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1a11-81e2-4ee5-b60c-c20c26fd6ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25d3a45355e49bbad1b29ce5ffe0200, user_id=77e60de7885e4927bffa684043f7d19c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.502553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1a11-81e2-4ee5-b60c-c20c26fd6ea8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.533919 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1089/2203] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:01 2022] PUT /identity/v3/projects/b25d3a45355e49bbad1b29ce5ffe0200/users/77e60de7885e4927bffa684043f7d19c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:01.544911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ebff-13fa-4c71-9fbf-9d6af54325b6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.545190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ebff-13fa-4c71-9fbf-9d6af54325b6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.545477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65ebff-13fa-4c71-9fbf-9d6af54325b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.558602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1115/2204] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:01 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:26:01.567611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.595560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1b65ebff-13fa-4c71-9fbf-9d6af54325b6 None None] MFA Rules not processed for user `77e60de7885e4927bffa684043f7d19c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:01.596813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b65ebff-13fa-4c71-9fbf-9d6af54325b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:01.646415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0e47-e474-4af5-8888-1e726f7fc21e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.659086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.660625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.661098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.661895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.662763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:01.663331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.665819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.685312 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1116/2205] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:01.685312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.685312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:01.700470 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1090/2206] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:01.710303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f02c-c32a-44ad-9cd4-6c93997c7a0f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.710303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f02c-c32a-44ad-9cd4-6c93997c7a0f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.710303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f02c-c32a-44ad-9cd4-6c93997c7a0f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.710303 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1091/2207] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:26:01.711202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f02c-c32a-44ad-9cd4-6c93997c7a0f None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:01.713437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e63f02c-c32a-44ad-9cd4-6c93997c7a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:01.765255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc3930-3a4c-4444-b0c5-3d234cdeb1dc tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.773448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.774123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.774405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.774681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] PATH_INFO: `/v3/users/66210c012bc3404583b9e2acc5cb4014` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.775837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66210c012bc3404583b9e2acc5cb4014)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.777793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.818514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f02c-c32a-44ad-9cd4-6c93997c7a0f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:01.830153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f02c-c32a-44ad-9cd4-6c93997c7a0f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:01.834890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2bd4-b992-4c1f-933c-59f39e7afaf8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:01.835552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2bd4-b992-4c1f-933c-59f39e7afaf8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.835843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2bd4-b992-4c1f-933c-59f39e7afaf8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.836124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2bd4-b992-4c1f-933c-59f39e7afaf8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/762964e997d24582933fdaa95c234710` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.837420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2bd4-b992-4c1f-933c-59f39e7afaf8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=762964e997d24582933fdaa95c234710)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:01.839381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2bd4-b992-4c1f-933c-59f39e7afaf8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:01.841106 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1092/2208] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:01 2022] GET /identity/v3/projects/762964e997d24582933fdaa95c234710 => generated 371 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:01.842230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c69f2-d9a4-4d32-b49c-a814e7ac69d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:01.842512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c69f2-d9a4-4d32-b49c-a814e7ac69d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:01.842969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c69f2-d9a4-4d32-b49c-a814e7ac69d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:01.862286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-929c69f2-d9a4-4d32-b49c-a814e7ac69d0 None None] MFA Rules not processed for user `5c053ac77b3c479da2f3145adb4dfc21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:01.864271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-929c69f2-d9a4-4d32-b49c-a814e7ac69d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:01.925143 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1093/2209] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:02.006885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66210c012bc3404583b9e2acc5cb4014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:02.024680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c69f2-d9a4-4d32-b49c-a814e7ac69d0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:02.026688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66210c012bc3404583b9e2acc5cb4014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:02.027493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66210c012bc3404583b9e2acc5cb4014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:02.040572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c69f2-d9a4-4d32-b49c-a814e7ac69d0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:02.042115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66210c012bc3404583b9e2acc5cb4014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:02.047990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b0bd-363f-417b-9fb3-948c4df123f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:02.048296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b0bd-363f-417b-9fb3-948c4df123f6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.048401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b0bd-363f-417b-9fb3-948c4df123f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.048671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b0bd-363f-417b-9fb3-948c4df123f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.050552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b14b0bd-363f-417b-9fb3-948c4df123f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:02.061923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14b0bd-363f-417b-9fb3-948c4df123f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:02.064214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14b0bd-363f-417b-9fb3-948c4df123f6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:02.073378 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1094/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:02.123216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5d06b49a-a8a8-4789-b386-58b17754d58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66210c012bc3404583b9e2acc5cb4014'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:02.133241 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1117/2211] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:01 2022] DELETE /identity/v3/users/66210c012bc3404583b9e2acc5cb4014 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:02.139137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.139750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.140176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.161590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:02.162903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:02.208727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:02.239412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008421-c782-4ab1-97f6-ca79594fca91 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.239992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008421-c782-4ab1-97f6-ca79594fca91 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.240438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9008421-c782-4ab1-97f6-ca79594fca91 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.241037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1095/2212] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:02.242583 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1118/2213] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:26:02.247899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:02.251835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:02.253850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9008421-c782-4ab1-97f6-ca79594fca91 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:02.255727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9008421-c782-4ab1-97f6-ca79594fca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:02.260836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:02.325092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9008421-c782-4ab1-97f6-ca79594fca91 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:02.330923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:02.331867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.332303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.333046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.344338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:02.346622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:02.349566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:02.351754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:02.358025 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1119/2214] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:26:02.432452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848051a-b6b3-4033-b535-06cfa34c9271 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:02.439464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:02.441435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.442688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.443004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/762964e997d24582933fdaa95c234710` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.444639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=762964e997d24582933fdaa95c234710)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:02.447295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:02.449844 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1096/2215] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:02 2022] GET /identity/v3/projects/762964e997d24582933fdaa95c234710 => generated 371 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:02.511279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:02.521575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001335fb-db11-4ecf-bb84-dadbcbcaa241 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:02.526673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:02.527281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.527564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.527869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.528519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:02.528832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:02.530820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:02.545143 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1120/2216] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:02.549941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:02.562715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5f22e-be2c-4ca0-84a2-7dae6c3c0761 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:02.569509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:02.569509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.569509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.569815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.570220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:02.572498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:02.720988 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1097/2217] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:02 2022] POST /identity/v3/users => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:02.725232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:02.738749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312cefe-5b3d-4991-84e1-ade7a5cd014e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:02.747797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf0f2-24ea-473f-9608-4d36375266d8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:02.748626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf0f2-24ea-473f-9608-4d36375266d8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.748912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf0f2-24ea-473f-9608-4d36375266d8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.749191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf0f2-24ea-473f-9608-4d36375266d8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.749887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf0f2-24ea-473f-9608-4d36375266d8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:02.750198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf0f2-24ea-473f-9608-4d36375266d8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:02.751839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf0f2-24ea-473f-9608-4d36375266d8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:02.767040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1121/2218] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:02.903560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:02.905528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:02.924999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6483a32-c686-486f-b5df-fec16f069ee0 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:02.944793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:02.945547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.945920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.946303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] PATH_INFO: `/v3/projects/4b5d86b9c96f46808d1965cee5b380c1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.947633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5d86b9c96f46808d1965cee5b380c1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:02.950274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:02.973167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f32f7-0876-42bb-8e5a-3007dba8f32a None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:02.973453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f32f7-0876-42bb-8e5a-3007dba8f32a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:02.973728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f32f7-0876-42bb-8e5a-3007dba8f32a None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:02.975125 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1122/2219] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:26:02.979938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f32f7-0876-42bb-8e5a-3007dba8f32a None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:02.996307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f32f7-0876-42bb-8e5a-3007dba8f32a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:03.006498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f32f7-0876-42bb-8e5a-3007dba8f32a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:03.010927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:03.011556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:03.011834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:03.012129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/762964e997d24582933fdaa95c234710` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:03.013430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=762964e997d24582933fdaa95c234710)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:03.015495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:03.018039 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1123/2220] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:02 2022] GET /identity/v3/projects/762964e997d24582933fdaa95c234710 => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:03.118321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5d86b9c96f46808d1965cee5b380c1', 'request_id': 'req-637c4a4b-79fc-42ad-beaf-2680b7af4b01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.129060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5d86b9c96f46808d1965cee5b380c1', 'request_id': 'req-637c4a4b-79fc-42ad-beaf-2680b7af4b01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.188709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5d86b9c96f46808d1965cee5b380c1', 'request_id': 'req-637c4a4b-79fc-42ad-beaf-2680b7af4b01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.213396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] The token cache is being invalidate because project 4b5d86b9c96f46808d1965cee5b380c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:03.213926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.214823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-637c4a4b-79fc-42ad-beaf-2680b7af4b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.216527 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1098/2221] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:02 2022] DELETE /identity/v3/projects/4b5d86b9c96f46808d1965cee5b380c1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:03.221824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:03.223808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:03.235762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:03.236171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:03.236520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:03.237852 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1099/2222] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:26:03.241281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522b7e-a4e3-4261-b947-3c64d9f8e7fe tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:03.245466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:03.247315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:03.321095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:03.321999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:03.322421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:03.322753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] PATH_INFO: `/v3/users/a3eb2115e91e4dd0a8dd73b5c31d908b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:03.323988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3eb2115e91e4dd0a8dd73b5c31d908b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:03.326099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:03.347326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:03.348604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:03.358305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:03.420150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d51024-f1df-46f6-b7c5-54d3ea64cc70 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:03.428251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:03.428858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:03.429210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:03.429532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/762964e997d24582933fdaa95c234710` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:03.430798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=762964e997d24582933fdaa95c234710)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:03.433332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:03.439903 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1100/2223] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:03 2022] GET /identity/v3/projects/762964e997d24582933fdaa95c234710 => generated 371 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:03.474792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:03.485439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e22fb-5bad-4494-b6b2-bbe0406a62a3 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:03.490706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:03.491403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:03.491691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:03.491968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/users/ec5034e8553647b5bd6317123a7bc3d2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:03.509009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec5034e8553647b5bd6317123a7bc3d2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:03.511083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:03.542004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3eb2115e91e4dd0a8dd73b5c31d908b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.549517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3eb2115e91e4dd0a8dd73b5c31d908b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.550271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3eb2115e91e4dd0a8dd73b5c31d908b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.561808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3eb2115e91e4dd0a8dd73b5c31d908b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.622467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3eb2115e91e4dd0a8dd73b5c31d908b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.646146 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1124/2224] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:03 2022] DELETE /identity/v3/users/a3eb2115e91e4dd0a8dd73b5c31d908b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:03.796120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5034e8553647b5bd6317123a7bc3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.798565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5034e8553647b5bd6317123a7bc3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.853160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5034e8553647b5bd6317123a7bc3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.854485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5034e8553647b5bd6317123a7bc3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.871071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5034e8553647b5bd6317123a7bc3d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:03.892771 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1101/2225] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:03 2022] DELETE /identity/v3/users/ec5034e8553647b5bd6317123a7bc3d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:26:03.898272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:03.900149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:04.002258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656ebc4-8773-4bd6-9e21-1baf9d8c1857 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:04.043254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:04.165817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:04.166578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.166870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.167154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/762964e997d24582933fdaa95c234710` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:04.168308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:delete_project(project_id=762964e997d24582933fdaa95c234710)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:04.170258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:04.269659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:04.276853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:04.348143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762964e997d24582933fdaa95c234710', 'request_id': 'req-964f1fab-563c-4427-95ba-b84755ef04ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.357070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762964e997d24582933fdaa95c234710', 'request_id': 'req-964f1fab-563c-4427-95ba-b84755ef04ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.420206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f495126-b005-47c5-80e6-fd0ae80210e8 tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:04.436692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762964e997d24582933fdaa95c234710', 'request_id': 'req-964f1fab-563c-4427-95ba-b84755ef04ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.462146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] The token cache is being invalidate because project 762964e997d24582933fdaa95c234710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:04.462146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.462146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-964f1fab-563c-4427-95ba-b84755ef04ac tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.472441 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1125/2226] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:03 2022] DELETE /identity/v3/projects/762964e997d24582933fdaa95c234710 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:04.506948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.507395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.507766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:04.509238 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1126/2227] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:26:04.514737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:04.520076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:04.535537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:04.536198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.536482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.536756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] PATH_INFO: `/v3/projects/c0db162b992a445aa39fa0be90db1666` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:04.539525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0db162b992a445aa39fa0be90db1666)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:04.542678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:04.621576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:04.622765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:04.663928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0db162b992a445aa39fa0be90db1666', 'request_id': 'req-76a95976-202f-4f73-ae92-f1d31052ba31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.672329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0db162b992a445aa39fa0be90db1666', 'request_id': 'req-76a95976-202f-4f73-ae92-f1d31052ba31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.725876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf0866-c745-4d54-a155-333e1a3f5117 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:04.728286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0db162b992a445aa39fa0be90db1666', 'request_id': 'req-76a95976-202f-4f73-ae92-f1d31052ba31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.751742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] The token cache is being invalidate because project c0db162b992a445aa39fa0be90db1666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:04.752184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.753247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76a95976-202f-4f73-ae92-f1d31052ba31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:04.756740 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1102/2228] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:04 2022] DELETE /identity/v3/projects/c0db162b992a445aa39fa0be90db1666 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:26:04.761513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbfe8a-1d13-4dd7-b893-b7a37f5ddfea None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.761966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbfe8a-1d13-4dd7-b893-b7a37f5ddfea None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.762426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbfe8a-1d13-4dd7-b893-b7a37f5ddfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:04.788032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a4bbfe8a-1d13-4dd7-b893-b7a37f5ddfea None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:04.789358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4bbfe8a-1d13-4dd7-b893-b7a37f5ddfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:04.798680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77609a8f-70e3-4e7e-aca3-33940961c94e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:04.799325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609a8f-70e3-4e7e-aca3-33940961c94e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.799610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609a8f-70e3-4e7e-aca3-33940961c94e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.799885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77609a8f-70e3-4e7e-aca3-33940961c94e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:04.801215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77609a8f-70e3-4e7e-aca3-33940961c94e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2ebe6bccec0417c8e57d59162dad1cd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:04.803475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77609a8f-70e3-4e7e-aca3-33940961c94e tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:04.805138 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1127/2229] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:04 2022] GET /identity/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd => generated 373 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:04.877219 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1103/2230] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:04.885142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619e71f-9326-421f-9810-6181b8c355f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.885478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619e71f-9326-421f-9810-6181b8c355f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.885767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619e71f-9326-421f-9810-6181b8c355f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:04.905865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f619e71f-9326-421f-9810-6181b8c355f7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:04.907189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f619e71f-9326-421f-9810-6181b8c355f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:04.915523 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1128/2231] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:04.920277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbfe8a-1d13-4dd7-b893-b7a37f5ddfea None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:04.932180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bbfe8a-1d13-4dd7-b893-b7a37f5ddfea None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:04.943195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9914290-d5d9-4251-b874-4eac4e39a635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:04.943195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9914290-d5d9-4251-b874-4eac4e39a635 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.943195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9914290-d5d9-4251-b874-4eac4e39a635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.943195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9914290-d5d9-4251-b874-4eac4e39a635 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:04.943595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9914290-d5d9-4251-b874-4eac4e39a635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:04.943595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9914290-d5d9-4251-b874-4eac4e39a635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:04.943595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9914290-d5d9-4251-b874-4eac4e39a635 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:04.958341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1104/2232] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:04.959742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619e71f-9326-421f-9810-6181b8c355f7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:04.981656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619e71f-9326-421f-9810-6181b8c355f7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:04.991085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:04.992349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:04.992836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:04.993064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.001836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:05.004857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:05.056385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.056677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.056956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.058357 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1105/2233] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:26:05.064362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:05.066875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:05.093092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1129/2234] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:04 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:05.097644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:05.179473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:05.181023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:05.187052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:05.205973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74259714-e746-4ada-9d40-de49a5b4ff21 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:05.208893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bd559-7f8a-4920-abad-feb5fe120a3a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:05.216037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:05.216951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.217331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.218002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.219039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:05.222248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:05.291963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:05.293043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.293359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.293643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.294887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2ebe6bccec0417c8e57d59162dad1cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:05.297002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:05.299551 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1106/2235] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:05 2022] GET /identity/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd => generated 373 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:05.333466 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1130/2236] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:05 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:26:05.340187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:05.361477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cb5b1-87bb-4cc1-93e1-86ca7afa375f tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:05.373725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:05.374653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.378401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.378401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.378401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:05.378703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:05.398028 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1107/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:05.407439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:05.423110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eed0e9-eb0c-4389-b9cc-ffd3eb1e26a0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:05.428747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72ada7-9215-4cb0-853b-6be03d52729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:05.429490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ada7-9215-4cb0-853b-6be03d52729c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.429961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ada7-9215-4cb0-853b-6be03d52729c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.430332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ada7-9215-4cb0-853b-6be03d52729c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.431607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72ada7-9215-4cb0-853b-6be03d52729c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:05.433330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72ada7-9215-4cb0-853b-6be03d52729c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:05.450157 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1131/2238] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:05.451659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:05.464802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a6bc-46cb-48de-a710-c013e3dfb2db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:05.471000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:05.471855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.472189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.472466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] PATH_INFO: `/v3/projects/9f5cd093b94c4161bed82c6495bc37be/users/92f8b851f06d4b038a147c7dd873cb34/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.489528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5cd093b94c4161bed82c6495bc37be, user_id=92f8b851f06d4b038a147c7dd873cb34, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:05.492352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:05.574096 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1108/2239] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:05 2022] PUT /identity/v3/projects/9f5cd093b94c4161bed82c6495bc37be/users/92f8b851f06d4b038a147c7dd873cb34/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:26:05.584245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7790c-95cf-4a02-bca6-f33a899430c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.584525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7790c-95cf-4a02-bca6-f33a899430c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.584806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7790c-95cf-4a02-bca6-f33a899430c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.619640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9fd7790c-95cf-4a02-bca6-f33a899430c9 None None] MFA Rules not processed for user `92f8b851f06d4b038a147c7dd873cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:05.621007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9fd7790c-95cf-4a02-bca6-f33a899430c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:05.713606 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1132/2240] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:05.714729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:05.769322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:05.812959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766046f-1c4c-4fbe-945f-4e8d4482f003 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:05.818563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:05.819237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:05.819542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:05.823233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:05.827208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:05.830433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:05.961310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1109/2241] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:05 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:05.965726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7790c-95cf-4a02-bca6-f33a899430c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:05.986334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:05.993487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7790c-95cf-4a02-bca6-f33a899430c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:06.095961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:06.111231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:06.111663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:06.111942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:06.114563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:06.118786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:06.231459 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1133/2242] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:05 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:06.235254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:06.245626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291a25e-632e-46d6-91c2-555e75d528d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:06.262452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:06.263630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:06.263984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:06.264441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:06.265268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:06.268270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:06.283717 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1110/2243] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:06.287461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:06.302525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72df37-1372-4bb0-a7a9-bdb52d1d1efb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:06.310439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:06.311111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:06.311388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:06.311662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] PATH_INFO: `/v3/projects/c2f545fbb8744c9a9deed4b2670743ed/users/4745c3400f76467b9dee23665006a56e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:06.337993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f545fbb8744c9a9deed4b2670743ed, user_id=4745c3400f76467b9dee23665006a56e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:06.343121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:06.454609 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1134/2244] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:06 2022] PUT /identity/v3/projects/c2f545fbb8744c9a9deed4b2670743ed/users/4745c3400f76467b9dee23665006a56e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:26:06.454823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:06.465200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25865f-d581-4002-8413-741111c910f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:06.544358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe5e7e-14fd-4c1c-849f-32d8013d9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:06.544990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe5e7e-14fd-4c1c-849f-32d8013d9da7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:06.545269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe5e7e-14fd-4c1c-849f-32d8013d9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:06.545539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe5e7e-14fd-4c1c-849f-32d8013d9da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:06.546232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe5e7e-14fd-4c1c-849f-32d8013d9da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:06.548405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe5e7e-14fd-4c1c-849f-32d8013d9da7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:06.563546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1111/2245] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:06.565015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:06.584272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09c5f-8f35-49f8-80f9-706caa2045e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:06.590254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efc2ee-2e82-4b45-8447-abcb41026d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:06.590947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc2ee-2e82-4b45-8447-abcb41026d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:06.591230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc2ee-2e82-4b45-8447-abcb41026d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:06.591504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc2ee-2e82-4b45-8447-abcb41026d2d admin admin] PATH_INFO: `/v3/projects/c2f545fbb8744c9a9deed4b2670743ed/users/4745c3400f76467b9dee23665006a56e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:06.593725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efc2ee-2e82-4b45-8447-abcb41026d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f545fbb8744c9a9deed4b2670743ed, user_id=4745c3400f76467b9dee23665006a56e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:06.597019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efc2ee-2e82-4b45-8447-abcb41026d2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:06.620912 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1135/2246] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:06 2022] PUT /identity/v3/projects/c2f545fbb8744c9a9deed4b2670743ed/users/4745c3400f76467b9dee23665006a56e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:06.622509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a92e7c-8a68-49ef-8fe1-37b5764d3211 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:06.622884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a92e7c-8a68-49ef-8fe1-37b5764d3211 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:06.623415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a92e7c-8a68-49ef-8fe1-37b5764d3211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:06.692190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a9a92e7c-8a68-49ef-8fe1-37b5764d3211 None None] MFA Rules not processed for user `4745c3400f76467b9dee23665006a56e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:06.692488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9a92e7c-8a68-49ef-8fe1-37b5764d3211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:06.794320 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1112/2247] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:06.805674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:06.806221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:06.806324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:06.846859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] MFA Rules not processed for user `92f8b851f06d4b038a147c7dd873cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:06.848101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:06.854327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:06.955347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:06.957197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1136/2248] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:07.204242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0703f-4dca-4491-9e56-647d675bedfa None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:07.204531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0703f-4dca-4491-9e56-647d675bedfa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:07.204808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0703f-4dca-4491-9e56-647d675bedfa None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:07.206361 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1113/2249] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:26:07.212142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:26:07.213657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:07.298463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:07.362104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a1d4-a5ab-4ca1-b710-816caba5c247 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:07.367055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f0c80fbc6b646d88ea08af1f9567bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b44bdcfbad945fcb82e46cc17a472e3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:07.367713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:07.367983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:07.368257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] PATH_INFO: `/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:07.369398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorizing `identity:get_project(project_id=c2ebe6bccec0417c8e57d59162dad1cd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:07.371504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:07.373211 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1137/2250] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:26:07 2022] GET /identity/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd => generated 373 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:07.651660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0703f-4dca-4491-9e56-647d675bedfa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:07.667205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0703f-4dca-4491-9e56-647d675bedfa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:07.673513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b526275-f739-4a55-a62d-da85fd189b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:07.674255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526275-f739-4a55-a62d-da85fd189b70 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:07.674608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526275-f739-4a55-a62d-da85fd189b70 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:07.674993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b526275-f739-4a55-a62d-da85fd189b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:07.682986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b526275-f739-4a55-a62d-da85fd189b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:07.684575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b526275-f739-4a55-a62d-da85fd189b70 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:07.693606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1114/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:07.888882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:08.042801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:08.762681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:08.831491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:09.305398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:09.307969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:09.392971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401a40a-1de5-4f45-adb4-e8ba50eb61cd tempest-QuotasAdminTestJSON-316701900 tempest-QuotasAdminTestJSON-316701900-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:09.398624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:09.399506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:09.399950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:09.400231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] PATH_INFO: `/v3/users/d67dfe438ffa49a58fbe69705a6f4bba` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:09.401531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67dfe438ffa49a58fbe69705a6f4bba)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:09.403516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:09.616711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67dfe438ffa49a58fbe69705a6f4bba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:09.623613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67dfe438ffa49a58fbe69705a6f4bba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:09.627408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67dfe438ffa49a58fbe69705a6f4bba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:09.641915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67dfe438ffa49a58fbe69705a6f4bba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:09.699689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67dfe438ffa49a58fbe69705a6f4bba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:09.709140 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1138/2252] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:09 2022] DELETE /identity/v3/users/d67dfe438ffa49a58fbe69705a6f4bba => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:09.714425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965d42-a56b-4e29-81f9-e3293ce411a0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:09.714718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965d42-a56b-4e29-81f9-e3293ce411a0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:09.715031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66965d42-a56b-4e29-81f9-e3293ce411a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:09.734991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66965d42-a56b-4e29-81f9-e3293ce411a0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:09.736521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66965d42-a56b-4e29-81f9-e3293ce411a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:09.802096 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1115/2253] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:09.811947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:09.813372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:09.820282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:09.876560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:09.882913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982949d-dc61-4c33-ba02-8fd26141f1ee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:09.886731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:09.887523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:09.887873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:09.888215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:09.899378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:09.900988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:09.912256 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1139/2254] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:10.043754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:10.077038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:10.390677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:10.391033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:10.391309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:10.454397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:10.460613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:10.542314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:10.557931 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1116/2255] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:10.582878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:10.584412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:10.667643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e886c6-17f6-4933-9f18-e161c44053ff service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:10.674692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:10.675320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:10.675608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:10.675883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:10.689230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:10.691306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:10.703721 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1140/2256] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:26:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:10.727817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:11.376342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:11.376342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:11.383140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9224b-30ea-40c9-90d5-010d100550a5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:11.387858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:11.388545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:11.388825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:11.389098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] PATH_INFO: `/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:11.390281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ebe6bccec0417c8e57d59162dad1cd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:11.392910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:11.549882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ebe6bccec0417c8e57d59162dad1cd', 'request_id': 'req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.557431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ebe6bccec0417c8e57d59162dad1cd', 'request_id': 'req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.657455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ebe6bccec0417c8e57d59162dad1cd', 'request_id': 'req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.665633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:11.667680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:11.684383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3051a1-cd56-4a01-bae3-bc42db4bb7d6 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:11.692630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] The token cache is being invalidate because project c2ebe6bccec0417c8e57d59162dad1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:11.692918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.695183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.698437 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1117/2257] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:11 2022] DELETE /identity/v3/projects/c2ebe6bccec0417c8e57d59162dad1cd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:11.702931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:11.704909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:11.753857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:11.754680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:11.757669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:11.758041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] PATH_INFO: `/v3/users/19343438b3424ea0afd623dfab43f5d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:11.760132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19343438b3424ea0afd623dfab43f5d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:11.762294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:11.785516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebf44b-bae8-44fd-b6b7-b90701bfa797 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:11.792686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:11.793522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:11.793905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:11.795012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] PATH_INFO: `/v3/users/5f0c80fbc6b646d88ea08af1f9567bc7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:11.795748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0c80fbc6b646d88ea08af1f9567bc7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:11.799103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:11.889582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:11.950832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19343438b3424ea0afd623dfab43f5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.957909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19343438b3424ea0afd623dfab43f5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.958621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19343438b3424ea0afd623dfab43f5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.974966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19343438b3424ea0afd623dfab43f5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.979259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0c80fbc6b646d88ea08af1f9567bc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:11.980052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0c80fbc6b646d88ea08af1f9567bc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:12.037624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a815b9d1-da95-4631-9029-7907a8f44423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19343438b3424ea0afd623dfab43f5d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:12.054368 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1141/2258] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:11 2022] DELETE /identity/v3/users/19343438b3424ea0afd623dfab43f5d5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:12.063343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:12.064350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:12.064638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:12.083280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:12.084473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:12.145709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0c80fbc6b646d88ea08af1f9567bc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:12.146426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0c80fbc6b646d88ea08af1f9567bc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:12.152261 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1142/2259] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:12.161368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:12.162749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:12.164167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0c80fbc6b646d88ea08af1f9567bc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:12.194249 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1118/2260] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:11 2022] DELETE /identity/v3/users/5f0c80fbc6b646d88ea08af1f9567bc7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:12.254252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbef9d5-da3c-4907-8dbd-3d90c4d5aab5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:12.331825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba908f-606e-4330-82dc-4e4b7108f2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:12.332484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba908f-606e-4330-82dc-4e4b7108f2ca service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:12.332933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba908f-606e-4330-82dc-4e4b7108f2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:12.333212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba908f-606e-4330-82dc-4e4b7108f2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:12.406810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba908f-606e-4330-82dc-4e4b7108f2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:12.408895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba908f-606e-4330-82dc-4e4b7108f2ca service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:12.421276 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1143/2261] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:26:12.874655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:12.878666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:12.915067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4e9be-1b46-4c1a-88fc-f2b533c9b6e3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:12.921179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:12.922118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:12.922397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:12.922890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] PATH_INFO: `/v3/projects/9b44bdcfbad945fcb82e46cc17a472e3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:12.924595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b44bdcfbad945fcb82e46cc17a472e3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:12.930425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.026431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:13.106797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b44bdcfbad945fcb82e46cc17a472e3', 'request_id': 'req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.115770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b44bdcfbad945fcb82e46cc17a472e3', 'request_id': 'req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.197131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:13.219445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b44bdcfbad945fcb82e46cc17a472e3', 'request_id': 'req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.235616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] The token cache is being invalidate because project 9b44bdcfbad945fcb82e46cc17a472e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:13.236182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.237001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.242358 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1119/2262] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:12 2022] DELETE /identity/v3/projects/9b44bdcfbad945fcb82e46cc17a472e3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:13.250438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ee75-6e65-46dd-b231-3217e3f4c555 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.251396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ee75-6e65-46dd-b231-3217e3f4c555 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.252272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ee75-6e65-46dd-b231-3217e3f4c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.280787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a1d7ee75-6e65-46dd-b231-3217e3f4c555 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:13.282087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a1d7ee75-6e65-46dd-b231-3217e3f4c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:13.349769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.352098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:13.371580 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1144/2263] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:13.380956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d9ab-7e70-4cdd-8b15-0570be32557e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.381495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d9ab-7e70-4cdd-8b15-0570be32557e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.381936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d9ab-7e70-4cdd-8b15-0570be32557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.411259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ece5d9ab-7e70-4cdd-8b15-0570be32557e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:13.411259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ece5d9ab-7e70-4cdd-8b15-0570be32557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:13.412829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f82a-47a2-4314-b0e2-f55a7ea66f3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.413895 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1145/2264] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:13.418249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5d9ab-7e70-4cdd-8b15-0570be32557e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.418905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.419671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.419954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.420224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] PATH_INFO: `/v3/projects/66130c964c634dab874f3cacc09c5db6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.421365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66130c964c634dab874f3cacc09c5db6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.425663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.428954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5d9ab-7e70-4cdd-8b15-0570be32557e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.436667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.436667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.436667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.436667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.437149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:13.437149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.438093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.460761 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1146/2265] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:13.462494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.474413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bbe7b-1392-4d1a-97bb-43910c6c7426 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.479346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.479948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.480227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.480506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.481310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.483437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.568913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66130c964c634dab874f3cacc09c5db6', 'request_id': 'req-c3878619-5208-4745-81f4-014d0c117903'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.575318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66130c964c634dab874f3cacc09c5db6', 'request_id': 'req-c3878619-5208-4745-81f4-014d0c117903'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.587954 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1147/2266] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:13 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:13.597508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.660362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fe2af-aafd-458e-897d-43aa937433b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.665328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb869d4c-6e15-42e3-a5ec-cc238778c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.665931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869d4c-6e15-42e3-a5ec-cc238778c410 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.666251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869d4c-6e15-42e3-a5ec-cc238778c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.666523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869d4c-6e15-42e3-a5ec-cc238778c410 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.667137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb869d4c-6e15-42e3-a5ec-cc238778c410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.669088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb869d4c-6e15-42e3-a5ec-cc238778c410 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.710891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66130c964c634dab874f3cacc09c5db6', 'request_id': 'req-c3878619-5208-4745-81f4-014d0c117903'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.723050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] The token cache is being invalidate because project 66130c964c634dab874f3cacc09c5db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:13.723368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.724187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3878619-5208-4745-81f4-014d0c117903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:13.726226 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1120/2267] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:13 2022] DELETE /identity/v3/projects/66130c964c634dab874f3cacc09c5db6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:13.730785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.731011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.731289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.752356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:13.755744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:13.762969 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1121/2268] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:13.786913 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1148/2269] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:13 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:13.795840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.796983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:13.812805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565702-095a-4ff8-9a34-7b56aba01fee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.820207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.821352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.825724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.825724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.825724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.825724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.833899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740e68-5fe4-492d-aef5-9e0fc098d704 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.834213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740e68-5fe4-492d-aef5-9e0fc098d704 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.834485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740e68-5fe4-492d-aef5-9e0fc098d704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.841628 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1122/2270] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:13.843016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.858100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbca1a-4638-4e81-b727-160d334b8b85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.864303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.864926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.865369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.865662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.866582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.870413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5d740e68-5fe4-492d-aef5-9e0fc098d704 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:13.870680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.870771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d740e68-5fe4-492d-aef5-9e0fc098d704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:13.878630 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1149/2271] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:13.881669 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1123/2272] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:13.885439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d740e68-5fe4-492d-aef5-9e0fc098d704 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.886486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.896758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d740e68-5fe4-492d-aef5-9e0fc098d704 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.903645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee6dd3-33dd-4624-a9bc-703126379d28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.903787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.903787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.904187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.904574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.905280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e53466-6880-407a-9331-14903d920d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.905438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:13.905797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.905945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53466-6880-407a-9331-14903d920d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.906399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53466-6880-407a-9331-14903d920d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.906708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e53466-6880-407a-9331-14903d920d71 admin admin] PATH_INFO: `/v3/projects/2c6d37b5e72d4311a49f6ef5c0746f17/users/f5af5f9215be43d1a820d28dfb777b2d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.909165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.925586 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1150/2273] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:26:13.926694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53466-6880-407a-9331-14903d920d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6d37b5e72d4311a49f6ef5c0746f17, user_id=f5af5f9215be43d1a820d28dfb777b2d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.929562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e53466-6880-407a-9331-14903d920d71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:13.929769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:13.941969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780841d-2a2a-475f-b42e-3e7bfd18ace6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:13.950074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:13.950715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:13.950993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:13.951374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:13.952009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:13.953998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.008091 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1124/2274] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:13 2022] PUT /identity/v3/projects/2c6d37b5e72d4311a49f6ef5c0746f17/users/f5af5f9215be43d1a820d28dfb777b2d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:14.021187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e8475-c98d-4bc0-8e8f-48ceb70fe833 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.021614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e8475-c98d-4bc0-8e8f-48ceb70fe833 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.021896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e8475-c98d-4bc0-8e8f-48ceb70fe833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.038241 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1151/2275] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:13 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:14.038241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.073255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-732e8475-c98d-4bc0-8e8f-48ceb70fe833 None None] MFA Rules not processed for user `f5af5f9215be43d1a820d28dfb777b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:14.074787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-732e8475-c98d-4bc0-8e8f-48ceb70fe833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:14.140330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4379e-efa8-454a-8f86-93d991b372c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.146623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.147261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.147527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.148642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.148642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.151097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.178150 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1125/2276] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:14.182680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e8475-c98d-4bc0-8e8f-48ceb70fe833 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.196595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e8475-c98d-4bc0-8e8f-48ceb70fe833 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.202816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.204704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.204704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.204704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.205255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.208086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.278265 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1152/2277] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:14 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:14.282980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.311557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860790-f858-43e4-ad53-610ddb067ba2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.334759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.335501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.335920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.336380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.337338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.339931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.350102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1126/2278] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:14 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:26:14.354000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.367840 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1153/2279] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:14.373026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.387420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c492-1a7d-41d1-96db-0cf90ec6bba5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.495422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.496142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.496636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.496984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.497708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.499655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.513538 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1154/2280] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:14.516044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58202e2-e4d6-467e-9d9c-0a95a3ab6b87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.518273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.534870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.535619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.535974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.536330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.537132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.539644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c286-c367-404e-8d04-f683212c49e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.540384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.551097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f0a5-d3fb-4a3c-807e-772dd8698406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.552126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f0a5-d3fb-4a3c-807e-772dd8698406 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.552477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f0a5-d3fb-4a3c-807e-772dd8698406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.553177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f0a5-d3fb-4a3c-807e-772dd8698406 admin admin] PATH_INFO: `/v3/projects/5ede599ca0234feb928a00539d9aeb82/users/2dc31958aee54271985c85e5a569ceb0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.572741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f0a5-d3fb-4a3c-807e-772dd8698406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ede599ca0234feb928a00539d9aeb82, user_id=2dc31958aee54271985c85e5a569ceb0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.584999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f0a5-d3fb-4a3c-807e-772dd8698406 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.649952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1127/2281] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:14 2022] POST /identity/v3/users => generated 308 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:14.654175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.666908 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1155/2282] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:14 2022] PUT /identity/v3/projects/5ede599ca0234feb928a00539d9aeb82/users/2dc31958aee54271985c85e5a569ceb0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:14.674186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3902616-ddc5-4020-8214-a010d7397fe8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.675997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.676356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.676746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.711444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] MFA Rules not processed for user `2dc31958aee54271985c85e5a569ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:14.712792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:14.740935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.742325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.742832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.743195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.743919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.745676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.758366 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1128/2283] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:26:14.760136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:14.761667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.772276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5579e-8ca9-4464-a604-d18e79c40bca admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.777328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.778147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.778434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.778716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] PATH_INFO: `/v3/projects/7c969d0d64484e6a84a392b374a6af57/users/17445340347f40cda0fe8d704a0a4b7c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.790809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1156/2284] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:14.799605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c969d0d64484e6a84a392b374a6af57, user_id=17445340347f40cda0fe8d704a0a4b7c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.802622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.808443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.808443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:14.838517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:14.865025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a661-e81a-4f75-92c2-5750c37c47a2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.868741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.869388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.871685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.871685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.879195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.880669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.889488 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1157/2285] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:14.894290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1129/2286] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:14 2022] PUT /identity/v3/projects/7c969d0d64484e6a84a392b374a6af57/users/17445340347f40cda0fe8d704a0a4b7c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:26:14.898001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.908831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2b77-d5a1-401b-bf78-857437b403ee service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:14.966694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef524c2-873b-4a40-80c5-f5d79de5fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:14.967299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef524c2-873b-4a40-80c5-f5d79de5fe71 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:14.967576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef524c2-873b-4a40-80c5-f5d79de5fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:14.967846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef524c2-873b-4a40-80c5-f5d79de5fe71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:14.968484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef524c2-873b-4a40-80c5-f5d79de5fe71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:14.970161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef524c2-873b-4a40-80c5-f5d79de5fe71 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:14.983030 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1158/2287] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:26:14.984260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:14.995576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30584b-c098-4975-bbde-9d2714c2e504 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:15.000390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:15.001666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:15.001951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:15.002261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] PATH_INFO: `/v3/projects/7c969d0d64484e6a84a392b374a6af57/users/17445340347f40cda0fe8d704a0a4b7c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:15.004178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c969d0d64484e6a84a392b374a6af57, user_id=17445340347f40cda0fe8d704a0a4b7c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:15.010595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:15.017844 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1130/2288] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:14 2022] PUT /identity/v3/projects/7c969d0d64484e6a84a392b374a6af57/users/17445340347f40cda0fe8d704a0a4b7c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:15.028093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599fba-581f-4e66-b541-39d2a649618d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:15.028313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599fba-581f-4e66-b541-39d2a649618d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:15.028587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599fba-581f-4e66-b541-39d2a649618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:15.060951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-14599fba-581f-4e66-b541-39d2a649618d None None] MFA Rules not processed for user `17445340347f40cda0fe8d704a0a4b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:15.062225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14599fba-581f-4e66-b541-39d2a649618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:15.133791 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1159/2289] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:15 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:15.146322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:15.148039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:15.221649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e431f-78e8-4ed7-947c-a260b31d1f9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:15.227431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:15.228063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:15.228346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:15.228675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:15.237444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:15.239438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:15.248847 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1131/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:15 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:15.328659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.379833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.539949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.568095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.694232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.734255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.839723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.873063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:15.934082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599fba-581f-4e66-b541-39d2a649618d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:15.936566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14599fba-581f-4e66-b541-39d2a649618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:15.957402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599fba-581f-4e66-b541-39d2a649618d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:15.963369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00093ed-0e85-4bdf-9f2a-a42b4f9ae214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:15.964176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00093ed-0e85-4bdf-9f2a-a42b4f9ae214 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:15.964521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00093ed-0e85-4bdf-9f2a-a42b4f9ae214 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:15.964856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00093ed-0e85-4bdf-9f2a-a42b4f9ae214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:15.991493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:16.024871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00093ed-0e85-4bdf-9f2a-a42b4f9ae214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:16.026511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00093ed-0e85-4bdf-9f2a-a42b4f9ae214 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:16.035483 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1160/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:15 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:16.072973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:16.076980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:16.145451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef361d-5769-4ea9-a9e5-29c032478ba1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:16.151255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:16.152138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:16.152584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:16.153007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] PATH_INFO: `/v3/users/f5af5f9215be43d1a820d28dfb777b2d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:16.155477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5af5f9215be43d1a820d28dfb777b2d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:16.157784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:16.203615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:16.203994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:16.205127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:16.228866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:16.230216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:16.292015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:16.300722 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1161/2292] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:26:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:16.311288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:16.312833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:16.390698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b3593-15c6-4921-a33f-be75cb45de0a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:16.397137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428e6b-c043-4f14-b15a-07f9dfcb2d77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:16.397768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428e6b-c043-4f14-b15a-07f9dfcb2d77 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:16.398046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428e6b-c043-4f14-b15a-07f9dfcb2d77 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:16.398478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428e6b-c043-4f14-b15a-07f9dfcb2d77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:16.407883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5af5f9215be43d1a820d28dfb777b2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:16.408237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428e6b-c043-4f14-b15a-07f9dfcb2d77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:16.409081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5af5f9215be43d1a820d28dfb777b2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:16.409881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428e6b-c043-4f14-b15a-07f9dfcb2d77 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:16.420095 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1162/2293] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:16.579713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5af5f9215be43d1a820d28dfb777b2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:16.580347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5af5f9215be43d1a820d28dfb777b2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:16.598232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5af5f9215be43d1a820d28dfb777b2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:16.638825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:16.649508 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1132/2294] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:16 2022] DELETE /identity/v3/users/f5af5f9215be43d1a820d28dfb777b2d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:16.651458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:16.651810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:16.652149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:16.674397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:16.675708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:16.701798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:16.769210 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1163/2295] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:16.779500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:16.781097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:16.876023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32474c5-4fab-4fa6-ac07-6464de15c837 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:16.882483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:16.883991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:16.884291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:16.884582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:16.900220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:16.904500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:16.904976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:16.920032 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1133/2296] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:17.149228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:17.150701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:17.157832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:17.235421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:17.242548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aface2dd-a635-4b68-ab33-59ea8aed0369 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:17.248854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:17.249657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:17.250158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:17.250442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:17.253316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:17.357085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:17.358741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:17.370195 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1164/2297] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:17.510653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:17.514228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:17.545333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77da4b-f7a2-4b84-b2ad-2e508301d0c1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:17.554533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:17.555451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:17.555941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:17.556315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] PATH_INFO: `/v3/projects/2c6d37b5e72d4311a49f6ef5c0746f17` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:17.557914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6d37b5e72d4311a49f6ef5c0746f17)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:17.560635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:17.711967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6d37b5e72d4311a49f6ef5c0746f17', 'request_id': 'req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:17.718841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6d37b5e72d4311a49f6ef5c0746f17', 'request_id': 'req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:17.798536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6d37b5e72d4311a49f6ef5c0746f17', 'request_id': 'req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:17.817935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] The token cache is being invalidate because project 2c6d37b5e72d4311a49f6ef5c0746f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:17.818196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:17.818885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6331ae9f-ff50-49c3-b27c-7f37cf20c7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:17.828581 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1134/2298] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:17 2022] DELETE /identity/v3/projects/2c6d37b5e72d4311a49f6ef5c0746f17 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:17.831221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:17.854650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde2a2-4fad-45f2-8293-8f0e2b062e37 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:17.881193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d3e14-adfa-4dfb-b80a-9b9fd32e8721 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:17.881792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d3e14-adfa-4dfb-b80a-9b9fd32e8721 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:17.882249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d3e14-adfa-4dfb-b80a-9b9fd32e8721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:17.910138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7a8d3e14-adfa-4dfb-b80a-9b9fd32e8721 None None] MFA Rules not processed for user `5c053ac77b3c479da2f3145adb4dfc21`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:17.912265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a8d3e14-adfa-4dfb-b80a-9b9fd32e8721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:17.995256 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1135/2299] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:18.022929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:18.026972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:18.027376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:18.027729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] PATH_INFO: `/v3/users/17445340347f40cda0fe8d704a0a4b7c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:18.030360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17445340347f40cda0fe8d704a0a4b7c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:18.033273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:18.036953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:18.073176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:18.306735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17445340347f40cda0fe8d704a0a4b7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:18.309671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:18.310405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:18.314439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:18.327613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17445340347f40cda0fe8d704a0a4b7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:18.328265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17445340347f40cda0fe8d704a0a4b7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:18.362292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17445340347f40cda0fe8d704a0a4b7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:18.392085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:18.409060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:18.442246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17445340347f40cda0fe8d704a0a4b7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:18.467428 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1165/2300] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:17 2022] DELETE /identity/v3/users/17445340347f40cda0fe8d704a0a4b7c => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:18.552904 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1136/2301] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:26:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:18.575666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:18.593965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:18.736064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:18.782610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d8ccf-385b-4e66-8e49-39aa12c04058 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:18.787624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0213b7-34fb-4572-9aa5-5e03e42e3410 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:18.788349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0213b7-34fb-4572-9aa5-5e03e42e3410 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:18.788949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0213b7-34fb-4572-9aa5-5e03e42e3410 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:18.788949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0213b7-34fb-4572-9aa5-5e03e42e3410 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:18.880189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0213b7-34fb-4572-9aa5-5e03e42e3410 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:18.882440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0213b7-34fb-4572-9aa5-5e03e42e3410 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:18.896142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:18.897479 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1166/2302] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:19.303572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:19.305060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:19.327925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ba914-554a-4bc7-8618-b7647270398a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:19.444792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:19.445840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:19.447014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:19.450277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] PATH_INFO: `/v3/projects/7c969d0d64484e6a84a392b374a6af57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:19.451808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c969d0d64484e6a84a392b374a6af57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:19.454804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:19.635067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c969d0d64484e6a84a392b374a6af57', 'request_id': 'req-48a894d4-b2fb-4013-a424-cbd46de0ed58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:19.643923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c969d0d64484e6a84a392b374a6af57', 'request_id': 'req-48a894d4-b2fb-4013-a424-cbd46de0ed58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:19.762385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c969d0d64484e6a84a392b374a6af57', 'request_id': 'req-48a894d4-b2fb-4013-a424-cbd46de0ed58'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:19.783494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] The token cache is being invalidate because project 7c969d0d64484e6a84a392b374a6af57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:19.783780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:19.784717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a894d4-b2fb-4013-a424-cbd46de0ed58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:19.786302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1137/2303] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:19 2022] DELETE /identity/v3/projects/7c969d0d64484e6a84a392b374a6af57 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:19.792738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb7930-906e-411e-a0ba-44af778d9c65 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:19.793023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb7930-906e-411e-a0ba-44af778d9c65 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:19.793297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb7930-906e-411e-a0ba-44af778d9c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:19.820427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26fb7930-906e-411e-a0ba-44af778d9c65 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:19.827380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26fb7930-906e-411e-a0ba-44af778d9c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:19.920814 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1167/2304] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:19.995978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae87f5-6f17-4ace-b173-e837176c0a96 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:19.996513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae87f5-6f17-4ace-b173-e837176c0a96 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:19.997126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae87f5-6f17-4ace-b173-e837176c0a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.021139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06ae87f5-6f17-4ace-b173-e837176c0a96 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:20.022785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06ae87f5-6f17-4ace-b173-e837176c0a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:20.037529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1138/2305] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:20.038859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb7930-906e-411e-a0ba-44af778d9c65 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.053800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb7930-906e-411e-a0ba-44af778d9c65 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:20.059042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:20.059910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.060370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.060800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.061633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:20.062172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:20.064838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:20.068380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:20.094082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1168/2306] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:20.104274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae87f5-6f17-4ace-b173-e837176c0a96 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.114648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae87f5-6f17-4ace-b173-e837176c0a96 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:20.119895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:20.121015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.121324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.121578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.122284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:20.124211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:20.200018 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1139/2307] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:20 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:20.204170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.219595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc50615-0118-4ba0-9965-e78069b65708 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:20.304445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:20.305812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.306406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.309476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.310561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:20.312727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:20.430144 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1169/2308] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:20 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:26:20.431735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.449586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88f54-8cea-4e59-bf08-bee69b01d3ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:20.460019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:20.461325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.461613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.461939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.463718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:20.466633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:20.484079 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1140/2309] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:20.499196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.514936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91340-79f5-48db-ba10-81c2d5328981 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:20.521499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d403b-65f1-445a-b3f8-c4bfe726dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:20.522173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d403b-65f1-445a-b3f8-c4bfe726dba6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.522454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d403b-65f1-445a-b3f8-c4bfe726dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.522734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d403b-65f1-445a-b3f8-c4bfe726dba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.523472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d403b-65f1-445a-b3f8-c4bfe726dba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:20.525229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d403b-65f1-445a-b3f8-c4bfe726dba6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:20.540548 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1170/2310] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:20.546204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.558859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a7362-65da-4451-a2c4-f96a019d8524 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:20.569221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:20.576484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.576484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.576484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] PATH_INFO: `/v3/projects/3bb6d67967fa4a17a6f408db6b3703ac/users/5507f20b83274556b0a37641ef9e097b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.590780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb6d67967fa4a17a6f408db6b3703ac, user_id=5507f20b83274556b0a37641ef9e097b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:20.593944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:20.694674 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1141/2311] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:20 2022] PUT /identity/v3/projects/3bb6d67967fa4a17a6f408db6b3703ac/users/5507f20b83274556b0a37641ef9e097b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:20.705547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436077c4-bf95-4105-82ba-1c95f69d5eac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.705912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436077c4-bf95-4105-82ba-1c95f69d5eac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.706281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436077c4-bf95-4105-82ba-1c95f69d5eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.716577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:20.742944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-436077c4-bf95-4105-82ba-1c95f69d5eac None None] MFA Rules not processed for user `5507f20b83274556b0a37641ef9e097b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:20.744325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-436077c4-bf95-4105-82ba-1c95f69d5eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:20.830097 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1171/2312] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:20.840100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.841878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:20.882151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.882679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.883108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.908458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:20.909879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:20.945008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc4d12-e07c-4021-b887-71224b719b9c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:20.954990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:20.955629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:20.955892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:20.956256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:20.965128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:20.966960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:20.968196 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1172/2313] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:26:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:20.977024 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1142/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:20.983178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:20.984607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:21.062328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c113d-e780-4489-ae2c-422ee2845d26 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:21.069753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11cd4a-5576-46df-847a-e418d2f321ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:21.070493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11cd4a-5576-46df-847a-e418d2f321ee service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:21.076275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11cd4a-5576-46df-847a-e418d2f321ee service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:21.076275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11cd4a-5576-46df-847a-e418d2f321ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:21.090906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11cd4a-5576-46df-847a-e418d2f321ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:21.092650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11cd4a-5576-46df-847a-e418d2f321ee service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:21.103200 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1173/2315] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:26:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:21.212146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:21.284079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301655a-cade-4a97-96dd-6c758585c73a service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:21.288899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:21.289677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:21.289963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:21.290284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] PATH_INFO: `/v3/users/5507f20b83274556b0a37641ef9e097b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:21.291447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5507f20b83274556b0a37641ef9e097b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:21.293502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:21.484647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5507f20b83274556b0a37641ef9e097b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:21.484647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5507f20b83274556b0a37641ef9e097b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:21.567741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5507f20b83274556b0a37641ef9e097b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:21.568451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5507f20b83274556b0a37641ef9e097b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:21.577299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9cee4214-ff9a-4c97-b80a-07ab654301d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5507f20b83274556b0a37641ef9e097b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:21.594246 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1143/2316] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:21 2022] DELETE /identity/v3/users/5507f20b83274556b0a37641ef9e097b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:21.598856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e813ab5-1f1a-4182-be1c-dfa801e8f5c0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:21.599401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e813ab5-1f1a-4182-be1c-dfa801e8f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:21.599857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e813ab5-1f1a-4182-be1c-dfa801e8f5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:21.601235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:21.605134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:21.605421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:21.605696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:21.621385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5e813ab5-1f1a-4182-be1c-dfa801e8f5c0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:21.622725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e813ab5-1f1a-4182-be1c-dfa801e8f5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:21.626383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] MFA Rules not processed for user `2dc31958aee54271985c85e5a569ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:21.627556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:21.684337 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1144/2317] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:21.692321 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1174/2318] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:21.701792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:21.703510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:21.755606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:21.773838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a90fd-e006-4b14-94d0-1708b982d767 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:21.777741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:21.778549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:21.778809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:21.779153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:21.788884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:21.790383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:21.801141 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1145/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:22.025631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:22.139456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6dca6-ab41-4738-b6af-34387b0d58a7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:22.139456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6dca6-ab41-4738-b6af-34387b0d58a7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:22.139796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6dca6-ab41-4738-b6af-34387b0d58a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:22.157616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:22.161728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f3c6dca6-ab41-4738-b6af-34387b0d58a7 None None] MFA Rules not processed for user `2dc31958aee54271985c85e5a569ceb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:22.163030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f3c6dca6-ab41-4738-b6af-34387b0d58a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:22.170036 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1175/2320] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:26:22.188536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:22.191207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:22.223093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cfd63-5bf6-4d9e-bc31-ee6571dec238 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:22.234634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:22.237088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:22.237548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:22.237969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] PATH_INFO: `/v3/projects/3bb6d67967fa4a17a6f408db6b3703ac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:22.240285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb6d67967fa4a17a6f408db6b3703ac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:22.246269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:22.411895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb6d67967fa4a17a6f408db6b3703ac', 'request_id': 'req-f46ed181-7f41-4bad-af00-8e71fc4fa700'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:22.421403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb6d67967fa4a17a6f408db6b3703ac', 'request_id': 'req-f46ed181-7f41-4bad-af00-8e71fc4fa700'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:22.524948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb6d67967fa4a17a6f408db6b3703ac', 'request_id': 'req-f46ed181-7f41-4bad-af00-8e71fc4fa700'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:22.550341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] The token cache is being invalidate because project 3bb6d67967fa4a17a6f408db6b3703ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:26:22.552583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:22.553972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f46ed181-7f41-4bad-af00-8e71fc4fa700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:22.559935 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1146/2321] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:22 2022] DELETE /identity/v3/projects/3bb6d67967fa4a17a6f408db6b3703ac => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:22.571028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269f26-0ec4-4a9d-8436-b6642e292822 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:22.571028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269f26-0ec4-4a9d-8436-b6642e292822 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:22.571028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89269f26-0ec4-4a9d-8436-b6642e292822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:22.602459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-89269f26-0ec4-4a9d-8436-b6642e292822 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:22.603690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89269f26-0ec4-4a9d-8436-b6642e292822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:22.742188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:22.749036 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1176/2322] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:22.757866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597121-d308-4b78-9d2e-823af962a7fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:22.758469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597121-d308-4b78-9d2e-823af962a7fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:22.758952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03597121-d308-4b78-9d2e-823af962a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:22.787782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-03597121-d308-4b78-9d2e-823af962a7fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:22.789114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03597121-d308-4b78-9d2e-823af962a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:22.802873 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1147/2323] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:22.803871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89269f26-0ec4-4a9d-8436-b6642e292822 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:22.815249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89269f26-0ec4-4a9d-8436-b6642e292822 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:22.821899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:22.822825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:22.823212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:22.823581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:22.824399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:26:22.824949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:22.826704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:22.855719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1177/2324] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:26:22.865702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03597121-d308-4b78-9d2e-823af962a7fd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:22.884411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03597121-d308-4b78-9d2e-823af962a7fd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:22.893866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:22.915237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:22.916116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:22.916407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:22.922011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:22.925439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:22.932058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:23.067594 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1148/2325] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:26:22 2022] POST /identity/v3/projects => generated 397 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:23.068949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:23.085615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb162-1afe-42d8-8f34-c491507cbb71 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:23.220455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:23.221402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:23.221560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:23.221997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:23.222667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:23.230895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:23.341018 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1178/2326] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:26:23 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:26:23.344983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:23.378645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af144-7198-4825-be22-41585e7478ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:23.384348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:23.385354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:23.385936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:23.386449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:23.387348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:23.389118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:23.404246 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1149/2327] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:26:23.405227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:23.416909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bccde-947a-4435-817f-94509d260d3a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:23.422083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbe305-05f4-411f-a2ac-e7825834bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:23.424709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbe305-05f4-411f-a2ac-e7825834bb46 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:23.425078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbe305-05f4-411f-a2ac-e7825834bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:23.425398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbe305-05f4-411f-a2ac-e7825834bb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:23.426107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbe305-05f4-411f-a2ac-e7825834bb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:23.427767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbe305-05f4-411f-a2ac-e7825834bb46 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:23.444941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:23.462903 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1179/2328] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:26:23.465674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d554d3-0350-46d0-a634-40340c93902e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:23.481241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20ff86-7651-4d6a-8653-4c8a503e9fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:23.482763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ff86-7651-4d6a-8653-4c8a503e9fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:23.483988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ff86-7651-4d6a-8653-4c8a503e9fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:23.484354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ff86-7651-4d6a-8653-4c8a503e9fc9 admin admin] PATH_INFO: `/v3/projects/e3669621720549bba2466676e40d638a/users/3424ff1ac4404c4cb1b47907bf255b4b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:23.496327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:23.496867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:23.499650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:23.514431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ff86-7651-4d6a-8653-4c8a503e9fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3669621720549bba2466676e40d638a, user_id=3424ff1ac4404c4cb1b47907bf255b4b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:23.518507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20ff86-7651-4d6a-8653-4c8a503e9fc9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:23.525197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:23.525197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:23.605147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1180/2329] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:23.623905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:23.623905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:23.650914 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1150/2330] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:26:23 2022] PUT /identity/v3/projects/e3669621720549bba2466676e40d638a/users/3424ff1ac4404c4cb1b47907bf255b4b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:26:23.657844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:23.658414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:23.658913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:23.734210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:23.750966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:23.753203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:23.801818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad931-40ef-4773-b6cd-4219c0ff2d2a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:23.905189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:23.906713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:23.907571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:23.907855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:23.918385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1151/2331] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:23.938538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:23.940297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:23.979639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:24.044925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:24.046775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:24.058763 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1181/2332] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:24.059917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9ac0d-0b33-4966-bf20-78d69f467936 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:24.072115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18474301-d7a5-4e29-bee8-ecbfcfd22875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:24.072769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474301-d7a5-4e29-bee8-ecbfcfd22875 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:24.073066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474301-d7a5-4e29-bee8-ecbfcfd22875 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:24.073405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18474301-d7a5-4e29-bee8-ecbfcfd22875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:24.091169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18474301-d7a5-4e29-bee8-ecbfcfd22875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:24.091169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18474301-d7a5-4e29-bee8-ecbfcfd22875 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:24.109092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1152/2333] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:26:24.345395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:25.225399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:25.409959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:26.494264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:26.694420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:27.133649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:27.476213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:27.477980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:27.596015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0cfee-dd42-40bc-b351-e9f8b027e99c service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:27.613560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69227e-027d-485b-b261-b65bec63b59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:27.614769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69227e-027d-485b-b261-b65bec63b59f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:27.615223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69227e-027d-485b-b261-b65bec63b59f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:27.615643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69227e-027d-485b-b261-b65bec63b59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:27.619316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd69227e-027d-485b-b261-b65bec63b59f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:27.777198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69227e-027d-485b-b261-b65bec63b59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:27.781724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69227e-027d-485b-b261-b65bec63b59f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:27.809330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1182/2334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:27.832132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:28.173863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:29.083409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:29.528170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:29.698225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec6bfe-8ce3-4324-b121-08a0ff0bdf0e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:29.698659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec6bfe-8ce3-4324-b121-08a0ff0bdf0e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:29.699037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec6bfe-8ce3-4324-b121-08a0ff0bdf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:29.759993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7fec6bfe-8ce3-4324-b121-08a0ff0bdf0e None None] MFA Rules not processed for user `92f8b851f06d4b038a147c7dd873cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:29.763502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fec6bfe-8ce3-4324-b121-08a0ff0bdf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:29.884123 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1153/2335] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:29.956533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:30.118262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:30.196870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:30.473763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:31.256202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:33.593221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c4bf-1de2-43f4-924d-ba9db521f88a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:33.593747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c4bf-1de2-43f4-924d-ba9db521f88a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:33.593747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0c4bf-1de2-43f4-924d-ba9db521f88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:33.625283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95b0c4bf-1de2-43f4-924d-ba9db521f88a None None] MFA Rules not processed for user `6c1cd81ee6174cee97e384cae58a2e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:33.627067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95b0c4bf-1de2-43f4-924d-ba9db521f88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:33.798779 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1183/2336] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:41.712343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=57 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:43.780975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=62 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:44.598392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22961b-4940-4821-b5d0-6fb8839e35da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:44.599299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22961b-4940-4821-b5d0-6fb8839e35da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:44.599731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22961b-4940-4821-b5d0-6fb8839e35da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:44.660293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce22961b-4940-4821-b5d0-6fb8839e35da None None] MFA Rules not processed for user `3424ff1ac4404c4cb1b47907bf255b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:44.661537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce22961b-4940-4821-b5d0-6fb8839e35da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:44.811176 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1154/2337] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:44.829301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:44.830181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:44.830611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:44.884720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] MFA Rules not processed for user `3424ff1ac4404c4cb1b47907bf255b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:44.886033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:44.895069 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1184/2338] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:44.907401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22961b-4940-4821-b5d0-6fb8839e35da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:44.952727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22961b-4940-4821-b5d0-6fb8839e35da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:44.964690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:44.965331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:44.965612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:44.965883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:44.982632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:44.984264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:45.008951 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1155/2339] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:46.138516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:46.141030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:46.265262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f333ab-bd9a-4eea-b741-6c4291c8a086 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:46.271247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f9faa-483a-4b43-be95-e6cf76b38e8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:46.271872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9faa-483a-4b43-be95-e6cf76b38e8b service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:46.272148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9faa-483a-4b43-be95-e6cf76b38e8b service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:46.272420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9faa-483a-4b43-be95-e6cf76b38e8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:46.275078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d4f9faa-483a-4b43-be95-e6cf76b38e8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:46.289133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f9faa-483a-4b43-be95-e6cf76b38e8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:46.290779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f9faa-483a-4b43-be95-e6cf76b38e8b service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:46.306532 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1185/2340] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:26:47.583445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:47.584875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:47.620110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bef7f-0827-46b7-9a66-7689b2acd79c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:47.647335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:47.649595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:47.650073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:47.651590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:47.656037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:47.678932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:47.681659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:47.709888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1156/2341] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:26:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:26:49.794628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcff71-0999-4bf5-9f22-1ee9da059f4b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:49.795372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcff71-0999-4bf5-9f22-1ee9da059f4b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:49.795735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcff71-0999-4bf5-9f22-1ee9da059f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:49.832761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ffcff71-0999-4bf5-9f22-1ee9da059f4b None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:49.834616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ffcff71-0999-4bf5-9f22-1ee9da059f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:49.851073 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1186/2342] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:26:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:49.872849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:49.908212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e995624-c7c8-4f87-9035-a0d7ce9e39b3 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:49.925069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:49.925703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:49.925984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:49.927532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:49.944011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:49.953233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:49.980233 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1157/2343] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:26:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:51.583760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4412b4-61db-4b07-8741-1e24b77192aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:51.584856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4412b4-61db-4b07-8741-1e24b77192aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:51.585967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4412b4-61db-4b07-8741-1e24b77192aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:51.628015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d4412b4-61db-4b07-8741-1e24b77192aa None None] MFA Rules not processed for user `356ffdf6f40b4d71a7f39c414c008491`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:26:51.631844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d4412b4-61db-4b07-8741-1e24b77192aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:51.736813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1187/2344] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:26:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:26:59.298738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:26:59.304042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:26:59.344415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627685d4-1386-4bd8-98f4-2022377a7080 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:26:59.353207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:26:59.354360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:26:59.354828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:26:59.355698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] PATH_INFO: `/v3/users/d75623286dda46cfb4d8d70608655b9c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:26:59.358079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75623286dda46cfb4d8d70608655b9c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:26:59.361525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:26:59.567228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75623286dda46cfb4d8d70608655b9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:59.567960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75623286dda46cfb4d8d70608655b9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:59.715984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75623286dda46cfb4d8d70608655b9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:59.716941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75623286dda46cfb4d8d70608655b9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:59.731238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75623286dda46cfb4d8d70608655b9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:26:59.798961 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1158/2345] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:26:59 2022] DELETE /identity/v3/users/d75623286dda46cfb4d8d70608655b9c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:00.826716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4412b4-61db-4b07-8741-1e24b77192aa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:00.840739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4412b4-61db-4b07-8741-1e24b77192aa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:00.898162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:00.898794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:00.899069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:00.899340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] PATH_INFO: `/v3/projects/2a89fd93a0d843e1ad91d158b7be21fb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:00.900571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a89fd93a0d843e1ad91d158b7be21fb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:00.902621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:00.931859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:01.005601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a89fd93a0d843e1ad91d158b7be21fb', 'request_id': 'req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.012344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a89fd93a0d843e1ad91d158b7be21fb', 'request_id': 'req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.064494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a89fd93a0d843e1ad91d158b7be21fb', 'request_id': 'req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.075432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] The token cache is being invalidate because project 2a89fd93a0d843e1ad91d158b7be21fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:01.075720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.076335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.077923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1188/2346] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:00 2022] DELETE /identity/v3/projects/2a89fd93a0d843e1ad91d158b7be21fb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:01.081666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:01.083110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:01.098258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0871e0-4ee8-4bb1-a0ba-9ed970b36f76 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:01.120830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:01.176628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:01.177471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:01.178253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:01.178253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] PATH_INFO: `/v3/users/6ea6c81b85374045be838535697eb2d2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:01.179375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea6c81b85374045be838535697eb2d2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:01.181482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:01.401680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea6c81b85374045be838535697eb2d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.403723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea6c81b85374045be838535697eb2d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.475965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea6c81b85374045be838535697eb2d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.476587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea6c81b85374045be838535697eb2d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.484332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-16e70a18-6664-4ed8-8a04-80599dd03bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea6c81b85374045be838535697eb2d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:01.502595 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1159/2347] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:01 2022] DELETE /identity/v3/users/6ea6c81b85374045be838535697eb2d2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:01.844261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:01.846382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:01.867059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7ada9-677b-4f78-81bf-6a960c2b6cc8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:01.990489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:01.991382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:01.991720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:01.992226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] PATH_INFO: `/v3/projects/2a10d37c93e743faa8cd29e05a06185f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:01.993599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a10d37c93e743faa8cd29e05a06185f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:01.996244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.134828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a10d37c93e743faa8cd29e05a06185f', 'request_id': 'req-16b5c110-25f8-495d-bb86-2c9ba0d010eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.155557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a10d37c93e743faa8cd29e05a06185f', 'request_id': 'req-16b5c110-25f8-495d-bb86-2c9ba0d010eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.219511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a10d37c93e743faa8cd29e05a06185f', 'request_id': 'req-16b5c110-25f8-495d-bb86-2c9ba0d010eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.236859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] The token cache is being invalidate because project 2a10d37c93e743faa8cd29e05a06185f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:02.237326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.238438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-16b5c110-25f8-495d-bb86-2c9ba0d010eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.245625 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1189/2348] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:01 2022] DELETE /identity/v3/projects/2a10d37c93e743faa8cd29e05a06185f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:02.247491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06e9e5-da1a-460a-8306-1d1f4695541c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.248008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06e9e5-da1a-460a-8306-1d1f4695541c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.248126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06e9e5-da1a-460a-8306-1d1f4695541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.269783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3b06e9e5-da1a-460a-8306-1d1f4695541c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:02.271217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b06e9e5-da1a-460a-8306-1d1f4695541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:02.340576 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1160/2349] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:02.348508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.348807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.349085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.392486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:02.393794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:02.405460 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1190/2350] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:02.408960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06e9e5-da1a-460a-8306-1d1f4695541c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:02.434342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06e9e5-da1a-460a-8306-1d1f4695541c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:02.451724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:02.452696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.455245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.455245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.455245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:27:02.455245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:02.457669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.467924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:02.474019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:02.497027 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1161/2351] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:02.498105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9f32a-1235-4915-867c-6fb50eee001a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:02.499236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:02.508647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:02.509303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.509581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.509824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59560056-3df8-4050-ab9e-56fa3fe18a9a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:02.509943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] PATH_INFO: `/v3/users/5c053ac77b3c479da2f3145adb4dfc21` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.515015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c053ac77b3c479da2f3145adb4dfc21)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:02.518715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:02.518715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.519112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.519543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.521688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:02.524981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.527701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.661319 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1162/2352] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:02 2022] POST /identity/v3/projects => generated 405 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:02.665356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:02.675227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:02.731697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc49da-234e-439c-9fe7-ebab78b4be86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:02.737164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:02.737873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.738285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.738913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.739621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:02.741618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.805655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:02.824135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c053ac77b3c479da2f3145adb4dfc21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.836833 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1163/2353] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:02 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:27:02.842137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:02.842598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c053ac77b3c479da2f3145adb4dfc21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.844042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c053ac77b3c479da2f3145adb4dfc21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.846442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:02.863354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dda0-30e6-4823-8e26-fd8bc1da0c5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:02.868494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c053ac77b3c479da2f3145adb4dfc21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.870939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:02.870939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.870939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.870939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.871594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:02.873199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.883848 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1164/2354] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:27:02.887804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:02.899862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917762f-4804-498d-aea9-3f51fd5d469a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:02.904659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:02.905269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.905554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.905831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.907070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:02.908650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.919766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1165/2355] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:27:02.924217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:02.937786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b110-5e01-4937-b2e4-47f149f90306 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:02.942499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd247b23-0160-42de-b8ee-0b4d86b782df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:02.944439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c42dd5d-062e-432f-9622-d9ca1c5b4a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c053ac77b3c479da2f3145adb4dfc21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:02.944588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247b23-0160-42de-b8ee-0b4d86b782df admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.944738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247b23-0160-42de-b8ee-0b4d86b782df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.945018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247b23-0160-42de-b8ee-0b4d86b782df admin admin] PATH_INFO: `/v3/projects/96ecf7d7327442aa89c64aed1cfbbf78/users/24f00d49604a4e98b98ca61fa425ef9c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.953482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1191/2356] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:02 2022] DELETE /identity/v3/users/5c053ac77b3c479da2f3145adb4dfc21 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:27:02.960907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2986-6b1f-4d24-badc-d37b05cc2516 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:02.961285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2986-6b1f-4d24-badc-d37b05cc2516 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:02.961463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2986-6b1f-4d24-badc-d37b05cc2516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:02.969847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd247b23-0160-42de-b8ee-0b4d86b782df admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ecf7d7327442aa89c64aed1cfbbf78, user_id=24f00d49604a4e98b98ca61fa425ef9c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:02.973266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd247b23-0160-42de-b8ee-0b4d86b782df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:02.983418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d2d2986-6b1f-4d24-badc-d37b05cc2516 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:02.984660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d2d2986-6b1f-4d24-badc-d37b05cc2516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:03.048567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1192/2357] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:03.050312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:03.050595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:03.050869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:03.057609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1166/2358] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:02 2022] PUT /identity/v3/projects/96ecf7d7327442aa89c64aed1cfbbf78/users/24f00d49604a4e98b98ca61fa425ef9c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:27:03.061434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:03.062731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:03.063236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:03.088629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:03.089272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:03.131806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:03.133294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:03.184176 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1193/2359] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:27:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:03.185390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:03.187735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:03.299310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1167/2360] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:03.300807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:03.301778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc6b-fe55-4664-bb04-93a824b99770 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:03.306143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:03.311741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:03.314933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:03.314933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:03.315201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:03.337703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:03.339630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:03.353174 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1194/2361] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:03.354451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:03.356232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:03.389403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd099c-7416-4c5c-a940-ad5461ce88a7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:03.402844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:03.404383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:03.406080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:03.407278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:03.420344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:03.422558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:03.442448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1195/2362] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:03.525898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268ca85-f3ed-4dcc-877e-576b5a971580 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:03.533384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:03.534123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:03.534480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:03.534815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:03.545172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:03.547562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:03.560496 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1168/2363] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:27:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:03.838544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:03.841013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:03.869178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb453a1-2f71-4014-b71a-4dee9ec2f78d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:03.880202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:03.882079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:03.883147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:03.883858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] PATH_INFO: `/v3/projects/e374527f6eda4730aa116c71d01dfd4b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:03.886278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e374527f6eda4730aa116c71d01dfd4b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:03.889898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:04.076129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e374527f6eda4730aa116c71d01dfd4b', 'request_id': 'req-235da3de-9a1b-49f4-b3c8-b375835ba639'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.084763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e374527f6eda4730aa116c71d01dfd4b', 'request_id': 'req-235da3de-9a1b-49f4-b3c8-b375835ba639'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.099420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:04.178337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e374527f6eda4730aa116c71d01dfd4b', 'request_id': 'req-235da3de-9a1b-49f4-b3c8-b375835ba639'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.201862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] The token cache is being invalidate because project e374527f6eda4730aa116c71d01dfd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:04.216745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.225499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.229286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1196/2364] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:03 2022] DELETE /identity/v3/projects/e374527f6eda4730aa116c71d01dfd4b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:04.233572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:04.274865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bbc27-96be-45e8-80cf-5a7f2bacd3f7 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:04.384892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:04.399237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:04.400711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:04.400999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:04.401285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] PATH_INFO: `/v3/users/77e60de7885e4927bffa684043f7d19c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:04.404356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e60de7885e4927bffa684043f7d19c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:04.411314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:04.667146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e60de7885e4927bffa684043f7d19c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.670862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e60de7885e4927bffa684043f7d19c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.772846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e60de7885e4927bffa684043f7d19c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.773569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e60de7885e4927bffa684043f7d19c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.783357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-00e34667-4e80-462d-b8fa-494760d542da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e60de7885e4927bffa684043f7d19c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:04.829676 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1169/2365] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:04 2022] DELETE /identity/v3/users/77e60de7885e4927bffa684043f7d19c => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:05.500718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:05.502495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:05.537757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235da3de-9a1b-49f4-b3c8-b375835ba639 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:05.731159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:05.732669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:05.733095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:05.733396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] PATH_INFO: `/v3/projects/b25d3a45355e49bbad1b29ce5ffe0200` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:05.735224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25d3a45355e49bbad1b29ce5ffe0200)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:05.737406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:05.960203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25d3a45355e49bbad1b29ce5ffe0200', 'request_id': 'req-e213486e-b405-47ca-a410-4b60b2436408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:05.972944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25d3a45355e49bbad1b29ce5ffe0200', 'request_id': 'req-e213486e-b405-47ca-a410-4b60b2436408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:06.099589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7abf7-4863-43ef-9655-5c8c23f5280c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:06.100058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7abf7-4863-43ef-9655-5c8c23f5280c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:06.100191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7abf7-4863-43ef-9655-5c8c23f5280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:06.116191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25d3a45355e49bbad1b29ce5ffe0200', 'request_id': 'req-e213486e-b405-47ca-a410-4b60b2436408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:06.123304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:06.139518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] The token cache is being invalidate because project b25d3a45355e49bbad1b29ce5ffe0200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:06.141518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:06.143233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e213486e-b405-47ca-a410-4b60b2436408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:06.149477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2d7abf7-4863-43ef-9655-5c8c23f5280c None None] MFA Rules not processed for user `92f8b851f06d4b038a147c7dd873cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:06.150135 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1197/2366] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:05 2022] DELETE /identity/v3/projects/b25d3a45355e49bbad1b29ce5ffe0200 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:06.153468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2d7abf7-4863-43ef-9655-5c8c23f5280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:06.155420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb705aa-c635-44f1-9274-dd97ed6527f6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:06.155995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb705aa-c635-44f1-9274-dd97ed6527f6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:06.158644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb705aa-c635-44f1-9274-dd97ed6527f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:06.204758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-deb705aa-c635-44f1-9274-dd97ed6527f6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:06.206519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-deb705aa-c635-44f1-9274-dd97ed6527f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:06.320114 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1170/2367] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:06.454815 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1198/2368] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:06.455710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eb8e9-b2f5-437b-ab0e-9ed21983eba8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:06.456122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eb8e9-b2f5-437b-ab0e-9ed21983eba8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:06.456503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eb8e9-b2f5-437b-ab0e-9ed21983eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:06.480595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:06.499185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f63eb8e9-b2f5-437b-ab0e-9ed21983eba8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:06.513954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f63eb8e9-b2f5-437b-ab0e-9ed21983eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:06.543998 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1171/2369] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:06.548818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb705aa-c635-44f1-9274-dd97ed6527f6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:06.563121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb705aa-c635-44f1-9274-dd97ed6527f6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:06.586779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:06.587496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:06.587796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:06.589149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:06.596418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:27:06.598680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:06.602929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:06.648630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eb8e9-b2f5-437b-ab0e-9ed21983eba8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:06.649172 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1199/2370] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:06.676547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eb8e9-b2f5-437b-ab0e-9ed21983eba8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:06.683210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:06.684035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:06.685606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:06.686001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:06.686807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:06.689996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:06.904464 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1172/2371] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:06 2022] POST /identity/v3/projects => generated 359 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:06.908956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:06.935011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ee8eb-fd0b-4c42-8c4b-eb17550604bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:07.153566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dab77-92fa-437f-aa3b-6da77e0f3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:07.153566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dab77-92fa-437f-aa3b-6da77e0f3e0b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.153566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dab77-92fa-437f-aa3b-6da77e0f3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.153566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dab77-92fa-437f-aa3b-6da77e0f3e0b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.154398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dab77-92fa-437f-aa3b-6da77e0f3e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:07.164792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dab77-92fa-437f-aa3b-6da77e0f3e0b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:07.322461 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1200/2372] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:06 2022] POST /identity/v3/users => generated 280 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:07.325549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:07.340267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd91aca-9bb6-4770-956c-47adc1467b46 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.340551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd91aca-9bb6-4770-956c-47adc1467b46 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.340989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd91aca-9bb6-4770-956c-47adc1467b46 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.342535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1201/2373] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:27:07.346863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97384-c617-4277-8f0d-96348c7c638a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:07.354646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.355321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.355812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.365440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:07.366048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.366356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.366636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.367310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:07.381129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:07.396603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:07.403779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:07.414104 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1173/2374] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:07.426516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:07.478268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b702976-526e-48be-b66b-7360985710a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:07.498994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:07.499663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.499949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.500230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.500891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:07.502544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:07.565852 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1174/2375] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:07.567249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:07.584667 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1202/2376] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:27:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:07.597800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:07.600673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:07.608421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd504a2-d341-4f93-a9cb-c178c4da00bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:07.619609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:07.624249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.624249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.624249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] PATH_INFO: `/v3/projects/61c4f1d7229d4740815c13c26012a2b8/users/a762a5c933554701a1764bc82ce4dbbd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.625139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:07.688399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c4f1d7229d4740815c13c26012a2b8, user_id=a762a5c933554701a1764bc82ce4dbbd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:07.688399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:07.713555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aed73-8f88-465c-a612-9c25f91096e4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:07.722350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0234bf-cb4e-4293-9c91-5f6d017b2fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:07.722848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0234bf-cb4e-4293-9c91-5f6d017b2fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.723893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0234bf-cb4e-4293-9c91-5f6d017b2fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.724752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0234bf-cb4e-4293-9c91-5f6d017b2fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.740174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0234bf-cb4e-4293-9c91-5f6d017b2fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:07.747864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0234bf-cb4e-4293-9c91-5f6d017b2fe6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:07.767254 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1203/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:27:07.843883 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1175/2378] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:07 2022] PUT /identity/v3/projects/61c4f1d7229d4740815c13c26012a2b8/users/a762a5c933554701a1764bc82ce4dbbd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:07.845379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68323c-20b1-4d17-8f72-98cb1af5acc7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:07.846909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68323c-20b1-4d17-8f72-98cb1af5acc7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:07.847883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68323c-20b1-4d17-8f72-98cb1af5acc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:07.902845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ac68323c-20b1-4d17-8f72-98cb1af5acc7 None None] MFA Rules not processed for user `a762a5c933554701a1764bc82ce4dbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:07.906026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac68323c-20b1-4d17-8f72-98cb1af5acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:08.080070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:08.081080 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1204/2379] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:08.290863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7341ee-07cb-4c3c-b4e3-92872990e4e8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:08.315169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:08.322829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:08.322829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:08.322829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:08.322829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:08.345429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:08.472916 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1176/2380] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:08 2022] POST /identity/v3/projects => generated 361 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:27:08.476847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68323c-20b1-4d17-8f72-98cb1af5acc7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:08.497527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68323c-20b1-4d17-8f72-98cb1af5acc7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:08.651853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:08.654378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:08.654956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:08.660161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:08.660161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:08.660161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:08.744545 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1205/2381] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:08 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:08.748353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:08.769120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245aba2-ca02-46d8-b5f0-5c3f2bcfc3d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:08.801940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:08.805106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:08.805390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:08.805665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:08.806359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:08.807972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:08.836392 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1177/2382] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:08.842809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:08.869723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750de58-e180-4005-a491-8dcbc796ba1b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:08.884171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:08.885499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:08.886522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:08.886969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] PATH_INFO: `/v3/projects/c0bd3a496b0746369c812e5232c9fb45/users/184de38040084e659f9d4b23313c49d7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:08.936850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bd3a496b0746369c812e5232c9fb45, user_id=184de38040084e659f9d4b23313c49d7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:08.947321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:09.070819 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1206/2383] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:08 2022] PUT /identity/v3/projects/c0bd3a496b0746369c812e5232c9fb45/users/184de38040084e659f9d4b23313c49d7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:09.075028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:09.099453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6f630-626a-4ae5-b057-22bdb3b38f09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:09.313879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65001-877e-4b1e-b186-229495143324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:09.314280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65001-877e-4b1e-b186-229495143324 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:09.314628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65001-877e-4b1e-b186-229495143324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:09.314909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65001-877e-4b1e-b186-229495143324 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:09.315570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65001-877e-4b1e-b186-229495143324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:09.317397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65001-877e-4b1e-b186-229495143324 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:09.336613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:09.369275 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1178/2384] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:09.373376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:09.385084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:09.397385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668da37b-7cfc-4298-8b29-9a75edfda497 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:09.420713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:09.421451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:09.424112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:09.424112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] PATH_INFO: `/v3/projects/c0bd3a496b0746369c812e5232c9fb45/users/184de38040084e659f9d4b23313c49d7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:09.427304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bd3a496b0746369c812e5232c9fb45, user_id=184de38040084e659f9d4b23313c49d7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:09.433353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:09.456620 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1207/2385] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:09 2022] PUT /identity/v3/projects/c0bd3a496b0746369c812e5232c9fb45/users/184de38040084e659f9d4b23313c49d7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:09.475809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e011a-51e2-41ee-af24-34c1463c53ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:09.476439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e011a-51e2-41ee-af24-34c1463c53ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:09.476895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e011a-51e2-41ee-af24-34c1463c53ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:09.568938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-760e011a-51e2-41ee-af24-34c1463c53ac None None] MFA Rules not processed for user `184de38040084e659f9d4b23313c49d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:09.572459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-760e011a-51e2-41ee-af24-34c1463c53ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:09.819221 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1179/2386] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:10.333218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:10.335705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:10.451874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2903722-884d-4371-ba1b-b61160ed8230 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:10.457197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea667eaa-cc3c-4749-b189-0ff21c5baac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:10.457830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea667eaa-cc3c-4749-b189-0ff21c5baac8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:10.458288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea667eaa-cc3c-4749-b189-0ff21c5baac8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:10.458561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea667eaa-cc3c-4749-b189-0ff21c5baac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:10.469367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea667eaa-cc3c-4749-b189-0ff21c5baac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:10.472270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea667eaa-cc3c-4749-b189-0ff21c5baac8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:10.504458 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1208/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:12.326937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e011a-51e2-41ee-af24-34c1463c53ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:12.515578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e011a-51e2-41ee-af24-34c1463c53ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:12.537374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:12.537374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:12.537374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:12.537374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] PATH_INFO: `/v3/users/a762a5c933554701a1764bc82ce4dbbd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:12.538863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a762a5c933554701a1764bc82ce4dbbd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:12.542949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:12.994764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a762a5c933554701a1764bc82ce4dbbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:12.997913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a762a5c933554701a1764bc82ce4dbbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:13.116699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a762a5c933554701a1764bc82ce4dbbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:13.117785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a762a5c933554701a1764bc82ce4dbbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:13.129655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a762a5c933554701a1764bc82ce4dbbd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:13.218853 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1180/2388] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:12 2022] DELETE /identity/v3/users/a762a5c933554701a1764bc82ce4dbbd => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:13.220335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:13.220990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:13.220990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:13.274883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:13.276560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:13.454819 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1209/2389] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:13.503321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:13.505327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:13.513873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:13.690854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47df87-e303-44e2-8469-10f28489c9ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:13.696244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:13.698084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:13.701371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:13.702551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:13.720070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:13.724078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:13.774143 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1181/2390] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:15.527185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:15.532808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:15.560521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c81d6-8df0-4a9f-b28e-4cceb3173d8f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:15.584876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:15.585773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:15.586270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:15.586705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] PATH_INFO: `/v3/projects/61c4f1d7229d4740815c13c26012a2b8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:15.590796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c4f1d7229d4740815c13c26012a2b8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:15.598275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:15.803496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c4f1d7229d4740815c13c26012a2b8', 'request_id': 'req-3d959e34-6a72-465c-8c68-2c7eb5410638'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:15.825633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c4f1d7229d4740815c13c26012a2b8', 'request_id': 'req-3d959e34-6a72-465c-8c68-2c7eb5410638'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:15.938122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c4f1d7229d4740815c13c26012a2b8', 'request_id': 'req-3d959e34-6a72-465c-8c68-2c7eb5410638'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:15.960126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:15.984179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] The token cache is being invalidate because project 61c4f1d7229d4740815c13c26012a2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:15.984480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:15.990730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:16.018465 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1210/2391] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:15 2022] DELETE /identity/v3/projects/61c4f1d7229d4740815c13c26012a2b8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:16.022410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:16.035173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de16ae-db3d-42c6-bacd-037ae5d04ed0 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:16.362560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:16.363484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:16.364207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:16.364636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] PATH_INFO: `/v3/users/184de38040084e659f9d4b23313c49d7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:16.368094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184de38040084e659f9d4b23313c49d7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:16.370282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:16.657861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184de38040084e659f9d4b23313c49d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:16.658599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184de38040084e659f9d4b23313c49d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:16.754652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184de38040084e659f9d4b23313c49d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:16.755394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184de38040084e659f9d4b23313c49d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:16.770406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c3867a7a-9281-4671-ad13-522f11171500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184de38040084e659f9d4b23313c49d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:16.822176 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1182/2392] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:16 2022] DELETE /identity/v3/users/184de38040084e659f9d4b23313c49d7 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:18.707737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:18.707737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:18.748569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959e34-6a72-465c-8c68-2c7eb5410638 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:19.043243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:19.044846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:19.045291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:19.045712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] PATH_INFO: `/v3/projects/c0bd3a496b0746369c812e5232c9fb45` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:19.047980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bd3a496b0746369c812e5232c9fb45)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:19.051435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:19.232598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bd3a496b0746369c812e5232c9fb45', 'request_id': 'req-95744ccc-6209-4fe7-a47a-854917dc10fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:19.246810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bd3a496b0746369c812e5232c9fb45', 'request_id': 'req-95744ccc-6209-4fe7-a47a-854917dc10fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:19.306092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bd3a496b0746369c812e5232c9fb45', 'request_id': 'req-95744ccc-6209-4fe7-a47a-854917dc10fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:19.333807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] The token cache is being invalidate because project c0bd3a496b0746369c812e5232c9fb45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:19.334484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:19.336141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95744ccc-6209-4fe7-a47a-854917dc10fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:19.341269 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1211/2393] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:18 2022] DELETE /identity/v3/projects/c0bd3a496b0746369c812e5232c9fb45 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:19.348124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32479e-d74b-4892-8439-37681bdf590a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:19.348705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32479e-d74b-4892-8439-37681bdf590a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:19.348705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32479e-d74b-4892-8439-37681bdf590a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:19.415855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6f32479e-d74b-4892-8439-37681bdf590a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:19.422400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f32479e-d74b-4892-8439-37681bdf590a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:19.505600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:19.715999 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1183/2394] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:19.723617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253df82-979a-4932-8252-aadd19500c87 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:19.724444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253df82-979a-4932-8252-aadd19500c87 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:19.724914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253df82-979a-4932-8252-aadd19500c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:19.782044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5253df82-979a-4932-8252-aadd19500c87 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:19.784472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5253df82-979a-4932-8252-aadd19500c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:19.804276 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1212/2395] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:19.808258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32479e-d74b-4892-8439-37681bdf590a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:19.823191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32479e-d74b-4892-8439-37681bdf590a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:19.831351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:19.833601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:19.834580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:19.835015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:19.835842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:27:19.836368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:19.838245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:19.855640 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1184/2396] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:19.860040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253df82-979a-4932-8252-aadd19500c87 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:19.884023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253df82-979a-4932-8252-aadd19500c87 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:19.895426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae5536-ffc0-4fec-b527-509447414512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:19.896577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5536-ffc0-4fec-b527-509447414512 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:19.897134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5536-ffc0-4fec-b527-509447414512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:19.898271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5536-ffc0-4fec-b527-509447414512 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:19.899249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae5536-ffc0-4fec-b527-509447414512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:19.902765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae5536-ffc0-4fec-b527-509447414512 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:20.024224 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1213/2397] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:19 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:20.028601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:20.041599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f92e8-cb55-4d17-b520-14b21765a77f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:20.067759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:20.068274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:20.068837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:20.141528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] MFA Rules not processed for user `24f00d49604a4e98b98ca61fa425ef9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:20.142823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:20.285953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:20.286627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:20.286949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:20.287182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:20.287829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:20.289914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:20.309785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:20.372098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1214/2398] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:20.373023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:20.374994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:20.413457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efabec-6ee2-4a80-9e45-b0137cea864c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:20.426916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:20.427485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:20.428454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:20.428749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:20.429406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:20.431376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:20.460697 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1185/2399] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:20 2022] POST /identity/v3/users => generated 292 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:20.467758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:20.495991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc775c7-f775-47cd-897f-9a471067fb7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:20.511272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:20.511914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:20.512195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:20.512469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:20.513127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:20.516074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:20.541344 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1186/2400] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:27:20.547860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:20.569922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff533c3a-e05e-4c66-9aa6-e555fe1a7e89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:20.576879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:20.577791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:20.578096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:20.578380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:20.579041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:20.589636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:20.613271 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1187/2401] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:20.619110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:20.641563 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1215/2402] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:20 2022] POST /identity/v3/projects => generated 403 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:20.645768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:20.658529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f15281-c800-479c-9506-584226f8845b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:20.853074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d127c-2be2-4371-9659-bae7a3780ba7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:20.866270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ec1f1-b9c4-409b-8819-86eb4ca0b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:20.867222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ec1f1-b9c4-409b-8819-86eb4ca0b0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:20.867651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ec1f1-b9c4-409b-8819-86eb4ca0b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:20.868083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ec1f1-b9c4-409b-8819-86eb4ca0b0ea admin admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20/users/0bb4f887293049caa63d2e05fe937224/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:20.871338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:20.871966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:20.872247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:20.872517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:20.873479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:20.877127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:20.905431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ec1f1-b9c4-409b-8819-86eb4ca0b0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3605ca5c82984d1fbefb1cfed86e9f20, user_id=0bb4f887293049caa63d2e05fe937224, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:20.914333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ec1f1-b9c4-409b-8819-86eb4ca0b0ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:21.551283 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1216/2403] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:20 2022] POST /identity/v3/users => generated 308 bytes in 889 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:21.553753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:21.570311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5af09e-b944-4f63-9a76-2ffb31979d2e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:21.576419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:21.577031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:21.577377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:21.577694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:21.578379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:21.580067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:21.597240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1217/2404] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:21.601431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:21.614138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d4c32-a0d2-4a46-984e-1cef8574995e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:21.619452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:21.620130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:21.620765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:21.621039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] PATH_INFO: `/v3/projects/3cd4894c66464e8ebcd66d0bceae52c4/users/211a891e6a0e4d6186262feadb61aef6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:21.636787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4894c66464e8ebcd66d0bceae52c4, user_id=211a891e6a0e4d6186262feadb61aef6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:21.639574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:21.728562 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1188/2405] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:20 2022] PUT /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20/users/0bb4f887293049caa63d2e05fe937224/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 1110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:21.777874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f100f5-6e26-4121-a2a3-0f78d0acca5e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:21.778202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f100f5-6e26-4121-a2a3-0f78d0acca5e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:21.778503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f100f5-6e26-4121-a2a3-0f78d0acca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:21.787187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:21.807868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b3f100f5-6e26-4121-a2a3-0f78d0acca5e None None] MFA Rules not processed for user `0bb4f887293049caa63d2e05fe937224`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:21.815340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3f100f5-6e26-4121-a2a3-0f78d0acca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:21.908106 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1189/2406] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:21.908106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f100f5-6e26-4121-a2a3-0f78d0acca5e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:21.919067 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1218/2407] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:21 2022] PUT /identity/v3/projects/3cd4894c66464e8ebcd66d0bceae52c4/users/211a891e6a0e4d6186262feadb61aef6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:21.923510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:22.009464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f100f5-6e26-4121-a2a3-0f78d0acca5e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:22.170729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae49351-9ef2-4707-b335-9084b602cc90 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:22.181199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:22.181199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:22.181199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:22.181199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:22.181579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:22.183881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:22.213769 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1219/2408] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:22.215911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:22.222854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:22.223800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:22.224289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:22.224737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:22.225534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:22.237876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:22.241039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37123eb6-ebf0-4d24-9b8b-9fe8bca9a60f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:22.253003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:22.254086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:22.254620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:22.255064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] PATH_INFO: `/v3/projects/3cd4894c66464e8ebcd66d0bceae52c4/users/211a891e6a0e4d6186262feadb61aef6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:22.258309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd4894c66464e8ebcd66d0bceae52c4, user_id=211a891e6a0e4d6186262feadb61aef6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:22.270647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:22.296706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1220/2409] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:22 2022] PUT /identity/v3/projects/3cd4894c66464e8ebcd66d0bceae52c4/users/211a891e6a0e4d6186262feadb61aef6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:22.409872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1190/2410] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:21 2022] POST /identity/v3/projects => generated 381 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:22.413859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:22.420061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:22.523049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47346-dc3d-4daf-8e41-0bbe93d98fdb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:22.695818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:22.697046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:22.697524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:22.697809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:22.698630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:22.700935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:22.789246 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1221/2411] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:22 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:27:22.790511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:22.802887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973341f5-622c-4ee7-b069-805080fde501 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:22.825847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:22.826526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:22.826811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:22.827092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:22.827848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:22.829498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:22.871401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:22.871629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1191/2412] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:22.894253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66432c13-ac2c-4351-b34a-820f74f4694c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:22.900853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:22.904888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:22.905258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:22.907910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] PATH_INFO: `/v3/projects/7f1b3f156a374f3eb3480cad4b90680c/users/5cbf71b75c0e438988fbdc4c3216e299/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:22.976406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1b3f156a374f3eb3480cad4b90680c, user_id=5cbf71b75c0e438988fbdc4c3216e299, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:22.983131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:23.071335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1222/2413] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:22 2022] PUT /identity/v3/projects/7f1b3f156a374f3eb3480cad4b90680c/users/5cbf71b75c0e438988fbdc4c3216e299/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:27:23.075726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:23.088021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d08c7-08aa-46b3-9d8e-0962e125cbd0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:23.122400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:23.241353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4154e-b877-490e-9137-bcd9ff6d8608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:23.243713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4154e-b877-490e-9137-bcd9ff6d8608 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:23.243713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4154e-b877-490e-9137-bcd9ff6d8608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:23.243713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4154e-b877-490e-9137-bcd9ff6d8608 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:23.244373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4154e-b877-490e-9137-bcd9ff6d8608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:23.259852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4154e-b877-490e-9137-bcd9ff6d8608 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:23.302198 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1192/2414] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:23.302637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:23.322394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457c412-27ef-42cd-ac61-7ec4644d793e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:23.342045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:23.342768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:23.343609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:23.360407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] PATH_INFO: `/v3/projects/7f1b3f156a374f3eb3480cad4b90680c/users/5cbf71b75c0e438988fbdc4c3216e299/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:23.360407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1b3f156a374f3eb3480cad4b90680c, user_id=5cbf71b75c0e438988fbdc4c3216e299, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:23.368044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:23.408626 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1223/2415] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:23 2022] PUT /identity/v3/projects/7f1b3f156a374f3eb3480cad4b90680c/users/5cbf71b75c0e438988fbdc4c3216e299/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:23.422445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188967-f837-4a25-aeea-97856b39fd42 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:23.422810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188967-f837-4a25-aeea-97856b39fd42 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:23.423086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188967-f837-4a25-aeea-97856b39fd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:23.488109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-43188967-f837-4a25-aeea-97856b39fd42 None None] MFA Rules not processed for user `5cbf71b75c0e438988fbdc4c3216e299`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:23.489647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43188967-f837-4a25-aeea-97856b39fd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:23.665183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1193/2416] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:23.932496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:23.934934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:24.157224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:24.176293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745ec35-8851-4a8e-a2cc-b3d5b7edddd6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:24.222086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:24.222730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:24.223015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:24.223768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:24.254963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:24.261214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:24.285768 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1224/2417] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:24.317615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017bcdc-8bc2-4ade-8742-986f20e4f6a1 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:24.318945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017bcdc-8bc2-4ade-8742-986f20e4f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:24.319434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017bcdc-8bc2-4ade-8742-986f20e4f6a1 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:24.321644 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1194/2418] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:24.328837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:24.349610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:24.351997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89f26-0ca4-43f8-8e11-88f5807bbeb5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:24.352481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89f26-0ca4-43f8-8e11-88f5807bbeb5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:24.352940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89f26-0ca4-43f8-8e11-88f5807bbeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:24.402849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d115a-99ba-4b7c-a71f-93675a6a11ac service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:24.414205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5c89f26-0ca4-43f8-8e11-88f5807bbeb5 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:24.420201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5c89f26-0ca4-43f8-8e11-88f5807bbeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:24.422195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:24.428024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:24.436508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:24.436508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:24.436508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:24.440644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:24.443267 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1225/2419] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:24 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:24.598196 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1195/2420] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:27:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 18 13:27:24.612223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:24.615116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:24.772188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72de34-0352-4fbc-b788-5e473e5a5eb4 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:24.787216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:24.787999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:24.788501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:24.788785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:24.803224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:24.805024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:24.823797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1226/2421] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:27:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:26.163244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f76cec-b359-47c1-bcaf-917dfcf1685f None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:26.164166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f76cec-b359-47c1-bcaf-917dfcf1685f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:26.164651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f76cec-b359-47c1-bcaf-917dfcf1685f None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:26.166560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1196/2422] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:26.177003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:26.193490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:26.224255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b5d30-877c-4f35-8e8e-7c8df8fa7b31 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:26.241820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:26.242760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:26.243238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:26.243681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:26.246640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:26.255923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:26.270618 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1227/2423] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:26 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:26.536456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34590-e9d5-415c-8bc1-2fd7c42f58d0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:26.536765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34590-e9d5-415c-8bc1-2fd7c42f58d0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:26.537128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34590-e9d5-415c-8bc1-2fd7c42f58d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:26.591288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8c34590-e9d5-415c-8bc1-2fd7c42f58d0 None None] MFA Rules not processed for user `0bb4f887293049caa63d2e05fe937224`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:26.594730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8c34590-e9d5-415c-8bc1-2fd7c42f58d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:26.664780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:26.695518 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1197/2424] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:30.117741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:30.120593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:30.200959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c670b40-d3af-44cf-8dd5-b487d033c640 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:30.257868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:30.259667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:30.260271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:30.260711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:30.301089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:30.302937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:30.318910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1228/2425] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:31.356558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411e883-d8f1-4dcd-9099-75959e7bf595 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:31.357113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411e883-d8f1-4dcd-9099-75959e7bf595 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:31.357113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411e883-d8f1-4dcd-9099-75959e7bf595 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:31.359397 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1198/2426] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:31.372012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:31.391687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:31.413849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a66e5-f399-481a-a6d9-c5d6ac91abd3 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:31.427210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:31.427865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:31.428328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:31.428764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:31.430812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:31.433828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:31.443793 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1229/2427] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:31 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:32.446838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4f7f-2036-4d94-882e-6dae0a82eb18 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:32.447557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4f7f-2036-4d94-882e-6dae0a82eb18 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:32.450208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4f7f-2036-4d94-882e-6dae0a82eb18 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:32.453516 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1199/2428] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:32.459957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:32.476747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:32.489752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf6357-1f85-4e60-ad23-63747d2b4789 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:32.496423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:32.501584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:32.501584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:32.501584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:32.501584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:32.503040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:32.520019 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1230/2429] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:32 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:32.908116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29246-de93-4365-8754-d39be5083f46 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:32.908399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29246-de93-4365-8754-d39be5083f46 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:32.908975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a29246-de93-4365-8754-d39be5083f46 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:32.910638 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1200/2430] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:32.934507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:32.948416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:32.980016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d44ad-fc9d-4702-88ae-11beeb44ec63 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:32.990806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85157d-9530-4f8a-b4f7-4e3cb2fe69f2 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:32.991852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85157d-9530-4f8a-b4f7-4e3cb2fe69f2 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:32.992292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85157d-9530-4f8a-b4f7-4e3cb2fe69f2 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:32.994092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85157d-9530-4f8a-b4f7-4e3cb2fe69f2 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:32.995557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85157d-9530-4f8a-b4f7-4e3cb2fe69f2 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:33.000841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85157d-9530-4f8a-b4f7-4e3cb2fe69f2 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:33.016151 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1231/2431] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:32 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:33.243327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaec8a-59dd-4784-9bfd-4e06958f109e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:33.243977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaec8a-59dd-4784-9bfd-4e06958f109e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:33.244497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaec8a-59dd-4784-9bfd-4e06958f109e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:33.278736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-acbaec8a-59dd-4784-9bfd-4e06958f109e None None] MFA Rules not processed for user `0bb4f887293049caa63d2e05fe937224`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:33.280383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acbaec8a-59dd-4784-9bfd-4e06958f109e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:33.289662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1201/2432] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:34.429096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:34.429697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:34.429910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:34.533659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] MFA Rules not processed for user `211a891e6a0e4d6186262feadb61aef6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:34.535488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:34.695576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1232/2433] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:35.488032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334307a-7586-4e8e-9fac-6986c80a9874 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:35.488733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334307a-7586-4e8e-9fac-6986c80a9874 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:35.488733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334307a-7586-4e8e-9fac-6986c80a9874 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:35.491407 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1202/2434] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:35.505503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:35.526933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:35.544680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:35.558798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c1280-efe5-4870-8a55-52602b698b90 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:35.580496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8e16e-374c-4ae1-b84f-a8f051ba01f7 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:35.581699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e16e-374c-4ae1-b84f-a8f051ba01f7 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:35.582293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e16e-374c-4ae1-b84f-a8f051ba01f7 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:35.582799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8e16e-374c-4ae1-b84f-a8f051ba01f7 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:35.584217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8e16e-374c-4ae1-b84f-a8f051ba01f7 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:35.587538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8e16e-374c-4ae1-b84f-a8f051ba01f7 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:35.589869 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1233/2435] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:35 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:36.340725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:36.341225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:36.342180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:36.370488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] MFA Rules not processed for user `3424ff1ac4404c4cb1b47907bf255b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:36.372024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:36.524225 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1203/2436] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:36.707694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584078-571a-42b8-a040-145fd39ba51f None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:36.707694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584078-571a-42b8-a040-145fd39ba51f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:36.707694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584078-571a-42b8-a040-145fd39ba51f None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:36.707694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1234/2437] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:36.713330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:36.729305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:36.742673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c5ce7-2395-4225-8790-e95df655917e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:36.747926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:36.748945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:36.749744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:36.750027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:36.751536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:36.754210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:36.762169 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1204/2438] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:36 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:37.715806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a49e-1f25-458f-81cd-8d2e360acac6 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:37.716786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a49e-1f25-458f-81cd-8d2e360acac6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:37.717071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a49e-1f25-458f-81cd-8d2e360acac6 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:37.718498 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1235/2439] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:37.733899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:37.745508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:37.772779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095d17-58ae-4a31-8d9c-5c4ed5652249 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:37.786270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0d463-eed2-4299-9418-e98496fad9d3 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:37.787095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0d463-eed2-4299-9418-e98496fad9d3 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:37.787384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0d463-eed2-4299-9418-e98496fad9d3 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:37.787660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0d463-eed2-4299-9418-e98496fad9d3 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:37.792035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0d463-eed2-4299-9418-e98496fad9d3 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:37.803691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0d463-eed2-4299-9418-e98496fad9d3 tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:37.807223 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1205/2440] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:37 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:38.068484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c6801-b7ea-45bf-bdbc-db4eafc22a00 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:38.071824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c6801-b7ea-45bf-bdbc-db4eafc22a00 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:38.071824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c6801-b7ea-45bf-bdbc-db4eafc22a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:38.113397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ba5c6801-b7ea-45bf-bdbc-db4eafc22a00 None None] MFA Rules not processed for user `0bb4f887293049caa63d2e05fe937224`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:38.118028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba5c6801-b7ea-45bf-bdbc-db4eafc22a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:38.142405 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1236/2441] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:38.982223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2e54-60be-45d8-8600-0d4c6b2f7704 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:38.982728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2e54-60be-45d8-8600-0d4c6b2f7704 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:38.982834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2e54-60be-45d8-8600-0d4c6b2f7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:39.023889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c50a2e54-60be-45d8-8600-0d4c6b2f7704 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:39.026120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c50a2e54-60be-45d8-8600-0d4c6b2f7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:39.039736 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1206/2442] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:27:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:39.055823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c6801-b7ea-45bf-bdbc-db4eafc22a00 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:39.080118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c6801-b7ea-45bf-bdbc-db4eafc22a00 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:39.087955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080be55-faea-4c66-b2de-47b962a3518c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:39.089840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080be55-faea-4c66-b2de-47b962a3518c service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:39.094865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080be55-faea-4c66-b2de-47b962a3518c service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:39.095387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080be55-faea-4c66-b2de-47b962a3518c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:39.130235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080be55-faea-4c66-b2de-47b962a3518c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:39.134747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080be55-faea-4c66-b2de-47b962a3518c service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:39.200288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1237/2443] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:27:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:44.810685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1cb5-1a55-4e95-80aa-31e2ab9816c7 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:44.811364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1cb5-1a55-4e95-80aa-31e2ab9816c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:44.811487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1cb5-1a55-4e95-80aa-31e2ab9816c7 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:44.813301 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1207/2444] 10.222.0.27 () {54 vars in 921 bytes} [Tue Oct 18 13:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:44.944469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66854-ee25-48e6-b60d-8d0c53aa5227 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:44.945489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66854-ee25-48e6-b60d-8d0c53aa5227 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:44.945931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66854-ee25-48e6-b60d-8d0c53aa5227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:45.016613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3ea66854-ee25-48e6-b60d-8d0c53aa5227 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:45.020035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ea66854-ee25-48e6-b60d-8d0c53aa5227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:45.175282 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1238/2445] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 13:27:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:45.222636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1cb5-1a55-4e95-80aa-31e2ab9816c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:45.224678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c52b1cb5-1a55-4e95-80aa-31e2ab9816c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:45.280685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1cb5-1a55-4e95-80aa-31e2ab9816c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:45.297017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:45.299572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:45.299784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:45.300313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:45.322527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:45.324984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:45.362882 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1208/2446] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:49.920193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3e762-af93-429b-a529-a204a6b8b810 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:49.921380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3e762-af93-429b-a529-a204a6b8b810 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:49.922340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3e762-af93-429b-a529-a204a6b8b810 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:49.924493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1239/2447] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:27:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:27:49.931036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:27:49.983814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:50.008796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411f365-08d5-4415-875a-f4bc6d3795af service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:50.017869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbf71b75c0e438988fbdc4c3216e299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f1b3f156a374f3eb3480cad4b90680c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:50.019099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:50.020185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:50.020692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:50.024249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorizing `identity:get_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:50.031731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:50.052309 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1209/2448] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:27:49 2022] GET /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 383 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:50.770835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682169fc-350f-4b84-9705-d8554c82329a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:50.771336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682169fc-350f-4b84-9705-d8554c82329a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:50.771911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682169fc-350f-4b84-9705-d8554c82329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:50.839469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-682169fc-350f-4b84-9705-d8554c82329a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:50.846757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-682169fc-350f-4b84-9705-d8554c82329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:50.871466 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1240/2449] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:27:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:50.878128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:50.900620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02241ee-c9a4-4115-bdd2-d32716d654ce tempest-QuotasAdminNegativeTest-180219269 tempest-QuotasAdminNegativeTest-180219269-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:50.915584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3ee6d-c37b-4a8f-81f1-fa7d1645d8c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:50.917001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3ee6d-c37b-4a8f-81f1-fa7d1645d8c3 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:50.918874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3ee6d-c37b-4a8f-81f1-fa7d1645d8c3 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:50.921214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3ee6d-c37b-4a8f-81f1-fa7d1645d8c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:50.943582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3ee6d-c37b-4a8f-81f1-fa7d1645d8c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:50.947578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3ee6d-c37b-4a8f-81f1-fa7d1645d8c3 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:50.996068 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1210/2450] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:51.664453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682169fc-350f-4b84-9705-d8554c82329a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:51.794340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682169fc-350f-4b84-9705-d8554c82329a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:51.802752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:51.803421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:51.803705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:51.804025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] PATH_INFO: `/v3/users/0bb4f887293049caa63d2e05fe937224` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:51.813090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb4f887293049caa63d2e05fe937224)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:51.815208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:52.047700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb4f887293049caa63d2e05fe937224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:52.065478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb4f887293049caa63d2e05fe937224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:52.066464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb4f887293049caa63d2e05fe937224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:52.097574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:52.124168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb4f887293049caa63d2e05fe937224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:52.206950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb4f887293049caa63d2e05fe937224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:52.216813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1241/2451] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:51 2022] DELETE /identity/v3/users/0bb4f887293049caa63d2e05fe937224 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:52.224655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66af1c2-94ba-4004-a188-f82cad7864b6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:52.225234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66af1c2-94ba-4004-a188-f82cad7864b6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:52.225234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66af1c2-94ba-4004-a188-f82cad7864b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:52.248196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f66af1c2-94ba-4004-a188-f82cad7864b6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:52.250349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f66af1c2-94ba-4004-a188-f82cad7864b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:52.330399 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1211/2452] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:52.339920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:52.341435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:52.527812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11dbd7-6eda-45e5-8d8c-dabfebb56493 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:52.532917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1050f34-8655-4c17-9519-2ac3bdbb8fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:52.533777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050f34-8655-4c17-9519-2ac3bdbb8fcb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:52.534283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050f34-8655-4c17-9519-2ac3bdbb8fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:52.534710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1050f34-8655-4c17-9519-2ac3bdbb8fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:52.545202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050f34-8655-4c17-9519-2ac3bdbb8fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:52.547560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1050f34-8655-4c17-9519-2ac3bdbb8fcb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:52.571588 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1242/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:53.382479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:53.383489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:53.384019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:53.445066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] MFA Rules not processed for user `356ffdf6f40b4d71a7f39c414c008491`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:53.446560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:53.497663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:53.586638 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1212/2454] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:53.777117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eedef1-09f1-4b47-b04f-717449f35c0c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:53.778944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eedef1-09f1-4b47-b04f-717449f35c0c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:53.779407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eedef1-09f1-4b47-b04f-717449f35c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:53.830129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-30eedef1-09f1-4b47-b04f-717449f35c0c None None] MFA Rules not processed for user `92f8b851f06d4b038a147c7dd873cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:53.834235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30eedef1-09f1-4b47-b04f-717449f35c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:53.873043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:53.875789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:53.912658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84652e5-da18-4623-9b67-a295dc1f10e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:53.925412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:53.927718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:53.927996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:53.928476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] PATH_INFO: `/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:53.931802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3605ca5c82984d1fbefb1cfed86e9f20)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:53.937506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:53.967920 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1243/2455] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:54.127605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3605ca5c82984d1fbefb1cfed86e9f20', 'request_id': 'req-0699ebb7-5c59-455a-a268-640964e352ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.138990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3605ca5c82984d1fbefb1cfed86e9f20', 'request_id': 'req-0699ebb7-5c59-455a-a268-640964e352ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.223545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3605ca5c82984d1fbefb1cfed86e9f20', 'request_id': 'req-0699ebb7-5c59-455a-a268-640964e352ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.253577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] The token cache is being invalidate because project 3605ca5c82984d1fbefb1cfed86e9f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:54.253876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.256609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.263070 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1213/2456] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:53 2022] DELETE /identity/v3/projects/3605ca5c82984d1fbefb1cfed86e9f20 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:54.267596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eedef1-09f1-4b47-b04f-717449f35c0c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:54.283658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eedef1-09f1-4b47-b04f-717449f35c0c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:54.458357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:54.459039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:54.459336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:54.461993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] PATH_INFO: `/v3/users/5cbf71b75c0e438988fbdc4c3216e299` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:54.484650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbf71b75c0e438988fbdc4c3216e299)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:54.486717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:54.718618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:54.749946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbf71b75c0e438988fbdc4c3216e299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.765484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbf71b75c0e438988fbdc4c3216e299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.767518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbf71b75c0e438988fbdc4c3216e299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.798388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbf71b75c0e438988fbdc4c3216e299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.882926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbf71b75c0e438988fbdc4c3216e299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:54.892398 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1244/2457] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:54 2022] DELETE /identity/v3/users/5cbf71b75c0e438988fbdc4c3216e299 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:56.145437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:56.147561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:56.165594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699ebb7-5c59-455a-a268-640964e352ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:56.208370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:56.210734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:56.284613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:56.290038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:56.291297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:56.291597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] PATH_INFO: `/v3/users/24f00d49604a4e98b98ca61fa425ef9c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:56.296828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f00d49604a4e98b98ca61fa425ef9c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:56.307775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:56.390864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9fc1b-249a-4819-a683-7f8a16881e38 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:56.399161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:56.409440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:56.415568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:56.415855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] PATH_INFO: `/v3/projects/7f1b3f156a374f3eb3480cad4b90680c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:56.422150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1b3f156a374f3eb3480cad4b90680c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:56.424304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:56.666163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f00d49604a4e98b98ca61fa425ef9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.667977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f00d49604a4e98b98ca61fa425ef9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.668260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1b3f156a374f3eb3480cad4b90680c', 'request_id': 'req-f7970312-ff55-40b7-82cc-f948dd29b765'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.692146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1b3f156a374f3eb3480cad4b90680c', 'request_id': 'req-f7970312-ff55-40b7-82cc-f948dd29b765'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.783157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f00d49604a4e98b98ca61fa425ef9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.783887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f00d49604a4e98b98ca61fa425ef9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.786798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:56.798789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-560f1ed0-381c-4589-af48-f17df80113de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f00d49604a4e98b98ca61fa425ef9c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.842111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1b3f156a374f3eb3480cad4b90680c', 'request_id': 'req-f7970312-ff55-40b7-82cc-f948dd29b765'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.871425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] The token cache is being invalidate because project 7f1b3f156a374f3eb3480cad4b90680c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:56.873884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.875400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f7970312-ff55-40b7-82cc-f948dd29b765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:56.877300 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1214/2458] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:56 2022] DELETE /identity/v3/users/24f00d49604a4e98b98ca61fa425ef9c => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:56.878883 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1245/2459] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:56 2022] DELETE /identity/v3/projects/7f1b3f156a374f3eb3480cad4b90680c => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:56.885032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d71e6-d688-4360-8fed-64204e91c50e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:56.885379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d71e6-d688-4360-8fed-64204e91c50e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:56.885653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d71e6-d688-4360-8fed-64204e91c50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:56.927875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ee0d71e6-d688-4360-8fed-64204e91c50e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:56.929129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee0d71e6-d688-4360-8fed-64204e91c50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:57.094015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1215/2460] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:57.095930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e41517-3de3-48db-b62e-e126f496cb4f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:57.096274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e41517-3de3-48db-b62e-e126f496cb4f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:57.097550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e41517-3de3-48db-b62e-e126f496cb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:57.143217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-24e41517-3de3-48db-b62e-e126f496cb4f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:57.147158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24e41517-3de3-48db-b62e-e126f496cb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:57.168372 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1246/2461] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:27:57.174268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d71e6-d688-4360-8fed-64204e91c50e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:57.213233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d71e6-d688-4360-8fed-64204e91c50e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:57.226347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:57.226347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:57.226347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:57.226347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:57.226732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:27:57.226732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:57.228966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:57.304504 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1216/2462] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:27:57.305467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e41517-3de3-48db-b62e-e126f496cb4f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:57.324242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e41517-3de3-48db-b62e-e126f496cb4f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:57.350151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:57.350821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:57.351234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:57.351587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:57.352375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:57.365439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:57.507147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1247/2463] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:57 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:57.512077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:57.528627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca0552-b504-4194-a937-995f937da56a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:57.609280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:57.616323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:57.701387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:57.739097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:57.740095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:57.740774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:57.740774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:57.741278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:57.743329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:57.783049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ff66f-51fb-41d3-b391-1ae53d3f3f05 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:57.788858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:57.789829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:57.790430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:57.790870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] PATH_INFO: `/v3/projects/96ecf7d7327442aa89c64aed1cfbbf78` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:57.792131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ecf7d7327442aa89c64aed1cfbbf78)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:57.794254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:57.892454 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1217/2464] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:57 2022] POST /identity/v3/users => generated 288 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:27:57.894652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:57.910292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ec2d0-d4e3-4c37-98ca-30dc90bb880e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:57.919450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:57.920818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:57.921150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:57.921665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:57.922472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:57.924545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:57.942733 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1218/2465] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:57.944575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:57.967609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f1c8-eb91-4fa5-88a0-eddaa89fe9b5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:57.969822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ecf7d7327442aa89c64aed1cfbbf78', 'request_id': 'req-e0596efd-838a-463b-a34d-01bd830725a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:57.979339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ecf7d7327442aa89c64aed1cfbbf78', 'request_id': 'req-e0596efd-838a-463b-a34d-01bd830725a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.026791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:58.051468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:58.052111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:58.052373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:58.052653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:58.053312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:58.055620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:58.074887 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1219/2466] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:27:58.077554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ecf7d7327442aa89c64aed1cfbbf78', 'request_id': 'req-e0596efd-838a-463b-a34d-01bd830725a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.078183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:58.105392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac191a0-3b62-448a-8e21-50d793691558 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:58.107261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] The token cache is being invalidate because project 96ecf7d7327442aa89c64aed1cfbbf78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:27:58.108374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.109333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.111350 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1248/2467] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:27:57 2022] DELETE /identity/v3/projects/96ecf7d7327442aa89c64aed1cfbbf78 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:58.117203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:58.124946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee081-ce09-41ff-9fb9-3bb804bb83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:58.126736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee081-ce09-41ff-9fb9-3bb804bb83ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:58.126736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee081-ce09-41ff-9fb9-3bb804bb83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:58.126736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee081-ce09-41ff-9fb9-3bb804bb83ff admin admin] PATH_INFO: `/v3/projects/e25a068285474cdfa415f75774fab88f/users/8c3878480453431484cbe05c5d2107ce/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:58.133401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:58.156345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee081-ce09-41ff-9fb9-3bb804bb83ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25a068285474cdfa415f75774fab88f, user_id=8c3878480453431484cbe05c5d2107ce, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:58.157991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0596efd-838a-463b-a34d-01bd830725a4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:58.160638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee081-ce09-41ff-9fb9-3bb804bb83ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:58.173859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:58.174628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:58.174972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:58.175370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] PATH_INFO: `/v3/users/211a891e6a0e4d6186262feadb61aef6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:58.176577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211a891e6a0e4d6186262feadb61aef6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:58.178837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:58.249457 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1220/2468] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:27:58 2022] PUT /identity/v3/projects/e25a068285474cdfa415f75774fab88f/users/8c3878480453431484cbe05c5d2107ce/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:58.260265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:58.260872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:58.261215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:58.326626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] MFA Rules not processed for user `8c3878480453431484cbe05c5d2107ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:27:58.327902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:58.518551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211a891e6a0e4d6186262feadb61aef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.524090 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1221/2469] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:27:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:27:58.527118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:58.529371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:58.532566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211a891e6a0e4d6186262feadb61aef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.534018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211a891e6a0e4d6186262feadb61aef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.611391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211a891e6a0e4d6186262feadb61aef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.675313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff0c0a-635f-4b48-a3b2-794015fc3127 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:58.702237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:58.702890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:58.703176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:58.703458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:58.704109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:58.709458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:27:58.757270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211a891e6a0e4d6186262feadb61aef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:27:58.771317 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1249/2470] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:27:58 2022] DELETE /identity/v3/users/211a891e6a0e4d6186262feadb61aef6 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:27:58.905812 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1222/2471] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:27:58 2022] POST /identity/v3/projects => generated 373 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:27:58.909838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:27:58.911796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:27:58.989510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:59.088123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aa927-10d5-4541-a65e-997426216398 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:27:59.257852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:27:59.261279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:27:59.262020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:27:59.262550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:27:59.263558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:27:59.266872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:00.227456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:00.229795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:00.241131 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1250/2472] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:27:58 2022] POST /identity/v3/users => generated 293 bytes in 1329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:28:00.252937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:00.258652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd3919-0729-4fbb-aa4a-cda544bd5436 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:00.267714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:00.270802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.271343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.272947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] PATH_INFO: `/v3/projects/3cd4894c66464e8ebcd66d0bceae52c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.276937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd4894c66464e8ebcd66d0bceae52c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:00.281341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:00.296466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ae08f-6846-4134-88bf-baadc0d86875 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:00.301858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:00.303412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.303412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.303412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.303738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:00.306339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:00.334375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:00.336966 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1251/2473] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:28:00.347047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:00.371562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232def0-5bf4-4b68-b7a3-b01a95207a93 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:00.385536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:00.386449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.386564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.387520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] PATH_INFO: `/v3/projects/d6f3c09f474e4fc08dd88e2e9096b7b7/users/97ba4186d9c146ceb45dfe99470814bd/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.427946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f3c09f474e4fc08dd88e2e9096b7b7, user_id=97ba4186d9c146ceb45dfe99470814bd, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:00.431275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:00.519078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd4894c66464e8ebcd66d0bceae52c4', 'request_id': 'req-43bd604f-399b-49e8-a263-80e8b7af2895'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:28:00.545749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd4894c66464e8ebcd66d0bceae52c4', 'request_id': 'req-43bd604f-399b-49e8-a263-80e8b7af2895'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:28:00.624715 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1252/2474] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:28:00 2022] PUT /identity/v3/projects/d6f3c09f474e4fc08dd88e2e9096b7b7/users/97ba4186d9c146ceb45dfe99470814bd/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:28:00.626213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:00.641340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd4894c66464e8ebcd66d0bceae52c4', 'request_id': 'req-43bd604f-399b-49e8-a263-80e8b7af2895'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:28:00.660721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] The token cache is being invalidate because project 3cd4894c66464e8ebcd66d0bceae52c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:28:00.662120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:28:00.663076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43bd604f-399b-49e8-a263-80e8b7af2895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:28:00.668894 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1223/2475] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:00 2022] DELETE /identity/v3/projects/3cd4894c66464e8ebcd66d0bceae52c4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:28:00.672118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751845-ae2d-4ba4-99f7-33e07f139583 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.672410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751845-ae2d-4ba4-99f7-33e07f139583 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.672696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751845-ae2d-4ba4-99f7-33e07f139583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.739945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-05751845-ae2d-4ba4-99f7-33e07f139583 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:00.741528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05751845-ae2d-4ba4-99f7-33e07f139583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:00.797787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290f4f9-02b3-4a9b-b4d4-a3e9970ae2ea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:00.821471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:00.822022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.822336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.822676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.823344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:00.825626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:00.850458 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1253/2476] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:28:00.855972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:00.858371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:00.899960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1224/2477] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:00.902420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db697ff-89bf-4c70-bb1d-2fcbcb39375e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:00.911203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a71c3-d842-4f6c-a332-ba0f379b2d93 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.912265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a71c3-d842-4f6c-a332-ba0f379b2d93 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.912987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a71c3-d842-4f6c-a332-ba0f379b2d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.921094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd6ec-9c37-4bcd-8a8c-63a963df067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:00.921773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd6ec-9c37-4bcd-8a8c-63a963df067d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.922091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd6ec-9c37-4bcd-8a8c-63a963df067d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.922353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd6ec-9c37-4bcd-8a8c-63a963df067d admin admin] PATH_INFO: `/v3/projects/d6f3c09f474e4fc08dd88e2e9096b7b7/users/97ba4186d9c146ceb45dfe99470814bd/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.925578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd6ec-9c37-4bcd-8a8c-63a963df067d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f3c09f474e4fc08dd88e2e9096b7b7, user_id=97ba4186d9c146ceb45dfe99470814bd, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:00.931206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd6ec-9c37-4bcd-8a8c-63a963df067d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:00.959770 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1254/2478] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:28:00 2022] PUT /identity/v3/projects/d6f3c09f474e4fc08dd88e2e9096b7b7/users/97ba4186d9c146ceb45dfe99470814bd/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:28:00.984413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1674f-d9b8-4f03-9c49-951026349b49 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:00.984694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1674f-d9b8-4f03-9c49-951026349b49 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:00.986603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1674f-d9b8-4f03-9c49-951026349b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:00.996337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e3a71c3-d842-4f6c-a332-ba0f379b2d93 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:01.007199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e3a71c3-d842-4f6c-a332-ba0f379b2d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:01.049939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dba1674f-d9b8-4f03-9c49-951026349b49 None None] MFA Rules not processed for user `97ba4186d9c146ceb45dfe99470814bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:01.052562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dba1674f-d9b8-4f03-9c49-951026349b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:01.173150 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1225/2479] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:01.177698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a71c3-d842-4f6c-a332-ba0f379b2d93 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:01.219221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a71c3-d842-4f6c-a332-ba0f379b2d93 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:01.222917 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1255/2480] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:01.235045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfc2a-360a-48bb-bb77-9409f1e23ab9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:01.235329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfc2a-360a-48bb-bb77-9409f1e23ab9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:01.235849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcfc2a-360a-48bb-bb77-9409f1e23ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:01.238331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:01.240282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:01.240282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:01.240606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:01.241355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:28:01.241738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:01.244273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:01.275560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1226/2481] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:28:01.277712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-62dcfc2a-360a-48bb-bb77-9409f1e23ab9 None None] MFA Rules not processed for user `8c3878480453431484cbe05c5d2107ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:01.280303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:01.280893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62dcfc2a-360a-48bb-bb77-9409f1e23ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:01.298494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3377ab4-2e7a-4199-82a0-192403df3134 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:01.312844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:01.313803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:01.314284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:01.314751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:01.315589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:01.318796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:01.418502 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1256/2482] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:01.519723 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1227/2483] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:28:01 2022] POST /identity/v3/projects => generated 371 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:28:01.523905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfc2a-360a-48bb-bb77-9409f1e23ab9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:01.560039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcfc2a-360a-48bb-bb77-9409f1e23ab9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:01.669086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:01.671177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:01.671352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:01.672939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:01.674629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:01.675142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:01.676125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:01.686523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:01.815984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eacc7-5ea9-4a8b-97d5-8247ddd2d09a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:01.823749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:01.828372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:01.828372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:01.828622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:01.831737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:01.906980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:01.908938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:01.922302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1228/2484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:28:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:28:01.946542 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1257/2485] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:28:01 2022] POST /identity/v3/users => generated 286 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:28:01.950324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:01.994811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba68ca-33b1-41b6-b758-9c797b02fa32 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:02.011268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:02.011579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:02.011991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:02.012687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:02.013483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:02.016401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:02.054667 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1229/2486] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:28:02.055400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:02.068505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c018-7850-4f35-93ba-6497c5e62041 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:02.073985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0686ef-044b-4bef-a242-edab45f07e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:02.074749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0686ef-044b-4bef-a242-edab45f07e81 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:02.075581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0686ef-044b-4bef-a242-edab45f07e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:02.075581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0686ef-044b-4bef-a242-edab45f07e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:02.077003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0686ef-044b-4bef-a242-edab45f07e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:02.078769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0686ef-044b-4bef-a242-edab45f07e81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:02.094982 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1258/2487] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:28:02.096192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:02.125885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c1baa-e3da-4bfc-bec7-a6060c802330 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:02.133931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:02.134317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:02.134724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:02.136005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] PATH_INFO: `/v3/projects/9395a050de444357956d4ac79adefee6/users/d5ed601492e2486bad8ba5b09515d52a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:02.161135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9395a050de444357956d4ac79adefee6, user_id=d5ed601492e2486bad8ba5b09515d52a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:02.162523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:02.263340 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1230/2488] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:28:02 2022] PUT /identity/v3/projects/9395a050de444357956d4ac79adefee6/users/d5ed601492e2486bad8ba5b09515d52a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:28:02.265909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499e94-2c3f-4689-9944-0a4ea3fa79c2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:02.266235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499e94-2c3f-4689-9944-0a4ea3fa79c2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:02.266574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499e94-2c3f-4689-9944-0a4ea3fa79c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:02.297328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a499e94-2c3f-4689-9944-0a4ea3fa79c2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:02.300174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a499e94-2c3f-4689-9944-0a4ea3fa79c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:02.366939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:02.470146 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1259/2489] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:02.485243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:02.485243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:02.533130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:02.636858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aa416-5ad7-4257-9b67-bd55604f5325 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:02.645651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd4fd5-c78b-4ebe-8d12-213db96e75a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:02.646371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4fd5-c78b-4ebe-8d12-213db96e75a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:02.647059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4fd5-c78b-4ebe-8d12-213db96e75a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:02.647059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd4fd5-c78b-4ebe-8d12-213db96e75a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:02.671870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd4fd5-c78b-4ebe-8d12-213db96e75a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:02.673333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd4fd5-c78b-4ebe-8d12-213db96e75a3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:02.698018 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1231/2490] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:28:04.814749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941695b0-747d-405e-bfc4-6c955cb11d49 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:04.815230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941695b0-747d-405e-bfc4-6c955cb11d49 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:04.815313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941695b0-747d-405e-bfc4-6c955cb11d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:04.850588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-941695b0-747d-405e-bfc4-6c955cb11d49 None None] MFA Rules not processed for user `6c1cd81ee6174cee97e384cae58a2e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:04.852227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-941695b0-747d-405e-bfc4-6c955cb11d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:04.946718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1260/2491] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:05.031134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:14.249830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097439-084c-4315-9056-b6f7abbad772 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:14.252347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097439-084c-4315-9056-b6f7abbad772 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:14.252347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097439-084c-4315-9056-b6f7abbad772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:14.322306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-36097439-084c-4315-9056-b6f7abbad772 None None] MFA Rules not processed for user `d5ed601492e2486bad8ba5b09515d52a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:14.324213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36097439-084c-4315-9056-b6f7abbad772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:14.337430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:14.459092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941695b0-747d-405e-bfc4-6c955cb11d49 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:14.461655 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1232/2492] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:14.480007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941695b0-747d-405e-bfc4-6c955cb11d49 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:14.516935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:14.517580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:14.517864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:14.523964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:14.524654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:14.526632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:14.735805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097439-084c-4315-9056-b6f7abbad772 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:14.746388 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1261/2493] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:28:14 2022] POST /identity/v3/projects => generated 369 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:28:14.754095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097439-084c-4315-9056-b6f7abbad772 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:14.986740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:14.987574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:14.988498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:14.988977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:14.990077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:14.992422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:15.127736 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1233/2494] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:28:14 2022] POST /identity/v3/users => generated 291 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:28:15.132459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:15.157570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971046e-f847-4523-9e20-f9015b4a3913 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:15.166849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edab958-8a14-4976-a529-37ffa81a97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:15.167487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edab958-8a14-4976-a529-37ffa81a97d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:15.169594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edab958-8a14-4976-a529-37ffa81a97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:15.170656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edab958-8a14-4976-a529-37ffa81a97d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:15.173937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edab958-8a14-4976-a529-37ffa81a97d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:15.179429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edab958-8a14-4976-a529-37ffa81a97d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:15.224557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:15.225940 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1262/2495] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:28:15.247217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3747b4-b6fb-45f2-9fa3-f9994b238f4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:15.262877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:15.265623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:15.265623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:15.265812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:15.265812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:15.265812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:15.265812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] PATH_INFO: `/v3/projects/78fa68afc03e4e81a50ccc146aaf6f68/users/2302b2fd0f814069a8969175ee09f7f6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:15.317607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:15.321200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:15.330206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fa68afc03e4e81a50ccc146aaf6f68, user_id=2302b2fd0f814069a8969175ee09f7f6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:15.333655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:15.440260 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1234/2496] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:28:15 2022] PUT /identity/v3/projects/78fa68afc03e4e81a50ccc146aaf6f68/users/2302b2fd0f814069a8969175ee09f7f6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:28:15.444671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:15.504999 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1263/2497] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:28:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:28:15.543047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:15.548288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:15.598107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:15.682076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c825d7-1772-4299-b52f-95b4d8857ac6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:15.697264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:15.697914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:15.698226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:15.698505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:15.699392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:15.702942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:15.736157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7c396-b4f0-4bd7-be3c-fca50fc45efb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:15.749202 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1235/2498] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:28:15.752630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:15.788577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6f044-6c6e-4bb4-a775-268b8be2ed81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:15.801324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc61168-930f-4ad6-88d4-c6a1e3121799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:15.802105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61168-930f-4ad6-88d4-c6a1e3121799 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:15.802400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61168-930f-4ad6-88d4-c6a1e3121799 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:15.802800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61168-930f-4ad6-88d4-c6a1e3121799 admin admin] PATH_INFO: `/v3/projects/78fa68afc03e4e81a50ccc146aaf6f68/users/2302b2fd0f814069a8969175ee09f7f6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:15.808369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc61168-930f-4ad6-88d4-c6a1e3121799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fa68afc03e4e81a50ccc146aaf6f68, user_id=2302b2fd0f814069a8969175ee09f7f6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:15.825078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc61168-930f-4ad6-88d4-c6a1e3121799 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:15.842669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:15.862177 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1236/2499] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:28:15 2022] PUT /identity/v3/projects/78fa68afc03e4e81a50ccc146aaf6f68/users/2302b2fd0f814069a8969175ee09f7f6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:28:15.915966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e44db-ce5b-4aa8-b1f8-188c966b4ed2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:15.917945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e44db-ce5b-4aa8-b1f8-188c966b4ed2 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:15.918526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e44db-ce5b-4aa8-b1f8-188c966b4ed2 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:15.919267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e44db-ce5b-4aa8-b1f8-188c966b4ed2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:16.102720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e44db-ce5b-4aa8-b1f8-188c966b4ed2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:16.105808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e44db-ce5b-4aa8-b1f8-188c966b4ed2 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:16.139685 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1264/2500] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:28:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:28:16.265001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa432-4c5c-4213-ab9e-493947532ba2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:16.265001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa432-4c5c-4213-ab9e-493947532ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:16.265259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfa432-4c5c-4213-ab9e-493947532ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:16.357242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c1bfa432-4c5c-4213-ab9e-493947532ba2 None None] MFA Rules not processed for user `92f8b851f06d4b038a147c7dd873cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:16.358597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1bfa432-4c5c-4213-ab9e-493947532ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:16.457512 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1237/2501] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:18.189968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f488-b68f-475a-aff1-1b4f950a9430 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:18.190917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f488-b68f-475a-aff1-1b4f950a9430 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:18.191372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f488-b68f-475a-aff1-1b4f950a9430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:18.233241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f376f488-b68f-475a-aff1-1b4f950a9430 None None] MFA Rules not processed for user `3424ff1ac4404c4cb1b47907bf255b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:18.233241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f376f488-b68f-475a-aff1-1b4f950a9430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:18.397574 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1265/2502] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:25.497167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e12b-c92e-41e7-b5f0-9c96e1508fc4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:25.498387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e12b-c92e-41e7-b5f0-9c96e1508fc4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:25.498644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e12b-c92e-41e7-b5f0-9c96e1508fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:25.532417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3442e12b-c92e-41e7-b5f0-9c96e1508fc4 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:25.537622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3442e12b-c92e-41e7-b5f0-9c96e1508fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:25.602119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1238/2503] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:28:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:25.625178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f488-b68f-475a-aff1-1b4f950a9430 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:25.685289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:25.816557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f488-b68f-475a-aff1-1b4f950a9430 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:25.833726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bdd4b-f1f9-47a8-8b6c-bbd1a308cc62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:25.834417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdd4b-f1f9-47a8-8b6c-bbd1a308cc62 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:25.834688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdd4b-f1f9-47a8-8b6c-bbd1a308cc62 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:25.834964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bdd4b-f1f9-47a8-8b6c-bbd1a308cc62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:25.850993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bdd4b-f1f9-47a8-8b6c-bbd1a308cc62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:25.852847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9bdd4b-f1f9-47a8-8b6c-bbd1a308cc62 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:25.880493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1266/2504] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:28:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:30.683081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:30.683642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:30.683751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:30.724039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] MFA Rules not processed for user `2302b2fd0f814069a8969175ee09f7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:30.725544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:30.831697 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1239/2505] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:30.843740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083b58-d886-45fc-a017-5766f67913e7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:30.844742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083b58-d886-45fc-a017-5766f67913e7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:30.845349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083b58-d886-45fc-a017-5766f67913e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:30.900602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07083b58-d886-45fc-a017-5766f67913e7 None None] MFA Rules not processed for user `d5ed601492e2486bad8ba5b09515d52a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:30.902136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07083b58-d886-45fc-a017-5766f67913e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:31.050839 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1267/2506] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:39.085856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:39.088890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:39.161978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:39.245640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed67bb-8b02-45e2-8f3a-59a41dccd2da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:39.252925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:39.253554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:39.253833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:39.254137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:39.265272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:39.267193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:39.283236 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1240/2507] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:28:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:28:41.037193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=49 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:43.905705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dfa6b-ba94-40e6-8e48-576bcf7cf9f9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:43.909362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dfa6b-ba94-40e6-8e48-576bcf7cf9f9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:43.909362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120dfa6b-ba94-40e6-8e48-576bcf7cf9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:43.944712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-120dfa6b-ba94-40e6-8e48-576bcf7cf9f9 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:43.946404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-120dfa6b-ba94-40e6-8e48-576bcf7cf9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:43.954578 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1268/2508] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:28:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:43.969849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:43.985656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a73791-dfa1-47ea-805c-2ba5bca54b2f service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:43.991524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a3506-c094-4a9c-a6ed-c44862211df1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:43.992141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3506-c094-4a9c-a6ed-c44862211df1 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:43.992482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3506-c094-4a9c-a6ed-c44862211df1 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:43.992749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3506-c094-4a9c-a6ed-c44862211df1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:44.002485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a3506-c094-4a9c-a6ed-c44862211df1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:44.004593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a3506-c094-4a9c-a6ed-c44862211df1 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:44.018404 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1241/2509] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:28:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:44.839874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628fe7-f819-450b-a533-092508f81214 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:44.840247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628fe7-f819-450b-a533-092508f81214 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:44.840592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb628fe7-f819-450b-a533-092508f81214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:44.861181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bb628fe7-f819-450b-a533-092508f81214 None None] MFA Rules not processed for user `356ffdf6f40b4d71a7f39c414c008491`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:44.862642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb628fe7-f819-450b-a533-092508f81214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:44.948997 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1269/2510] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:45.428249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ac8dd-f574-4e05-b31a-688d0023b1a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:45.429253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ac8dd-f574-4e05-b31a-688d0023b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:45.429694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ac8dd-f574-4e05-b31a-688d0023b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:45.449123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d36ac8dd-f574-4e05-b31a-688d0023b1a5 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:45.450823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d36ac8dd-f574-4e05-b31a-688d0023b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:45.460528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1242/2511] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:28:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:45.482357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb628fe7-f819-450b-a533-092508f81214 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:45.495823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb628fe7-f819-450b-a533-092508f81214 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:45.501831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3348d-7466-4d4e-b1ae-773c891811e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:45.502547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3348d-7466-4d4e-b1ae-773c891811e0 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:45.503129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3348d-7466-4d4e-b1ae-773c891811e0 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:45.503553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3348d-7466-4d4e-b1ae-773c891811e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:45.516217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3348d-7466-4d4e-b1ae-773c891811e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:45.517819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3348d-7466-4d4e-b1ae-773c891811e0 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:45.529546 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1270/2512] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:28:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:28:46.206294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be978c-edf0-4cd5-a660-e24fb245b56e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:46.206955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be978c-edf0-4cd5-a660-e24fb245b56e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:46.207828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be978c-edf0-4cd5-a660-e24fb245b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:46.262228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48be978c-edf0-4cd5-a660-e24fb245b56e None None] MFA Rules not processed for user `92f8b851f06d4b038a147c7dd873cb34`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:46.265204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48be978c-edf0-4cd5-a660-e24fb245b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:46.291442 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1243/2513] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:47.134319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe4ade-dea0-46b6-8cf9-c4a60ec92621 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:47.135125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe4ade-dea0-46b6-8cf9-c4a60ec92621 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:47.135595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe4ade-dea0-46b6-8cf9-c4a60ec92621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:47.159008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5dbe4ade-dea0-46b6-8cf9-c4a60ec92621 None None] MFA Rules not processed for user `fa4ca05a0c6a405f8fa014ee06dbcef4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:47.161568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5dbe4ade-dea0-46b6-8cf9-c4a60ec92621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:47.174594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fec79-252f-4cee-b286-a8b020830f04 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:47.175532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fec79-252f-4cee-b286-a8b020830f04 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:47.176085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fec79-252f-4cee-b286-a8b020830f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:47.244559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b3fec79-252f-4cee-b286-a8b020830f04 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:47.247274 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1271/2514] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:47.254465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b3fec79-252f-4cee-b286-a8b020830f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:47.273379 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1244/2515] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:47.290665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe4ade-dea0-46b6-8cf9-c4a60ec92621 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:47.324044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe4ade-dea0-46b6-8cf9-c4a60ec92621 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:47.335024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e594d-ab06-439d-bc9b-ac9b37bba94c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:47.335652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e594d-ab06-439d-bc9b-ac9b37bba94c service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:47.336063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e594d-ab06-439d-bc9b-ac9b37bba94c service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:47.336468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e594d-ab06-439d-bc9b-ac9b37bba94c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:47.351580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e594d-ab06-439d-bc9b-ac9b37bba94c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:47.351580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e594d-ab06-439d-bc9b-ac9b37bba94c service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:47.394751 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1272/2516] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:28:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:49.427899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fec79-252f-4cee-b286-a8b020830f04 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:49.473859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fec79-252f-4cee-b286-a8b020830f04 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:49.483335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:49.483335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:49.483335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:49.483335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:49.631996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:49.637080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:49.681022 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1245/2517] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:28:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:28:50.483576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c9da7-8c5a-495e-b84d-02db79964650 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:50.484531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c9da7-8c5a-495e-b84d-02db79964650 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:50.485072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c9da7-8c5a-495e-b84d-02db79964650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:50.538623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-303c9da7-8c5a-495e-b84d-02db79964650 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:28:50.540372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-303c9da7-8c5a-495e-b84d-02db79964650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:50.581145 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1273/2518] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:28:50.598787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:50.619948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e512b4-aed6-4ebf-904f-9746ca5ff1ff service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:50.642423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:50.643068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:50.643360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:50.643638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:50.663961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:50.665760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:50.686920 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1246/2519] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:28:54.452655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c9da7-8c5a-495e-b84d-02db79964650 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:28:54.559642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c9da7-8c5a-495e-b84d-02db79964650 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:28:54.563912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:28:54.564818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:28:54.565163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:28:54.565668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:28:54.569376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:28:54.586638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:28:54.589110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:28:54.640142 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1274/2520] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:28:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:00.677890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:02.160914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:02.164927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:02.235289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab117ad-526a-451d-9756-72b083a24895 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:02.239586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:02.240689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:02.241191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:02.241479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:02.243360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:02.258613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:02.260070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:02.273567 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1247/2521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:04.597653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:04.907108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:04.924653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c9f5f-b862-4971-9d60-b3a32dc5b567 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:04.932061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:04.932940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:04.933465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:04.933755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:04.950857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:04.953472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:04.968861 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1275/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:08.277209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:08.305235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90b97c-729f-4a50-bd4c-0be6ed752799 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:08.312440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c428-a811-44ae-876d-ba38d7860c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:08.318867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c428-a811-44ae-876d-ba38d7860c7e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:08.318867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c428-a811-44ae-876d-ba38d7860c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:08.318867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c428-a811-44ae-876d-ba38d7860c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:08.323922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0470c428-a811-44ae-876d-ba38d7860c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:08.378851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c428-a811-44ae-876d-ba38d7860c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:08.383274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c428-a811-44ae-876d-ba38d7860c7e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:08.406298 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1248/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:09.164086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:09.165673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:09.282577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979caf9-82b9-41d2-abf1-00e8aa9484f2 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:09.287189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:09.287824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:09.288101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:09.288376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] PATH_INFO: `/v3/users/3424ff1ac4404c4cb1b47907bf255b4b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:09.289504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3424ff1ac4404c4cb1b47907bf255b4b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:09.291482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:10.021793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3424ff1ac4404c4cb1b47907bf255b4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:10.052123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3424ff1ac4404c4cb1b47907bf255b4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:10.053684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3424ff1ac4404c4cb1b47907bf255b4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:10.140135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3424ff1ac4404c4cb1b47907bf255b4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:10.258841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3424ff1ac4404c4cb1b47907bf255b4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:10.283127 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1276/2524] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:29:09 2022] DELETE /identity/v3/users/3424ff1ac4404c4cb1b47907bf255b4b => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:10.619267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:10.620210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:10.620626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:10.642998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:10.644694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:10.722567 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1249/2525] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:10.737785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:10.738890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:10.753126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:10.756431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:10.799450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:10.829718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6e707-5c4d-4c44-95f9-3533b65ad6aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:10.852860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9b214-c57b-4191-b20f-d0bfdeca9395 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:10.854748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591dd82-ea5e-4dbb-95cc-2c6555777cf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:10.855393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591dd82-ea5e-4dbb-95cc-2c6555777cf1 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:10.855679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591dd82-ea5e-4dbb-95cc-2c6555777cf1 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:10.855992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591dd82-ea5e-4dbb-95cc-2c6555777cf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:10.858416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:10.859399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:10.859685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:10.859958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] PATH_INFO: `/v3/projects/e3669621720549bba2466676e40d638a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:10.861319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3669621720549bba2466676e40d638a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:10.863344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:10.876214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591dd82-ea5e-4dbb-95cc-2c6555777cf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:10.882455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591dd82-ea5e-4dbb-95cc-2c6555777cf1 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:10.892067 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1277/2526] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:29:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:11.003888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:11.031704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3669621720549bba2466676e40d638a', 'request_id': 'req-e3511c14-1f62-4885-b321-718a728b89c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:11.039503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3669621720549bba2466676e40d638a', 'request_id': 'req-e3511c14-1f62-4885-b321-718a728b89c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:11.113936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3669621720549bba2466676e40d638a', 'request_id': 'req-e3511c14-1f62-4885-b321-718a728b89c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:11.127341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] The token cache is being invalidate because project e3669621720549bba2466676e40d638a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:29:11.127896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:11.128934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3511c14-1f62-4885-b321-718a728b89c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:11.131142 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1250/2527] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:10 2022] DELETE /identity/v3/projects/e3669621720549bba2466676e40d638a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:11.136582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c5cc-cb25-4bd3-8c4b-ddfc9df9d98f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.137238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c5cc-cb25-4bd3-8c4b-ddfc9df9d98f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.137848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c5cc-cb25-4bd3-8c4b-ddfc9df9d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.166589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02d8c5cc-cb25-4bd3-8c4b-ddfc9df9d98f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:11.168186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02d8c5cc-cb25-4bd3-8c4b-ddfc9df9d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:11.236767 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1278/2528] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:11.245167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7d7d-fa2f-4f1b-882b-34f8ebc35d00 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.245519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7d7d-fa2f-4f1b-882b-34f8ebc35d00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.245797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc7d7d-fa2f-4f1b-882b-34f8ebc35d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.266444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-34dc7d7d-fa2f-4f1b-882b-34f8ebc35d00 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:11.267645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34dc7d7d-fa2f-4f1b-882b-34f8ebc35d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:11.281050 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1251/2529] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:11.285114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c5cc-cb25-4bd3-8c4b-ddfc9df9d98f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.296329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c5cc-cb25-4bd3-8c4b-ddfc9df9d98f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:11.302256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e3627-513b-4c71-9847-72d41dbb5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:11.302939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e3627-513b-4c71-9847-72d41dbb5ebb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.303290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e3627-513b-4c71-9847-72d41dbb5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.303632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e3627-513b-4c71-9847-72d41dbb5ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.304348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e3627-513b-4c71-9847-72d41dbb5ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:29:11.304819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e3627-513b-4c71-9847-72d41dbb5ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:11.307560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e3627-513b-4c71-9847-72d41dbb5ebb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:11.324197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1279/2530] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:29:11.328711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc7d7d-fa2f-4f1b-882b-34f8ebc35d00 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.340703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc7d7d-fa2f-4f1b-882b-34f8ebc35d00 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:11.345836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:11.346574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.346894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.347233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.347937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:11.350096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:11.457542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.463994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.463994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.477764 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1252/2531] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:11 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:11.483726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.499107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:11.499107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:11.572725 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1280/2532] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:29:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:11.587377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.591393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926c25b-05d0-40f6-aa27-66122859b62e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:11.591528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:11.593304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:11.594989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.595276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.595550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.596387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:11.598477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:11.657258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:11.663364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172e555-27a5-4baa-ba05-b2d60d2090c7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:11.669190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:11.669802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.670106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.670398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.679000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:11.680603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:11.689196 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1281/2533] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:29:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:29:11.724521 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1253/2534] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:11 2022] POST /identity/v3/users => generated 303 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:29:11.725884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.737602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8eff2-e1b7-4a8c-a7fe-0697056fdb9e service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:11.748879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:11.749501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.749783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.750083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.750736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:11.752331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:11.763792 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1282/2535] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:11.768243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.781290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f4035-a6a0-4d56-ae00-2543ea8b99c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:11.786294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b881a-2669-48bb-82b8-6232bd112e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:11.786986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b881a-2669-48bb-82b8-6232bd112e65 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.787330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b881a-2669-48bb-82b8-6232bd112e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.787792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b881a-2669-48bb-82b8-6232bd112e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.788441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b881a-2669-48bb-82b8-6232bd112e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:11.790011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b881a-2669-48bb-82b8-6232bd112e65 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:11.808055 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1254/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:11.812241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.827826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6941c-c2e6-49a0-9df3-fa410fb0aba3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:11.832944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:11.833614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.833884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.834177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] PATH_INFO: `/v3/projects/d1348916675647e5b2e68cc8d489faf8/users/35e2af24561642bf90a5650a83b093fa/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.856306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1348916675647e5b2e68cc8d489faf8, user_id=35e2af24561642bf90a5650a83b093fa, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:11.859485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:11.927711 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1283/2537] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:11 2022] PUT /identity/v3/projects/d1348916675647e5b2e68cc8d489faf8/users/35e2af24561642bf90a5650a83b093fa/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:11.933135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b037d-5fb3-403e-af8d-9236fecba4b0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:11.933699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b037d-5fb3-403e-af8d-9236fecba4b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:11.934097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b037d-5fb3-403e-af8d-9236fecba4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:11.959582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8a8b037d-5fb3-403e-af8d-9236fecba4b0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:11.961209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a8b037d-5fb3-403e-af8d-9236fecba4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:11.990879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:11.992726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:12.078653 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1255/2538] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:12.084559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9e96e-54f3-460c-92e9-aab7ba00394e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:12.091488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b037d-5fb3-403e-af8d-9236fecba4b0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:12.096448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9ea5-aca8-4471-8a57-753a93e7b59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:12.098030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ea5-aca8-4471-8a57-753a93e7b59e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:12.098030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ea5-aca8-4471-8a57-753a93e7b59e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:12.098030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ea5-aca8-4471-8a57-753a93e7b59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:12.100962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e6d9ea5-aca8-4471-8a57-753a93e7b59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:12.108031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b037d-5fb3-403e-af8d-9236fecba4b0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:12.113730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9ea5-aca8-4471-8a57-753a93e7b59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:12.115728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9ea5-aca8-4471-8a57-753a93e7b59e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:12.116066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:12.117238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:12.117667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:12.124400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:12.132190 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1284/2539] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:29:12.136410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:12.138642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:12.154019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1256/2540] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:29:12.702929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:12.703963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:12.704412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:12.727086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:12.728305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:12.839658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1285/2541] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:29:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:12.874482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:12.879812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:12.972619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315a0f4-4e5c-4582-b441-5e6a2620c535 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:12.977616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d55b4-e093-4af1-b30b-77293b2e4b87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:12.978273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d55b4-e093-4af1-b30b-77293b2e4b87 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:12.979065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d55b4-e093-4af1-b30b-77293b2e4b87 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:12.983020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d55b4-e093-4af1-b30b-77293b2e4b87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:12.988477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d55b4-e093-4af1-b30b-77293b2e4b87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:12.990509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d55b4-e093-4af1-b30b-77293b2e4b87 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:13.000354 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1257/2542] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:29:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:13.591732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:13.591732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:13.618575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ea8d2-30ff-44fd-b44f-4ccd6c36fd46 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:13.632577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:13.636415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:13.636415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:13.636415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] PATH_INFO: `/v3/users/2dc31958aee54271985c85e5a569ceb0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:13.636415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc31958aee54271985c85e5a569ceb0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:13.640505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:13.849968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc31958aee54271985c85e5a569ceb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:13.863017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc31958aee54271985c85e5a569ceb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:13.863973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc31958aee54271985c85e5a569ceb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:13.867036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:13.884559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc31958aee54271985c85e5a569ceb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:13.950543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc31958aee54271985c85e5a569ceb0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:13.960222 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1286/2543] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:29:13 2022] DELETE /identity/v3/users/2dc31958aee54271985c85e5a569ceb0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:13.965656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:13.966474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:13.966896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:14.037745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:14.038991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:14.163239 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1258/2544] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:14.526044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:14.528042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:14.682863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66da13-2951-4ea3-a5ea-30b6641b93a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:14.692815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:14.693504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:14.693886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:14.694081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:14.727620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:14.729167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:14.758789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:14.767619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:14.781051 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1287/2545] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:14.989653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40b7b8-de50-436f-a53f-bbccaf3f5095 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:15.002012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdd2ff-27ca-4618-ace5-cd2560971261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:15.002678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdd2ff-27ca-4618-ace5-cd2560971261 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:15.005687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdd2ff-27ca-4618-ace5-cd2560971261 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:15.006113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdd2ff-27ca-4618-ace5-cd2560971261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:15.010430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afbdd2ff-27ca-4618-ace5-cd2560971261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:15.026537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdd2ff-27ca-4618-ace5-cd2560971261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:15.029062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdd2ff-27ca-4618-ace5-cd2560971261 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:15.064404 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1259/2546] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:16.029816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:16.032442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:16.077016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9dcf9-7a14-448a-a893-da37cfbac075 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:16.094871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:16.096971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:16.099439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:16.099903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] PATH_INFO: `/v3/projects/5ede599ca0234feb928a00539d9aeb82` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:16.104395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ede599ca0234feb928a00539d9aeb82)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:16.111745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:16.319716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ede599ca0234feb928a00539d9aeb82', 'request_id': 'req-2d140233-591f-4e8a-93f4-9a5b55c83000'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:16.332780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ede599ca0234feb928a00539d9aeb82', 'request_id': 'req-2d140233-591f-4e8a-93f4-9a5b55c83000'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:16.416846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ede599ca0234feb928a00539d9aeb82', 'request_id': 'req-2d140233-591f-4e8a-93f4-9a5b55c83000'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:16.433253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] The token cache is being invalidate because project 5ede599ca0234feb928a00539d9aeb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:29:16.433565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:16.434412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2d140233-591f-4e8a-93f4-9a5b55c83000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:16.439446 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1288/2547] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:16 2022] DELETE /identity/v3/projects/5ede599ca0234feb928a00539d9aeb82 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:16.441171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e21a3-eec0-4766-abb9-7947902c2903 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:16.441670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e21a3-eec0-4766-abb9-7947902c2903 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:16.441769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e21a3-eec0-4766-abb9-7947902c2903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:16.468751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e2e21a3-eec0-4766-abb9-7947902c2903 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:16.470174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e2e21a3-eec0-4766-abb9-7947902c2903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:16.487586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:16.566443 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1260/2548] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:16.572650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c525-b068-4241-a2dc-4765cc1c7c9a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:16.572933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c525-b068-4241-a2dc-4765cc1c7c9a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:16.574295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c525-b068-4241-a2dc-4765cc1c7c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:16.639568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-09c5c525-b068-4241-a2dc-4765cc1c7c9a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:16.639568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09c5c525-b068-4241-a2dc-4765cc1c7c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:16.648092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1289/2549] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:16.652570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e21a3-eec0-4766-abb9-7947902c2903 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:16.663672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e21a3-eec0-4766-abb9-7947902c2903 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:16.670049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:16.670700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:16.670980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:16.671248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:16.671950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:29:16.672279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:16.674873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:16.696863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1261/2550] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:29:16.698631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c525-b068-4241-a2dc-4765cc1c7c9a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:16.716586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c525-b068-4241-a2dc-4765cc1c7c9a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:16.733751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:16.734553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:16.735292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:16.735583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:16.736231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:16.743633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:16.885975 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1290/2551] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:16 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:16.890909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:16.902950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ffda-1c00-46e2-937d-8ee2db3d6b42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:16.982908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:16.983819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:16.984055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:16.984330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:16.984974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:16.988019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:17.138458 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1262/2552] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:16 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:17.143156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:17.171262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a753e-7495-427c-9dbd-52026cab860e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:17.176603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:17.177262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:17.177543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:17.177813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:17.178542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:17.180380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:17.194326 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1291/2553] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:17.198145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:17.212469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8b56b-67db-4047-b561-a1b30f0e02bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:17.222646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a863a-518e-4968-a830-2009c562f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:17.223297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a863a-518e-4968-a830-2009c562f1bd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:17.223627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a863a-518e-4968-a830-2009c562f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:17.223914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a863a-518e-4968-a830-2009c562f1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:17.224634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a863a-518e-4968-a830-2009c562f1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:17.226421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a863a-518e-4968-a830-2009c562f1bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:17.241285 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1263/2554] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:29:17.260582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:17.282947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c538557-f738-4e76-b1c0-9b27b219e6b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:17.288088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:17.288758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:17.289094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:17.289291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] PATH_INFO: `/v3/projects/47b1b67b0d544a0a9f0b16a475dbdb9e/users/590825db49c0483583b6f9f247a56eb7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:17.318995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b1b67b0d544a0a9f0b16a475dbdb9e, user_id=590825db49c0483583b6f9f247a56eb7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:17.323134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:17.328162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:17.436875 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1292/2555] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:17 2022] PUT /identity/v3/projects/47b1b67b0d544a0a9f0b16a475dbdb9e/users/590825db49c0483583b6f9f247a56eb7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:17.446459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd28d-4079-4725-aa32-a863d9989ed6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:17.447483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd28d-4079-4725-aa32-a863d9989ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:17.454373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd28d-4079-4725-aa32-a863d9989ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:17.495371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c94bd28d-4079-4725-aa32-a863d9989ed6 None None] MFA Rules not processed for user `590825db49c0483583b6f9f247a56eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:17.496793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c94bd28d-4079-4725-aa32-a863d9989ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:17.582904 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1264/2556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:17.958097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:17.961822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:18.087373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb54aa-daf0-40ea-9221-ce0c75348aab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:18.096811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9d211-56e7-4d65-89bb-3e940da04be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:18.097757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d211-56e7-4d65-89bb-3e940da04be7 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:18.098311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d211-56e7-4d65-89bb-3e940da04be7 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:18.098734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d211-56e7-4d65-89bb-3e940da04be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:18.109468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9d211-56e7-4d65-89bb-3e940da04be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:18.112825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9d211-56e7-4d65-89bb-3e940da04be7 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:18.124907 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1293/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:18.513340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd28d-4079-4725-aa32-a863d9989ed6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:18.548669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:18.658679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd28d-4079-4725-aa32-a863d9989ed6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:18.675281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:18.676119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:18.676502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:18.676878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] PATH_INFO: `/v3/users/590825db49c0483583b6f9f247a56eb7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:18.678479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590825db49c0483583b6f9f247a56eb7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:18.680787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:19.020895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590825db49c0483583b6f9f247a56eb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:19.021807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590825db49c0483583b6f9f247a56eb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:19.140466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590825db49c0483583b6f9f247a56eb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:19.144912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590825db49c0483583b6f9f247a56eb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:19.149685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590825db49c0483583b6f9f247a56eb7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:19.186445 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1265/2558] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:29:18 2022] DELETE /identity/v3/users/590825db49c0483583b6f9f247a56eb7 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:19.188327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:19.188837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:19.189038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:19.209110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:19.210523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:19.286820 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1294/2559] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:19.298029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:19.300023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:19.380421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9da05f-e392-4539-a2d3-99adc05d2b13 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:19.384505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add034ac-5488-4f3c-b7b9-e5ebae1e6e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:19.385135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add034ac-5488-4f3c-b7b9-e5ebae1e6e7a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:19.385423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add034ac-5488-4f3c-b7b9-e5ebae1e6e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:19.386678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add034ac-5488-4f3c-b7b9-e5ebae1e6e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:19.399518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add034ac-5488-4f3c-b7b9-e5ebae1e6e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:19.403376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add034ac-5488-4f3c-b7b9-e5ebae1e6e7a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:19.415069 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1266/2560] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:20.117020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:20.119555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:20.154684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366de75e-098d-4c6f-87ea-93fd34b8560a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:20.167613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:20.168299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:20.168585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:20.169087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] PATH_INFO: `/v3/projects/47b1b67b0d544a0a9f0b16a475dbdb9e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:20.172294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b1b67b0d544a0a9f0b16a475dbdb9e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:20.174415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:20.347725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b1b67b0d544a0a9f0b16a475dbdb9e', 'request_id': 'req-dde8921f-9fab-46c4-90a3-0124b3b16875'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:20.359151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b1b67b0d544a0a9f0b16a475dbdb9e', 'request_id': 'req-dde8921f-9fab-46c4-90a3-0124b3b16875'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:20.491841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b1b67b0d544a0a9f0b16a475dbdb9e', 'request_id': 'req-dde8921f-9fab-46c4-90a3-0124b3b16875'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:20.507552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] The token cache is being invalidate because project 47b1b67b0d544a0a9f0b16a475dbdb9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:29:20.507996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:20.508843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dde8921f-9fab-46c4-90a3-0124b3b16875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:20.511097 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1295/2561] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:20 2022] DELETE /identity/v3/projects/47b1b67b0d544a0a9f0b16a475dbdb9e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:20.516777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab9f5-ff2f-44f9-8fef-10dd915bff35 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:20.524608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab9f5-ff2f-44f9-8fef-10dd915bff35 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:20.524608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab9f5-ff2f-44f9-8fef-10dd915bff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:20.542342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3a8ab9f5-ff2f-44f9-8fef-10dd915bff35 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:20.543726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a8ab9f5-ff2f-44f9-8fef-10dd915bff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:20.605782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:20.651375 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1267/2562] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:20.661323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf0428-27fb-40ae-a9a4-c883932847f8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:20.661918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf0428-27fb-40ae-a9a4-c883932847f8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:20.662326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf0428-27fb-40ae-a9a4-c883932847f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:20.674177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:20.712542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9bcf0428-27fb-40ae-a9a4-c883932847f8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:20.715940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bcf0428-27fb-40ae-a9a4-c883932847f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:20.760388 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1296/2563] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:20.763116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ab9f5-ff2f-44f9-8fef-10dd915bff35 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:20.788727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ab9f5-ff2f-44f9-8fef-10dd915bff35 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:20.792833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:20.794455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:20.794938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:20.796239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:20.796628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:29:20.798034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:20.800345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:20.825507 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1268/2564] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:29:20.829859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf0428-27fb-40ae-a9a4-c883932847f8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:20.842909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf0428-27fb-40ae-a9a4-c883932847f8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:20.849962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:20.850992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:20.851750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:20.852245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:20.853133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:20.855377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:21.036601 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1297/2565] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:20 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:21.041161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:21.055085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7353e6-01c1-423b-a978-24a394ecff4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:21.145243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:21.145243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:21.145243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:21.145243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:21.145761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:21.147207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:21.363811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:21.377087 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1269/2566] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:21 2022] POST /identity/v3/users => generated 287 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:29:21.381092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8621-8002-45c1-91bf-65a7c380e9fc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:21.397251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:21.398011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:21.398354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:21.398665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:21.399578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:21.401265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:21.430237 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1298/2567] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:21.431274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:21.446239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8739da-c5cc-42cc-bcd7-e52dd2690852 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:21.457229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45508aa6-e207-4c02-940f-640a57f5aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:21.457894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508aa6-e207-4c02-940f-640a57f5aa3e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:21.458208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508aa6-e207-4c02-940f-640a57f5aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:21.458550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45508aa6-e207-4c02-940f-640a57f5aa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:21.459727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45508aa6-e207-4c02-940f-640a57f5aa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:21.466120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45508aa6-e207-4c02-940f-640a57f5aa3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:21.492958 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1270/2568] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:21.496000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:21.508051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3324d7-7b03-49e1-8692-6e960040769e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:21.520017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:21.521947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:21.535703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:21.536481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] PATH_INFO: `/v3/projects/a2529bd1ac1f4273a5914da5a633f08d/users/0671920e1f96433b9bba3bfb2162e84a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:21.585190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2529bd1ac1f4273a5914da5a633f08d, user_id=0671920e1f96433b9bba3bfb2162e84a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:21.592094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:21.769902 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1299/2569] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:21 2022] PUT /identity/v3/projects/a2529bd1ac1f4273a5914da5a633f08d/users/0671920e1f96433b9bba3bfb2162e84a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:21.786779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badc570-b7af-40f9-838e-09175ac26cc4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:21.787255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badc570-b7af-40f9-838e-09175ac26cc4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:21.787356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badc570-b7af-40f9-838e-09175ac26cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:21.839617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3badc570-b7af-40f9-838e-09175ac26cc4 None None] MFA Rules not processed for user `0671920e1f96433b9bba3bfb2162e84a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:21.843707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3badc570-b7af-40f9-838e-09175ac26cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:21.995030 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1271/2570] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:22.191029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:22.202678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:22.313540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f97541-26f4-47c4-b366-45abc12be122 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:22.321779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:22.322469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:22.322732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:22.323006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:22.333960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:22.336068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:22.353098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1300/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:22.776632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16ebe-c72c-423b-9824-33a71a5a5f55 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:22.777356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16ebe-c72c-423b-9824-33a71a5a5f55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:22.777860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16ebe-c72c-423b-9824-33a71a5a5f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:22.863538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-26b16ebe-c72c-423b-9824-33a71a5a5f55 None None] MFA Rules not processed for user `35e2af24561642bf90a5650a83b093fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:22.866090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26b16ebe-c72c-423b-9824-33a71a5a5f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:23.027156 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1272/2572] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:23.163785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:23.177202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:23.193290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae463b-8e64-4176-805b-bdaff90d820a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:23.216691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:23.217323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:23.219106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:23.220932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:23.243121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:23.273004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:23.298259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1301/2573] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:23 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:25.718005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926de80-5855-453a-a694-8be7c2c5d845 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:25.718494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926de80-5855-453a-a694-8be7c2c5d845 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:25.718588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926de80-5855-453a-a694-8be7c2c5d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:25.738604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d926de80-5855-453a-a694-8be7c2c5d845 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:25.740261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d926de80-5855-453a-a694-8be7c2c5d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:25.798661 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1273/2574] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:29:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:25.831407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:25.833475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:25.916671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd32cc2-5aa3-4447-b3c0-07da6ff3cab9 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:25.923641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7a71e-d7da-4f4e-97a3-556d620f3d2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:25.923641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7a71e-d7da-4f4e-97a3-556d620f3d2e service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:25.923937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7a71e-d7da-4f4e-97a3-556d620f3d2e service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:25.924189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7a71e-d7da-4f4e-97a3-556d620f3d2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:25.933542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7a71e-d7da-4f4e-97a3-556d620f3d2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:25.942926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7a71e-d7da-4f4e-97a3-556d620f3d2e service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:25.950298 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1302/2575] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:29:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:28.083437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926de80-5855-453a-a694-8be7c2c5d845 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:28.169689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926de80-5855-453a-a694-8be7c2c5d845 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:28.189804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:28.190661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:28.194185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:28.194185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] PATH_INFO: `/v3/users/0671920e1f96433b9bba3bfb2162e84a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:28.194185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0671920e1f96433b9bba3bfb2162e84a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:28.197085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:28.198010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736835-d9eb-46ae-897f-fb5bca4a7f50 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:28.199087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736835-d9eb-46ae-897f-fb5bca4a7f50 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:28.200074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47736835-d9eb-46ae-897f-fb5bca4a7f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:28.210211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:28.230618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-47736835-d9eb-46ae-897f-fb5bca4a7f50 None None] MFA Rules not processed for user `d5ed601492e2486bad8ba5b09515d52a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:28.231950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47736835-d9eb-46ae-897f-fb5bca4a7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:28.294384 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1303/2576] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:29:28.454623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0671920e1f96433b9bba3bfb2162e84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:28.455575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0671920e1f96433b9bba3bfb2162e84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:28.506416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:28.506701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:28.506990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:28.540172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] MFA Rules not processed for user `356ffdf6f40b4d71a7f39c414c008491`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:28.541836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:28.546541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0671920e1f96433b9bba3bfb2162e84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:28.547661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0671920e1f96433b9bba3bfb2162e84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:28.556855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-861be873-a7b6-48fc-9a32-acf4792db07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0671920e1f96433b9bba3bfb2162e84a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:28.563397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:28.590855 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1274/2577] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:29:28 2022] DELETE /identity/v3/users/0671920e1f96433b9bba3bfb2162e84a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:28.595509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:28.595906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:28.596329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:28.618033 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1304/2578] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:28.633858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:28.635465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:28.713753 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1275/2579] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:29:28.724095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:28.725743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:28.815996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4603f-642f-430f-88af-b6746d3abc20 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:28.847043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:28.848452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:28.907234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:28.907870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:28.908148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:28.908420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:28.935607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:28.937188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:28.950491 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1305/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:28.986158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc43964-8507-4f0a-beb2-974c85e8bcf6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:28.995976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:28.996672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:28.996956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:28.997593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:28.999495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:29.012456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:29.014563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:29.037164 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1276/2581] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:29.642325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:29.647149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:29.732608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3b9c1-6fbe-4ef3-856b-7f808c0128a1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:29.743513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6b10-eb1b-46a2-9b0b-c83339f12fb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:29.743513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6b10-eb1b-46a2-9b0b-c83339f12fb1 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:29.743513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6b10-eb1b-46a2-9b0b-c83339f12fb1 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:29.743513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6b10-eb1b-46a2-9b0b-c83339f12fb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:29.744048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a9d6b10-eb1b-46a2-9b0b-c83339f12fb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:29.756206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6b10-eb1b-46a2-9b0b-c83339f12fb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:29.757970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6b10-eb1b-46a2-9b0b-c83339f12fb1 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:29.769758 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1306/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:30.241353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:30.421967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:30.424062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:30.483483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c013fb-1685-46bf-967e-317e289c93ba service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:30.510401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:30.510975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:30.514460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:30.516189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] PATH_INFO: `/v3/projects/a2529bd1ac1f4273a5914da5a633f08d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:30.519423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2529bd1ac1f4273a5914da5a633f08d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:30.534489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:30.726855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2529bd1ac1f4273a5914da5a633f08d', 'request_id': 'req-3173d286-0382-4c7c-94a7-61523eae1221'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:30.742901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2529bd1ac1f4273a5914da5a633f08d', 'request_id': 'req-3173d286-0382-4c7c-94a7-61523eae1221'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:30.841607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2529bd1ac1f4273a5914da5a633f08d', 'request_id': 'req-3173d286-0382-4c7c-94a7-61523eae1221'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:30.880711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] The token cache is being invalidate because project a2529bd1ac1f4273a5914da5a633f08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:29:30.894291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:30.897315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3173d286-0382-4c7c-94a7-61523eae1221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:30.903058 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1277/2583] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:30 2022] DELETE /identity/v3/projects/a2529bd1ac1f4273a5914da5a633f08d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:30.908345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce283-719f-48b8-a706-d2abe725e9fd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:30.908810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce283-719f-48b8-a706-d2abe725e9fd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:30.908984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce283-719f-48b8-a706-d2abe725e9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:30.958721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48bce283-719f-48b8-a706-d2abe725e9fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:30.963088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48bce283-719f-48b8-a706-d2abe725e9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:31.152786 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1307/2584] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:31.162157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa72e4-b1ab-4d84-a3d9-b992390ce6c1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:31.162455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa72e4-b1ab-4d84-a3d9-b992390ce6c1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:31.162739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa72e4-b1ab-4d84-a3d9-b992390ce6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:31.230028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-38aa72e4-b1ab-4d84-a3d9-b992390ce6c1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:31.236381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38aa72e4-b1ab-4d84-a3d9-b992390ce6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:31.273910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40eeed-4d92-4dfc-a018-d0fe14e3cb1c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:31.274305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40eeed-4d92-4dfc-a018-d0fe14e3cb1c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:31.274629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40eeed-4d92-4dfc-a018-d0fe14e3cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:31.275673 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1278/2585] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:31.283194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa72e4-b1ab-4d84-a3d9-b992390ce6c1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:31.295953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:31.305723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa72e4-b1ab-4d84-a3d9-b992390ce6c1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:31.314636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b40eeed-4d92-4dfc-a018-d0fe14e3cb1c None None] MFA Rules not processed for user `6c1cd81ee6174cee97e384cae58a2e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:31.318992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:31.319150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b40eeed-4d92-4dfc-a018-d0fe14e3cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:31.319529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:31.319758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:31.321195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:31.321978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:29:31.323018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:31.326601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:31.361565 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1279/2586] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:29:31.362642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:31.403981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed1fe-182c-433b-a5e3-58b497eae98d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:31.427102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:31.427798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:31.428405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:31.428754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:31.429469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:31.431493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:31.503578 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1308/2587] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:29:31.627518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40eeed-4d92-4dfc-a018-d0fe14e3cb1c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:31.627934 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1280/2588] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:31 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:31.646091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40eeed-4d92-4dfc-a018-d0fe14e3cb1c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:31.747370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:31.762695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:31.763326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:31.763610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:31.763886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:31.764591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:31.766639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:31.932587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1309/2589] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:31 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:29:31.938284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:31.954352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc54405-af3d-4438-935c-35f25d81bb1e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:31.962575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:31.963235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:31.964069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:31.964575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:31.966197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:31.967612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:31.988945 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1281/2590] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:31.989360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:32.000599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca547778-9fc1-45b8-ad4f-f9c3f15ea45d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:32.007148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b69e43-7309-4858-a172-b3ef96c02bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:32.007872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69e43-7309-4858-a172-b3ef96c02bad admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:32.008162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69e43-7309-4858-a172-b3ef96c02bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:32.008440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69e43-7309-4858-a172-b3ef96c02bad admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:32.009262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b69e43-7309-4858-a172-b3ef96c02bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:32.010981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b69e43-7309-4858-a172-b3ef96c02bad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:32.032586 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1310/2591] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:29:32.037048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:32.049652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56038b-88c6-4585-a41b-361f047f627f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:32.055452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:32.056272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:32.056651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:32.056815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] PATH_INFO: `/v3/projects/b3f57afe938f4118aed9e3b1f6b2bcdc/users/677fe6a60f0742b3820c41beccc07d11/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:32.077855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f57afe938f4118aed9e3b1f6b2bcdc, user_id=677fe6a60f0742b3820c41beccc07d11, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:32.080889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:32.162295 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1282/2592] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:32 2022] PUT /identity/v3/projects/b3f57afe938f4118aed9e3b1f6b2bcdc/users/677fe6a60f0742b3820c41beccc07d11/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:32.168385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:32.168674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:32.168927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:32.197497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:32.198812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:32.202026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:32.203820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:32.278620 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1311/2593] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:32.289120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:32.290794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:32.329859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2fff9-9e04-4db7-99c0-1ef3e49deeac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:32.335765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:32.336380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:32.336733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:32.337008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:32.338773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:32.348022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b974f8d-fc9a-47e9-bd98-61d3389cda4d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:32.351872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:32.352745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:32.353167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:32.360250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:32.360492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:32.360492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:32.373594 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1283/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:29:32.389947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:32.391619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:32.420010 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1312/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:33.101784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:33.124875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89873-48d6-46a7-88c6-aa10bb17cb45 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:33.143501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dfae3-1499-4bae-9126-4bd115c4c50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:33.144239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dfae3-1499-4bae-9126-4bd115c4c50a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:33.144623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dfae3-1499-4bae-9126-4bd115c4c50a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:33.147447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dfae3-1499-4bae-9126-4bd115c4c50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:33.149672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a1dfae3-1499-4bae-9126-4bd115c4c50a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:33.271291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dfae3-1499-4bae-9126-4bd115c4c50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:33.273285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dfae3-1499-4bae-9126-4bd115c4c50a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:33.317945 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1284/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:39.322534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:39.326299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:39.347048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c0c3c-bdf7-4688-b586-a81524c4976f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:39.365482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:39.366169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:39.366455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:39.366729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] PATH_INFO: `/v3/users/8c3878480453431484cbe05c5d2107ce` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:39.370121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3878480453431484cbe05c5d2107ce)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:39.375185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:39.650539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3878480453431484cbe05c5d2107ce'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:39.663513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3878480453431484cbe05c5d2107ce'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:39.664949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3878480453431484cbe05c5d2107ce'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:39.672570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:39.681854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3878480453431484cbe05c5d2107ce'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:39.765258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3878480453431484cbe05c5d2107ce'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:39.773796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1313/2597] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:29:39 2022] DELETE /identity/v3/users/8c3878480453431484cbe05c5d2107ce => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:39.780172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:39.780172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:39.780172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:39.819194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:39.821907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:39.851341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:39.966571 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1285/2598] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:39.999046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:40.001161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:40.120687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9cb3-310c-4f90-a05a-c5b1f204ef22 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:40.125482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:40.129668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:40.129668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:40.129668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:40.141464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:40.143513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:40.160226 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1314/2599] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:41.660607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:41.663978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:41.683325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d12e6-c324-4070-88d5-f93771fc0637 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:41.691867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:41.694673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:41.694964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:41.695243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] PATH_INFO: `/v3/projects/e25a068285474cdfa415f75774fab88f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:41.699212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25a068285474cdfa415f75774fab88f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:41.705379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:41.875333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25a068285474cdfa415f75774fab88f', 'request_id': 'req-e011a042-d111-4023-9d77-52dc1ff2442a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:41.888258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25a068285474cdfa415f75774fab88f', 'request_id': 'req-e011a042-d111-4023-9d77-52dc1ff2442a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:41.982160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25a068285474cdfa415f75774fab88f', 'request_id': 'req-e011a042-d111-4023-9d77-52dc1ff2442a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:41.999878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] The token cache is being invalidate because project e25a068285474cdfa415f75774fab88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:29:42.000535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:42.001585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:42.005344 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1286/2600] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:41 2022] DELETE /identity/v3/projects/e25a068285474cdfa415f75774fab88f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:42.011131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:42.037193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c1763-7956-45e7-8ddb-2971eeb4c824 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:42.158916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:42.159703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:42.160074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:42.167650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] PATH_INFO: `/v3/users/97ba4186d9c146ceb45dfe99470814bd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:42.167650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ba4186d9c146ceb45dfe99470814bd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:42.167650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:42.223513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:42.226273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:42.358643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011a042-d111-4023-9d77-52dc1ff2442a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:42.380348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:42.380985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:42.381266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:42.381571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:42.383525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:42.401976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:42.403641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:42.456214 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1287/2601] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:42.500054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ba4186d9c146ceb45dfe99470814bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:42.522569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ba4186d9c146ceb45dfe99470814bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:42.523439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ba4186d9c146ceb45dfe99470814bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:42.582397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ba4186d9c146ceb45dfe99470814bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:42.669234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ba4186d9c146ceb45dfe99470814bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:42.679788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1315/2602] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:29:42 2022] DELETE /identity/v3/users/97ba4186d9c146ceb45dfe99470814bd => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:44.578916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:44.597458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b682f4-789b-450e-8b60-baefc56b20e9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:44.637845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:44.714036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6225508-88b3-4554-bb9c-f42c065718ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:44.714367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6225508-88b3-4554-bb9c-f42c065718ab service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:44.715200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6225508-88b3-4554-bb9c-f42c065718ab service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:44.715752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6225508-88b3-4554-bb9c-f42c065718ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:44.717724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6225508-88b3-4554-bb9c-f42c065718ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:44.815535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6225508-88b3-4554-bb9c-f42c065718ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:44.817540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6225508-88b3-4554-bb9c-f42c065718ab service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:44.834696 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1288/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:46.861369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:46.865547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:46.887655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:47.023064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda2cf7-d533-4243-955f-f53c00ab2c6f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:47.029720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:47.030874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:47.032312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:47.032994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] PATH_INFO: `/v3/projects/d6f3c09f474e4fc08dd88e2e9096b7b7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:47.035645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f3c09f474e4fc08dd88e2e9096b7b7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:47.039602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:47.285058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f3c09f474e4fc08dd88e2e9096b7b7', 'request_id': 'req-a7710f8f-271a-490b-a695-a1b7590e3a8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:47.303097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f3c09f474e4fc08dd88e2e9096b7b7', 'request_id': 'req-a7710f8f-271a-490b-a695-a1b7590e3a8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:47.391859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f3c09f474e4fc08dd88e2e9096b7b7', 'request_id': 'req-a7710f8f-271a-490b-a695-a1b7590e3a8a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:47.405095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] The token cache is being invalidate because project d6f3c09f474e4fc08dd88e2e9096b7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:29:47.405693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:47.406703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a7710f8f-271a-490b-a695-a1b7590e3a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:47.408599 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1316/2604] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:46 2022] DELETE /identity/v3/projects/d6f3c09f474e4fc08dd88e2e9096b7b7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:47.416048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffae9-b944-4b17-b56d-4b7991cbccd3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:47.419541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffae9-b944-4b17-b56d-4b7991cbccd3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:47.420712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffae9-b944-4b17-b56d-4b7991cbccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:47.456096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7adffae9-b944-4b17-b56d-4b7991cbccd3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:47.458632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7adffae9-b944-4b17-b56d-4b7991cbccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:47.578707 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1289/2605] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:47.586829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ffe4-fa84-4540-a495-439486163057 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:47.587193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ffe4-fa84-4540-a495-439486163057 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:47.587547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ffe4-fa84-4540-a495-439486163057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:47.627978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-85f2ffe4-fa84-4540-a495-439486163057 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:47.629463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85f2ffe4-fa84-4540-a495-439486163057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:47.645471 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1317/2606] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:47.645681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adffae9-b944-4b17-b56d-4b7991cbccd3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:47.656935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adffae9-b944-4b17-b56d-4b7991cbccd3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:47.662406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:47.663248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:47.663858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:47.664321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:47.665164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:29:47.665701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:47.668717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:47.684616 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1290/2607] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:29:47.689389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2ffe4-fa84-4540-a495-439486163057 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:47.701457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2ffe4-fa84-4540-a495-439486163057 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:47.708662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:47.710329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:47.711082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:47.711581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:47.712457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:47.715444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:47.843808 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1318/2608] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:47 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:47.848625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:47.881492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05c268-d1a8-47aa-ba11-2585f00f2d7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:47.989512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:48.006876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:48.008603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:48.008900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:48.009351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:48.010246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:48.013456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:48.147177 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1291/2609] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:47 2022] POST /identity/v3/users => generated 289 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:48.151130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:48.172791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ebffb-c11b-4260-aed9-cc79525bcaf9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:48.188589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:48.189230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:48.189519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:48.189797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:48.190570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:48.192272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:48.219829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:48.226808 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1319/2610] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:48.232686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179455e6-acdf-4f95-b6e1-bd15cdf76abe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:48.246541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f32132-fc67-4c98-a80e-2a6bc86c9bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:48.246934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32132-fc67-4c98-a80e-2a6bc86c9bff admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:48.247216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32132-fc67-4c98-a80e-2a6bc86c9bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:48.247493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32132-fc67-4c98-a80e-2a6bc86c9bff admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:48.248159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f32132-fc67-4c98-a80e-2a6bc86c9bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:48.249766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f32132-fc67-4c98-a80e-2a6bc86c9bff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:48.267795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1292/2611] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:48.269930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:48.288660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc439d4b-d7c4-4dca-873c-62c9a4a7f3d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:48.297838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:48.298684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:48.301345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:48.301645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] PATH_INFO: `/v3/projects/cb1d59a6188a4b2fb67e6eba8f64d79f/users/d54a9109295b426ba1060c63bfb230ed/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:48.327597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1d59a6188a4b2fb67e6eba8f64d79f, user_id=d54a9109295b426ba1060c63bfb230ed, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:48.341439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:48.446005 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1320/2612] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:48 2022] PUT /identity/v3/projects/cb1d59a6188a4b2fb67e6eba8f64d79f/users/d54a9109295b426ba1060c63bfb230ed/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:48.469313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717e5f-4606-4a0a-aa01-241f913cbc3a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:48.469313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717e5f-4606-4a0a-aa01-241f913cbc3a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:48.469313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d717e5f-4606-4a0a-aa01-241f913cbc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:48.505031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3d717e5f-4606-4a0a-aa01-241f913cbc3a None None] MFA Rules not processed for user `d54a9109295b426ba1060c63bfb230ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:48.506748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d717e5f-4606-4a0a-aa01-241f913cbc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:48.589191 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1293/2613] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:48.590083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:48.627499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:48.695116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694742b-80ba-4023-bdef-ea8319e63a96 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:48.717922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8eca3b-e51f-43eb-b758-445fdd7ad8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:48.725504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eca3b-e51f-43eb-b758-445fdd7ad8fa admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:48.725790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eca3b-e51f-43eb-b758-445fdd7ad8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:48.726085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8eca3b-e51f-43eb-b758-445fdd7ad8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:48.726758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eca3b-e51f-43eb-b758-445fdd7ad8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:48.728714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8eca3b-e51f-43eb-b758-445fdd7ad8fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:48.850408 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1321/2614] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:48 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:29:48.856773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d717e5f-4606-4a0a-aa01-241f913cbc3a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:48.899904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:48.900252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:48.900717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:48.907656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d717e5f-4606-4a0a-aa01-241f913cbc3a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:48.994966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] MFA Rules not processed for user `677fe6a60f0742b3820c41beccc07d11`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:48.998573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:49.085230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.086330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.090291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.090995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.091952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.093931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.187470 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1322/2615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:49.191901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.193632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:49.206354 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1294/2616] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:48 2022] POST /identity/v3/users => generated 295 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:49.209626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.232664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6068a-3cf3-4547-9943-8dae011063a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.235707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcbc82-676e-4807-b11d-2e2cd1b5a00e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.243885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.246248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.246548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.251327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.251327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.251621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.251621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.251621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.251621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.251960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.253968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.254605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.285027 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1295/2617] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:49.285737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.305607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710c57-84e0-4229-b486-7497e7affc5f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.312546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.313242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.313578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.316016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] PATH_INFO: `/v3/projects/c360dd76b1bf4dd891944860b13849cd/users/2d772301c5174f2fb6907315d9576589/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.335326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c360dd76b1bf4dd891944860b13849cd, user_id=2d772301c5174f2fb6907315d9576589, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.339942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.408691 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1323/2618] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:49 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:49.413492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.452912 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1296/2619] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:49 2022] PUT /identity/v3/projects/c360dd76b1bf4dd891944860b13849cd/users/2d772301c5174f2fb6907315d9576589/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:49.455926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.490595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:49.578743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1820c-3854-4abe-903e-faaa50ecb97e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.599841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063e0af-04e7-4265-a7fd-76e98c0b1099 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.601257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.602837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.603510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.604012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.605549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.607808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.622902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.624008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.624796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.625420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.626402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.630740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.659504 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1297/2620] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:29:49.664226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.688558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c726c-402d-4365-88c6-362c534d6e51 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.702719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734100e-c6c1-495f-b50c-0fc8082d0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.704007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734100e-c6c1-495f-b50c-0fc8082d0b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.704334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734100e-c6c1-495f-b50c-0fc8082d0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.704719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734100e-c6c1-495f-b50c-0fc8082d0b87 admin admin] PATH_INFO: `/v3/projects/c360dd76b1bf4dd891944860b13849cd/users/2d772301c5174f2fb6907315d9576589/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.711156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734100e-c6c1-495f-b50c-0fc8082d0b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c360dd76b1bf4dd891944860b13849cd, user_id=2d772301c5174f2fb6907315d9576589, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.738418 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1324/2621] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:49 2022] POST /identity/v3/users => generated 296 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:29:49.739591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734100e-c6c1-495f-b50c-0fc8082d0b87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.741043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.755721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f95d80-0ce1-44d0-8ac9-e66b42f6336a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.767108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:49.777746 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1298/2622] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:49 2022] PUT /identity/v3/projects/c360dd76b1bf4dd891944860b13849cd/users/2d772301c5174f2fb6907315d9576589/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:49.779878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aaf90-4afe-4bfc-bc70-903ff2a75120 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.782147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aaf90-4afe-4bfc-bc70-903ff2a75120 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.782490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aaf90-4afe-4bfc-bc70-903ff2a75120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.861604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c80aaf90-4afe-4bfc-bc70-903ff2a75120 None None] MFA Rules not processed for user `2d772301c5174f2fb6907315d9576589`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:49.864627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c80aaf90-4afe-4bfc-bc70-903ff2a75120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:49.893377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.895478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.896209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.898010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.898987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.903357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.931657 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1325/2623] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:29:49.931657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:49.952080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c459816-5701-48bb-8335-a4a055f957db admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:49.962640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:49.963322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:49.963942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:49.964224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] PATH_INFO: `/v3/projects/649a444e9851468394cd8cedde88bf28/users/06c97740a7924fbe93edb7cc45157637/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:49.994220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649a444e9851468394cd8cedde88bf28, user_id=06c97740a7924fbe93edb7cc45157637, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:49.997987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:49.998661 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1299/2624] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:50.008461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb71b1-60c9-4700-90b4-42a2ad6a8734 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:50.008752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb71b1-60c9-4700-90b4-42a2ad6a8734 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:50.011887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb71b1-60c9-4700-90b4-42a2ad6a8734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:50.067101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17cb71b1-60c9-4700-90b4-42a2ad6a8734 None None] MFA Rules not processed for user `d54a9109295b426ba1060c63bfb230ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:50.069461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17cb71b1-60c9-4700-90b4-42a2ad6a8734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:50.132962 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1326/2625] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:49 2022] PUT /identity/v3/projects/649a444e9851468394cd8cedde88bf28/users/06c97740a7924fbe93edb7cc45157637/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:50.137626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:50.266727 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1300/2626] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:50.269456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52602440-0502-44bb-a95b-f9b568cad479 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:50.281853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:50.283829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:50.283829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:50.283829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:50.286012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:50.290807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:50.318762 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1327/2627] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:50.323385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb71b1-60c9-4700-90b4-42a2ad6a8734 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:50.339377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb71b1-60c9-4700-90b4-42a2ad6a8734 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:50.355275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:50.356314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:50.356661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:50.358190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] PATH_INFO: `/v3/projects/649a444e9851468394cd8cedde88bf28/users/06c97740a7924fbe93edb7cc45157637/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:50.366935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] RBAC: Authorizing `identity:create_grant(project_id=649a444e9851468394cd8cedde88bf28, user_id=06c97740a7924fbe93edb7cc45157637, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:50.372739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:50.409841 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1301/2628] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:50 2022] PUT /identity/v3/projects/649a444e9851468394cd8cedde88bf28/users/06c97740a7924fbe93edb7cc45157637/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:51.091966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:51.094816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:51.311254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdad21e-937c-4451-89bf-57f87f4962d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:51.364801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:51.553924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284ea7b-d5f0-48bb-bffb-3450bd24a68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:51.553924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ea7b-d5f0-48bb-bffb-3450bd24a68d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:51.553924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ea7b-d5f0-48bb-bffb-3450bd24a68d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:51.553924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ea7b-d5f0-48bb-bffb-3450bd24a68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:51.687033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284ea7b-d5f0-48bb-bffb-3450bd24a68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:51.689004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284ea7b-d5f0-48bb-bffb-3450bd24a68d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:51.711329 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1328/2629] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:52.742918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:52.745359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:52.770128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:52.812027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc420f60-89d2-4208-8291-b660fbd86474 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:52.814108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc420f60-89d2-4208-8291-b660fbd86474 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:52.814609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc420f60-89d2-4208-8291-b660fbd86474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:52.883533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fc420f60-89d2-4208-8291-b660fbd86474 None None] MFA Rules not processed for user `d54a9109295b426ba1060c63bfb230ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:52.887960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc420f60-89d2-4208-8291-b660fbd86474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:52.926972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebae243-1f40-4923-a017-9ea206e542da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:52.927673 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1329/2630] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:52.941065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:52.941960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:52.942556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:52.942925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] PATH_INFO: `/v3/users/35e2af24561642bf90a5650a83b093fa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:52.944405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e2af24561642bf90a5650a83b093fa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:52.946616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:53.291281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e2af24561642bf90a5650a83b093fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:53.293030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e2af24561642bf90a5650a83b093fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:53.431367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e2af24561642bf90a5650a83b093fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:53.432587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e2af24561642bf90a5650a83b093fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:53.444484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ebe306a-6fd1-4c67-8a4d-2c504afe13cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e2af24561642bf90a5650a83b093fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:53.496079 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1302/2631] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:29:52 2022] DELETE /identity/v3/users/35e2af24561642bf90a5650a83b093fa => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:54.078543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc420f60-89d2-4208-8291-b660fbd86474 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:54.127186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc420f60-89d2-4208-8291-b660fbd86474 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:54.216003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:54.216882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:54.217256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:54.217619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] PATH_INFO: `/v3/projects/d1348916675647e5b2e68cc8d489faf8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:54.218980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1348916675647e5b2e68cc8d489faf8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:54.221052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:54.366379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1348916675647e5b2e68cc8d489faf8', 'request_id': 'req-c022685c-26bd-412b-94c7-11fa70ed4909'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:54.367678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:54.374878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1348916675647e5b2e68cc8d489faf8', 'request_id': 'req-c022685c-26bd-412b-94c7-11fa70ed4909'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:54.486809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1348916675647e5b2e68cc8d489faf8', 'request_id': 'req-c022685c-26bd-412b-94c7-11fa70ed4909'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:54.500789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] The token cache is being invalidate because project d1348916675647e5b2e68cc8d489faf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:29:54.501080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:54.502558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c022685c-26bd-412b-94c7-11fa70ed4909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:29:54.504078 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1330/2632] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:29:54 2022] DELETE /identity/v3/projects/d1348916675647e5b2e68cc8d489faf8 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:54.510413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb1d91-54b8-47ea-b723-75111b8e80f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:54.510878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb1d91-54b8-47ea-b723-75111b8e80f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:54.510986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb1d91-54b8-47ea-b723-75111b8e80f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:54.534597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-03fb1d91-54b8-47ea-b723-75111b8e80f5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:54.535836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03fb1d91-54b8-47ea-b723-75111b8e80f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:54.646381 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1303/2633] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:54.653232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d07ee-057f-404f-8546-298551269bc8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:54.653633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d07ee-057f-404f-8546-298551269bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:54.653970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d07ee-057f-404f-8546-298551269bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:54.704026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d03d07ee-057f-404f-8546-298551269bc8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:54.705281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d03d07ee-057f-404f-8546-298551269bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:54.717669 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1331/2634] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:54.722988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb1d91-54b8-47ea-b723-75111b8e80f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:54.738033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb1d91-54b8-47ea-b723-75111b8e80f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:54.743437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:54.744092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:54.744433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:54.744718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:54.745383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:29:54.746316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:54.748129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:54.764561 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1304/2635] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:29:54.773500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d07ee-057f-404f-8546-298551269bc8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:54.788729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d07ee-057f-404f-8546-298551269bc8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:54.816661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:54.818638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:54.819382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:54.822492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:54.823393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:54.825673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:54.973097 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1332/2636] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:29:54 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:54.977113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:55.013543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc1b4-3a9e-420b-9842-4764fec1738e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:55.083604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:55.170497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:55.170497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:55.170497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:55.170497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:55.186468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:55.189830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:55.329308 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1305/2637] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:29:54 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:29:55.347418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:55.360950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1c8d-a9f0-4d3f-a843-6c688f75180d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:55.374488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:55.375517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:55.376335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:55.377195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:55.378396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:55.380505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:55.397311 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1333/2638] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:55.402947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:55.421481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98b456-df25-4e30-a92e-a4ba917b1119 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:55.445948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e82a5-c924-48a7-b18e-255d905f01bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:55.446747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e82a5-c924-48a7-b18e-255d905f01bf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:55.447875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e82a5-c924-48a7-b18e-255d905f01bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:55.448084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e82a5-c924-48a7-b18e-255d905f01bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:55.449480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e82a5-c924-48a7-b18e-255d905f01bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:55.451205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e82a5-c924-48a7-b18e-255d905f01bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:55.494890 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1306/2639] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:29:55.499106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:55.521555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ec3c-e53b-4277-bb96-5cef7bfcf2e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:55.533080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:55.534838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:55.536697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:55.537795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] PATH_INFO: `/v3/projects/ec257d037b37472bb8a1b779fa39bb91/users/f6d59e6bbc724bd98b96a2e4458d1c4f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:55.610983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec257d037b37472bb8a1b779fa39bb91, user_id=f6d59e6bbc724bd98b96a2e4458d1c4f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:55.610983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:55.712044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:55.712897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:55.713315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:55.716214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1334/2640] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:29:55 2022] PUT /identity/v3/projects/ec257d037b37472bb8a1b779fa39bb91/users/f6d59e6bbc724bd98b96a2e4458d1c4f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:29:55.734381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:29:55.735944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:55.830445 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1307/2641] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:29:55.842920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:55.845344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:55.924391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5a241-fe97-4cd1-ac87-463902542d4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:55.929473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:55.930946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:55.931585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:55.931865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:55.945230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:55.948173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:55.961656 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1335/2642] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:29:58.241804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:29:58.242863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:58.374017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133f216-d798-4678-a6e2-353882a10ce8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:29:58.379990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:29:58.380745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:29:58.381196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:29:58.382292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:29:58.384351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:29:58.398414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:29:58.400121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:29:58.412237 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1308/2643] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:29:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:01.617509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:01.623588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:01.648596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c252-c0b3-44c3-9aaa-48949f39c277 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:01.669450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63a36e-73dd-4b17-ab27-45d037be1adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:01.670371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a36e-73dd-4b17-ab27-45d037be1adc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:01.671190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a36e-73dd-4b17-ab27-45d037be1adc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:01.671647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a36e-73dd-4b17-ab27-45d037be1adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:01.678071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d63a36e-73dd-4b17-ab27-45d037be1adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:01.828854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63a36e-73dd-4b17-ab27-45d037be1adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:01.830916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63a36e-73dd-4b17-ab27-45d037be1adc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:01.860327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1336/2644] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:01.992397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:02.025265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb4ec-159c-45df-bfdb-5cef680d5a9e service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:02.038546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:02.039183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:02.039465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:02.039735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:02.048395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:02.076654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:02.081201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:02.099437 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1309/2645] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:04.504485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:04.504933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:04.505029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:04.525990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:04.586445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] MFA Rules not processed for user `06c97740a7924fbe93edb7cc45157637`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:04.595058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:04.752711 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1337/2646] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:04.761769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:04.764122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:04.810545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:05.010413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5899a-7d49-4f4a-8d8c-52bfdf023324 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:05.015912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08d4c-6a97-407f-bb74-97412076f358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:05.020845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08d4c-6a97-407f-bb74-97412076f358 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:05.021231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08d4c-6a97-407f-bb74-97412076f358 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:05.021533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08d4c-6a97-407f-bb74-97412076f358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:05.030908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8eb08d4c-6a97-407f-bb74-97412076f358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:05.041764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:05.044352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:05.072251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ef81b-3996-483d-bded-b3085c807e77 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:05.086584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:05.089053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:05.089340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:05.089993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:05.094021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:05.124652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:05.128741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:05.148638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb08d4c-6a97-407f-bb74-97412076f358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:05.151812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb08d4c-6a97-407f-bb74-97412076f358 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:05.163304 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1338/2647] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:30:05.184023 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1310/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:06.996231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:07.000938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:07.041305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69438fc-8ae0-4061-9da9-3a153496cf56 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:07.065090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:07.068512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:07.071961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:07.072293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] PATH_INFO: `/v3/users/92f8b851f06d4b038a147c7dd873cb34` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:07.076921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f8b851f06d4b038a147c7dd873cb34)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:07.089449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:07.428140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f8b851f06d4b038a147c7dd873cb34'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:07.460820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f8b851f06d4b038a147c7dd873cb34'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:07.462750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f8b851f06d4b038a147c7dd873cb34'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:07.501253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f8b851f06d4b038a147c7dd873cb34'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:07.608756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f8b851f06d4b038a147c7dd873cb34'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:07.636958 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1339/2649] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:30:06 2022] DELETE /identity/v3/users/92f8b851f06d4b038a147c7dd873cb34 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:30:07.639036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:07.639697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:07.640149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:07.689046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:07.690405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:07.900720 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1311/2650] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:30:08.253574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:08.259533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:08.423252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:08.437507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9017cb-ebd6-4e87-ba88-cb01a96e9424 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:08.458092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:08.471480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:08.472231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:08.472676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:08.514564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:08.516402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:08.542666 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1340/2651] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:10.156750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:10.158242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:10.233719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2249c-3b78-4899-8b8e-25adb0599cff None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:10.261750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:10.263733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:10.266483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:10.267656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] PATH_INFO: `/v3/projects/9f5cd093b94c4161bed82c6495bc37be` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:10.275508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5cd093b94c4161bed82c6495bc37be)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:10.280574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:10.547695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:10.558784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5cd093b94c4161bed82c6495bc37be', 'request_id': 'req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:10.599654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5cd093b94c4161bed82c6495bc37be', 'request_id': 'req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:10.735243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5cd093b94c4161bed82c6495bc37be', 'request_id': 'req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:10.760129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] The token cache is being invalidate because project 9f5cd093b94c4161bed82c6495bc37be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:30:10.762899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:10.764375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dff79009-3c7f-4cc7-9f14-701dd0a9c7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:10.773001 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1312/2652] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:30:10 2022] DELETE /identity/v3/projects/9f5cd093b94c4161bed82c6495bc37be => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:30:10.775191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:10.813109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae153226-5ab0-4a49-9f86-a45c9c34f980 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:10.997703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:10.998494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:10.998777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:10.999058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] PATH_INFO: `/v3/users/4745c3400f76467b9dee23665006a56e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:11.005888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4745c3400f76467b9dee23665006a56e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:11.010352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:11.322142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:11.322946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:11.323442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:11.372597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4745c3400f76467b9dee23665006a56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:11.391595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4745c3400f76467b9dee23665006a56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:11.392726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4745c3400f76467b9dee23665006a56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:11.455327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] MFA Rules not processed for user `f6d59e6bbc724bd98b96a2e4458d1c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:11.473945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4745c3400f76467b9dee23665006a56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:11.491585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:11.602674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4745c3400f76467b9dee23665006a56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:11.614153 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1341/2653] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:30:10 2022] DELETE /identity/v3/users/4745c3400f76467b9dee23665006a56e => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:30:11.727798 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1313/2654] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:11.868385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:11.870199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:12.094897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10da22-bf74-4349-8c69-cf220488f6dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:12.107448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d197df-64f8-4c92-b78f-82a31896e3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:12.108698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d197df-64f8-4c92-b78f-82a31896e3b5 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:12.109465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d197df-64f8-4c92-b78f-82a31896e3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:12.109901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d197df-64f8-4c92-b78f-82a31896e3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:12.114895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:12.264136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d197df-64f8-4c92-b78f-82a31896e3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:12.271007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d197df-64f8-4c92-b78f-82a31896e3b5 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:12.322094 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1342/2655] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:12.376517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:12.377799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:12.443852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc68600-e976-4a24-8366-c7d66cf39171 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:12.636157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:12.636157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:12.636157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:12.636157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] PATH_INFO: `/v3/projects/c2f545fbb8744c9a9deed4b2670743ed` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:12.637981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f545fbb8744c9a9deed4b2670743ed)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:12.643999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:12.882867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f545fbb8744c9a9deed4b2670743ed', 'request_id': 'req-329a5730-8129-437b-94dd-cea0f2bba023'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:12.900075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f545fbb8744c9a9deed4b2670743ed', 'request_id': 'req-329a5730-8129-437b-94dd-cea0f2bba023'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:13.010498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f545fbb8744c9a9deed4b2670743ed', 'request_id': 'req-329a5730-8129-437b-94dd-cea0f2bba023'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:13.016127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:13.053585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] The token cache is being invalidate because project c2f545fbb8744c9a9deed4b2670743ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:30:13.055824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:13.055824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-329a5730-8129-437b-94dd-cea0f2bba023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:13.062841 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1314/2656] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:30:12 2022] DELETE /identity/v3/projects/c2f545fbb8744c9a9deed4b2670743ed => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:30:13.067739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a0f7b-864a-4baa-9097-8b8f631ff532 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:13.068282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a0f7b-864a-4baa-9097-8b8f631ff532 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:13.068388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a0f7b-864a-4baa-9097-8b8f631ff532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:13.096806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-720a0f7b-864a-4baa-9097-8b8f631ff532 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:13.098310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-720a0f7b-864a-4baa-9097-8b8f631ff532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:13.224252 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1343/2657] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:13.228615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79cbc0-06c6-4a99-82bf-c944d1901462 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:13.231720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79cbc0-06c6-4a99-82bf-c944d1901462 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:13.231720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79cbc0-06c6-4a99-82bf-c944d1901462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:13.267604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad79cbc0-06c6-4a99-82bf-c944d1901462 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:13.272641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad79cbc0-06c6-4a99-82bf-c944d1901462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:13.328119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1315/2658] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:13.329343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a0f7b-864a-4baa-9097-8b8f631ff532 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:13.344556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a0f7b-864a-4baa-9097-8b8f631ff532 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:13.389165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:13.395427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:13.401061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:13.401419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:13.402138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:30:13.402448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:13.418529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:13.452036 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1344/2659] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:30:13.453294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79cbc0-06c6-4a99-82bf-c944d1901462 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:13.467860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79cbc0-06c6-4a99-82bf-c944d1901462 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:13.486977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:13.489123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:13.489588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:13.499262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:13.499262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:13.499262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:13.686626 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1316/2660] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:30:13 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:30:13.688124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:13.703027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919aa8f-4983-41e0-98cd-366c443b7288 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:13.801101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:13.803194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:13.873785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:13.874587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:13.875027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:13.875300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:13.877662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:13.879790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:14.009679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269edff7-3e70-486f-a33b-fd77365f087d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:14.017151 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1345/2661] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:30:13 2022] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:30:14.023752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:14.041425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e073e-f2aa-4cbe-9d02-2d373c8e3a64 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:14.056512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:14.057207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:14.057339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4bf8f-b1e5-4b61-af7f-8e4455f16dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:14.057585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:14.057778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:14.058476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:14.062864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4bf8f-b1e5-4b61-af7f-8e4455f16dba service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:14.064972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:14.065209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4bf8f-b1e5-4b61-af7f-8e4455f16dba service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:14.068308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4bf8f-b1e5-4b61-af7f-8e4455f16dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:14.083017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7b4bf8f-b1e5-4b61-af7f-8e4455f16dba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:14.101382 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1346/2662] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:30:14.105811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:14.132781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc5623-93e9-488a-a29c-5f2644b582c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:14.158153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:14.159159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:14.159595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:14.160019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:14.160846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:14.162641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:14.201425 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1347/2663] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:30:14.202658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:14.229050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605391-ce33-47b5-aa9b-9833f6b86b1a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:14.242152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:14.243139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:14.243760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:14.245224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] PATH_INFO: `/v3/projects/7308e67ff4a34e4e90cc2cb73dd715ca/users/25a3037c50994ccfb3fec51fa07bd3c0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:14.259630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:14.280757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4bf8f-b1e5-4b61-af7f-8e4455f16dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:14.295217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4bf8f-b1e5-4b61-af7f-8e4455f16dba service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:14.295689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7308e67ff4a34e4e90cc2cb73dd715ca, user_id=25a3037c50994ccfb3fec51fa07bd3c0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:14.299028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:14.332258 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1317/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:13 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:30:14.436961 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1348/2665] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:30:14 2022] PUT /identity/v3/projects/7308e67ff4a34e4e90cc2cb73dd715ca/users/25a3037c50994ccfb3fec51fa07bd3c0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:30:14.438278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43f541-111d-4886-9fd2-b5f303865953 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:14.439468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43f541-111d-4886-9fd2-b5f303865953 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:14.439924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43f541-111d-4886-9fd2-b5f303865953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:14.511802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa43f541-111d-4886-9fd2-b5f303865953 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:14.520373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa43f541-111d-4886-9fd2-b5f303865953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:14.836239 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1318/2666] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:30:14.847639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:14.853907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:15.016056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca35a2-5b51-45e0-a88c-0a98a7ff7448 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:15.020700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5c9d7-bb51-4ec6-94b4-ee5e084369d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:15.023269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5c9d7-bb51-4ec6-94b4-ee5e084369d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:15.023269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5c9d7-bb51-4ec6-94b4-ee5e084369d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:15.023269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5c9d7-bb51-4ec6-94b4-ee5e084369d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:15.037721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5c9d7-bb51-4ec6-94b4-ee5e084369d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:15.039868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5c9d7-bb51-4ec6-94b4-ee5e084369d9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:15.054966 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1349/2667] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:15.245149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:18.413672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43f541-111d-4886-9fd2-b5f303865953 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:18.441009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43f541-111d-4886-9fd2-b5f303865953 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:18.465262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0e050-57cc-48f6-bad8-51e6ff670af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:18.466184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0e050-57cc-48f6-bad8-51e6ff670af1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:18.467089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0e050-57cc-48f6-bad8-51e6ff670af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:18.467536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0e050-57cc-48f6-bad8-51e6ff670af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:18.470575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43c0e050-57cc-48f6-bad8-51e6ff670af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:18.496990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0e050-57cc-48f6-bad8-51e6ff670af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:18.500618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0e050-57cc-48f6-bad8-51e6ff670af1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:18.523018 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1319/2668] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:18.887630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c43b-a623-4fbf-81d3-f9acef445ac1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:18.889016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c43b-a623-4fbf-81d3-f9acef445ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:18.889550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c43b-a623-4fbf-81d3-f9acef445ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:18.933345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2122c43b-a623-4fbf-81d3-f9acef445ac1 None None] MFA Rules not processed for user `f6d59e6bbc724bd98b96a2e4458d1c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:18.935003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2122c43b-a623-4fbf-81d3-f9acef445ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:19.070095 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1350/2669] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:19.899532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:19.900009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:19.900124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:19.952702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] MFA Rules not processed for user `d54a9109295b426ba1060c63bfb230ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:19.954294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:20.052956 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1320/2670] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:30:20.788282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c43b-a623-4fbf-81d3-f9acef445ac1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:20.805303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c43b-a623-4fbf-81d3-f9acef445ac1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:20.809322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ee069-b28e-40dd-8e38-52d319bf6bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:20.809951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee069-b28e-40dd-8e38-52d319bf6bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:20.812245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee069-b28e-40dd-8e38-52d319bf6bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:20.812245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee069-b28e-40dd-8e38-52d319bf6bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:20.813614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-355ee069-b28e-40dd-8e38-52d319bf6bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:20.836725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ee069-b28e-40dd-8e38-52d319bf6bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:20.838110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ee069-b28e-40dd-8e38-52d319bf6bd6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:20.848890 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1351/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:23.869500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:23.872343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:23.986733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecdf24-f7ea-4624-8453-ba71b2999d51 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:24.002522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e01af-2fda-4350-b923-816a6f72792b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:24.003503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e01af-2fda-4350-b923-816a6f72792b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:24.003935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e01af-2fda-4350-b923-816a6f72792b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:24.004346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e01af-2fda-4350-b923-816a6f72792b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:24.010626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d63e01af-2fda-4350-b923-816a6f72792b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:24.226177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e01af-2fda-4350-b923-816a6f72792b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:24.227918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e01af-2fda-4350-b923-816a6f72792b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:24.273442 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1321/2672] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:28.709232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dfc1b-8e3a-474f-9adc-72dec6466d78 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:28.709232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dfc1b-8e3a-474f-9adc-72dec6466d78 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:28.709232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dfc1b-8e3a-474f-9adc-72dec6466d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:28.783165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-de5dfc1b-8e3a-474f-9adc-72dec6466d78 None None] MFA Rules not processed for user `25a3037c50994ccfb3fec51fa07bd3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:28.784634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-de5dfc1b-8e3a-474f-9adc-72dec6466d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:28.947728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:28.954420 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1352/2673] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:28.966043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253849-be48-4868-8ebb-8ef7bbb8531f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:28.970632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253849-be48-4868-8ebb-8ef7bbb8531f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:28.970632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253849-be48-4868-8ebb-8ef7bbb8531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:29.005564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06253849-be48-4868-8ebb-8ef7bbb8531f None None] MFA Rules not processed for user `25a3037c50994ccfb3fec51fa07bd3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:29.007365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06253849-be48-4868-8ebb-8ef7bbb8531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:29.035378 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1322/2674] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:29.474207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dfc1b-8e3a-474f-9adc-72dec6466d78 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:29.509200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dfc1b-8e3a-474f-9adc-72dec6466d78 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:29.523807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:29.526911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:29.527193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:29.527466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:29.547640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:29.549345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:29.575865 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1353/2675] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:33.089971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89585ab4-47fa-4afe-ae24-cab08d85b7e1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:33.090466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89585ab4-47fa-4afe-ae24-cab08d85b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:33.090719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89585ab4-47fa-4afe-ae24-cab08d85b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:33.130707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89585ab4-47fa-4afe-ae24-cab08d85b7e1 None None] MFA Rules not processed for user `d5ed601492e2486bad8ba5b09515d52a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:33.141472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89585ab4-47fa-4afe-ae24-cab08d85b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:33.177504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:33.294571 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1323/2676] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:34.414534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:34.414534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:34.440208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730757-a01b-4a82-a9ce-f3c06c316618 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:34.453043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:34.457545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:34.458070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:34.459850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] PATH_INFO: `/v3/users/356ffdf6f40b4d71a7f39c414c008491` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:34.472473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=356ffdf6f40b4d71a7f39c414c008491)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:34.479744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:34.813270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356ffdf6f40b4d71a7f39c414c008491'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:34.825452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356ffdf6f40b4d71a7f39c414c008491'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:34.829788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356ffdf6f40b4d71a7f39c414c008491'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:34.902694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356ffdf6f40b4d71a7f39c414c008491'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:35.023873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5567ad60-5710-47bd-a309-ec9f6c9487a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356ffdf6f40b4d71a7f39c414c008491'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:35.036023 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1354/2677] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:30:34 2022] DELETE /identity/v3/users/356ffdf6f40b4d71a7f39c414c008491 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:30:36.545130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89585ab4-47fa-4afe-ae24-cab08d85b7e1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:36.559915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89585ab4-47fa-4afe-ae24-cab08d85b7e1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:36.746484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:36.747964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:36.748275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:36.748561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] PATH_INFO: `/v3/projects/a2b1a51ccc344c649308631c71afd5b7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:36.752705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b1a51ccc344c649308631c71afd5b7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:36.755532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:36.998895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b1a51ccc344c649308631c71afd5b7', 'request_id': 'req-ac89050a-958b-4191-a48c-9529452ce42a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:37.012430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b1a51ccc344c649308631c71afd5b7', 'request_id': 'req-ac89050a-958b-4191-a48c-9529452ce42a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:37.134851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b1a51ccc344c649308631c71afd5b7', 'request_id': 'req-ac89050a-958b-4191-a48c-9529452ce42a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:37.158740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] The token cache is being invalidate because project a2b1a51ccc344c649308631c71afd5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:30:37.159038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:37.161150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac89050a-958b-4191-a48c-9529452ce42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:30:37.175767 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1324/2678] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:30:36 2022] DELETE /identity/v3/projects/a2b1a51ccc344c649308631c71afd5b7 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:30:37.180625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087859b-f321-41e1-9282-df650dc0217f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:37.182129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087859b-f321-41e1-9282-df650dc0217f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:37.185757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087859b-f321-41e1-9282-df650dc0217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:37.239100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0087859b-f321-41e1-9282-df650dc0217f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:37.241213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0087859b-f321-41e1-9282-df650dc0217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:37.326106 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1355/2679] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:37.334998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ced0b-9b4e-43b1-8fff-27fca9af4e72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:37.335378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ced0b-9b4e-43b1-8fff-27fca9af4e72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:37.335719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ced0b-9b4e-43b1-8fff-27fca9af4e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:37.388660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-943ced0b-9b4e-43b1-8fff-27fca9af4e72 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:37.388660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-943ced0b-9b4e-43b1-8fff-27fca9af4e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:37.398292 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1325/2680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:37.403554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087859b-f321-41e1-9282-df650dc0217f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:37.417424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087859b-f321-41e1-9282-df650dc0217f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:37.427889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:37.428910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:37.429388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:37.429836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:37.432382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:30:37.432941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:37.436479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:37.487059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ced0b-9b4e-43b1-8fff-27fca9af4e72 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:37.488817 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1356/2681] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:30:37.491934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ced0b-9b4e-43b1-8fff-27fca9af4e72 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:37.498522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:37.499147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:37.499430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:37.499700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:37.500856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:37.502820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:37.698456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1326/2682] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:30:37 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:30:37.701779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:37.717608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab129-3554-4624-adf0-a20f8e332cb9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:37.830853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:37.861466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:37.862172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:37.862664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:37.862871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:37.863517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:37.866696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:37.987482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1357/2683] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:30:37 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:30:37.991842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:38.032401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd003-b198-45fb-9ecd-81718f0c675a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:38.042529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:38.050273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:38.050273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:38.050273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:38.050273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:38.054241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:38.092661 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1327/2684] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:30:38.096957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:38.129631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d67b57-b294-4ec4-b86b-bdb625990596 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:38.148363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3393f-d183-45d1-838a-52c634236165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:38.149115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3393f-d183-45d1-838a-52c634236165 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:38.152649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3393f-d183-45d1-838a-52c634236165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:38.152939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3393f-d183-45d1-838a-52c634236165 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:38.153648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3393f-d183-45d1-838a-52c634236165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:38.158342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3393f-d183-45d1-838a-52c634236165 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:38.183669 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1358/2685] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:30:38.184644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:38.205900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd90cf6-8df3-4e67-88af-a539cacc2c93 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:38.221178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:38.228068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:38.228068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:38.228068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] PATH_INFO: `/v3/projects/aea9ea82f78a407996b24272734e942f/users/a1d6385312694da692b60a1d7756dffd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:38.259803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:38.266815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea9ea82f78a407996b24272734e942f, user_id=a1d6385312694da692b60a1d7756dffd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:38.277189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:38.422841 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1328/2686] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:30:38 2022] PUT /identity/v3/projects/aea9ea82f78a407996b24272734e942f/users/a1d6385312694da692b60a1d7756dffd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:30:38.428846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:38.429557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:38.430199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:38.471337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:38.475183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:38.592724 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1359/2687] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:30:39.197422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:39.202912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:39.336403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40eaf-22a0-42a3-aa0e-7c3f610025ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:39.350006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c84b0e-e70c-495b-a89e-834035501761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:39.350006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84b0e-e70c-495b-a89e-834035501761 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:39.350006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84b0e-e70c-495b-a89e-834035501761 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:39.350006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84b0e-e70c-495b-a89e-834035501761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:39.374154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c84b0e-e70c-495b-a89e-834035501761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:39.375936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c84b0e-e70c-495b-a89e-834035501761 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:39.397909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1329/2688] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:46.849141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:46.851987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:46.950535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46e43-d775-4f33-aee3-90cf883c9c14 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:46.956987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:46.957656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:46.957937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:46.958255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:46.960139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:47.031893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:47.033535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:47.037643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:47.044029 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1360/2689] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:30:49.400866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:54.272099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a1f7-f3d6-4626-a2e1-04980b03b2b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:54.272815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a1f7-f3d6-4626-a2e1-04980b03b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:54.272815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a1f7-f3d6-4626-a2e1-04980b03b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:54.336673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9573a1f7-f3d6-4626-a2e1-04980b03b2b8 None None] MFA Rules not processed for user `a1d6385312694da692b60a1d7756dffd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:30:54.341104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9573a1f7-f3d6-4626-a2e1-04980b03b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:30:54.572039 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1330/2690] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:30:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:30:55.573505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:30:55.595500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666000-c078-46ef-a994-de5f77b9846b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:30:55.627655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:30:55.628568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:30:55.629012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:30:55.630180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:30:55.641308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:30:55.643651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:30:55.681826 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1361/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:30:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:04.549247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:05.663322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:05.876915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573a1f7-f3d6-4626-a2e1-04980b03b2b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:05.904911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573a1f7-f3d6-4626-a2e1-04980b03b2b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:05.922012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:05.930216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:05.930526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:05.930938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:05.946463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:06.142366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:06.144337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:06.158937 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1331/2692] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:10.055129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:10.057200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:10.207775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a265-4ccb-446c-82c5-ea4290605e42 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:10.213400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:10.214224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:10.214572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:10.214909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:10.217216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:10.234228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:10.239559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:10.245873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:10.248065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:10.283326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe1a51-5186-4d65-b034-64de1762cb59 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:10.293144 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1362/2693] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:10.294805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:10.296200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:10.296665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:10.297115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] PATH_INFO: `/v3/users/25a3037c50994ccfb3fec51fa07bd3c0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:10.298915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a3037c50994ccfb3fec51fa07bd3c0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:10.312936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:10.619558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a3037c50994ccfb3fec51fa07bd3c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:10.621762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a3037c50994ccfb3fec51fa07bd3c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:10.737142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a3037c50994ccfb3fec51fa07bd3c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:10.740141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a3037c50994ccfb3fec51fa07bd3c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:10.762970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08ef8c96-e5b5-4cea-863a-7975b5a9c62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a3037c50994ccfb3fec51fa07bd3c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:10.805671 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1332/2694] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:31:10 2022] DELETE /identity/v3/users/25a3037c50994ccfb3fec51fa07bd3c0 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:31:11.734411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:11.766236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3c9b6-2309-4373-9d0a-163ef640184c service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:11.915251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:11.916185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:11.917758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:11.918276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] PATH_INFO: `/v3/projects/7308e67ff4a34e4e90cc2cb73dd715ca` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:11.922405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7308e67ff4a34e4e90cc2cb73dd715ca)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:11.926294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:12.117340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7308e67ff4a34e4e90cc2cb73dd715ca', 'request_id': 'req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:12.127663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7308e67ff4a34e4e90cc2cb73dd715ca', 'request_id': 'req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:12.277624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7308e67ff4a34e4e90cc2cb73dd715ca', 'request_id': 'req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:12.298633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] The token cache is being invalidate because project 7308e67ff4a34e4e90cc2cb73dd715ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:31:12.299209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:12.326573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06b77bb9-2bba-47f6-aff7-cbc09e385c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:12.334842 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1363/2695] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:31:11 2022] DELETE /identity/v3/projects/7308e67ff4a34e4e90cc2cb73dd715ca => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:12.341814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f2a0-f56a-4941-9b5f-bd524bb1d6af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:12.342736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f2a0-f56a-4941-9b5f-bd524bb1d6af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:12.343209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34f2a0-f56a-4941-9b5f-bd524bb1d6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:12.395835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf34f2a0-f56a-4941-9b5f-bd524bb1d6af None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:12.397162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf34f2a0-f56a-4941-9b5f-bd524bb1d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:12.581032 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1333/2696] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:12.589168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a9e7-e45f-4118-869c-fae9afef032d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:12.590071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a9e7-e45f-4118-869c-fae9afef032d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:12.590967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a9e7-e45f-4118-869c-fae9afef032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:12.645302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-50f2a9e7-e45f-4118-869c-fae9afef032d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:12.649002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50f2a9e7-e45f-4118-869c-fae9afef032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:12.673877 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1364/2697] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:12.674001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f2a0-f56a-4941-9b5f-bd524bb1d6af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:12.687285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34f2a0-f56a-4941-9b5f-bd524bb1d6af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:12.695678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:12.696394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:12.698145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:12.698145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:12.698337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:31:12.698467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:12.700237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:12.702008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:12.752192 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1334/2698] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:31:12.754435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2a9e7-e45f-4118-869c-fae9afef032d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:12.766187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2a9e7-e45f-4118-869c-fae9afef032d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:12.774194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:12.775902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:12.776352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:12.776920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:12.790530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:12.798920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:12.837109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:12.955857 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1365/2699] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:31:12 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:12.957564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:12.998322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd139-5fb6-45cc-b670-029b32a380a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:13.173018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:13.174862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:13.174862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:13.174862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:13.174862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:13.177867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:13.328555 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1335/2700] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:31:12 2022] POST /identity/v3/users => generated 288 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:13.334949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:13.353366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b308cc-3672-401c-8da8-89c27125296c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:13.359129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:13.360113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:13.360613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:13.361432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:13.362424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:13.364341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:13.380987 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1366/2701] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:13.385344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:13.404899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91562c82-313b-4af2-96e4-08004c3a4282 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:13.420403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75944b5b-c44b-43e6-ba94-860fdb82461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:13.422515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944b5b-c44b-43e6-ba94-860fdb82461c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:13.422800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944b5b-c44b-43e6-ba94-860fdb82461c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:13.423074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944b5b-c44b-43e6-ba94-860fdb82461c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:13.423742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75944b5b-c44b-43e6-ba94-860fdb82461c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:13.425350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75944b5b-c44b-43e6-ba94-860fdb82461c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:13.477388 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1336/2702] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:13.478697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:13.500310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84920ca3-817d-4f29-9d81-eb3fef73fe10 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:13.513230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:13.518521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:13.518927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:13.519344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] PATH_INFO: `/v3/projects/4dca924d685b46a2a0e1ef8b6a92e5bd/users/ff608b054a0c49ce8598b8f49f7e241d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:13.553599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dca924d685b46a2a0e1ef8b6a92e5bd, user_id=ff608b054a0c49ce8598b8f49f7e241d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:13.564828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:13.682986 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1367/2703] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:31:13 2022] PUT /identity/v3/projects/4dca924d685b46a2a0e1ef8b6a92e5bd/users/ff608b054a0c49ce8598b8f49f7e241d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:13.694637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f4bd-97d4-40df-a741-134df4486ace None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:13.694960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f4bd-97d4-40df-a741-134df4486ace None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:13.695715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591f4bd-97d4-40df-a741-134df4486ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:13.778261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e591f4bd-97d4-40df-a741-134df4486ace None None] MFA Rules not processed for user `ff608b054a0c49ce8598b8f49f7e241d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:13.780269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e591f4bd-97d4-40df-a741-134df4486ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:13.929195 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1337/2704] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:14.526387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:14.528186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:14.677645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fc8ad-1db4-445d-bcb0-60e75e246457 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:14.706900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973a4b-ccda-4f19-913f-4ccd14102612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:14.707546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973a4b-ccda-4f19-913f-4ccd14102612 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:14.708097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973a4b-ccda-4f19-913f-4ccd14102612 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:14.708097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973a4b-ccda-4f19-913f-4ccd14102612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:14.731367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973a4b-ccda-4f19-913f-4ccd14102612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:14.732406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89973a4b-ccda-4f19-913f-4ccd14102612 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:14.764141 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1368/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:18.037167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f4bd-97d4-40df-a741-134df4486ace None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:18.205221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591f4bd-97d4-40df-a741-134df4486ace None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:18.215183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:18.216026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:18.217335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:18.219506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] PATH_INFO: `/v3/users/ff608b054a0c49ce8598b8f49f7e241d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:18.222942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff608b054a0c49ce8598b8f49f7e241d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:18.225681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:18.229832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:18.521934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff608b054a0c49ce8598b8f49f7e241d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:18.522759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff608b054a0c49ce8598b8f49f7e241d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:18.651343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff608b054a0c49ce8598b8f49f7e241d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:18.651343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff608b054a0c49ce8598b8f49f7e241d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:18.700397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff608b054a0c49ce8598b8f49f7e241d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:18.749014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1338/2706] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:31:18 2022] DELETE /identity/v3/users/ff608b054a0c49ce8598b8f49f7e241d => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:18.749149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388721e9-09bf-4507-8bff-bbaf95e1f658 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:18.749149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388721e9-09bf-4507-8bff-bbaf95e1f658 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:18.749149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388721e9-09bf-4507-8bff-bbaf95e1f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:18.795657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-388721e9-09bf-4507-8bff-bbaf95e1f658 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:18.796911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-388721e9-09bf-4507-8bff-bbaf95e1f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:18.974181 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1369/2707] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:19.016998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:19.018935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:19.160253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da3f1-ead0-4fb2-aa0b-55692f52050b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:19.168297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee0483-44d6-4aea-84ed-4c26b590dd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:19.170004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0483-44d6-4aea-84ed-4c26b590dd82 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:19.171672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0483-44d6-4aea-84ed-4c26b590dd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:19.172140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0483-44d6-4aea-84ed-4c26b590dd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:19.193571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee0483-44d6-4aea-84ed-4c26b590dd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:19.202474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee0483-44d6-4aea-84ed-4c26b590dd82 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:19.230748 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1339/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:19.685890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:19.686213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:19.686605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:19.713427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] MFA Rules not processed for user `677fe6a60f0742b3820c41beccc07d11`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:19.714911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:19.763849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:19.784602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1370/2709] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:19.795763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa372-d53e-4940-9fd7-7154120609d8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:19.796636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa372-d53e-4940-9fd7-7154120609d8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:19.797493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673aa372-d53e-4940-9fd7-7154120609d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:19.830734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-673aa372-d53e-4940-9fd7-7154120609d8 None None] MFA Rules not processed for user `677fe6a60f0742b3820c41beccc07d11`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:19.832052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-673aa372-d53e-4940-9fd7-7154120609d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:19.840410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1340/2710] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:19.855336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:19.856947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:19.883289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1995-7402-4268-b593-d2f5a4e7e1ba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:19.895562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:19.896227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:19.896507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:19.896780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] PATH_INFO: `/v3/projects/4dca924d685b46a2a0e1ef8b6a92e5bd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:19.897970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dca924d685b46a2a0e1ef8b6a92e5bd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:19.900288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:20.115236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dca924d685b46a2a0e1ef8b6a92e5bd', 'request_id': 'req-397bc624-bda4-48ea-af8b-c45c97ef5bee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:20.124080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dca924d685b46a2a0e1ef8b6a92e5bd', 'request_id': 'req-397bc624-bda4-48ea-af8b-c45c97ef5bee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:20.200683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dca924d685b46a2a0e1ef8b6a92e5bd', 'request_id': 'req-397bc624-bda4-48ea-af8b-c45c97ef5bee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:20.215387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] The token cache is being invalidate because project 4dca924d685b46a2a0e1ef8b6a92e5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:31:20.215699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:20.216500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-397bc624-bda4-48ea-af8b-c45c97ef5bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:20.218463 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1371/2711] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:31:19 2022] DELETE /identity/v3/projects/4dca924d685b46a2a0e1ef8b6a92e5bd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:20.223776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df20c57-6f58-4a3a-8435-0f89e0b8fb78 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:20.225299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df20c57-6f58-4a3a-8435-0f89e0b8fb78 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:20.225783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df20c57-6f58-4a3a-8435-0f89e0b8fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:20.256193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1df20c57-6f58-4a3a-8435-0f89e0b8fb78 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:20.257661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1df20c57-6f58-4a3a-8435-0f89e0b8fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:20.345361 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1341/2712] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:31:20.360097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb531e-d7b1-4c0f-8c83-14a7ed09f619 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:20.360392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb531e-d7b1-4c0f-8c83-14a7ed09f619 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:20.360674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb531e-d7b1-4c0f-8c83-14a7ed09f619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:20.392492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cfbb531e-d7b1-4c0f-8c83-14a7ed09f619 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:20.394099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfbb531e-d7b1-4c0f-8c83-14a7ed09f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:20.424875 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1372/2713] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:20.428861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df20c57-6f58-4a3a-8435-0f89e0b8fb78 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:20.451234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df20c57-6f58-4a3a-8435-0f89e0b8fb78 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:20.495788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:20.495788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:20.495788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:20.495788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:20.496250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:31:20.496250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:20.498406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:20.518733 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1342/2714] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:31:20.519849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb531e-d7b1-4c0f-8c83-14a7ed09f619 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:20.536339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb531e-d7b1-4c0f-8c83-14a7ed09f619 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:20.546560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:20.547610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:20.547951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:20.548290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:20.549011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:20.570699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:20.667015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1373/2715] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:31:20 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:20.670840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:20.678561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:20.690411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0237b21-6e75-4335-9a78-c321b9602461 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:20.774226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:20.775728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:20.776266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:20.776759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:20.777626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:20.781879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:20.878170 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1343/2716] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:31:20 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:20.887195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:20.924135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171e38c-16ec-4698-bfd3-c1c9d84724f3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:20.929946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:20.933210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:20.933833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:20.934321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:20.935153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:20.941490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:20.978248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1374/2717] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:20.983146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:21.001330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d89e4-34ef-4708-a0db-447e23da4c0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:21.017793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96db1c4-8e5a-4534-b960-e4e08d4c539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:21.018848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db1c4-8e5a-4534-b960-e4e08d4c539f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:21.019949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db1c4-8e5a-4534-b960-e4e08d4c539f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:21.020437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db1c4-8e5a-4534-b960-e4e08d4c539f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:21.021915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96db1c4-8e5a-4534-b960-e4e08d4c539f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:21.024676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96db1c4-8e5a-4534-b960-e4e08d4c539f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:21.042329 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1344/2718] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:21.045817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:21.076318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060462b-e9f7-4723-906e-bead29c3ad1b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:21.100901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:21.101603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:21.101887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:21.103374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] PATH_INFO: `/v3/projects/4f11662f8c8f4d15bce1b769946dff4e/users/c3bebd1e839f467e981fa5b8d5228ce5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:21.171585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f11662f8c8f4d15bce1b769946dff4e, user_id=c3bebd1e839f467e981fa5b8d5228ce5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:21.175366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:21.308389 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1375/2719] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:31:21 2022] PUT /identity/v3/projects/4f11662f8c8f4d15bce1b769946dff4e/users/c3bebd1e839f467e981fa5b8d5228ce5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:21.314082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:21.314619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:21.314907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:21.367615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:21.369336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:21.499313 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1345/2720] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:21.514622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:21.519068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:21.665978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e397ba-e094-4dd8-ac67-23b1b50a35a6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:21.679037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:21.679669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:21.680163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:21.680742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:21.702255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:21.704218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:21.732978 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1376/2721] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:31:22.342337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:22.346121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:22.361961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6aeb1-28eb-4110-8800-43623fc013da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:22.372665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:22.374173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:22.374699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:22.375461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] PATH_INFO: `/v3/users/a1d6385312694da692b60a1d7756dffd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:22.377218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d6385312694da692b60a1d7756dffd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:22.379649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:22.611368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d6385312694da692b60a1d7756dffd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:22.612108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d6385312694da692b60a1d7756dffd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:22.726999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d6385312694da692b60a1d7756dffd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:22.728939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d6385312694da692b60a1d7756dffd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:22.754851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de34038b-0848-4a23-ba81-fa52ba066933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d6385312694da692b60a1d7756dffd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:22.790100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:22.800772 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1346/2722] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:31:22 2022] DELETE /identity/v3/users/a1d6385312694da692b60a1d7756dffd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:23.441245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:23.456427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240216-52f7-4b9d-81de-b89b03a89b41 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:23.461291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:23.555911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:23.557079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:23.559006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:23.559006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] PATH_INFO: `/v3/projects/aea9ea82f78a407996b24272734e942f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:23.559006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea9ea82f78a407996b24272734e942f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:23.562643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:23.683751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea9ea82f78a407996b24272734e942f', 'request_id': 'req-82eaffcf-6395-4581-8c1a-571d92114e7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:23.691178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea9ea82f78a407996b24272734e942f', 'request_id': 'req-82eaffcf-6395-4581-8c1a-571d92114e7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:23.781633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea9ea82f78a407996b24272734e942f', 'request_id': 'req-82eaffcf-6395-4581-8c1a-571d92114e7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:23.794419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] The token cache is being invalidate because project aea9ea82f78a407996b24272734e942f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:31:23.794715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:23.795374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82eaffcf-6395-4581-8c1a-571d92114e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:23.796871 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1377/2723] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:31:23 2022] DELETE /identity/v3/projects/aea9ea82f78a407996b24272734e942f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:23.804328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eab81-4e91-47c3-acde-a675a0bce7da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:23.805289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eab81-4e91-47c3-acde-a675a0bce7da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:23.805873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eab81-4e91-47c3-acde-a675a0bce7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:23.827469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-942eab81-4e91-47c3-acde-a675a0bce7da None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:23.828681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-942eab81-4e91-47c3-acde-a675a0bce7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:23.892097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1347/2724] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:23.964003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da43d-51f3-40f5-b3a5-4bfdd8e7b846 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:23.964510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da43d-51f3-40f5-b3a5-4bfdd8e7b846 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:23.964953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da43d-51f3-40f5-b3a5-4bfdd8e7b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:23.989993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-624da43d-51f3-40f5-b3a5-4bfdd8e7b846 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:23.992393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-624da43d-51f3-40f5-b3a5-4bfdd8e7b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:24.003606 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1378/2725] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:24.007602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942eab81-4e91-47c3-acde-a675a0bce7da None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:24.019871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942eab81-4e91-47c3-acde-a675a0bce7da None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:24.038606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:24.040017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:24.040598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:24.041094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:24.042508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:31:24.043058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:24.046508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:24.075587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1348/2726] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:31:24.080851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da43d-51f3-40f5-b3a5-4bfdd8e7b846 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:24.099626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da43d-51f3-40f5-b3a5-4bfdd8e7b846 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:24.105370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:24.105998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:24.106436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:24.106761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:24.107409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:24.109406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:24.238518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1379/2727] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:31:24 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:24.244113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:24.261302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b111-a506-4b88-9178-46c21021ea86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:24.408842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:24.409950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:24.410482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:24.411549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:24.413463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:24.415984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:24.542679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1349/2728] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:31:24 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:24.546582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:24.563941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7af94-d491-4ba0-a51d-5683b3969fe3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:24.577034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:24.578987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:24.579495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:24.579960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:24.580996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:24.583092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:24.623221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1380/2729] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:24.627252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:24.640855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e44b-0cda-49c3-a333-38bd2f327948 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:24.648010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe12938-e840-4997-94ce-3cecdabc534a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:24.648743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12938-e840-4997-94ce-3cecdabc534a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:24.649213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12938-e840-4997-94ce-3cecdabc534a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:24.650148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe12938-e840-4997-94ce-3cecdabc534a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:24.650874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe12938-e840-4997-94ce-3cecdabc534a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:24.652551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe12938-e840-4997-94ce-3cecdabc534a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:24.665418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1350/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:24.669564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:24.683418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc007d5-6c91-47af-997a-a870cd1bb760 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:24.689928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:24.691170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:24.691647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:24.692182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] PATH_INFO: `/v3/projects/9a43ee032d0f403db4cb4223c63b7f2e/users/cfb4fc39da53465d9bf6262a60b9c922/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:24.718193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a43ee032d0f403db4cb4223c63b7f2e, user_id=cfb4fc39da53465d9bf6262a60b9c922, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:24.721242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:24.815126 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1381/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:31:24 2022] PUT /identity/v3/projects/9a43ee032d0f403db4cb4223c63b7f2e/users/cfb4fc39da53465d9bf6262a60b9c922/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:24.820207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1819e9-c562-4e26-846b-44facef1835b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:24.820726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1819e9-c562-4e26-846b-44facef1835b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:24.820833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1819e9-c562-4e26-846b-44facef1835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:24.882521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7e1819e9-c562-4e26-846b-44facef1835b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:24.886684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e1819e9-c562-4e26-846b-44facef1835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:25.011887 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1351/2732] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:25.033172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:25.035704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:25.095292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:25.115488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add430a7-ff03-410f-844c-872e7af90c9d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:25.120929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:25.122157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:25.122157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:25.122157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:25.132502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:25.133983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:25.160521 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1382/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:32.070753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:32.072657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:32.079595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:32.091027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:32.149135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] MFA Rules not processed for user `c3bebd1e839f467e981fa5b8d5228ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:32.153454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:32.462376 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1352/2734] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:32.671533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:32.672960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:32.851180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa34266-bdb5-487a-a340-ac2b20ce3e46 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:32.886959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52828b-2375-45be-bcc0-9ebda1e990d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:32.887811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52828b-2375-45be-bcc0-9ebda1e990d9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:32.888290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52828b-2375-45be-bcc0-9ebda1e990d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:32.888573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52828b-2375-45be-bcc0-9ebda1e990d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:32.907474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52828b-2375-45be-bcc0-9ebda1e990d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:32.913706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52828b-2375-45be-bcc0-9ebda1e990d9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:32.942237 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1383/2735] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:33.330960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:33.332652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:33.350996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61282ee4-312e-4f00-b4ac-197176ffa017 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:33.356611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:33.358277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:33.358660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:33.359040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] PATH_INFO: `/v3/users/6c1cd81ee6174cee97e384cae58a2e6a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:33.360442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c1cd81ee6174cee97e384cae58a2e6a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:33.363544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:33.625807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1cd81ee6174cee97e384cae58a2e6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:33.626967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1cd81ee6174cee97e384cae58a2e6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:33.706313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1cd81ee6174cee97e384cae58a2e6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:33.707249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1cd81ee6174cee97e384cae58a2e6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:33.718222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1cd81ee6174cee97e384cae58a2e6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:33.758906 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1353/2736] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:31:33 2022] DELETE /identity/v3/users/6c1cd81ee6174cee97e384cae58a2e6a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:33.763712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:33.764282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:33.764282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:33.816767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:33.819264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:34.020715 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1384/2737] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:34.033311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:34.036006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:34.126194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06141cd-5c50-4dc3-a970-e8b77d77c5a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:34.148754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6df323-ba89-438a-8ed9-454d205589ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:34.149964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df323-ba89-438a-8ed9-454d205589ef service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:34.150404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df323-ba89-438a-8ed9-454d205589ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:34.150774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6df323-ba89-438a-8ed9-454d205589ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:34.169360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df323-ba89-438a-8ed9-454d205589ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:34.171363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6df323-ba89-438a-8ed9-454d205589ef service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:34.205171 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1354/2738] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:36.318464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:36.320099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:36.340904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec441c16-b8a4-456f-ba8a-0b807a459168 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:36.360455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:36.361133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:36.361411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:36.361944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] PATH_INFO: `/v3/projects/41d29c076c7d4bb288da6f42ddee05fb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:36.365755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d29c076c7d4bb288da6f42ddee05fb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:36.369105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:36.607054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa842c-2c6e-47f0-ad09-0b445649884c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:36.608077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa842c-2c6e-47f0-ad09-0b445649884c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:36.608564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa842c-2c6e-47f0-ad09-0b445649884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:36.626558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d29c076c7d4bb288da6f42ddee05fb', 'request_id': 'req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:36.654166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:36.665104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d29c076c7d4bb288da6f42ddee05fb', 'request_id': 'req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:36.674542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:36.682294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-76fa842c-2c6e-47f0-ad09-0b445649884c None None] MFA Rules not processed for user `c3bebd1e839f467e981fa5b8d5228ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:36.682294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76fa842c-2c6e-47f0-ad09-0b445649884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:36.809579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1355/2739] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:36.817225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d29c076c7d4bb288da6f42ddee05fb', 'request_id': 'req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:36.842347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] The token cache is being invalidate because project 41d29c076c7d4bb288da6f42ddee05fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:31:36.848133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:36.848133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:36.848133 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1385/2740] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:31:36 2022] DELETE /identity/v3/projects/41d29c076c7d4bb288da6f42ddee05fb => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:36.850153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa842c-2c6e-47f0-ad09-0b445649884c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:37.034357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa842c-2c6e-47f0-ad09-0b445649884c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:37.044171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:37.046390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:37.048231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:37.048525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] PATH_INFO: `/v3/users/c8ff684c96ea4fc9beee82ff1c825ee4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:37.053282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ff684c96ea4fc9beee82ff1c825ee4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:37.056407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:37.291891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:37.293370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:37.330104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ff684c96ea4fc9beee82ff1c825ee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:37.330989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ff684c96ea4fc9beee82ff1c825ee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:37.392017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ff684c96ea4fc9beee82ff1c825ee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:37.392773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ff684c96ea4fc9beee82ff1c825ee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:37.404396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ff684c96ea4fc9beee82ff1c825ee4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:37.418679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fe5a5-c6f7-4b2c-be5b-2c19f38f998d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:37.429987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b8af9-4ba7-49e8-b459-902e8894e189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:37.431234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b8af9-4ba7-49e8-b459-902e8894e189 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:37.431518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b8af9-4ba7-49e8-b459-902e8894e189 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:37.431806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b8af9-4ba7-49e8-b459-902e8894e189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:37.433681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-714b8af9-4ba7-49e8-b459-902e8894e189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:37.448672 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1356/2741] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:31:36 2022] DELETE /identity/v3/users/c8ff684c96ea4fc9beee82ff1c825ee4 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:37.483344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b8af9-4ba7-49e8-b459-902e8894e189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:37.495093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b8af9-4ba7-49e8-b459-902e8894e189 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:37.512883 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1386/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:31:38.088484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:38.089993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:38.343439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ac17-c1b1-4525-8855-463db1ec2533 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:38.353540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:38.354353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:38.354744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:38.355142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] PATH_INFO: `/v3/projects/dd3aea217bc34d51b6816c2f220d1c5e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:38.356449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3aea217bc34d51b6816c2f220d1c5e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:38.359275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:38.579198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3aea217bc34d51b6816c2f220d1c5e', 'request_id': 'req-12b83812-2255-4a09-8d1d-007fc11fcffa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:38.590799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3aea217bc34d51b6816c2f220d1c5e', 'request_id': 'req-12b83812-2255-4a09-8d1d-007fc11fcffa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:38.702938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3aea217bc34d51b6816c2f220d1c5e', 'request_id': 'req-12b83812-2255-4a09-8d1d-007fc11fcffa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:38.718957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] The token cache is being invalidate because project dd3aea217bc34d51b6816c2f220d1c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:31:38.719393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:38.720502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-12b83812-2255-4a09-8d1d-007fc11fcffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:38.723050 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1357/2743] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:31:38 2022] DELETE /identity/v3/projects/dd3aea217bc34d51b6816c2f220d1c5e => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:38.732672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba09d7f-a104-4008-bcb0-badc719ab71f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:38.732672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba09d7f-a104-4008-bcb0-badc719ab71f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:38.732672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba09d7f-a104-4008-bcb0-badc719ab71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:38.762805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ba09d7f-a104-4008-bcb0-badc719ab71f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:38.764033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ba09d7f-a104-4008-bcb0-badc719ab71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:38.859187 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1387/2744] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:38.867685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819fb9-55f1-4541-8849-54a15b47da96 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:38.868005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819fb9-55f1-4541-8849-54a15b47da96 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:38.868287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5819fb9-55f1-4541-8849-54a15b47da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:38.914598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5819fb9-55f1-4541-8849-54a15b47da96 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:38.915876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5819fb9-55f1-4541-8849-54a15b47da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:38.937575 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1358/2745] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:38.941904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba09d7f-a104-4008-bcb0-badc719ab71f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:38.954337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba09d7f-a104-4008-bcb0-badc719ab71f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:38.954641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:38.974872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:38.978902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:38.978902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:38.978902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:38.978902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:31:38.978902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:38.978902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:39.006364 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1388/2746] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:31:39.016555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819fb9-55f1-4541-8849-54a15b47da96 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:39.028797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5819fb9-55f1-4541-8849-54a15b47da96 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:39.044978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:39.045617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:39.047702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:39.047702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:39.047702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:39.049345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:39.160479 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1359/2747] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:31:39 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:39.161740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:39.179800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb920d2-23e5-495b-9159-28b968a0536a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:39.348472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:39.348945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:39.349370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:39.349653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:39.352371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:39.356768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:39.513698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:39.525118 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1389/2748] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:31:39 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:39.532494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:39.566427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d4e03-0ceb-42ba-bf85-d396ba2e2691 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:39.583768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:39.584943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:39.585679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:39.586149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:39.587030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:39.588901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:39.605439 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1360/2749] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:39.611121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:39.626706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbba63a-4fcb-4e43-bc02-271421e6b976 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:39.638494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794cc4d-4316-49d5-97e1-0e65b5fbf0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:39.639077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794cc4d-4316-49d5-97e1-0e65b5fbf0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:39.639361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794cc4d-4316-49d5-97e1-0e65b5fbf0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:39.641601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794cc4d-4316-49d5-97e1-0e65b5fbf0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:39.642322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794cc4d-4316-49d5-97e1-0e65b5fbf0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:39.646961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794cc4d-4316-49d5-97e1-0e65b5fbf0e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:39.675049 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1390/2750] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:39.676048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:39.695078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488f22-d3af-4982-88c2-7c54f914871d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:39.705906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:39.706681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:39.707074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:39.707551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] PATH_INFO: `/v3/projects/38f95c7096d240c88053e9fb05fb9e3c/users/2182a3c281364aa6b39832172235e711/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:39.755333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f95c7096d240c88053e9fb05fb9e3c, user_id=2182a3c281364aa6b39832172235e711, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:39.768929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:39.858930 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1361/2751] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:31:39 2022] PUT /identity/v3/projects/38f95c7096d240c88053e9fb05fb9e3c/users/2182a3c281364aa6b39832172235e711/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:31:39.862047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a8a11-bb11-4037-b236-7166c02c07e1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:39.863125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a8a11-bb11-4037-b236-7166c02c07e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:39.863577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a8a11-bb11-4037-b236-7166c02c07e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:39.940844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-633a8a11-bb11-4037-b236-7166c02c07e1 None None] MFA Rules not processed for user `2182a3c281364aa6b39832172235e711`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:39.951720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-633a8a11-bb11-4037-b236-7166c02c07e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:40.136273 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1391/2752] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:40.140720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:40.362127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5b03e-2c10-4580-9980-00e46939f8af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:40.385892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:40.388712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:40.390429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:40.390829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:40.393020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:40.407253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:40.582729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1362/2753] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:31:40 2022] POST /identity/v3/projects => generated 395 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:40.587427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a8a11-bb11-4037-b236-7166c02c07e1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:40.625115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a8a11-bb11-4037-b236-7166c02c07e1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:40.771444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:40.796740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:40.797827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:40.799102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:40.799615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:40.800627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:40.802892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:40.926952 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1392/2754] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:31:40 2022] POST /identity/v3/users => generated 304 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:40.931530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:40.945764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25647c02-12b0-4517-8fff-d09bf0652b4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:40.960713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ce485-77a5-4ff4-8476-f5d91abd898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:40.961772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce485-77a5-4ff4-8476-f5d91abd898f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:40.963340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce485-77a5-4ff4-8476-f5d91abd898f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:40.963874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce485-77a5-4ff4-8476-f5d91abd898f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:40.964860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ce485-77a5-4ff4-8476-f5d91abd898f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:40.972569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ce485-77a5-4ff4-8476-f5d91abd898f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:41.001840 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1363/2755] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:41.006126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:41.023522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e2e1-d8d6-4afa-950c-2ae23510b8e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:41.039638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:41.043194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:41.049613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:41.049959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] PATH_INFO: `/v3/projects/e7324854ef8b4d86afec03b498ab9470/users/eb1e5ff3d50249519bd3f6d1d054737d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:41.075231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7324854ef8b4d86afec03b498ab9470, user_id=eb1e5ff3d50249519bd3f6d1d054737d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:41.080564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:41.153609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6941-1b12-44ce-a902-98eb0a913814 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:41.154235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6941-1b12-44ce-a902-98eb0a913814 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:41.154692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c6941-1b12-44ce-a902-98eb0a913814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:41.160448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1393/2756] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:31:41 2022] PUT /identity/v3/projects/e7324854ef8b4d86afec03b498ab9470/users/eb1e5ff3d50249519bd3f6d1d054737d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:41.168776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:41.210102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-445c6941-1b12-44ce-a902-98eb0a913814 None None] MFA Rules not processed for user `cfb4fc39da53465d9bf6262a60b9c922`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:41.211652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-445c6941-1b12-44ce-a902-98eb0a913814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:41.313160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:41.323531 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1364/2757] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:41.349143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97faa2a-ba0f-4ff9-8ed3-44f7a5f395bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:41.356087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03afe80-6510-4414-a569-7f18deafd16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:41.357141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03afe80-6510-4414-a569-7f18deafd16e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:41.357693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03afe80-6510-4414-a569-7f18deafd16e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:41.371723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03afe80-6510-4414-a569-7f18deafd16e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:41.373382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03afe80-6510-4414-a569-7f18deafd16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:41.376348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03afe80-6510-4414-a569-7f18deafd16e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:41.406197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1394/2758] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:41.409425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c6941-1b12-44ce-a902-98eb0a913814 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:41.424091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c6941-1b12-44ce-a902-98eb0a913814 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:41.430022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62016f8c-d67a-4180-bd26-03e9f3fec3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:41.431162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016f8c-d67a-4180-bd26-03e9f3fec3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:41.431663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016f8c-d67a-4180-bd26-03e9f3fec3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:41.432112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62016f8c-d67a-4180-bd26-03e9f3fec3e4 admin admin] PATH_INFO: `/v3/projects/e7324854ef8b4d86afec03b498ab9470/users/eb1e5ff3d50249519bd3f6d1d054737d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:41.435126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62016f8c-d67a-4180-bd26-03e9f3fec3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7324854ef8b4d86afec03b498ab9470, user_id=eb1e5ff3d50249519bd3f6d1d054737d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:41.438336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62016f8c-d67a-4180-bd26-03e9f3fec3e4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:41.457830 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1365/2759] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:31:41 2022] PUT /identity/v3/projects/e7324854ef8b4d86afec03b498ab9470/users/eb1e5ff3d50249519bd3f6d1d054737d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:31:41.470111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:41.470681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:41.471149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:41.522917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] MFA Rules not processed for user `eb1e5ff3d50249519bd3f6d1d054737d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:41.524956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:41.672587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1395/2760] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:41.674482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:41.674772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:41.675222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:41.740149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] MFA Rules not processed for user `2182a3c281364aa6b39832172235e711`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:41.744787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:41.829002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:41.832489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:41.847621 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1366/2761] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:41.901551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:41.905520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:42.059579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859c0e-e74c-4d03-a14b-29577c314a04 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:42.074551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dca9c2-fe06-4bb5-a2a2-e88d8e87e720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:42.075484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dca9c2-fe06-4bb5-a2a2-e88d8e87e720 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:42.075949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dca9c2-fe06-4bb5-a2a2-e88d8e87e720 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:42.076377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dca9c2-fe06-4bb5-a2a2-e88d8e87e720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:42.087312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4690bdb-3ceb-40e2-b4e8-b62d5bee67f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:42.095092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:42.096114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:42.096646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:42.097276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:42.121052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:42.123670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:42.141622 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1367/2762] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:31:42.232961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dca9c2-fe06-4bb5-a2a2-e88d8e87e720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:42.239271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dca9c2-fe06-4bb5-a2a2-e88d8e87e720 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:42.264580 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1396/2763] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:42.554867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:42.759112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:47.072506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:47.073970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:47.424920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55720d-7851-4963-a6aa-5753419a22e6 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:47.449390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:47.450026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:47.450404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:47.453527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:47.459889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:47.489663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:47.491602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:47.519854 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1368/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:50.448596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:50.449130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:50.449130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:50.484952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] MFA Rules not processed for user `cfb4fc39da53465d9bf6262a60b9c922`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:50.487148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:50.502917 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1397/2765] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:52.168587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:52.181957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b8831-8a5c-4077-a2c0-6081c469376f service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:52.192763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:52.193773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:52.194279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:52.194868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:52.197020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:52.213516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:52.215208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:52.258757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1369/2766] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:31:55.452425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:55.455119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:55.574203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251289-267f-437c-bc29-4e2fdf6abe0d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:55.579409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:55.580705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:55.582751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:55.583270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] PATH_INFO: `/v3/users/f6d59e6bbc724bd98b96a2e4458d1c4f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:55.584787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d59e6bbc724bd98b96a2e4458d1c4f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:55.587529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:55.836786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d59e6bbc724bd98b96a2e4458d1c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:55.847228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d59e6bbc724bd98b96a2e4458d1c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:55.847895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d59e6bbc724bd98b96a2e4458d1c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:55.896888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d59e6bbc724bd98b96a2e4458d1c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:56.019731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8239a3e5-c196-4564-8d70-41c5cb8ec90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d59e6bbc724bd98b96a2e4458d1c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:56.041501 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1398/2767] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:31:55 2022] DELETE /identity/v3/users/f6d59e6bbc724bd98b96a2e4458d1c4f => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:56.652201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:56.671122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb844adc-b3a2-44e7-b53c-ada7223597cc service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:56.826245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:56.827383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:56.827851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:56.828300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] PATH_INFO: `/v3/projects/ec257d037b37472bb8a1b779fa39bb91` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:56.829771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec257d037b37472bb8a1b779fa39bb91)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:56.832004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:56.962882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:56.997382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec257d037b37472bb8a1b779fa39bb91', 'request_id': 'req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:57.016468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec257d037b37472bb8a1b779fa39bb91', 'request_id': 'req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:57.172842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec257d037b37472bb8a1b779fa39bb91', 'request_id': 'req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:57.218419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] The token cache is being invalidate because project ec257d037b37472bb8a1b779fa39bb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:31:57.218719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:57.222654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9942ef2a-25a3-4b13-843d-44ea25c3d0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:31:57.225391 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1370/2768] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:31:56 2022] DELETE /identity/v3/projects/ec257d037b37472bb8a1b779fa39bb91 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:57.230404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b614-7915-4e42-a663-a2e436707b00 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:57.230938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b614-7915-4e42-a663-a2e436707b00 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:57.230938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b614-7915-4e42-a663-a2e436707b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:57.261774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7246b614-7915-4e42-a663-a2e436707b00 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:57.265769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7246b614-7915-4e42-a663-a2e436707b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:57.353879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:57.365985 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1399/2769] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:31:57.375659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44616-6925-4490-86fa-06cac16ca96c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:57.376340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44616-6925-4490-86fa-06cac16ca96c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:57.376954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b44616-6925-4490-86fa-06cac16ca96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:57.416038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5b44616-6925-4490-86fa-06cac16ca96c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:57.418021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5b44616-6925-4490-86fa-06cac16ca96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:57.446549 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1371/2770] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:57.450699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b614-7915-4e42-a663-a2e436707b00 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:57.473528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b614-7915-4e42-a663-a2e436707b00 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:57.487904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:57.489113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:57.490888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:57.491875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:57.494047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:31:57.501012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:57.501012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:57.533871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44616-6925-4490-86fa-06cac16ca96c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:57.537035 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1400/2771] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:31:57.558681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b44616-6925-4490-86fa-06cac16ca96c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:57.572129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:57.572768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:57.573048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:57.573402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:57.573955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:57.578371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:57.743649 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1372/2772] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:31:57 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:31:57.748374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:57.764437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36257581-270d-4684-9ad3-d2129fdd3b33 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:57.894247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:57.895019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:57.895383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:57.895610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:57.896215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:57.898276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:58.032979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:58.042917 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1401/2773] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:31:57 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:31:58.049837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353d183-3e7c-4dcd-a5fc-6806b899f789 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:58.057895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:58.059932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:58.061051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:58.061888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:58.063522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:58.066022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:58.093172 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1373/2774] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:58.093395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:58.108552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364def31-462b-42a1-b4a3-7adf69be9290 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:58.135196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73349bb-9f4f-4430-86af-f8ee9d483c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:58.136000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73349bb-9f4f-4430-86af-f8ee9d483c1e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:58.136102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73349bb-9f4f-4430-86af-f8ee9d483c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:58.136368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73349bb-9f4f-4430-86af-f8ee9d483c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:58.137043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73349bb-9f4f-4430-86af-f8ee9d483c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:58.138731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73349bb-9f4f-4430-86af-f8ee9d483c1e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:58.178818 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1402/2775] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:31:58.181393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:58.204823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffb9e2-51a5-449b-a3f9-705c27f2a19b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:58.218500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:58.219443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:58.219734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:58.220012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] PATH_INFO: `/v3/projects/ec92fae78dea4886be2b6988e6eb1edb/users/1d5d823540f041a283fe2c9b283514d1/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:58.259186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec92fae78dea4886be2b6988e6eb1edb, user_id=1d5d823540f041a283fe2c9b283514d1, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:58.266353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:58.365073 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1374/2776] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:31:58 2022] PUT /identity/v3/projects/ec92fae78dea4886be2b6988e6eb1edb/users/1d5d823540f041a283fe2c9b283514d1/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:31:58.371827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:58.372379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:58.372379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:58.423749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:31:58.425428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:58.568035 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1403/2777] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:31:58.585285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:31:58.588765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:31:58.722802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb3d35-722d-4d9b-a69f-cb4baa5ca0a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:31:58.731447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:31:58.732158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:31:58.732565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:31:58.733727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:31:58.764332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:31:58.780578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:31:58.820125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1375/2778] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:04.502826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:04.504540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:04.529324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc0db-6aa5-47f3-8126-059763738ab0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:04.541161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:04.545913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:04.566514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:04.572462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] PATH_INFO: `/v3/users/fa4ca05a0c6a405f8fa014ee06dbcef4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:04.581143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4ca05a0c6a405f8fa014ee06dbcef4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:04.605131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:05.007880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4ca05a0c6a405f8fa014ee06dbcef4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:05.038329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4ca05a0c6a405f8fa014ee06dbcef4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:05.040249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4ca05a0c6a405f8fa014ee06dbcef4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:05.043295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:05.067557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4ca05a0c6a405f8fa014ee06dbcef4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:05.199424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4ca05a0c6a405f8fa014ee06dbcef4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:05.206695 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1404/2779] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:04 2022] DELETE /identity/v3/users/fa4ca05a0c6a405f8fa014ee06dbcef4 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:05.801528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:05.812453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b6597-e01d-4441-9aa0-bdf464ec9399 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:05.952110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:05.990934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:05.992477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:05.992775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:05.995787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] PATH_INFO: `/v3/projects/5d09f371e0a64ff99d885489a5ca3bd2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:05.997596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d09f371e0a64ff99d885489a5ca3bd2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:05.999572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:06.203461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d09f371e0a64ff99d885489a5ca3bd2', 'request_id': 'req-d2090785-25ad-4e82-87db-6e74ec43be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.220957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d09f371e0a64ff99d885489a5ca3bd2', 'request_id': 'req-d2090785-25ad-4e82-87db-6e74ec43be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.370358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d09f371e0a64ff99d885489a5ca3bd2', 'request_id': 'req-d2090785-25ad-4e82-87db-6e74ec43be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.386883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] The token cache is being invalidate because project 5d09f371e0a64ff99d885489a5ca3bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:06.387840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.388668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.393892 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1376/2780] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:05 2022] DELETE /identity/v3/projects/5d09f371e0a64ff99d885489a5ca3bd2 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:06.395050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:06.396703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:06.430334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45572-ceba-47f7-aa61-69e6dddefe6c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:06.597142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:06.598568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:06.599663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:06.600733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] PATH_INFO: `/v3/users/7900e8079145470dbbac1334b0009f71` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:06.604925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7900e8079145470dbbac1334b0009f71)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:06.607903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:06.836902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7900e8079145470dbbac1334b0009f71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.845743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7900e8079145470dbbac1334b0009f71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.847043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7900e8079145470dbbac1334b0009f71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.868016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7900e8079145470dbbac1334b0009f71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.975109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec61e98c-c9ce-4259-982e-dfd8d7f6e0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7900e8079145470dbbac1334b0009f71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:06.987635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1405/2781] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:06 2022] DELETE /identity/v3/users/7900e8079145470dbbac1334b0009f71 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:08.267975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:08.270217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:08.297435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090785-25ad-4e82-87db-6e74ec43be0b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:08.393360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:08.394087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:08.394374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:08.394835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] PATH_INFO: `/v3/projects/0db9f9b02869488dafd14b6d5c3e1ff7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:08.397266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db9f9b02869488dafd14b6d5c3e1ff7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:08.404021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:08.626020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db9f9b02869488dafd14b6d5c3e1ff7', 'request_id': 'req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:08.641823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db9f9b02869488dafd14b6d5c3e1ff7', 'request_id': 'req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:08.776780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db9f9b02869488dafd14b6d5c3e1ff7', 'request_id': 'req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:08.794331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] The token cache is being invalidate because project 0db9f9b02869488dafd14b6d5c3e1ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:08.794855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:08.795987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7c2e33fe-61b6-4c81-bebd-47e4ceb48b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:08.801976 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1377/2782] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:08 2022] DELETE /identity/v3/projects/0db9f9b02869488dafd14b6d5c3e1ff7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:08.803045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443b54-990c-4602-bb1c-ebc7c555c106 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:08.803508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443b54-990c-4602-bb1c-ebc7c555c106 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:08.803892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443b54-990c-4602-bb1c-ebc7c555c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:08.864674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-41443b54-990c-4602-bb1c-ebc7c555c106 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:08.869053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-41443b54-990c-4602-bb1c-ebc7c555c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:09.010237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:09.054413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67b98-6063-4fcf-b562-d3623254bb8e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.054749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67b98-6063-4fcf-b562-d3623254bb8e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.055162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f67b98-6063-4fcf-b562-d3623254bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.060950 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1406/2783] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:32:09.110541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10f67b98-6063-4fcf-b562-d3623254bb8e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:09.114935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10f67b98-6063-4fcf-b562-d3623254bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:09.148198 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1378/2784] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:09.151804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41443b54-990c-4602-bb1c-ebc7c555c106 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:09.164828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41443b54-990c-4602-bb1c-ebc7c555c106 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:09.173060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:09.185081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.186035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.186585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.187716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:09.188245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:09.205745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:09.267207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67b98-6063-4fcf-b562-d3623254bb8e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:09.275674 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1407/2785] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:09.278804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f67b98-6063-4fcf-b562-d3623254bb8e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:09.285837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:09.290205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.290205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.290205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.290205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:09.292283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:09.300390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:09.429321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:09.442731 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1379/2786] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:09 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:32:09.446834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae240c80-98e3-484a-8947-e4a3975ef6d3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:09.564788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:09.566807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.566807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.566807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.567085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:09.568909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:09.671016 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1408/2787] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:09 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:09.674763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:09.686977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6953ad-457b-45d2-9fdc-a5034827d08f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:09.692947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:09.693553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.697213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.697779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.698679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:09.700731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:09.716116 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1380/2788] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:09.717657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:09.729777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370c33-0ee5-454a-98f1-8021d447b62b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:09.739361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda5b62-77b9-420e-b095-acdfeaf570e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:09.740708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda5b62-77b9-420e-b095-acdfeaf570e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.741201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda5b62-77b9-420e-b095-acdfeaf570e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.742732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda5b62-77b9-420e-b095-acdfeaf570e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.743659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda5b62-77b9-420e-b095-acdfeaf570e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:09.746603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda5b62-77b9-420e-b095-acdfeaf570e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:09.767015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1409/2789] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:09.771053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:09.796222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ada3b-8004-4902-8dfe-46d09d3a494c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:09.807688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:09.808721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.809193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.809664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] PATH_INFO: `/v3/projects/4af2a9605ecb4e2ea0e769af6f99bc67/users/51c4f9265dc04dbea091459bf5452d4d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.832517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af2a9605ecb4e2ea0e769af6f99bc67, user_id=51c4f9265dc04dbea091459bf5452d4d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:09.837350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:09.916782 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1381/2790] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:09 2022] PUT /identity/v3/projects/4af2a9605ecb4e2ea0e769af6f99bc67/users/51c4f9265dc04dbea091459bf5452d4d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:09.927489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9aa53-ae16-4c8d-912d-99b260ec1ac3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:09.927985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9aa53-ae16-4c8d-912d-99b260ec1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:09.928098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9aa53-ae16-4c8d-912d-99b260ec1ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:09.986591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-96f9aa53-ae16-4c8d-912d-99b260ec1ac3 None None] MFA Rules not processed for user `51c4f9265dc04dbea091459bf5452d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:09.988180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-96f9aa53-ae16-4c8d-912d-99b260ec1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:10.104114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1410/2791] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:10.104592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:10.268022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbee5fc-1154-4a6a-83b9-157079233991 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:10.275841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:10.276800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:10.277220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:10.277509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:10.278261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:10.281956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:10.442088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9aa53-ae16-4c8d-912d-99b260ec1ac3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:10.458306 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1382/2792] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:10 2022] POST /identity/v3/projects => generated 375 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:10.461190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9aa53-ae16-4c8d-912d-99b260ec1ac3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:10.583611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:10.600226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:10.603805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:10.603805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:10.603805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:10.603805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:10.604375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:10.726305 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1411/2793] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:10 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:10.730276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:10.749581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a72496-d59b-4580-bab1-43454e967e77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:10.765107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:10.767265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:10.767575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:10.767853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:10.769227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:10.771618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:10.800403 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1383/2794] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:10.805195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:10.821887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b116a-b8dd-4c1c-a920-9408a58c0a77 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:10.840520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:10.842719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:10.843093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:10.844980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] PATH_INFO: `/v3/projects/09cae37710d140a686e9335dd6ea67c7/users/bb0531a4b1874b309d5162f2a8a741c2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:10.881030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cae37710d140a686e9335dd6ea67c7, user_id=bb0531a4b1874b309d5162f2a8a741c2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:10.885043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:10.978635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1412/2795] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:10 2022] PUT /identity/v3/projects/09cae37710d140a686e9335dd6ea67c7/users/bb0531a4b1874b309d5162f2a8a741c2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:10.982253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:10.995223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231728-8660-4a05-a356-d63f69c4d528 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:11.094425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784f94d-6172-4932-8b52-9adc83ed30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:11.094717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784f94d-6172-4932-8b52-9adc83ed30c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:11.095302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784f94d-6172-4932-8b52-9adc83ed30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:11.095518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784f94d-6172-4932-8b52-9adc83ed30c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:11.096388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784f94d-6172-4932-8b52-9adc83ed30c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:11.100566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784f94d-6172-4932-8b52-9adc83ed30c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:11.121542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:11.121990 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1384/2796] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:11.136594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a38b6-0dca-40b3-9293-095c37f2c71b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:11.148322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:11.150265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:11.155952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:11.170501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] PATH_INFO: `/v3/projects/09cae37710d140a686e9335dd6ea67c7/users/bb0531a4b1874b309d5162f2a8a741c2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:11.179210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cae37710d140a686e9335dd6ea67c7, user_id=bb0531a4b1874b309d5162f2a8a741c2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:11.183627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:11.218115 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1413/2797] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:11 2022] PUT /identity/v3/projects/09cae37710d140a686e9335dd6ea67c7/users/bb0531a4b1874b309d5162f2a8a741c2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:11.228612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad8b7-d39d-4592-b905-12be1bf3591d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:11.234168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad8b7-d39d-4592-b905-12be1bf3591d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:11.234168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad8b7-d39d-4592-b905-12be1bf3591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:11.306781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-df1ad8b7-d39d-4592-b905-12be1bf3591d None None] MFA Rules not processed for user `bb0531a4b1874b309d5162f2a8a741c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:11.314707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df1ad8b7-d39d-4592-b905-12be1bf3591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:11.347433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:11.481968 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1385/2798] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:11.482458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:11.505310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0114d8-2645-41de-836f-52ca1dfdd816 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:11.516387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:11.520476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:11.520476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:11.520476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:11.520476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:11.520476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:11.530943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:11.570863 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1414/2799] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:11.576513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad8b7-d39d-4592-b905-12be1bf3591d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:11.590954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad8b7-d39d-4592-b905-12be1bf3591d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:11.603576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:11.603576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:11.603576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:11.604015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:11.604739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:11.607347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:11.731695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:11.739729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1386/2800] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:11 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:11.755830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39924b-2478-4450-8500-852cb685480a tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:11.886723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d53bc-22a4-40d9-8e85-29f2a18f0ef8 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:11.888952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d53bc-22a4-40d9-8e85-29f2a18f0ef8 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:11.889317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d53bc-22a4-40d9-8e85-29f2a18f0ef8 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:11.890411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d53bc-22a4-40d9-8e85-29f2a18f0ef8 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:11.893470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d53bc-22a4-40d9-8e85-29f2a18f0ef8 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:11.893801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d53bc-22a4-40d9-8e85-29f2a18f0ef8 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:11.896512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d53bc-22a4-40d9-8e85-29f2a18f0ef8 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:11.930946 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1415/2801] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:12.515047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:12.516854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:12.839689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8a4a7-e1df-4882-aefb-ba3a624e7554 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:12.849577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:12.851861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:12.851861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:12.851861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:12.864660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:12.869785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:12.893131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1387/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:12.905653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fdedd-47ce-44ca-887d-7467ff909419 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:12.906587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fdedd-47ce-44ca-887d-7467ff909419 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:12.907055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fdedd-47ce-44ca-887d-7467ff909419 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:12.908648 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1416/2803] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:12.916144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:12.930294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:12.941258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d079b-8aca-4c01-b312-b8731c6d79fa service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:12.948563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:12.950773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:12.951083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:12.954256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/projects/46d64b8e42bb4469bd2c382192a531b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:12.955535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:get_project(project_id=46d64b8e42bb4469bd2c382192a531b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:12.958033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:12.984727 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1388/2804] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:12 2022] GET /identity/v3/projects/46d64b8e42bb4469bd2c382192a531b9 => generated 371 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:14.276233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1f55-589b-4d67-9af4-38b75baaf3e5 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:14.276698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1f55-589b-4d67-9af4-38b75baaf3e5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:14.276808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1f55-589b-4d67-9af4-38b75baaf3e5 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:14.278330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1417/2805] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:14.292478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:14.294380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:14.316052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:14.342954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223d074-c534-48a6-9024-9f268dd8dc9c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:14.356252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:14.357393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:14.357675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:14.357948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/projects/46d64b8e42bb4469bd2c382192a531b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:14.361049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:get_project(project_id=46d64b8e42bb4469bd2c382192a531b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:14.363093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:14.388727 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1389/2806] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:14 2022] GET /identity/v3/projects/46d64b8e42bb4469bd2c382192a531b9 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:14.438545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e1f55-589b-4d67-9af4-38b75baaf3e5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:14.472385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e1f55-589b-4d67-9af4-38b75baaf3e5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:14.478444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:14.479078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:14.479366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:14.479649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:14.480308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:14.480820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:14.482759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:14.511799 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1418/2807] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:14.515759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:14.535338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3295d-17bf-4e46-82fe-d1546ba4f7ff tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:14.546391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a144627-59c1-4602-92f2-240ebebc2d8c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:14.546391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a144627-59c1-4602-92f2-240ebebc2d8c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:14.546391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a144627-59c1-4602-92f2-240ebebc2d8c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:14.546930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a144627-59c1-4602-92f2-240ebebc2d8c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:14.546930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a144627-59c1-4602-92f2-240ebebc2d8c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:14.564178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a144627-59c1-4602-92f2-240ebebc2d8c tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:14.739874 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1390/2808] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:14 2022] POST /identity/v3/users => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:14.745729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:14.761372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56fac-c6e6-4043-af7e-014d91c77ccc tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:14.777194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c263ce-394b-4af1-8869-d36cd85f8333 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:14.786156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c263ce-394b-4af1-8869-d36cd85f8333 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:14.786156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c263ce-394b-4af1-8869-d36cd85f8333 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:14.786156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c263ce-394b-4af1-8869-d36cd85f8333 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:14.786156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c263ce-394b-4af1-8869-d36cd85f8333 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:14.786156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c263ce-394b-4af1-8869-d36cd85f8333 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:14.792041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c263ce-394b-4af1-8869-d36cd85f8333 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:14.815326 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1419/2809] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:15.206289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931acf82-6345-4eb7-9e31-cdbc7d956c95 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:15.207267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931acf82-6345-4eb7-9e31-cdbc7d956c95 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:15.208417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931acf82-6345-4eb7-9e31-cdbc7d956c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:15.285031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:15.296638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c23c7-edaf-4d10-b62a-9ef4615f7bf7 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:15.297569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c23c7-edaf-4d10-b62a-9ef4615f7bf7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:15.298013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c23c7-edaf-4d10-b62a-9ef4615f7bf7 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:15.299974 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1420/2810] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:15.305913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c23c7-edaf-4d10-b62a-9ef4615f7bf7 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:15.319216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-931acf82-6345-4eb7-9e31-cdbc7d956c95 None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:15.321091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-931acf82-6345-4eb7-9e31-cdbc7d956c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:15.327560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c23c7-edaf-4d10-b62a-9ef4615f7bf7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:15.363290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c23c7-edaf-4d10-b62a-9ef4615f7bf7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:15.380331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c8fa1-ac45-4952-8d6b-db363b0c59ac tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:15.381458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8fa1-ac45-4952-8d6b-db363b0c59ac tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:15.381838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8fa1-ac45-4952-8d6b-db363b0c59ac tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:15.382397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c8fa1-ac45-4952-8d6b-db363b0c59ac tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/projects/46d64b8e42bb4469bd2c382192a531b9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:15.387800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c8fa1-ac45-4952-8d6b-db363b0c59ac tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:get_project(project_id=46d64b8e42bb4469bd2c382192a531b9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:15.390703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c8fa1-ac45-4952-8d6b-db363b0c59ac tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:15.397201 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1421/2811] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:15 2022] GET /identity/v3/projects/46d64b8e42bb4469bd2c382192a531b9 => generated 371 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:32:15.562174 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1391/2812] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:15.568671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cc89-71b2-4e65-b362-0a3cda6b5fad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:15.569162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cc89-71b2-4e65-b362-0a3cda6b5fad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:15.569446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81cc89-71b2-4e65-b362-0a3cda6b5fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:15.623341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6f81cc89-71b2-4e65-b362-0a3cda6b5fad None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:15.641106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6f81cc89-71b2-4e65-b362-0a3cda6b5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:15.650086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1422/2813] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:16.040170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931acf82-6345-4eb7-9e31-cdbc7d956c95 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:16.062672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931acf82-6345-4eb7-9e31-cdbc7d956c95 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:16.077010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:16.077653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:16.077939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:16.078442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:16.107486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:16.109125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:16.153955 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1392/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:16.625889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1183b5-889a-431b-9657-5526f890c416 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:16.626471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1183b5-889a-431b-9657-5526f890c416 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:16.626591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1183b5-889a-431b-9657-5526f890c416 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:16.628209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1423/2815] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:16.635929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:16.653000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:16.673436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a6db4-fd9c-4e35-b808-3e6c49cbf9e5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:16.680480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:16.682124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:16.682635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:16.683850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/projects/46d64b8e42bb4469bd2c382192a531b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:16.685396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:get_project(project_id=46d64b8e42bb4469bd2c382192a531b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:16.687916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:16.700797 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1393/2816] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:16 2022] GET /identity/v3/projects/46d64b8e42bb4469bd2c382192a531b9 => generated 371 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:16.733547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1183b5-889a-431b-9657-5526f890c416 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:16.754631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1183b5-889a-431b-9657-5526f890c416 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:16.772654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:16.775470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:16.776803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:16.777613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/users/811304cd440c42d4adb27c0607e40e68` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:16.812994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=811304cd440c42d4adb27c0607e40e68)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:16.816428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:16.953781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:17.000786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811304cd440c42d4adb27c0607e40e68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.021632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811304cd440c42d4adb27c0607e40e68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.024127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811304cd440c42d4adb27c0607e40e68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.057088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811304cd440c42d4adb27c0607e40e68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.158730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811304cd440c42d4adb27c0607e40e68'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.167511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1424/2817] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:16 2022] DELETE /identity/v3/users/811304cd440c42d4adb27c0607e40e68 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:17.170580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:17.173102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:17.213957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566519f-4a92-4bab-a0ad-a70975bd6378 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:17.405644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb0531a4b1874b309d5162f2a8a741c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '09cae37710d140a686e9335dd6ea67c7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:17.406596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:17.406882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:17.407097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] PATH_INFO: `/v3/projects/46d64b8e42bb4469bd2c382192a531b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:17.421156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=46d64b8e42bb4469bd2c382192a531b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:17.430511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:17.763162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d64b8e42bb4469bd2c382192a531b9', 'request_id': 'req-20c365e9-ed66-443b-ac92-d2810c0ef09e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.782565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d64b8e42bb4469bd2c382192a531b9', 'request_id': 'req-20c365e9-ed66-443b-ac92-d2810c0ef09e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.907799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d64b8e42bb4469bd2c382192a531b9', 'request_id': 'req-20c365e9-ed66-443b-ac92-d2810c0ef09e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.925815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] The token cache is being invalidate because project 46d64b8e42bb4469bd2c382192a531b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:17.927517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.931782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-20c365e9-ed66-443b-ac92-d2810c0ef09e tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:17.935037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1394/2818] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:17 2022] DELETE /identity/v3/projects/46d64b8e42bb4469bd2c382192a531b9 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:17.940354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:17.942117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:18.216569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972f1f-e821-4b0d-aa2e-039492ec1165 tempest-QuotasAdminTestV236-1598035094 tempest-QuotasAdminTestV236-1598035094-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:18.373853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:18.374397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:18.374706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:18.375963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] PATH_INFO: `/v3/users/51c4f9265dc04dbea091459bf5452d4d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:18.377472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c4f9265dc04dbea091459bf5452d4d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:18.380058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:18.776307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c4f9265dc04dbea091459bf5452d4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:18.784603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:18.787591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c4f9265dc04dbea091459bf5452d4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:18.789353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c4f9265dc04dbea091459bf5452d4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:18.813547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c4f9265dc04dbea091459bf5452d4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:18.925030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c4f9265dc04dbea091459bf5452d4d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:18.932593 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1425/2819] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:17 2022] DELETE /identity/v3/users/51c4f9265dc04dbea091459bf5452d4d => generated 0 bytes in 993 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:18.937870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:18.938416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:18.938769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:18.983519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:19.016972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:19.021015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:19.125062 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1395/2820] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:19.132457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:19.134268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:19.139168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:19.141373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:19.161040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6af50-c63a-463d-bf61-bfe1ddd680a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:19.178334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:19.179091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:19.179478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:19.179827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] PATH_INFO: `/v3/users/2182a3c281364aa6b39832172235e711` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:19.181107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2182a3c281364aa6b39832172235e711)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:19.183179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:19.270528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6e58-b63e-4884-a2ee-b3202a7c4cfc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:19.277499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e2330-d4ba-4e3f-947d-c67b486feade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:19.278443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e2330-d4ba-4e3f-947d-c67b486feade service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:19.278757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e2330-d4ba-4e3f-947d-c67b486feade service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:19.278757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e2330-d4ba-4e3f-947d-c67b486feade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:19.321103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e2330-d4ba-4e3f-947d-c67b486feade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:19.322618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e2330-d4ba-4e3f-947d-c67b486feade service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:19.368158 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1396/2821] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:19.916316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2182a3c281364aa6b39832172235e711'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:19.935237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2182a3c281364aa6b39832172235e711'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:19.937298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2182a3c281364aa6b39832172235e711'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:19.978802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2182a3c281364aa6b39832172235e711'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:20.090369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2182a3c281364aa6b39832172235e711'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:20.111571 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1426/2822] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:19 2022] DELETE /identity/v3/users/2182a3c281364aa6b39832172235e711 => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:20.116176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:20.117628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:20.117797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:20.185419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:20.185780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:20.296467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:20.306261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:20.414771 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1397/2823] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:20.453398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:20.455274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:20.475410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2fa63-4f11-4e11-8622-6ec79fbf65e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:20.504873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:20.506223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:20.506635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:20.509664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] PATH_INFO: `/v3/projects/4af2a9605ecb4e2ea0e769af6f99bc67` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:20.516427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af2a9605ecb4e2ea0e769af6f99bc67)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:20.520943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:20.659126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08955ed1-11a7-4509-bdb7-701577dd1374 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:20.669704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:20.670371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:20.670651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:20.670921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:20.692130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:20.693808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:20.704261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af2a9605ecb4e2ea0e769af6f99bc67', 'request_id': 'req-987be0c3-fd4f-41ee-bad3-5b2327cee699'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:20.716031 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1398/2824] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:20.720051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af2a9605ecb4e2ea0e769af6f99bc67', 'request_id': 'req-987be0c3-fd4f-41ee-bad3-5b2327cee699'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:20.833251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af2a9605ecb4e2ea0e769af6f99bc67', 'request_id': 'req-987be0c3-fd4f-41ee-bad3-5b2327cee699'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:20.862098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] The token cache is being invalidate because project 4af2a9605ecb4e2ea0e769af6f99bc67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:20.862560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:20.866304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:20.875383 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1427/2825] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:20 2022] DELETE /identity/v3/projects/4af2a9605ecb4e2ea0e769af6f99bc67 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:20.880803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:20.892915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb5cfe-fef0-4212-aea9-8dff3b195e51 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:21.063439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:21.064102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:21.064380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:21.064653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] PATH_INFO: `/v3/users/bb0531a4b1874b309d5162f2a8a741c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:21.072060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0531a4b1874b309d5162f2a8a741c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:21.072060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:21.395582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0531a4b1874b309d5162f2a8a741c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:21.397973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0531a4b1874b309d5162f2a8a741c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:21.511678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0531a4b1874b309d5162f2a8a741c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:21.513005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0531a4b1874b309d5162f2a8a741c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:21.536661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0531a4b1874b309d5162f2a8a741c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:21.610729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1399/2826] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:20 2022] DELETE /identity/v3/users/bb0531a4b1874b309d5162f2a8a741c2 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:21.673499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:21.913400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:22.133466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:22.134964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:22.156825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987be0c3-fd4f-41ee-bad3-5b2327cee699 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:22.314893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:22.315913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:22.316345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:22.317932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] PATH_INFO: `/v3/projects/38f95c7096d240c88053e9fb05fb9e3c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:22.320055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f95c7096d240c88053e9fb05fb9e3c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:22.322381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:22.500948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f95c7096d240c88053e9fb05fb9e3c', 'request_id': 'req-56499185-f104-4093-9962-98eb9a453c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:22.510732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f95c7096d240c88053e9fb05fb9e3c', 'request_id': 'req-56499185-f104-4093-9962-98eb9a453c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:22.611247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f95c7096d240c88053e9fb05fb9e3c', 'request_id': 'req-56499185-f104-4093-9962-98eb9a453c4f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:22.656555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] The token cache is being invalidate because project 38f95c7096d240c88053e9fb05fb9e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:22.659722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:22.664958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:22.669190 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1428/2827] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:22 2022] DELETE /identity/v3/projects/38f95c7096d240c88053e9fb05fb9e3c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:22.672715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:22.675844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:22.709855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9850b3-31c1-4a91-857d-88134e5e34ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:22.880160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:22.909320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:22.910392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:22.910782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:22.911984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] PATH_INFO: `/v3/users/eb1e5ff3d50249519bd3f6d1d054737d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:22.916567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1e5ff3d50249519bd3f6d1d054737d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:22.930837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:23.288081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1e5ff3d50249519bd3f6d1d054737d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.289967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1e5ff3d50249519bd3f6d1d054737d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.371084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:23.372710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:23.389484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56499185-f104-4093-9962-98eb9a453c4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:23.395868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:23.396859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:23.397453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:23.397913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] PATH_INFO: `/v3/projects/09cae37710d140a686e9335dd6ea67c7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:23.399948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cae37710d140a686e9335dd6ea67c7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:23.404122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1e5ff3d50249519bd3f6d1d054737d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.404122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1e5ff3d50249519bd3f6d1d054737d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.404559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:23.411495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47323354-1856-4a45-9ecd-88e60db2eb29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1e5ff3d50249519bd3f6d1d054737d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.502884 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1400/2828] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:22 2022] DELETE /identity/v3/users/eb1e5ff3d50249519bd3f6d1d054737d => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:23.566829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cae37710d140a686e9335dd6ea67c7', 'request_id': 'req-d3cb088d-6f0c-42f3-82ac-b9f01794da92'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.583424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cae37710d140a686e9335dd6ea67c7', 'request_id': 'req-d3cb088d-6f0c-42f3-82ac-b9f01794da92'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.588826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:23.671338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cae37710d140a686e9335dd6ea67c7', 'request_id': 'req-d3cb088d-6f0c-42f3-82ac-b9f01794da92'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.695345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] The token cache is being invalidate because project 09cae37710d140a686e9335dd6ea67c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:23.696639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.698369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3cb088d-6f0c-42f3-82ac-b9f01794da92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:23.702324 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1429/2829] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:23 2022] DELETE /identity/v3/projects/09cae37710d140a686e9335dd6ea67c7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:23.709166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43824c-ed92-4f2a-82af-9246a1695224 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:23.710361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43824c-ed92-4f2a-82af-9246a1695224 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:23.711454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43824c-ed92-4f2a-82af-9246a1695224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:23.813115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1e43824c-ed92-4f2a-82af-9246a1695224 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:23.813115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e43824c-ed92-4f2a-82af-9246a1695224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:24.007067 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1401/2830] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:24.009140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f596a-6505-4fe4-ad52-69fb08342563 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:24.009429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f596a-6505-4fe4-ad52-69fb08342563 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:24.009699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f596a-6505-4fe4-ad52-69fb08342563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:24.043277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-062f596a-6505-4fe4-ad52-69fb08342563 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:24.044780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-062f596a-6505-4fe4-ad52-69fb08342563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:24.073862 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1430/2831] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:24.073964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43824c-ed92-4f2a-82af-9246a1695224 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:24.087122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43824c-ed92-4f2a-82af-9246a1695224 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:24.093796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:24.094469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:24.094827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:24.095015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:24.096101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:24.096626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:24.098806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:24.113182 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1402/2832] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:24.123174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f596a-6505-4fe4-ad52-69fb08342563 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:24.136443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f596a-6505-4fe4-ad52-69fb08342563 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:24.141921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:24.143084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:24.143576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:24.144074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:24.144933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:24.149550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:24.343825 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1431/2833] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:24 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:24.349848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:24.362395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672058-df2f-4591-b46d-02b55f66f26b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:24.438649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:24.501203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:24.502692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:24.503043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:24.503387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:24.504104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:24.506308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:24.637706 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1403/2834] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:24 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:24.638976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:24.666595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c905e-fdf5-4f50-9ab8-e58930f302b4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:24.681642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:24.681642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:24.686016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:24.686517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:24.687226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:24.689431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:24.730518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1432/2835] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:24.732542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:24.757736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1cc63-391f-48f2-b0e9-b2e4b7869f86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:24.778365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc37d0-9e57-4fe7-b1a9-320fb099fe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:24.779006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc37d0-9e57-4fe7-b1a9-320fb099fe8b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:24.779288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc37d0-9e57-4fe7-b1a9-320fb099fe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:24.779562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc37d0-9e57-4fe7-b1a9-320fb099fe8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:24.780232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc37d0-9e57-4fe7-b1a9-320fb099fe8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:24.781888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc37d0-9e57-4fe7-b1a9-320fb099fe8b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:24.812861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:24.815325 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1404/2836] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:24.831506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc53eb7-ac41-4a06-a9fc-f12661844a3f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:24.843279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:24.843991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:24.844237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:24.844515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] PATH_INFO: `/v3/projects/25cba4d7b40f4c8faad54050ffc3ccd9/users/c8c83f50aa764d229f37b85f499edb95/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:24.881174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25cba4d7b40f4c8faad54050ffc3ccd9, user_id=c8c83f50aa764d229f37b85f499edb95, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:24.894307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:25.009159 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1433/2837] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:24 2022] PUT /identity/v3/projects/25cba4d7b40f4c8faad54050ffc3ccd9/users/c8c83f50aa764d229f37b85f499edb95/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:25.010094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:25.010824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:25.011315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:25.124705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] MFA Rules not processed for user `c8c83f50aa764d229f37b85f499edb95`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:25.134247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:25.272014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1405/2838] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:25.278422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:25.380964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17ec4-0034-4502-bc30-3379adcba6cf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:25.387726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:25.388612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:25.389996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:25.390546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:25.391409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:25.393818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:25.736988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:25.736988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:25.736988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0481-88d3-41ff-abf3-f1f93e4e9cda None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:25.739394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:25.739394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:25.739394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:25.739394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] PATH_INFO: `/v3/projects/e7324854ef8b4d86afec03b498ab9470` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:25.740383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7324854ef8b4d86afec03b498ab9470)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:25.740383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:25.742638 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1434/2839] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:25 2022] POST /identity/v3/projects => generated 373 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:25.742638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:25.742638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50ac47-8efd-43f1-8dfd-f33b1745d892 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:25.743396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7324854ef8b4d86afec03b498ab9470', 'request_id': 'req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:25.743396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7324854ef8b4d86afec03b498ab9470', 'request_id': 'req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:25.743603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:25.865712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:25.873162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:25.873162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:25.873162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:25.873162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:25.873162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:25.961977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7324854ef8b4d86afec03b498ab9470', 'request_id': 'req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:25.980637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] The token cache is being invalidate because project e7324854ef8b4d86afec03b498ab9470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:25.981106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:25.982042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6e2075cd-26c6-4bf6-b368-c6f5b2d153c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:25.983978 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1406/2840] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:25 2022] DELETE /identity/v3/projects/e7324854ef8b4d86afec03b498ab9470 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:25.988522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a62cc-527d-46b8-891f-9344ebd35d68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:25.988975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a62cc-527d-46b8-891f-9344ebd35d68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:25.989405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a62cc-527d-46b8-891f-9344ebd35d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.013571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7f2a62cc-527d-46b8-891f-9344ebd35d68 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:26.015110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f2a62cc-527d-46b8-891f-9344ebd35d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:26.025337 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1407/2841] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:26.036179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f58e50-d4b6-475a-9ee9-bdf43d3e9886 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.036476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f58e50-d4b6-475a-9ee9-bdf43d3e9886 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.036759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f58e50-d4b6-475a-9ee9-bdf43d3e9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.041482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1435/2842] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:25 2022] POST /identity/v3/users => generated 293 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:32:26.061279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-95f58e50-d4b6-475a-9ee9-bdf43d3e9886 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:26.061527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.063367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:26.063473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95f58e50-d4b6-475a-9ee9-bdf43d3e9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:26.078164 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1408/2843] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:26.079104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f58e50-d4b6-475a-9ee9-bdf43d3e9886 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.089130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f58e50-d4b6-475a-9ee9-bdf43d3e9886 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.094819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.095611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.096187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.097728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.098579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:26.099192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.101549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.102033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c5a3d-0dff-45c3-b6ad-2fac71921cc8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.114439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.117595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.118113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1409/2844] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:26.120445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.120445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.120445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.122218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.124004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.131889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:26.139370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac7e86-fe44-4d06-af6f-f790951822aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.155999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.157007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.157540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.158106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.159777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.160377 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1436/2845] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:26.161313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.166312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.183281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79342eb6-a759-45a6-8121-3601852482d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.200355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.204494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.204494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.204494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] PATH_INFO: `/v3/projects/167b8b66d5f046a0a9f031be02e5ab5e/users/cd344a22fb6840ddbb0749531fe60f24/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.231341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167b8b66d5f046a0a9f031be02e5ab5e, user_id=cd344a22fb6840ddbb0749531fe60f24, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.235844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.299799 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1410/2846] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:26 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:26.303913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.342989 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1437/2847] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:26 2022] PUT /identity/v3/projects/167b8b66d5f046a0a9f031be02e5ab5e/users/cd344a22fb6840ddbb0749531fe60f24/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:26.346746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.432044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370e3f-e607-4cf8-bdde-e6a930b50f54 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.500250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28b31a-56de-4ca8-8b49-d609dc51c661 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.516345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.517761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.518048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.518816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.519632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.521370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.535716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.536595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.536887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.538166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.538257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.540626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.545787 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1438/2848] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:26.549975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.565102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac9c8f-2773-40b4-9bac-d6784c4c71dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.570848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9cf85-cb0c-48e6-b880-445b660b8e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.571520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cf85-cb0c-48e6-b880-445b660b8e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.571844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cf85-cb0c-48e6-b880-445b660b8e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.572903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cf85-cb0c-48e6-b880-445b660b8e97 admin admin] PATH_INFO: `/v3/projects/167b8b66d5f046a0a9f031be02e5ab5e/users/cd344a22fb6840ddbb0749531fe60f24/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.574338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9cf85-cb0c-48e6-b880-445b660b8e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167b8b66d5f046a0a9f031be02e5ab5e, user_id=cd344a22fb6840ddbb0749531fe60f24, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.576993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9cf85-cb0c-48e6-b880-445b660b8e97 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.588875 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1439/2849] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:26 2022] PUT /identity/v3/projects/167b8b66d5f046a0a9f031be02e5ab5e/users/cd344a22fb6840ddbb0749531fe60f24/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:26.598938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1848c-c12a-4ff9-b2ca-6196344b7d00 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.599291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1848c-c12a-4ff9-b2ca-6196344b7d00 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.599856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1848c-c12a-4ff9-b2ca-6196344b7d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.653100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-def1848c-c12a-4ff9-b2ca-6196344b7d00 None None] MFA Rules not processed for user `cd344a22fb6840ddbb0749531fe60f24`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:26.658746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-def1848c-c12a-4ff9-b2ca-6196344b7d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:26.684831 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1411/2850] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:26 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:26.689995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.702348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6e7f3-46c4-4165-b686-4a3f091e3ce6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.744425 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1440/2851] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:32:26.751951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1848c-c12a-4ff9-b2ca-6196344b7d00 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.762321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1848c-c12a-4ff9-b2ca-6196344b7d00 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.777989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.779665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.780582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.781086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.782320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.784431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.785284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.785922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.786317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.786608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.787332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:26.787651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.789854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.809894 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1412/2852] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:26.814293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.832559 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1441/2853] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:32:26.836693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.839518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:26.846914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613da8d8-9a7c-442b-ac61-b067fd458e3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.850527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65a0c9-9c46-40aa-b3d1-b63065e17d6d tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.860461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.861637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.862545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.863112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.863549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.863969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.864678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.864833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.866130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.868066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.869226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.873759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.899278 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1413/2854] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:26.903416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:26.927397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e20531-7e06-407a-9ea5-a3009b75ac90 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:26.934015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75295174-705e-480e-a055-637503b552eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:26.943022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75295174-705e-480e-a055-637503b552eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:26.943556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75295174-705e-480e-a055-637503b552eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:26.944160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75295174-705e-480e-a055-637503b552eb admin admin] PATH_INFO: `/v3/projects/748285ba5df14278b813bddf805b0f2b/users/873c602253894da88809e4df2664c688/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:26.968916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75295174-705e-480e-a055-637503b552eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=748285ba5df14278b813bddf805b0f2b, user_id=873c602253894da88809e4df2664c688, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:26.973192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75295174-705e-480e-a055-637503b552eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:26.979400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:26.996805 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1442/2855] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:26 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:27.000482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:27.068412 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1414/2856] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:26 2022] PUT /identity/v3/projects/748285ba5df14278b813bddf805b0f2b/users/873c602253894da88809e4df2664c688/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:27.078535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a1ff-1cb0-44f7-8c6a-893aafa5ceb3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.079056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a1ff-1cb0-44f7-8c6a-893aafa5ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.079492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a1ff-1cb0-44f7-8c6a-893aafa5ceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.141920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3884f58-8863-41ab-a935-e969dabad716 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:27.148830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2868a1ff-1cb0-44f7-8c6a-893aafa5ceb3 None None] MFA Rules not processed for user `873c602253894da88809e4df2664c688`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:27.150091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2868a1ff-1cb0-44f7-8c6a-893aafa5ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:27.239790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:27.239790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.239790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.240266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.240266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:27.240266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:27.248589 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1415/2857] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:32:27.248589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.248589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.248589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.250642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:27.264968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1443/2858] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:27.264968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:27.283540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] MFA Rules not processed for user `c3bebd1e839f467e981fa5b8d5228ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:27.285087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:27.352066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:27.401534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a669e8-a63a-4961-99aa-82a081d7082a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:27.406483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:27.407108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.408577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.408577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.408577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:27.410686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:27.417765 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1416/2859] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:27.417765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:27.417765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:27.532394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbe03e-bf69-4fd1-ab6f-14ed9b0f8b1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:27.540510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da767a6d-db07-4014-b150-0034e89d5fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:27.541239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767a6d-db07-4014-b150-0034e89d5fce service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.541574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767a6d-db07-4014-b150-0034e89d5fce service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.545843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767a6d-db07-4014-b150-0034e89d5fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.550478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1444/2860] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:27 2022] POST /identity/v3/projects => generated 393 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:27.553157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:27.553278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da767a6d-db07-4014-b150-0034e89d5fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:27.553821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da767a6d-db07-4014-b150-0034e89d5fce service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:27.558512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:27.566694 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1417/2861] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:27.591111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c126e-1358-4937-abf1-a1ca09eac445 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.591285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c126e-1358-4937-abf1-a1ca09eac445 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.593403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c126e-1358-4937-abf1-a1ca09eac445 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.593403 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1418/2862] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:27.600922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c126e-1358-4937-abf1-a1ca09eac445 None None] Authenticating service token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:27.684671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1fcd5-418a-4c45-85fc-3f4e9f2585b4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:27.692630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:27.693831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.694441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.695440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.696340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:27.698613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c126e-1358-4937-abf1-a1ca09eac445 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:27.699819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:27.773839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c126e-1358-4937-abf1-a1ca09eac445 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:27.778837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:27.779600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.779927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.780233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/projects/b4958181912a4bffa35b302d42988659` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.781427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4958181912a4bffa35b302d42988659)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:27.783584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:27.785426 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1419/2863] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:27 2022] GET /identity/v3/projects/b4958181912a4bffa35b302d42988659 => generated 371 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:32:27.827650 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1445/2864] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:27 2022] POST /identity/v3/users => generated 303 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:27.832567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:27.848674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40703-1a01-48d3-9f47-c96583936096 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:27.855080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:27.860444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.860444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.860444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.860444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:27.860444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:27.872062 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1420/2865] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:27.876160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:27.887428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8627-c368-4ae6-9d60-a647123c5c32 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:27.892297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:27.894993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:27.894993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:27.894993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] PATH_INFO: `/v3/projects/9c2f795a3bc94c41a2321ec055331ec3/users/3c382d351ca340848b459676a41d0596/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:27.908969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2f795a3bc94c41a2321ec055331ec3, user_id=3c382d351ca340848b459676a41d0596, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:27.911746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.047763 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1446/2866] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:27 2022] PUT /identity/v3/projects/9c2f795a3bc94c41a2321ec055331ec3/users/3c382d351ca340848b459676a41d0596/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:28.048877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:28.060325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711bbd2-5180-49eb-a56e-b091e9cd6a00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:28.168627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed09b40-4c7d-49bd-a0a6-e7f2b850a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:28.169060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed09b40-4c7d-49bd-a0a6-e7f2b850a04a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.169280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed09b40-4c7d-49bd-a0a6-e7f2b850a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.169556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed09b40-4c7d-49bd-a0a6-e7f2b850a04a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.170249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed09b40-4c7d-49bd-a0a6-e7f2b850a04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:28.172013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed09b40-4c7d-49bd-a0a6-e7f2b850a04a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.183537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1421/2867] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:28.189314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:28.202517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12ce6-c46c-4072-900a-511824c5634c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:28.207577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e792a-3c59-4a4e-9a15-4ddf84ca6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:28.208308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e792a-3c59-4a4e-9a15-4ddf84ca6972 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.209354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e792a-3c59-4a4e-9a15-4ddf84ca6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.209354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e792a-3c59-4a4e-9a15-4ddf84ca6972 admin admin] PATH_INFO: `/v3/projects/9c2f795a3bc94c41a2321ec055331ec3/users/3c382d351ca340848b459676a41d0596/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.211432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e792a-3c59-4a4e-9a15-4ddf84ca6972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2f795a3bc94c41a2321ec055331ec3, user_id=3c382d351ca340848b459676a41d0596, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:28.214466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e792a-3c59-4a4e-9a15-4ddf84ca6972 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.228511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1447/2868] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:28 2022] PUT /identity/v3/projects/9c2f795a3bc94c41a2321ec055331ec3/users/3c382d351ca340848b459676a41d0596/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:28.239820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea84e9-69b5-4778-85bb-347c3e931a4a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.240172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea84e9-69b5-4778-85bb-347c3e931a4a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.240496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea84e9-69b5-4778-85bb-347c3e931a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.290009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aeea84e9-69b5-4778-85bb-347c3e931a4a None None] MFA Rules not processed for user `3c382d351ca340848b459676a41d0596`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:28.290009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aeea84e9-69b5-4778-85bb-347c3e931a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:28.313838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3268-bb8b-4b1c-bb0b-87fc2ae98342 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.314229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3268-bb8b-4b1c-bb0b-87fc2ae98342 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.315095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3268-bb8b-4b1c-bb0b-87fc2ae98342 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.316912 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1448/2869] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:28.324103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3268-bb8b-4b1c-bb0b-87fc2ae98342 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:28.378086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1422/2870] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:28.436743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3268-bb8b-4b1c-bb0b-87fc2ae98342 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:28.446507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10c18-56e5-48b0-be12-3b9b0025505a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.446824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10c18-56e5-48b0-be12-3b9b0025505a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.447063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e10c18-56e5-48b0-be12-3b9b0025505a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.457884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:28.484785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7e10c18-56e5-48b0-be12-3b9b0025505a None None] MFA Rules not processed for user `873c602253894da88809e4df2664c688`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:28.486086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7e10c18-56e5-48b0-be12-3b9b0025505a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:28.537362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3268-bb8b-4b1c-bb0b-87fc2ae98342 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:28.543649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:28.544307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.544898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.545183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/projects/b4958181912a4bffa35b302d42988659` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.546945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4958181912a4bffa35b302d42988659)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:28.549335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.555540 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1449/2871] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:28 2022] GET /identity/v3/projects/b4958181912a4bffa35b302d42988659 => generated 371 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:32:28.573975 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1423/2872] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:32:28.604846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:28.618302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:28.628417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241963a-2418-4f5a-92b2-9ce7de524ea4 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:28.635601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:28.636377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.636802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.637382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.638274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:28.640642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:28.642465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.664216 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1450/2873] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:28.667823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10c18-56e5-48b0-be12-3b9b0025505a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:28.679252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e10c18-56e5-48b0-be12-3b9b0025505a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:28.684074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537adcc6-0923-4e9f-83a3-88c0248cc289 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:28.684693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537adcc6-0923-4e9f-83a3-88c0248cc289 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.685007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537adcc6-0923-4e9f-83a3-88c0248cc289 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.685311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537adcc6-0923-4e9f-83a3-88c0248cc289 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.685970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537adcc6-0923-4e9f-83a3-88c0248cc289 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:28.687924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537adcc6-0923-4e9f-83a3-88c0248cc289 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.725602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:28.725602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:28.743049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca44ec3-8d1a-48d4-bdf6-0c473dd4eef5 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:28.750474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:28.751176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.751450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.751720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.759902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:28.761649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.773826 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1451/2874] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:32:28.817284 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1424/2875] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:28 2022] POST /identity/v3/users => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:28.821679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:28.837249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d559f8-5c56-435e-a4b8-2d00b3c364fb service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:28.842731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:28.843407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.843756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.844097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.844869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:28.845257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:28.847054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:28.861925 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1452/2876] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:28.989399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d1fb-c215-4f73-9f91-b61928c8200d None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:28.989722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d1fb-c215-4f73-9f91-b61928c8200d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:28.990000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d1fb-c215-4f73-9f91-b61928c8200d None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:28.992538 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1425/2877] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:29.012256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:29.029188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:29.039234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6df5-89c6-4fe6-a70f-3169f01ebb78 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:29.050161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:29.050903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:29.051321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:29.051600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/projects/b4958181912a4bffa35b302d42988659` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:29.052756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4958181912a4bffa35b302d42988659)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:29.054889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:29.056904 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1453/2878] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:29 2022] GET /identity/v3/projects/b4958181912a4bffa35b302d42988659 => generated 371 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:29.419797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7b6a-35d5-4acc-b2ae-285c5dbef780 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:29.420104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7b6a-35d5-4acc-b2ae-285c5dbef780 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:29.420377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7b6a-35d5-4acc-b2ae-285c5dbef780 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:29.422254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1426/2879] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:32:29.427363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:32:29.456603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:29.476349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a573dd8-f156-497d-97f7-c58ed9e9830a tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:29.488360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:29.488823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:29.489089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:29.489371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/projects/b4958181912a4bffa35b302d42988659` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:29.493496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:get_project(project_id=b4958181912a4bffa35b302d42988659)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:29.495617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:29.497353 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1454/2880] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:32:29 2022] GET /identity/v3/projects/b4958181912a4bffa35b302d42988659 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:29.535259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7b6a-35d5-4acc-b2ae-285c5dbef780 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:29.557297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7b6a-35d5-4acc-b2ae-285c5dbef780 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:29.579923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:29.580793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:29.581079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:29.581419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/users/5f7128b87ff04026a88b24c813ac2c74` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:29.611008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5f7128b87ff04026a88b24c813ac2c74)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:29.612970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:29.801487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7128b87ff04026a88b24c813ac2c74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:29.802209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7128b87ff04026a88b24c813ac2c74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:29.964397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7128b87ff04026a88b24c813ac2c74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:29.980762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7128b87ff04026a88b24c813ac2c74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:29.987255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7128b87ff04026a88b24c813ac2c74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.000895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:30.009186 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1427/2881] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:29 2022] DELETE /identity/v3/users/5f7128b87ff04026a88b24c813ac2c74 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:30.018844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:30.020747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:30.033809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64bea-a57f-4fc6-a8f0-de05115f9172 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:30.105582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd344a22fb6840ddbb0749531fe60f24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '167b8b66d5f046a0a9f031be02e5ab5e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:30.106381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:30.106688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:30.107009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] PATH_INFO: `/v3/projects/b4958181912a4bffa35b302d42988659` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:30.108289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4958181912a4bffa35b302d42988659)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:30.110621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:30.274988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4958181912a4bffa35b302d42988659', 'request_id': 'req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.283734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4958181912a4bffa35b302d42988659', 'request_id': 'req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.376013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4958181912a4bffa35b302d42988659', 'request_id': 'req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.377535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:30.388339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] The token cache is being invalidate because project b4958181912a4bffa35b302d42988659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:30.388658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.389262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-13668a7b-a9a3-4b6f-b1e5-a0fc36311d52 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.390820 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1455/2882] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:30 2022] DELETE /identity/v3/projects/b4958181912a4bffa35b302d42988659 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:30.396385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:30.397929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:30.465191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6d9f4-0fd4-41a0-8b64-5c4a08e2a220 tempest-QuotasAdminTestV257-715662081 tempest-QuotasAdminTestV257-715662081-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:30.531289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:30.531963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:30.532234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:30.532510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] PATH_INFO: `/v3/users/c8c83f50aa764d229f37b85f499edb95` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:30.533714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c83f50aa764d229f37b85f499edb95)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:30.535790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:30.857224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c83f50aa764d229f37b85f499edb95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.858391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c83f50aa764d229f37b85f499edb95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.965074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c83f50aa764d229f37b85f499edb95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.966204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c83f50aa764d229f37b85f499edb95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.974217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c83f50aa764d229f37b85f499edb95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:30.994916 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1428/2883] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:30 2022] DELETE /identity/v3/users/c8c83f50aa764d229f37b85f499edb95 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:30.999858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:31.000231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:31.000637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:31.022416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:31.022416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:31.027589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:31.029015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:31.085172 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1456/2884] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:31.095483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:31.096830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:31.099427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6401e3-2309-4b28-b7eb-a43e11372eb7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:31.105997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:31.106703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:31.106981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:31.107251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] PATH_INFO: `/v3/users/d54a9109295b426ba1060c63bfb230ed` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:31.108388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54a9109295b426ba1060c63bfb230ed)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:31.110334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:31.155689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c817dc-c774-4587-bf2e-5db797243f16 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:31.159713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb77b-4771-4962-b29e-bab4908ee6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:31.160326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb77b-4771-4962-b29e-bab4908ee6fa service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:31.160604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb77b-4771-4962-b29e-bab4908ee6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:31.160940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb77b-4771-4962-b29e-bab4908ee6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:31.171144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb77b-4771-4962-b29e-bab4908ee6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:31.172508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb77b-4771-4962-b29e-bab4908ee6fa service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:31.182600 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1457/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:31.396923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54a9109295b426ba1060c63bfb230ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:31.397602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54a9109295b426ba1060c63bfb230ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:31.526672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54a9109295b426ba1060c63bfb230ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:31.528720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54a9109295b426ba1060c63bfb230ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:31.544876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54a9109295b426ba1060c63bfb230ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:31.582357 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1429/2886] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:31 2022] DELETE /identity/v3/users/d54a9109295b426ba1060c63bfb230ed => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:31.587625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:31.587933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:31.588212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:31.617806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:31.619075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:31.718195 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1458/2887] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:31.730157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:31.730157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:31.806141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a2c63-9d79-417d-a6d6-773f7cbd5095 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:31.811563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:31.812218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:31.812496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:31.812769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:31.826919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:31.830384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:31.856265 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1430/2888] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:31.889987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:31.889987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:31.915036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58362-f724-4417-a8aa-6072443e96b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:31.920326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:31.921546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:31.921546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:31.921730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] PATH_INFO: `/v3/projects/25cba4d7b40f4c8faad54050ffc3ccd9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:31.922813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25cba4d7b40f4c8faad54050ffc3ccd9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:31.924738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:32.164044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25cba4d7b40f4c8faad54050ffc3ccd9', 'request_id': 'req-ed134570-28fe-409d-944a-8ed32d2b1b1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.173956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25cba4d7b40f4c8faad54050ffc3ccd9', 'request_id': 'req-ed134570-28fe-409d-944a-8ed32d2b1b1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.311614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25cba4d7b40f4c8faad54050ffc3ccd9', 'request_id': 'req-ed134570-28fe-409d-944a-8ed32d2b1b1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.332260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] The token cache is being invalidate because project 25cba4d7b40f4c8faad54050ffc3ccd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:32.332260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.332890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.335366 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1459/2889] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:31 2022] DELETE /identity/v3/projects/25cba4d7b40f4c8faad54050ffc3ccd9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:32.339205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:32.355927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9ab9e-42c0-4c70-b7c4-b2ca82423062 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:32.431531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:32.433581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:32.436914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:32.438647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:32.439079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:32.439695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] PATH_INFO: `/v3/users/cd344a22fb6840ddbb0749531fe60f24` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:32.442095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd344a22fb6840ddbb0749531fe60f24)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:32.445140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:32.480991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed134570-28fe-409d-944a-8ed32d2b1b1d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:32.491550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:32.494269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:32.494714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:32.495139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] PATH_INFO: `/v3/projects/cb1d59a6188a4b2fb67e6eba8f64d79f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:32.496770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1d59a6188a4b2fb67e6eba8f64d79f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:32.499047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:32.736221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd344a22fb6840ddbb0749531fe60f24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.737128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd344a22fb6840ddbb0749531fe60f24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.739226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'request_id': 'req-326c2a9c-450a-4685-82f6-312e1001cf6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.747279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'request_id': 'req-326c2a9c-450a-4685-82f6-312e1001cf6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.868692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd344a22fb6840ddbb0749531fe60f24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.874619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:32.879962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd344a22fb6840ddbb0749531fe60f24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.890572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd344a22fb6840ddbb0749531fe60f24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:32.932881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1431/2890] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:32 2022] DELETE /identity/v3/users/cd344a22fb6840ddbb0749531fe60f24 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:33.027671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1d59a6188a4b2fb67e6eba8f64d79f', 'request_id': 'req-326c2a9c-450a-4685-82f6-312e1001cf6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.041392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] The token cache is being invalidate because project cb1d59a6188a4b2fb67e6eba8f64d79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:33.041941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.043982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.048400 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1460/2891] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:32 2022] DELETE /identity/v3/projects/cb1d59a6188a4b2fb67e6eba8f64d79f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:33.051547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:33.052999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:33.137677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2a75-5efb-46ab-a8c2-2a2c6cec6c3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:33.147527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:33.148232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:33.148514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:33.148794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] PATH_INFO: `/v3/users/2d772301c5174f2fb6907315d9576589` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:33.151328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d772301c5174f2fb6907315d9576589)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:33.153627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:33.592937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d772301c5174f2fb6907315d9576589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.593979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d772301c5174f2fb6907315d9576589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.729933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d772301c5174f2fb6907315d9576589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.730985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d772301c5174f2fb6907315d9576589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.747955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d772301c5174f2fb6907315d9576589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:33.809916 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1432/2892] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:33 2022] DELETE /identity/v3/users/2d772301c5174f2fb6907315d9576589 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:34.101759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:34.552708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:34.554793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:34.630437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:34.633282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:34.713259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c2a9c-450a-4685-82f6-312e1001cf6b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:34.777315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166579-3680-4987-ae02-618aa28378f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:34.791181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:34.792607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:34.793366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:34.794097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] PATH_INFO: `/v3/projects/167b8b66d5f046a0a9f031be02e5ab5e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:34.795598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167b8b66d5f046a0a9f031be02e5ab5e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:34.799889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:34.898732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbff59-0360-4182-8005-915177786366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:34.899526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbff59-0360-4182-8005-915177786366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:34.899811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbff59-0360-4182-8005-915177786366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:34.900080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbff59-0360-4182-8005-915177786366 admin admin] PATH_INFO: `/v3/projects/c360dd76b1bf4dd891944860b13849cd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:34.902414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbff59-0360-4182-8005-915177786366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c360dd76b1bf4dd891944860b13849cd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:34.904408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbff59-0360-4182-8005-915177786366 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:34.964008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167b8b66d5f046a0a9f031be02e5ab5e', 'request_id': 'req-326b3d97-6675-442c-851b-558d9cea8820'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:34.972004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167b8b66d5f046a0a9f031be02e5ab5e', 'request_id': 'req-326b3d97-6675-442c-851b-558d9cea8820'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.057634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167b8b66d5f046a0a9f031be02e5ab5e', 'request_id': 'req-326b3d97-6675-442c-851b-558d9cea8820'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.072676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] The token cache is being invalidate because project 167b8b66d5f046a0a9f031be02e5ab5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:35.073725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.074694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-326b3d97-6675-442c-851b-558d9cea8820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.077229 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1433/2893] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:34 2022] DELETE /identity/v3/projects/167b8b66d5f046a0a9f031be02e5ab5e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:35.083526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba466-295f-4b69-9ba5-241ca353def2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.084665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba466-295f-4b69-9ba5-241ca353def2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.085082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba466-295f-4b69-9ba5-241ca353def2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.105197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bffbff59-0360-4182-8005-915177786366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c360dd76b1bf4dd891944860b13849cd', 'request_id': 'req-bffbff59-0360-4182-8005-915177786366'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.114271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bffbff59-0360-4182-8005-915177786366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c360dd76b1bf4dd891944860b13849cd', 'request_id': 'req-bffbff59-0360-4182-8005-915177786366'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.115259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f7dba466-295f-4b69-9ba5-241ca353def2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:35.117786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7dba466-295f-4b69-9ba5-241ca353def2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:35.194275 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1434/2894] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:35.203416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673948f0-d146-4674-b06b-86ca41466bdf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.203982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673948f0-d146-4674-b06b-86ca41466bdf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.204469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673948f0-d146-4674-b06b-86ca41466bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.204927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bffbff59-0360-4182-8005-915177786366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c360dd76b1bf4dd891944860b13849cd', 'request_id': 'req-bffbff59-0360-4182-8005-915177786366'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.232859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-673948f0-d146-4674-b06b-86ca41466bdf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:35.235515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-673948f0-d146-4674-b06b-86ca41466bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:35.256826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1435/2895] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:35.258215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bffbff59-0360-4182-8005-915177786366 admin admin] The token cache is being invalidate because project c360dd76b1bf4dd891944860b13849cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:35.259698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bffbff59-0360-4182-8005-915177786366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.261583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673948f0-d146-4674-b06b-86ca41466bdf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.265889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bffbff59-0360-4182-8005-915177786366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:35.272066 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1461/2896] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:34 2022] DELETE /identity/v3/projects/c360dd76b1bf4dd891944860b13849cd => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:35.278238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.278622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.279003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.292271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673948f0-d146-4674-b06b-86ca41466bdf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.311137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaad4ac-2e60-4460-ac49-ba45c19a14fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.313263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad4ac-2e60-4460-ac49-ba45c19a14fb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.313263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad4ac-2e60-4460-ac49-ba45c19a14fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.313263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad4ac-2e60-4460-ac49-ba45c19a14fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.315266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaad4ac-2e60-4460-ac49-ba45c19a14fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:35.318588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaad4ac-2e60-4460-ac49-ba45c19a14fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.321375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaad4ac-2e60-4460-ac49-ba45c19a14fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.329273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:35.331089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:35.339816 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1462/2897] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:35.346353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1436/2898] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:35.347560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.349190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:35.356106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ab37d-180e-49c7-9e3b-8ca4e5a22c2c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.356292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ab37d-180e-49c7-9e3b-8ca4e5a22c2c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.359589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ab37d-180e-49c7-9e3b-8ca4e5a22c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.362700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056fbca-8e0c-4a6e-8580-bdec1031156f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.368023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.369140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.369140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.369478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.370254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.372264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.380898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3d8ab37d-180e-49c7-9e3b-8ca4e5a22c2c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:35.382195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d8ab37d-180e-49c7-9e3b-8ca4e5a22c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:35.392823 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1437/2899] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:35.396831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ab37d-180e-49c7-9e3b-8ca4e5a22c2c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.408253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ab37d-180e-49c7-9e3b-8ca4e5a22c2c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.417063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.417685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.417972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.418284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.419397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:35.419895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.422157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.439566 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1438/2900] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:32:35.444645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.457221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19ea74-83de-4c5e-a6a4-9f337be95d07 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.463912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.464740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.464740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.465559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.466500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.468714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.511110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1463/2901] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:35.515008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.568704 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1439/2902] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:35.573043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.621974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a88f-2063-4139-8212-0b136fe60b64 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.677970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0af7c-09d2-484f-88aa-1c5ff641cb1f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.683917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.683917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.683917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.684180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.684739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.686845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.714163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.715123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.715595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.716352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.717377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.720137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.791232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:35.796959 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1440/2903] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:32:35.801024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.824500 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1464/2904] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:35 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:32:35.829188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.833642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0061b-f0eb-4731-9425-3c4e0023d3fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.854437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.855220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.855729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.856168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.856944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.859066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adbd64-c6da-4ec9-90c8-35ae827eddd3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.859338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.864966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.865813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.866141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.866420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.867399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.870127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.871837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1441/2905] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:35.877155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.892743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565f24c-50a2-46a6-8ff6-df6ce13c5e37 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.899766 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1465/2906] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:35.900311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.903060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.903596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.905122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.907199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.909810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:35.910705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.915827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.915937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e0d8d-004c-46e4-9234-0a5ee401eb7a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.938295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.938973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.939250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.940406 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1442/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:35.940676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.941417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.941518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.948412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.953964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41f131-5a79-4b60-a90d-ab3f928b74db admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:35.962237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55393e55-4118-46b3-a954-9b23a6347efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:35.962920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55393e55-4118-46b3-a954-9b23a6347efb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:35.963213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55393e55-4118-46b3-a954-9b23a6347efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:35.963492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55393e55-4118-46b3-a954-9b23a6347efb admin admin] PATH_INFO: `/v3/projects/d82cf578b2864ab381b613144be6b00b/users/d0e1b26675df4407a678af7ac54892fe/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:35.973248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1466/2908] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:35.987129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:35.991206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55393e55-4118-46b3-a954-9b23a6347efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82cf578b2864ab381b613144be6b00b, user_id=d0e1b26675df4407a678af7ac54892fe, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:35.995149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55393e55-4118-46b3-a954-9b23a6347efb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:35.999769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26c146-4e4c-40eb-bbf2-d6e990f5a720 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.005541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6ac19-3596-4d1f-ad94-17cba41a4b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.007750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6ac19-3596-4d1f-ad94-17cba41a4b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.007750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6ac19-3596-4d1f-ad94-17cba41a4b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.007750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6ac19-3596-4d1f-ad94-17cba41a4b2e admin admin] PATH_INFO: `/v3/projects/afca137bbbfd441f9afcc19b5833465c/users/e95f7902b8fb41c6b04a7e7a07a18130/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.036548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6ac19-3596-4d1f-ad94-17cba41a4b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=afca137bbbfd441f9afcc19b5833465c, user_id=e95f7902b8fb41c6b04a7e7a07a18130, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.041548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6ac19-3596-4d1f-ad94-17cba41a4b2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.082320 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1443/2909] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:35 2022] PUT /identity/v3/projects/d82cf578b2864ab381b613144be6b00b/users/d0e1b26675df4407a678af7ac54892fe/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:36.090404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d1184-9d1d-4d38-8e0b-b8929125fd30 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.090801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d1184-9d1d-4d38-8e0b-b8929125fd30 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.091153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d1184-9d1d-4d38-8e0b-b8929125fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.129027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dd7d1184-9d1d-4d38-8e0b-b8929125fd30 None None] MFA Rules not processed for user `d0e1b26675df4407a678af7ac54892fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:36.129549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd7d1184-9d1d-4d38-8e0b-b8929125fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:36.166949 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1467/2910] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:35 2022] PUT /identity/v3/projects/afca137bbbfd441f9afcc19b5833465c/users/e95f7902b8fb41c6b04a7e7a07a18130/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:36.180080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed664-ab86-4aa5-a72f-670146a6f503 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.181301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed664-ab86-4aa5-a72f-670146a6f503 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.187355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed664-ab86-4aa5-a72f-670146a6f503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.237266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef7ed664-ab86-4aa5-a72f-670146a6f503 None None] MFA Rules not processed for user `e95f7902b8fb41c6b04a7e7a07a18130`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:36.239026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef7ed664-ab86-4aa5-a72f-670146a6f503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:36.251753 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1444/2911] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:36.256520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d1184-9d1d-4d38-8e0b-b8929125fd30 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.374111 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1468/2912] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:36.377642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed664-ab86-4aa5-a72f-670146a6f503 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.430178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d1184-9d1d-4d38-8e0b-b8929125fd30 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.532265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.533219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.533565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.533727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed664-ab86-4aa5-a72f-670146a6f503 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.533971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.536396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.538977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.539636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.540044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.540497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.540859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.541508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.543592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.680680 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1469/2913] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:36 2022] POST /identity/v3/projects => generated 393 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:36.684538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.686221 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1445/2914] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:36 2022] POST /identity/v3/projects => generated 389 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:36.689585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.760811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7113233-33a2-4e47-8242-fa57e03b2121 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.765762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.766437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.766885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.767188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.767870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.769765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.770234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c42d75-135d-46f3-a6b7-0d8252138566 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.776171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.776338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.776618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.776898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.777540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.779679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.872738 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1446/2915] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:36 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:36.882133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.892649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c021a-7675-4a4a-97d8-be15b8574608 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.898900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.899525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.899804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.900114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.900728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.902602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.905674 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1470/2916] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:36 2022] POST /identity/v3/users => generated 303 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:36.909832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.915731 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1447/2917] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:36.920054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.923969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cae87-bd3c-4ccd-a745-c5729c9059b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.930443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.930443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.931296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.931296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.934984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.937065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ebff5-baed-4074-af82-02eacda5b60f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.937234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.943294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.944350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.944801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.945089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] PATH_INFO: `/v3/projects/f1cedb363dae46b2acec56e1b75fef31/users/3462419f57dc48ebbbc77d1c3956745d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.949950 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1471/2918] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:36.954272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:36.963893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cedb363dae46b2acec56e1b75fef31, user_id=3462419f57dc48ebbbc77d1c3956745d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.964882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8b714-dc35-4558-8d44-4b45481f740c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:36.967301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:36.969751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:36.970464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:36.970743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:36.971028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] PATH_INFO: `/v3/projects/046e1b7399b84063b14062881a0ac909/users/6b7fd59c441e4d5b9b0d81f58393aa57/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:36.987431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=046e1b7399b84063b14062881a0ac909, user_id=6b7fd59c441e4d5b9b0d81f58393aa57, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:36.990211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:37.055364 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1448/2919] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:36 2022] PUT /identity/v3/projects/f1cedb363dae46b2acec56e1b75fef31/users/3462419f57dc48ebbbc77d1c3956745d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:37.059307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:37.115717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1472/2920] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:36 2022] PUT /identity/v3/projects/046e1b7399b84063b14062881a0ac909/users/6b7fd59c441e4d5b9b0d81f58393aa57/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:37.121177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:37.139792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7411e6-8233-4de4-867c-65cad3b3d888 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:37.211023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2e09-d653-47c0-bf11-b097a553cb2f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:37.222272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:37.222949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.223228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.223501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.224153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:37.235533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:37.242421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:37.243214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.243561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.243935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.244649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:37.246956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:37.250809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1473/2921] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:37.251701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:37.264270 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1449/2922] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:37.275074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da5db-90fa-4e34-87c3-2861399b678e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:37.275074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5519e-d1ab-4d3b-a3ed-10afa6f31d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:37.275074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5519e-d1ab-4d3b-a3ed-10afa6f31d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.275074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5519e-d1ab-4d3b-a3ed-10afa6f31d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.275363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5519e-d1ab-4d3b-a3ed-10afa6f31d3c admin admin] PATH_INFO: `/v3/projects/046e1b7399b84063b14062881a0ac909/users/6b7fd59c441e4d5b9b0d81f58393aa57/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.275363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5519e-d1ab-4d3b-a3ed-10afa6f31d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=046e1b7399b84063b14062881a0ac909, user_id=6b7fd59c441e4d5b9b0d81f58393aa57, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:37.275363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5519e-d1ab-4d3b-a3ed-10afa6f31d3c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:37.278896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:37.294654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:37.295212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b523a-c5d1-4172-8bd2-0bc9d170cc2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:37.301508 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1474/2923] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:37 2022] PUT /identity/v3/projects/046e1b7399b84063b14062881a0ac909/users/6b7fd59c441e4d5b9b0d81f58393aa57/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:37.313458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef3db-0460-4cff-ac91-b003ad1afd54 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.314366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef3db-0460-4cff-ac91-b003ad1afd54 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.314366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ef3db-0460-4cff-ac91-b003ad1afd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.326103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:37.357789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eb9ef3db-0460-4cff-ac91-b003ad1afd54 None None] MFA Rules not processed for user `6b7fd59c441e4d5b9b0d81f58393aa57`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:37.359199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb9ef3db-0460-4cff-ac91-b003ad1afd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:37.372566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122d531-ded3-43e5-8c37-6a7676024a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:37.373557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122d531-ded3-43e5-8c37-6a7676024a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.373844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122d531-ded3-43e5-8c37-6a7676024a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.374186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122d531-ded3-43e5-8c37-6a7676024a35 admin admin] PATH_INFO: `/v3/projects/f1cedb363dae46b2acec56e1b75fef31/users/3462419f57dc48ebbbc77d1c3956745d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.376201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122d531-ded3-43e5-8c37-6a7676024a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cedb363dae46b2acec56e1b75fef31, user_id=3462419f57dc48ebbbc77d1c3956745d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:37.379145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122d531-ded3-43e5-8c37-6a7676024a35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:37.392967 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1450/2924] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:37 2022] PUT /identity/v3/projects/f1cedb363dae46b2acec56e1b75fef31/users/3462419f57dc48ebbbc77d1c3956745d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:37.404177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.404503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.404771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.437144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] MFA Rules not processed for user `3462419f57dc48ebbbc77d1c3956745d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:37.438573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:37.454893 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1475/2925] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:32:37.530795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1451/2926] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:32:37.546364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.546678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.551016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.570347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] MFA Rules not processed for user `d0e1b26675df4407a678af7ac54892fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:37.571735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:37.655448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1476/2927] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:37.844366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:37.845876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:37.927183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dd232-90c5-49e6-a8d9-96791b176da9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:37.933965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:37.934617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:37.934922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:37.935314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:37.997637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:37.999303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:38.008643 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1452/2928] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:38.061797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:38.063360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:38.080375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628822f-f79d-4b66-8141-1bed759003c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:38.088130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:38.089006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:38.089569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:38.093973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:38.101791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:38.103807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:38.118250 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1477/2929] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:38.576955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:38.644538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:39.185521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:39.189921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:39.203036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5114-39e8-4e47-8c1c-79a7242798fa service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:39.209277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297770cd-95b9-4389-89f0-3ec5051061c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:39.209891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297770cd-95b9-4389-89f0-3ec5051061c7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:39.210230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297770cd-95b9-4389-89f0-3ec5051061c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:39.210499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297770cd-95b9-4389-89f0-3ec5051061c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:39.269897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297770cd-95b9-4389-89f0-3ec5051061c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:39.271518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297770cd-95b9-4389-89f0-3ec5051061c7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:39.281202 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1453/2930] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:39.306958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:39.381176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10005d-5e0c-46d5-97fb-9f4d60da12fb service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:39.386680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:39.387319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:39.387595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:39.387865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] PATH_INFO: `/v3/users/e95f7902b8fb41c6b04a7e7a07a18130` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:39.395507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95f7902b8fb41c6b04a7e7a07a18130)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:39.395507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:39.647311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95f7902b8fb41c6b04a7e7a07a18130'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:39.654729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95f7902b8fb41c6b04a7e7a07a18130'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:39.655428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95f7902b8fb41c6b04a7e7a07a18130'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:39.662270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:39.671314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95f7902b8fb41c6b04a7e7a07a18130'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:39.844293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95f7902b8fb41c6b04a7e7a07a18130'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:39.852068 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1478/2931] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:39 2022] DELETE /identity/v3/users/e95f7902b8fb41c6b04a7e7a07a18130 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:39.856472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:39.857069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:39.857485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:39.892918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:39.894280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:39.994581 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1454/2932] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:40.019431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:40.024516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:40.060164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:40.103998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c94c-9c41-4445-bfc2-ab45a762982b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:40.114720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:40.114720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:40.114987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:40.115411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:40.133797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:40.135462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:40.149479 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1479/2933] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:40.648744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:40.651024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:40.663984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ee71d-81f1-43a4-97e2-0ee8b74e2c02 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:40.668868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:40.669745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:40.670125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:40.670469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] PATH_INFO: `/v3/projects/afca137bbbfd441f9afcc19b5833465c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:40.671803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afca137bbbfd441f9afcc19b5833465c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:40.673790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:40.717381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:40.799152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afca137bbbfd441f9afcc19b5833465c', 'request_id': 'req-38d8cca8-897f-49ea-ab1e-3efa48c26735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:40.806218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afca137bbbfd441f9afcc19b5833465c', 'request_id': 'req-38d8cca8-897f-49ea-ab1e-3efa48c26735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:40.872666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afca137bbbfd441f9afcc19b5833465c', 'request_id': 'req-38d8cca8-897f-49ea-ab1e-3efa48c26735'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:40.884632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] The token cache is being invalidate because project afca137bbbfd441f9afcc19b5833465c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:40.884979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:40.885680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:40.887293 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1455/2934] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:40 2022] DELETE /identity/v3/projects/afca137bbbfd441f9afcc19b5833465c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:40.891336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:40.901301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a76937-0444-4d9a-9925-f950db96db8c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:40.964665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:40.965303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:40.965585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:40.965860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] PATH_INFO: `/v3/users/6b7fd59c441e4d5b9b0d81f58393aa57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:40.967094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7fd59c441e4d5b9b0d81f58393aa57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:40.969017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:41.193077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7fd59c441e4d5b9b0d81f58393aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:41.200867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7fd59c441e4d5b9b0d81f58393aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:41.202102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7fd59c441e4d5b9b0d81f58393aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:41.218735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7fd59c441e4d5b9b0d81f58393aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:41.312492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-58924a4b-5f09-4dc9-a2ee-d3bdcf65efb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7fd59c441e4d5b9b0d81f58393aa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:41.320673 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1480/2935] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:32:40 2022] DELETE /identity/v3/users/6b7fd59c441e4d5b9b0d81f58393aa57 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:41.650300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:41.861451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:41.863428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:41.892860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8cca8-897f-49ea-ab1e-3efa48c26735 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:41.964418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:41.965516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:41.965999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:41.966518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] PATH_INFO: `/v3/projects/046e1b7399b84063b14062881a0ac909` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:41.968150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] RBAC: Authorizing `identity:delete_project(project_id=046e1b7399b84063b14062881a0ac909)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:41.970579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:42.136131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046e1b7399b84063b14062881a0ac909', 'request_id': 'req-c76372a4-226f-4fc4-8aca-d5812282971c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:42.143726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046e1b7399b84063b14062881a0ac909', 'request_id': 'req-c76372a4-226f-4fc4-8aca-d5812282971c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:42.288648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046e1b7399b84063b14062881a0ac909', 'request_id': 'req-c76372a4-226f-4fc4-8aca-d5812282971c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:42.307146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] The token cache is being invalidate because project 046e1b7399b84063b14062881a0ac909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:32:42.307725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:42.315569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c76372a4-226f-4fc4-8aca-d5812282971c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:32:42.317485 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1456/2936] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:32:41 2022] DELETE /identity/v3/projects/046e1b7399b84063b14062881a0ac909 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:32:42.324640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457b864-51aa-4f1c-b23b-bc5816927bf1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:42.325260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457b864-51aa-4f1c-b23b-bc5816927bf1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:42.325867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457b864-51aa-4f1c-b23b-bc5816927bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:42.387245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0457b864-51aa-4f1c-b23b-bc5816927bf1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:42.389818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0457b864-51aa-4f1c-b23b-bc5816927bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:42.397598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:42.419285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:42.559976 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1481/2937] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:42.570737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623ece-23a6-4b1e-90d5-8291478f356f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:42.570737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623ece-23a6-4b1e-90d5-8291478f356f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:42.572589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a623ece-23a6-4b1e-90d5-8291478f356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:42.625010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4a623ece-23a6-4b1e-90d5-8291478f356f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:42.630278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a623ece-23a6-4b1e-90d5-8291478f356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:42.663041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1457/2938] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:42.667969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457b864-51aa-4f1c-b23b-bc5816927bf1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:42.681767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457b864-51aa-4f1c-b23b-bc5816927bf1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:42.700980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:42.701618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:42.701902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:42.702209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:42.702878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:32:42.703181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:42.710806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:42.753464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:42.759978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a623ece-23a6-4b1e-90d5-8291478f356f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:42.766649 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1482/2939] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:32:42.771546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a623ece-23a6-4b1e-90d5-8291478f356f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:42.787059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:42.787962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:42.788410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:42.788864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:42.789668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:42.793527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:42.961263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1458/2940] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:32:42 2022] POST /identity/v3/projects => generated 393 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:32:42.972257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:42.983440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270173-378a-4a1b-9494-fa468161b306 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:43.146149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:43.147092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:43.148642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:43.149103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:43.151117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:43.157803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:43.267209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1483/2941] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:32:42 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:32:43.271278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:43.285049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2736-aedc-4d52-a133-9ea651b4a299 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:43.297683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:43.298711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:43.299382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:43.299850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:43.303251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:43.308154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:43.322307 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1459/2942] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:32:43.326020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:43.337859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60f656-833c-41e2-a8b1-813bb557d4c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:43.343934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea746ac9-f7ac-4c3e-87c7-c7d41ba6a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:43.344837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746ac9-f7ac-4c3e-87c7-c7d41ba6a6dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:43.345337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746ac9-f7ac-4c3e-87c7-c7d41ba6a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:43.345807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea746ac9-f7ac-4c3e-87c7-c7d41ba6a6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:43.346702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea746ac9-f7ac-4c3e-87c7-c7d41ba6a6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:43.349005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea746ac9-f7ac-4c3e-87c7-c7d41ba6a6dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:43.364359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1484/2943] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:32:43.369441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:43.383564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573516ec-65a8-4a05-b946-070ec1d36386 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:43.396369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:43.397317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:43.397910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:43.400543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] PATH_INFO: `/v3/projects/963d4b082d364d08a0d20f49f2085f1b/users/04584b0879e6499285f815007b4e8e1b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:43.439824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=963d4b082d364d08a0d20f49f2085f1b, user_id=04584b0879e6499285f815007b4e8e1b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:43.458628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:43.582289 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1460/2944] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:32:43 2022] PUT /identity/v3/projects/963d4b082d364d08a0d20f49f2085f1b/users/04584b0879e6499285f815007b4e8e1b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:32:43.587745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada92bc-b903-40b4-a463-5df2fcc863fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:43.587942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada92bc-b903-40b4-a463-5df2fcc863fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:43.590123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada92bc-b903-40b4-a463-5df2fcc863fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:43.618635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ada92bc-b903-40b4-a463-5df2fcc863fe None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:43.618635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ada92bc-b903-40b4-a463-5df2fcc863fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:43.765044 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1485/2945] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:43.839392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:43.843577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:44.017245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3ca92-8d94-4998-bd51-302a3380ce36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:44.022298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:44.023799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:44.024229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:44.024635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:44.035912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:44.037647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:44.049775 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1461/2946] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:44.198842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b78290-dfc6-48ae-ba0d-d856a4716db0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:44.199133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b78290-dfc6-48ae-ba0d-d856a4716db0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:44.199414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b78290-dfc6-48ae-ba0d-d856a4716db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:44.234522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-66b78290-dfc6-48ae-ba0d-d856a4716db0 None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:44.235746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66b78290-dfc6-48ae-ba0d-d856a4716db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:44.259438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:44.353770 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1486/2947] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:47.134135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:47.135508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:47.162119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:47.291432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3cfe-2715-40d4-b829-56ee0460059e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:47.312282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f3e75-47f2-437d-ab43-eb9c8f010a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:47.315412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f3e75-47f2-437d-ab43-eb9c8f010a6d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:47.315945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f3e75-47f2-437d-ab43-eb9c8f010a6d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:47.318453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f3e75-47f2-437d-ab43-eb9c8f010a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:47.323336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d8f3e75-47f2-437d-ab43-eb9c8f010a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:47.446154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f3e75-47f2-437d-ab43-eb9c8f010a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:47.467256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f3e75-47f2-437d-ab43-eb9c8f010a6d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:47.518008 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1462/2948] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:55.283999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=18 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:55.862631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b78290-dfc6-48ae-ba0d-d856a4716db0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:55.877496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b78290-dfc6-48ae-ba0d-d856a4716db0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:55.884639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb91788-d9c0-429e-b9b6-06a7ade10e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:55.885430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb91788-d9c0-429e-b9b6-06a7ade10e12 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:55.885855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb91788-d9c0-429e-b9b6-06a7ade10e12 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:55.886299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb91788-d9c0-429e-b9b6-06a7ade10e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:55.888282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2fb91788-d9c0-429e-b9b6-06a7ade10e12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:55.962522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb91788-d9c0-429e-b9b6-06a7ade10e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:55.964117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb91788-d9c0-429e-b9b6-06a7ade10e12 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:55.989881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1487/2949] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:56.017100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455eec-0e9e-4517-a559-d004c8c725ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:56.017559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455eec-0e9e-4517-a559-d004c8c725ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:56.017733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455eec-0e9e-4517-a559-d004c8c725ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:56.264338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3c455eec-0e9e-4517-a559-d004c8c725ac None None] MFA Rules not processed for user `873c602253894da88809e4df2664c688`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:56.267553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c455eec-0e9e-4517-a559-d004c8c725ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:56.385812 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1463/2950] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:57.654637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:57.655059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:57.655233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:57.722288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] MFA Rules not processed for user `04584b0879e6499285f815007b4e8e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:57.723779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:57.890101 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1488/2951] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:57.896679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b0c0a-0f7d-4d9e-b3c6-bba5548bf70c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:57.897749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b0c0a-0f7d-4d9e-b3c6-bba5548bf70c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:57.897836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b0c0a-0f7d-4d9e-b3c6-bba5548bf70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:57.934570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b04b0c0a-0f7d-4d9e-b3c6-bba5548bf70c None None] MFA Rules not processed for user `04584b0879e6499285f815007b4e8e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:32:57.970861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b04b0c0a-0f7d-4d9e-b3c6-bba5548bf70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:57.987228 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1464/2952] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:32:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:32:58.591759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:32:58.593238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:32:58.629910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34be35-26d3-4c38-8914-215dc774d142 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:32:58.644621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc05927-edca-4d95-90a8-5c148e0224bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:32:58.645302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc05927-edca-4d95-90a8-5c148e0224bf service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:32:58.645592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc05927-edca-4d95-90a8-5c148e0224bf service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:32:58.645897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc05927-edca-4d95-90a8-5c148e0224bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:32:58.665864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc05927-edca-4d95-90a8-5c148e0224bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:32:58.668022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc05927-edca-4d95-90a8-5c148e0224bf service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:32:58.705159 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1489/2953] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:32:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:33:02.286949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:02.286949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:02.286949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:02.320414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] MFA Rules not processed for user `d5ed601492e2486bad8ba5b09515d52a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:02.321997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:02.386505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:02.421068 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1465/2954] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:08.680797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=68 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:12.696920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:24.373146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79156458-b2db-4cd4-b06d-888621fbf5f3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:24.374020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79156458-b2db-4cd4-b06d-888621fbf5f3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:24.374490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79156458-b2db-4cd4-b06d-888621fbf5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:24.431468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-79156458-b2db-4cd4-b06d-888621fbf5f3 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:24.432704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79156458-b2db-4cd4-b06d-888621fbf5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:24.581965 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1490/2955] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:33:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:24.790480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:24.791920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:24.943074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2e35-d200-4d36-8458-4d08e17ed44a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:24.951783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:24.952360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:24.952870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:24.954868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3008af-e888-47cf-9ebf-5a7226a4f794 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:24.955253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3008af-e888-47cf-9ebf-5a7226a4f794 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:24.955684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3008af-e888-47cf-9ebf-5a7226a4f794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:24.964198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:24.986871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:24.988766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:24.994278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ef3008af-e888-47cf-9ebf-5a7226a4f794 None None] MFA Rules not processed for user `04584b0879e6499285f815007b4e8e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:24.995674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ef3008af-e888-47cf-9ebf-5a7226a4f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:25.021151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1466/2956] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:25.046484 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1491/2957] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:29.941159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:29.945324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:29.976117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f860dc-457d-4ff0-b375-86418d2aa80d service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:29.983820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:29.984537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:29.985853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:29.997134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] PATH_INFO: `/v3/users/c3bebd1e839f467e981fa5b8d5228ce5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:29.997134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3bebd1e839f467e981fa5b8d5228ce5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:29.997134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:30.356278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bebd1e839f467e981fa5b8d5228ce5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:30.357680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bebd1e839f467e981fa5b8d5228ce5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:30.506603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bebd1e839f467e981fa5b8d5228ce5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:30.510409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bebd1e839f467e981fa5b8d5228ce5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:30.518957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a9a0c54d-edb2-4c13-b0b3-5afa8d6c73c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bebd1e839f467e981fa5b8d5228ce5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:30.565462 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1467/2958] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:33:29 2022] DELETE /identity/v3/users/c3bebd1e839f467e981fa5b8d5228ce5 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:33:31.313311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3008af-e888-47cf-9ebf-5a7226a4f794 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:31.328563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3008af-e888-47cf-9ebf-5a7226a4f794 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:31.411456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:31.412283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:31.412634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:31.412981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] PATH_INFO: `/v3/projects/4f11662f8c8f4d15bce1b769946dff4e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:31.414277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f11662f8c8f4d15bce1b769946dff4e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:31.416319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:31.649215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f11662f8c8f4d15bce1b769946dff4e', 'request_id': 'req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:31.679770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f11662f8c8f4d15bce1b769946dff4e', 'request_id': 'req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:31.780105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f11662f8c8f4d15bce1b769946dff4e', 'request_id': 'req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:31.826291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] The token cache is being invalidate because project 4f11662f8c8f4d15bce1b769946dff4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:33:31.826599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:31.829885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d27a439-32ba-468b-bba2-cccf8c9e0b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:31.834484 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1492/2959] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:33:31 2022] DELETE /identity/v3/projects/4f11662f8c8f4d15bce1b769946dff4e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:33:31.838999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9984540-6004-4e12-9380-5b15fa3f0c47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:31.840339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9984540-6004-4e12-9380-5b15fa3f0c47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:31.840764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9984540-6004-4e12-9380-5b15fa3f0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:31.879506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9984540-6004-4e12-9380-5b15fa3f0c47 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:31.883859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9984540-6004-4e12-9380-5b15fa3f0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:31.959046 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1468/2960] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:31.966555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b178773-02b8-4f82-82ff-cef7de3c7fe3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:31.966922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b178773-02b8-4f82-82ff-cef7de3c7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:31.967335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b178773-02b8-4f82-82ff-cef7de3c7fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.001331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b178773-02b8-4f82-82ff-cef7de3c7fe3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:32.002674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b178773-02b8-4f82-82ff-cef7de3c7fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:32.018527 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1493/2961] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:32.019629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9984540-6004-4e12-9380-5b15fa3f0c47 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:32.025368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:32.031437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9984540-6004-4e12-9380-5b15fa3f0c47 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:32.047026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:32.047671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:32.047950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:32.048223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.048892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:33:32.049192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:32.050884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:32.077442 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1469/2962] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:33:32.082151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b178773-02b8-4f82-82ff-cef7de3c7fe3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:32.110351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b178773-02b8-4f82-82ff-cef7de3c7fe3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:32.128659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:32.129397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:32.131076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:32.131416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.132267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:32.134474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:32.164508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:32.336478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1494/2963] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:33:32 2022] POST /identity/v3/projects => generated 397 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:33:32.342044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:32.363264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651fc46-93d9-471a-a36e-26c507cb646d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:32.441983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:32.442971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:32.443414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:32.443868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.444721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:32.450091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:32.602687 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1470/2964] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:33:32 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:33:32.604165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:32.619722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3380c-cf3a-4d7b-a909-8f7828e45965 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:32.641820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:32.645459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:32.645459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:32.645459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.647231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:32.650863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:32.679658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1495/2965] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:33:32.683339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:32.698195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ca452-5479-443a-8ccd-15c9104ba2e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:32.710506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:32.714207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:32.714207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:32.714207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.714207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:32.721652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:32.737378 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1471/2966] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:33:32.741767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:32.760918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fec05c-e581-439b-a3c4-2050487abd67 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:32.766182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7d014-0ee6-4706-a650-a7ff47f2c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:32.766909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d014-0ee6-4706-a650-a7ff47f2c440 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:32.767871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d014-0ee6-4706-a650-a7ff47f2c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:32.768297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7d014-0ee6-4706-a650-a7ff47f2c440 admin admin] PATH_INFO: `/v3/projects/be4076eed4bf4278a4cbf18296bc66f8/users/2516c291f2ea471abedff1b8338c9ee4/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.790590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d014-0ee6-4706-a650-a7ff47f2c440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4076eed4bf4278a4cbf18296bc66f8, user_id=2516c291f2ea471abedff1b8338c9ee4, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:32.793660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7d014-0ee6-4706-a650-a7ff47f2c440 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:32.914621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:32.916981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:32.946134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df89094-7298-4340-b02b-2ff41da907f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:32.955248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:32.956060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:32.956472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:32.957009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] PATH_INFO: `/v3/users/873c602253894da88809e4df2664c688` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:32.958494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=873c602253894da88809e4df2664c688)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:32.961597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:33.056100 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1496/2967] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:33:32 2022] PUT /identity/v3/projects/be4076eed4bf4278a4cbf18296bc66f8/users/2516c291f2ea471abedff1b8338c9ee4/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:33:33.061200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:33.061689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:33.062255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:33.148439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:33.149683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:33.278801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873c602253894da88809e4df2664c688'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:33.282698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873c602253894da88809e4df2664c688'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:33.332759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1497/2968] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:33:33.347250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:33.350117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:33.407844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873c602253894da88809e4df2664c688'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:33.409900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873c602253894da88809e4df2664c688'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:33.418681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96e35db1-ff97-4e32-af36-5dc57f6b2fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873c602253894da88809e4df2664c688'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:33.460863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a83ee-5c78-4f53-9635-75e95b158187 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:33.472976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:33.473693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:33.474047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:33.475039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:33.488384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:33.491021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:33.497813 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1472/2969] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:33:32 2022] DELETE /identity/v3/users/873c602253894da88809e4df2664c688 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:33:33.504424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:33.504771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:33.506400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:33.512750 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1498/2970] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:33:33.549743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:33.551071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:33.616283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:33.682482 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1473/2971] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:33.759778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:33.770245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccef9ba-a7ba-4422-91fe-d4f6a4cd7997 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:33.861543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:33.862369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:33.862750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:33.863136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:33.875467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:33.877162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:33.900325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1499/2972] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:33:34.329986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:34.331729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:34.382496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff30023-d3bc-4e24-b419-4cbd1997ba6e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:34.400604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:34.401399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:34.401735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:34.402015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] PATH_INFO: `/v3/projects/748285ba5df14278b813bddf805b0f2b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:34.403225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=748285ba5df14278b813bddf805b0f2b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:34.405204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:34.611461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748285ba5df14278b813bddf805b0f2b', 'request_id': 'req-6039519d-a61d-4f25-af99-c51f137cab5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:34.637454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748285ba5df14278b813bddf805b0f2b', 'request_id': 'req-6039519d-a61d-4f25-af99-c51f137cab5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:34.837384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748285ba5df14278b813bddf805b0f2b', 'request_id': 'req-6039519d-a61d-4f25-af99-c51f137cab5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:34.858553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] The token cache is being invalidate because project 748285ba5df14278b813bddf805b0f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:33:34.858859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:34.863147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:34.867912 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1474/2973] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:33:34 2022] DELETE /identity/v3/projects/748285ba5df14278b813bddf805b0f2b => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:33:34.871918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:34.878135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:34.889030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195640e-7cd1-42cc-a6fd-d7c873eaa688 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:35.033230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:35.033996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:35.036399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:35.037216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] PATH_INFO: `/v3/users/3c382d351ca340848b459676a41d0596` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:35.040802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c382d351ca340848b459676a41d0596)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:35.045134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:35.352174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c382d351ca340848b459676a41d0596'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:35.359937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c382d351ca340848b459676a41d0596'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:35.363258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c382d351ca340848b459676a41d0596'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:35.380949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c382d351ca340848b459676a41d0596'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:35.553076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64cee9b0-47ef-44b1-9ab6-e15543d7cdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c382d351ca340848b459676a41d0596'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:35.570873 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1500/2974] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:33:34 2022] DELETE /identity/v3/users/3c382d351ca340848b459676a41d0596 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:33:36.144583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:36.151237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:36.181290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039519d-a61d-4f25-af99-c51f137cab5b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:36.279268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:36.279945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:36.280335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:36.280630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] PATH_INFO: `/v3/projects/9c2f795a3bc94c41a2321ec055331ec3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:36.282045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2f795a3bc94c41a2321ec055331ec3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:36.284317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:36.531471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2f795a3bc94c41a2321ec055331ec3', 'request_id': 'req-b0db358d-61c9-4ce6-bf19-3b06424703e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:36.548608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2f795a3bc94c41a2321ec055331ec3', 'request_id': 'req-b0db358d-61c9-4ce6-bf19-3b06424703e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:36.655241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2f795a3bc94c41a2321ec055331ec3', 'request_id': 'req-b0db358d-61c9-4ce6-bf19-3b06424703e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:36.662553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:36.671892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] The token cache is being invalidate because project 9c2f795a3bc94c41a2321ec055331ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:33:36.672270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:36.673045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0db358d-61c9-4ce6-bf19-3b06424703e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:33:36.680028 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1475/2975] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:33:36 2022] DELETE /identity/v3/projects/9c2f795a3bc94c41a2321ec055331ec3 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:33:36.682184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd440b5-9065-4ce9-9bbe-04e0cd5936db None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:36.683053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd440b5-9065-4ce9-9bbe-04e0cd5936db None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:36.683483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd440b5-9065-4ce9-9bbe-04e0cd5936db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:36.712420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0fd440b5-9065-4ce9-9bbe-04e0cd5936db None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:36.717874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0fd440b5-9065-4ce9-9bbe-04e0cd5936db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:36.892661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7af6c-ffd9-46cf-aa2c-e8f4a39f27fb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:36.892861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7af6c-ffd9-46cf-aa2c-e8f4a39f27fb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:36.893125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7af6c-ffd9-46cf-aa2c-e8f4a39f27fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:36.894083 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1501/2976] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:36.963745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-75e7af6c-ffd9-46cf-aa2c-e8f4a39f27fb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:36.968274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75e7af6c-ffd9-46cf-aa2c-e8f4a39f27fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:37.025484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1476/2977] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:37.030656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd440b5-9065-4ce9-9bbe-04e0cd5936db None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:37.050634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd440b5-9065-4ce9-9bbe-04e0cd5936db None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:37.059544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:37.060365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:37.064087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:37.064087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:37.064087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:33:37.064087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:37.065825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:37.095985 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1502/2978] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:33:37.098327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7af6c-ffd9-46cf-aa2c-e8f4a39f27fb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:37.115700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7af6c-ffd9-46cf-aa2c-e8f4a39f27fb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:37.125362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:37.126138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:37.126687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:37.126812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:37.127480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:37.129468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:37.300080 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1477/2979] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:33:37 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:33:37.304823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:37.330616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc98f8-ce3f-4caf-a9db-cafa75436684 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:37.338991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:37.408165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:37.410618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:37.411002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:37.415097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:37.418640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:37.420832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:38.211767 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1503/2980] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:33:37 2022] POST /identity/v3/users => generated 292 bytes in 908 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:33:38.216353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:38.238529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e7ab6-33a9-4b26-8fe4-228f3257f177 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:38.245102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:38.254853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:38.254853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:38.255126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:38.258453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:38.263895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:38.281680 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1478/2981] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:33:38.285576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:38.305854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ba4a-4879-481d-b151-543631aee525 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:38.318424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fa952-ed50-4654-b975-a96c042128da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:38.319562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa952-ed50-4654-b975-a96c042128da admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:38.320052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa952-ed50-4654-b975-a96c042128da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:38.320709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa952-ed50-4654-b975-a96c042128da admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:38.322291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fa952-ed50-4654-b975-a96c042128da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:38.332016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fa952-ed50-4654-b975-a96c042128da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:38.343497 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1504/2982] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:33:38.346816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:38.362784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce2a7-f14e-42ae-a657-a9bdabf5309d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:38.369591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:38.370844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:38.371430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:38.371957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] PATH_INFO: `/v3/projects/fa2e6c5545cd41cc99079ee7f2a9ff6c/users/3fd1e93724564bf18a8d3a15c12169dc/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:38.406888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2e6c5545cd41cc99079ee7f2a9ff6c, user_id=3fd1e93724564bf18a8d3a15c12169dc, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:38.413025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:38.518717 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1479/2983] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:33:38 2022] PUT /identity/v3/projects/fa2e6c5545cd41cc99079ee7f2a9ff6c/users/3fd1e93724564bf18a8d3a15c12169dc/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:33:38.524157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d003a8-c221-4922-9c15-120341688032 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:38.524506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d003a8-c221-4922-9c15-120341688032 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:38.524792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d003a8-c221-4922-9c15-120341688032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:38.576249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60d003a8-c221-4922-9c15-120341688032 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:38.579630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60d003a8-c221-4922-9c15-120341688032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:38.691136 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1505/2984] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:38.748827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:38.752339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:38.769498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d003a8-c221-4922-9c15-120341688032 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:38.772003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60d003a8-c221-4922-9c15-120341688032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:38.971614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d003a8-c221-4922-9c15-120341688032 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:38.983389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe1bf6-5e7a-45d5-90cb-516c8f71253b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:39.002579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3d17-59ad-47bc-822d-6eaf8c13464e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:39.002579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3d17-59ad-47bc-822d-6eaf8c13464e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:39.002579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3d17-59ad-47bc-822d-6eaf8c13464e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:39.002579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3d17-59ad-47bc-822d-6eaf8c13464e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:39.003014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:39.003014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:39.003014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:39.003014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:39.005046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:39.012965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3d17-59ad-47bc-822d-6eaf8c13464e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:39.015527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3d17-59ad-47bc-822d-6eaf8c13464e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:39.033206 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1506/2985] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:33:39.199402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:39.200871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:39.259657 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1480/2986] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:33:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:33:40.248319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb333df-47f1-4a90-ab87-89b35588f70b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:40.248878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb333df-47f1-4a90-ab87-89b35588f70b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:40.248878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb333df-47f1-4a90-ab87-89b35588f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:40.316242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1cb333df-47f1-4a90-ab87-89b35588f70b None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:40.317746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1cb333df-47f1-4a90-ab87-89b35588f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:40.426726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:40.537644 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1507/2987] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:43.096340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:43.098081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:43.182498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:43.286535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e7b6a-ae45-431b-9d02-11ec0b351c81 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:43.313476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861eea-1c51-41d8-9ae8-07db580d4cc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:43.320064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861eea-1c51-41d8-9ae8-07db580d4cc8 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:43.321013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861eea-1c51-41d8-9ae8-07db580d4cc8 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:43.322588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861eea-1c51-41d8-9ae8-07db580d4cc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:43.329574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53861eea-1c51-41d8-9ae8-07db580d4cc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:43.364771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861eea-1c51-41d8-9ae8-07db580d4cc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:43.369784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861eea-1c51-41d8-9ae8-07db580d4cc8 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:43.412539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1481/2988] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:33:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:33:44.010819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b91872-f78e-42d3-8382-d6d0840fb575 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:44.011394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b91872-f78e-42d3-8382-d6d0840fb575 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:44.011394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b91872-f78e-42d3-8382-d6d0840fb575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:44.093497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d7b91872-f78e-42d3-8382-d6d0840fb575 None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:44.097832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7b91872-f78e-42d3-8382-d6d0840fb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:44.136823 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1508/2989] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:33:46.509207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:46.509782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:46.509782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:46.585665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] MFA Rules not processed for user `2516c291f2ea471abedff1b8338c9ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:46.586927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:46.705725 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1482/2990] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:46.717786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae3d2-1cac-407d-aa95-f0cfb9828ce1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:46.718333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae3d2-1cac-407d-aa95-f0cfb9828ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:46.718582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ae3d2-1cac-407d-aa95-f0cfb9828ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:46.756370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7f4ae3d2-1cac-407d-aa95-f0cfb9828ce1 None None] MFA Rules not processed for user `2516c291f2ea471abedff1b8338c9ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:46.759991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f4ae3d2-1cac-407d-aa95-f0cfb9828ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:46.793175 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1509/2991] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:46.803916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:46.808388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:46.988576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3a0b-35b9-49d5-bb4f-7ca2c0789060 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:47.003860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2410296-d731-491a-bd27-c749321778f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:47.005170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410296-d731-491a-bd27-c749321778f5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:47.007726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410296-d731-491a-bd27-c749321778f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:47.008129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410296-d731-491a-bd27-c749321778f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:47.030044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2410296-d731-491a-bd27-c749321778f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:47.032103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2410296-d731-491a-bd27-c749321778f5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:47.055725 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1483/2992] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:33:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:33:55.176098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ae3d2-1cac-407d-aa95-f0cfb9828ce1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:55.207211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ae3d2-1cac-407d-aa95-f0cfb9828ce1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:55.222898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:55.227026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:55.231053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:55.231053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:55.237521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:55.266458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:55.268025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:55.289688 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1510/2993] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:33:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:33:56.382546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824e01-8352-47eb-a8fe-8d760cc61d59 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:56.383037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824e01-8352-47eb-a8fe-8d760cc61d59 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:56.383220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824e01-8352-47eb-a8fe-8d760cc61d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:56.452380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a5824e01-8352-47eb-a8fe-8d760cc61d59 None None] MFA Rules not processed for user `3fd1e93724564bf18a8d3a15c12169dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:33:56.457004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5824e01-8352-47eb-a8fe-8d760cc61d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:33:56.532814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:56.598281 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1484/2994] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:33:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:33:56.604477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:56.622088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c52cf-b2e6-48c1-8494-79a1e12411c3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:56.628146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:56.629199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:56.629636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:56.630360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:56.633224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:56.634396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:56.898480 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1511/2995] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:33:56 2022] POST /identity/v3/projects => generated 383 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:33:56.902708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5824e01-8352-47eb-a8fe-8d760cc61d59 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:56.915528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5824e01-8352-47eb-a8fe-8d760cc61d59 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:57.037695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:57.038353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:57.038642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:57.038919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:57.040183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:57.042097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:57.155830 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1485/2996] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:33:56 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:33:57.160558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:57.184997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf3561-096e-4cc5-9b39-92b161590a2a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:57.209888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:57.210971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:57.211358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:57.223204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:57.223204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:57.223204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:57.267492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:57.267627 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1512/2997] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:33:57.280966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de17cc-25a2-4735-afee-f36f6565abc2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:57.303099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:57.304061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:57.304355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:57.304635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] PATH_INFO: `/v3/projects/7a1545dd358d4b7fb9126628d5241b18/users/abec6e005f9f4bde9117e874cbb75d96/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:57.331468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1545dd358d4b7fb9126628d5241b18, user_id=abec6e005f9f4bde9117e874cbb75d96, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:57.334760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:57.425952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1486/2998] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:33:57 2022] PUT /identity/v3/projects/7a1545dd358d4b7fb9126628d5241b18/users/abec6e005f9f4bde9117e874cbb75d96/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:33:57.430083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:57.458988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687b708-4ac9-483c-9722-e96ed1e73612 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:57.673955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8becfb-7bde-49a8-bcf1-fa2852da33e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:57.674653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8becfb-7bde-49a8-bcf1-fa2852da33e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:57.675014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8becfb-7bde-49a8-bcf1-fa2852da33e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:57.675513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8becfb-7bde-49a8-bcf1-fa2852da33e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:57.676535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8becfb-7bde-49a8-bcf1-fa2852da33e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:57.679388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8becfb-7bde-49a8-bcf1-fa2852da33e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:57.693918 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1513/2999] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:33:57.701658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:33:57.722290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b91f4-370b-4707-8a61-f4b5b002d943 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:33:57.741673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:33:57.746127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:33:57.746613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:33:57.753804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] PATH_INFO: `/v3/projects/7a1545dd358d4b7fb9126628d5241b18/users/abec6e005f9f4bde9117e874cbb75d96/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:33:57.762184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1545dd358d4b7fb9126628d5241b18, user_id=abec6e005f9f4bde9117e874cbb75d96, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:33:57.767936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:33:57.806397 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1487/3000] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:33:57 2022] PUT /identity/v3/projects/7a1545dd358d4b7fb9126628d5241b18/users/abec6e005f9f4bde9117e874cbb75d96/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:00.826920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:00.827495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:00.827495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:00.870596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:00.872141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:01.029088 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1514/3001] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:34:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:01.036642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:01.039167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:01.147633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7935d-c2df-4353-94f2-f7e0b68a59d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:01.153714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:01.154848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:01.155365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:01.155796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:01.169407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:01.169407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:01.179441 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1488/3002] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:34:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:01.839437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:01.841337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:01.859466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:01.940112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb5944-6008-4424-9ab6-5e5dfadb13c4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:01.952603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:01.952603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:01.952971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:01.953604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:01.958884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:02.102924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:02.105729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:02.121680 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1515/3003] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:08.677831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:08.690424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9153c5-5e9e-4945-b5c6-4c22e80ad970 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:08.697721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:08.698757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:08.699263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:08.699752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:08.703398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:08.739936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:08.739936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:08.788313 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1489/3004] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:11.871054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:11.884894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7667ec-bee3-42de-997f-cc42f88f3db6 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:11.898536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3f98-eb98-43c5-80e6-34089603c172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:11.900143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3f98-eb98-43c5-80e6-34089603c172 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:11.903027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3f98-eb98-43c5-80e6-34089603c172 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:11.907546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3f98-eb98-43c5-80e6-34089603c172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:11.908010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6b3c3f98-eb98-43c5-80e6-34089603c172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:11.936573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c3f98-eb98-43c5-80e6-34089603c172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:11.941315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c3f98-eb98-43c5-80e6-34089603c172 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:11.963113 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1516/3005] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:12.884779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:12.905709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaacc9-d90a-4fe2-9676-4a2c01c65257 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:12.915090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:12.916132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:12.916605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:12.917204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:12.920734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:12.935637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:13.097824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:13.102919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:13.131086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1490/3006] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:13.865683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c9bf-013a-4e2d-9027-0bbba282f307 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:13.866599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c9bf-013a-4e2d-9027-0bbba282f307 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:13.867034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546c9bf-013a-4e2d-9027-0bbba282f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:13.932731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9546c9bf-013a-4e2d-9027-0bbba282f307 None None] MFA Rules not processed for user `abec6e005f9f4bde9117e874cbb75d96`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:13.934263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9546c9bf-013a-4e2d-9027-0bbba282f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:14.152041 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1517/3007] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:14.169185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:14.170673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:14.411057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a11109-9d3d-4092-a5ed-bf37b963c99b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:14.416068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:14.416689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:14.416968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:14.417317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:14.431998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:14.436667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:14.493499 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1491/3008] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:19.219946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546c9bf-013a-4e2d-9027-0bbba282f307 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:19.249243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546c9bf-013a-4e2d-9027-0bbba282f307 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:19.266439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6015f70-eb94-46c6-a8d5-2adb94d23145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:19.268253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6015f70-eb94-46c6-a8d5-2adb94d23145 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:19.269825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6015f70-eb94-46c6-a8d5-2adb94d23145 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:19.271510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6015f70-eb94-46c6-a8d5-2adb94d23145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:19.277701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6015f70-eb94-46c6-a8d5-2adb94d23145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:19.307973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6015f70-eb94-46c6-a8d5-2adb94d23145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:19.309569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6015f70-eb94-46c6-a8d5-2adb94d23145 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:19.325248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1518/3009] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:19.356538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:19.369091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a858c2-cbfd-48cb-b548-c138672c714f service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:19.374679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:19.375623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:19.376001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:19.376515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:19.380030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:19.392546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:19.394317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:19.405701 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1492/3010] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:34:20.776765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:20.777749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:20.778366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:20.800828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:20.877620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:20.879979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:20.907986 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1519/3011] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:34:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:20.916606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:20.967132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee904-ead6-4e28-97ce-7447344d335f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:20.978986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4962bbb-8cd1-47d7-8222-f55d41ab170e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:20.978986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4962bbb-8cd1-47d7-8222-f55d41ab170e service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:20.978986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4962bbb-8cd1-47d7-8222-f55d41ab170e service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:20.978986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4962bbb-8cd1-47d7-8222-f55d41ab170e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:20.984694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4962bbb-8cd1-47d7-8222-f55d41ab170e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:20.986313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4962bbb-8cd1-47d7-8222-f55d41ab170e service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:20.996115 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1493/3012] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:34:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:21.263916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:21.265390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:21.308022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cdc8b-47d4-4b22-92ca-391919aa77e7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:21.334773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:21.335411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:21.335684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:21.335953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:21.338446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:21.358578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:21.366973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:21.380905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1520/3013] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:28.034674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1eff3-832a-45cd-9791-60c982cd8ee3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:28.035218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1eff3-832a-45cd-9791-60c982cd8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:28.036031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1eff3-832a-45cd-9791-60c982cd8ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:28.072469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8de1eff3-832a-45cd-9791-60c982cd8ee3 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:28.073764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8de1eff3-832a-45cd-9791-60c982cd8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:28.083693 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1494/3014] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:34:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:34:28.123543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:28.141346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501442fb-002c-4862-8503-41203c8aad7e service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:28.174881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:28.175540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:28.175868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:28.176171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:28.209086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:28.216304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:28.269149 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1521/3015] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:34:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:29.907873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1eff3-832a-45cd-9791-60c982cd8ee3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:29.966971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:29.995328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1eff3-832a-45cd-9791-60c982cd8ee3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:30.006602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aa4b8-f619-4c9f-a2d4-e89fc8779e48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:30.008558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa4b8-f619-4c9f-a2d4-e89fc8779e48 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:30.009023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa4b8-f619-4c9f-a2d4-e89fc8779e48 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:30.009958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa4b8-f619-4c9f-a2d4-e89fc8779e48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:30.014928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:30.016342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:30.030778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-205aa4b8-f619-4c9f-a2d4-e89fc8779e48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:30.058792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aa4b8-f619-4c9f-a2d4-e89fc8779e48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:30.060996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aa4b8-f619-4c9f-a2d4-e89fc8779e48 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:30.100119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1495/3016] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:30.219577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debafd5-1455-47ee-b472-c7b65984e728 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:30.225865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:30.226705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:30.226942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:30.227310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] PATH_INFO: `/v3/users/04584b0879e6499285f815007b4e8e1b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:30.229222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04584b0879e6499285f815007b4e8e1b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:30.231327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:30.290309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e9d95-5cca-427a-85d5-778f3675c600 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:30.291412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e9d95-5cca-427a-85d5-778f3675c600 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:30.291907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e9d95-5cca-427a-85d5-778f3675c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:30.324284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-853e9d95-5cca-427a-85d5-778f3675c600 None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:30.325756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-853e9d95-5cca-427a-85d5-778f3675c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:30.475233 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1496/3017] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:34:30.491522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04584b0879e6499285f815007b4e8e1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:30.501301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04584b0879e6499285f815007b4e8e1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:30.501525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04584b0879e6499285f815007b4e8e1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:30.521589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04584b0879e6499285f815007b4e8e1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:30.643094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04584b0879e6499285f815007b4e8e1b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:30.651107 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1522/3018] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:34:30 2022] DELETE /identity/v3/users/04584b0879e6499285f815007b4e8e1b => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:31.018906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e9d95-5cca-427a-85d5-778f3675c600 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:31.042330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e9d95-5cca-427a-85d5-778f3675c600 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:31.092979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:31.098714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:31.142223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d038e90-5bbc-4808-a287-9e4f9a019eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:31.142875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d038e90-5bbc-4808-a287-9e4f9a019eaf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:31.143119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d038e90-5bbc-4808-a287-9e4f9a019eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:31.143387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d038e90-5bbc-4808-a287-9e4f9a019eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:31.146550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d038e90-5bbc-4808-a287-9e4f9a019eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:31.157482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:31.161457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d038e90-5bbc-4808-a287-9e4f9a019eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:31.161457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d038e90-5bbc-4808-a287-9e4f9a019eaf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:31.171893 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1497/3019] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:31.233080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078893-c94a-4604-9ea8-df99d5a02f28 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:31.238754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:31.240034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:31.240034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:31.240034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] PATH_INFO: `/v3/projects/963d4b082d364d08a0d20f49f2085f1b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:31.241226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] RBAC: Authorizing `identity:delete_project(project_id=963d4b082d364d08a0d20f49f2085f1b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:31.243463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:31.505758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963d4b082d364d08a0d20f49f2085f1b', 'request_id': 'req-9c2f002c-79e5-4902-a030-296bcee4271f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:31.509109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963d4b082d364d08a0d20f49f2085f1b', 'request_id': 'req-9c2f002c-79e5-4902-a030-296bcee4271f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:31.823539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963d4b082d364d08a0d20f49f2085f1b', 'request_id': 'req-9c2f002c-79e5-4902-a030-296bcee4271f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:31.829336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] The token cache is being invalidate because project 963d4b082d364d08a0d20f49f2085f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:34:31.829642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:31.832715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c2f002c-79e5-4902-a030-296bcee4271f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:31.839587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1523/3020] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:34:31 2022] DELETE /identity/v3/projects/963d4b082d364d08a0d20f49f2085f1b => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:31.840881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64bbe5-8616-4f7d-914d-0e756c3083a4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:31.841173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64bbe5-8616-4f7d-914d-0e756c3083a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:31.841453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64bbe5-8616-4f7d-914d-0e756c3083a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:31.877493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3f64bbe5-8616-4f7d-914d-0e756c3083a4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:32.139904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f64bbe5-8616-4f7d-914d-0e756c3083a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:32.139904 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1498/3021] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:34:32.167697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502279-e62f-42a6-9247-3c6aff5b6a1a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.168296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502279-e62f-42a6-9247-3c6aff5b6a1a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.168296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502279-e62f-42a6-9247-3c6aff5b6a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.208116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a4502279-e62f-42a6-9247-3c6aff5b6a1a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:32.211217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4502279-e62f-42a6-9247-3c6aff5b6a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:32.232187 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1524/3022] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:32.237034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64bbe5-8616-4f7d-914d-0e756c3083a4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:32.248756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64bbe5-8616-4f7d-914d-0e756c3083a4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:32.253759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:32.254611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.254826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.255216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.255940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:34:32.256373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:32.258441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:32.290553 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1499/3023] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:34:32.293955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502279-e62f-42a6-9247-3c6aff5b6a1a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:32.308891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502279-e62f-42a6-9247-3c6aff5b6a1a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:32.318935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:32.319736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.320031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.320350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.321002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:32.323184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:32.408208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:32.410341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:32.423819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:32.470240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1525/3024] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:34:32 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:34:32.472209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:32.569355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc8a3-027e-4016-baed-0a5fc6b50f1d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:32.596810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4a088-48d5-42cc-b997-b3b085fc0baf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:32.604160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:32.604865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.605156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.605422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.606234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:32.608625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:32.671977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:32.672779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.673198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.673591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.675677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:32.692255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:32.694094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:32.718491 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1500/3025] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:34:32.739040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1526/3026] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:34:32 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:34:32.743623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:32.768477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252df11-4e00-44c0-b1aa-0469b6e5fa7f service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:32.781235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:32.782375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.783151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.783445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.784132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:32.787634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:32.814148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1501/3027] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:34:32.814894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:32.847500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9e1b-e0d1-407f-b1c0-a24897488cfd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:32.868165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03807e-94e6-44c0-9286-aaeeeda5f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:32.868811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03807e-94e6-44c0-9286-aaeeeda5f24c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.869258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03807e-94e6-44c0-9286-aaeeeda5f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.869544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03807e-94e6-44c0-9286-aaeeeda5f24c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.870241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03807e-94e6-44c0-9286-aaeeeda5f24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:32.871879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03807e-94e6-44c0-9286-aaeeeda5f24c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:32.893443 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1527/3028] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:34:32.897958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:32.911967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c137a1-c78e-4923-9e14-bad5551ef065 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:32.927471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:32.928177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:32.928462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:32.928741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] PATH_INFO: `/v3/projects/fe0519cdc60d4673bed0904aa677e230/users/8b815207c9b44c53bbe617384fbed8c6/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:32.956753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0519cdc60d4673bed0904aa677e230, user_id=8b815207c9b44c53bbe617384fbed8c6, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:32.960131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:33.034629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1502/3029] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:34:32 2022] PUT /identity/v3/projects/fe0519cdc60d4673bed0904aa677e230/users/8b815207c9b44c53bbe617384fbed8c6/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:33.039890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:33.040382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:33.040657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:33.048741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:33.063891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:33.065236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:33.187123 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1528/3030] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:33.197927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:33.200582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:33.314688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07558-5672-4ba0-93cd-9db67f08250b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:33.323455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:33.324100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:33.324387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:33.325075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:33.337574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:33.339994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:33.352768 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1503/3031] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:40.023086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:40.026005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:40.049691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec6a11-a7bb-4266-a419-7cf6bd7d009a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:40.059066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:40.060860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:40.061358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:40.062967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] PATH_INFO: `/v3/users/2516c291f2ea471abedff1b8338c9ee4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:40.067006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2516c291f2ea471abedff1b8338c9ee4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:40.071381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:40.470844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2516c291f2ea471abedff1b8338c9ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:40.485550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2516c291f2ea471abedff1b8338c9ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:40.486635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2516c291f2ea471abedff1b8338c9ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:40.514622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2516c291f2ea471abedff1b8338c9ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:40.659599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2516c291f2ea471abedff1b8338c9ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:40.672552 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1529/3032] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:34:40 2022] DELETE /identity/v3/users/2516c291f2ea471abedff1b8338c9ee4 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:42.092274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:42.093949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:42.115625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:42.134547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:42.136007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:42.264815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa6a7-dcdf-4c4f-b750-ee1267b7da81 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:42.300552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65000e9-5d6e-477c-91b3-a737d168127d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:42.314762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:42.315549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:42.317829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:42.318241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] PATH_INFO: `/v3/projects/be4076eed4bf4278a4cbf18296bc66f8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:42.322119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4076eed4bf4278a4cbf18296bc66f8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:42.325226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:42.371604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:42.386721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b196e10-ff20-4e86-89ae-6cafac935056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:42.387841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196e10-ff20-4e86-89ae-6cafac935056 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:42.388375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196e10-ff20-4e86-89ae-6cafac935056 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:42.388891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196e10-ff20-4e86-89ae-6cafac935056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:42.391332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b196e10-ff20-4e86-89ae-6cafac935056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:42.413260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b196e10-ff20-4e86-89ae-6cafac935056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:42.415397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b196e10-ff20-4e86-89ae-6cafac935056 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:42.436601 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1504/3033] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:42.503053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4076eed4bf4278a4cbf18296bc66f8', 'request_id': 'req-a37ebe92-c20f-4ef9-a771-0d1a968eb951'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:42.525967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4076eed4bf4278a4cbf18296bc66f8', 'request_id': 'req-a37ebe92-c20f-4ef9-a771-0d1a968eb951'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:42.635170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4076eed4bf4278a4cbf18296bc66f8', 'request_id': 'req-a37ebe92-c20f-4ef9-a771-0d1a968eb951'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:42.653156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] The token cache is being invalidate because project be4076eed4bf4278a4cbf18296bc66f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:34:42.653593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:42.654380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a37ebe92-c20f-4ef9-a771-0d1a968eb951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:42.663187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8492ce7-7f48-4cbc-83a8-dccd1384ca19 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:42.664617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8492ce7-7f48-4cbc-83a8-dccd1384ca19 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:42.664912 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1530/3034] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:34:42 2022] DELETE /identity/v3/projects/be4076eed4bf4278a4cbf18296bc66f8 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:34:42.665486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8492ce7-7f48-4cbc-83a8-dccd1384ca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:42.718518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8492ce7-7f48-4cbc-83a8-dccd1384ca19 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:42.725568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8492ce7-7f48-4cbc-83a8-dccd1384ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:42.890236 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1505/3035] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:42.898807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc0d6-f8dd-412f-8950-c8228122a08a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:42.899097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc0d6-f8dd-412f-8950-c8228122a08a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:42.899376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc0d6-f8dd-412f-8950-c8228122a08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:42.952381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e6bcc0d6-f8dd-412f-8950-c8228122a08a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:42.953749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e6bcc0d6-f8dd-412f-8950-c8228122a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:42.979004 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1531/3036] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:42.979861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8492ce7-7f48-4cbc-83a8-dccd1384ca19 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:43.043173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8492ce7-7f48-4cbc-83a8-dccd1384ca19 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:43.057602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:43.058281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.058558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.058830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.059492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:34:43.059794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:43.074457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:43.096495 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1506/3037] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:34:43.104071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc0d6-f8dd-412f-8950-c8228122a08a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:43.126943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc0d6-f8dd-412f-8950-c8228122a08a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:43.136967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c493980-58b4-4066-b02c-011b3710e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:43.137745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c493980-58b4-4066-b02c-011b3710e0ad admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.138162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c493980-58b4-4066-b02c-011b3710e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.138537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c493980-58b4-4066-b02c-011b3710e0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.139251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c493980-58b4-4066-b02c-011b3710e0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:43.141487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c493980-58b4-4066-b02c-011b3710e0ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:43.333037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:43.333540 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1532/3038] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:34:43 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:34:43.348334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5150ead-4fa8-4609-941d-f1adf0f1c051 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:43.378531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:43.451431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:43.451431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.451431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.451431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.451897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:43.455936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:43.491390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.491911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.492351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.537209 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1507/3039] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:34:43 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:34:43.541533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:43.543387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] MFA Rules not processed for user `8b815207c9b44c53bbe617384fbed8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:43.544730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:43.561650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ef63-2c57-4bc5-8400-d9dfeaf103f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:43.568956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:43.569589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.569994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.570485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.571305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:43.573480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:43.592539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1508/3040] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:34:43.597191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:43.614518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c041c1-8fc1-4be4-9f62-16f9ecb67703 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:43.620879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:43.621587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.621984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.622423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.623140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:43.624908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:43.642023 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1509/3041] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:34:43.643768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:43.655702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27850d9a-aafa-4f62-a132-d68e6dd72c4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:43.665092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaef85-7f34-4b3b-89cc-15af2dba8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:43.665896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaef85-7f34-4b3b-89cc-15af2dba8ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.666217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaef85-7f34-4b3b-89cc-15af2dba8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.666494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaef85-7f34-4b3b-89cc-15af2dba8ca8 admin admin] PATH_INFO: `/v3/projects/50333c729f8742e4b78d007d13fe66a8/users/63497dd52a5c4cd58e8916d3ea348479/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.675074 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1533/3042] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:43.686963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:43.688855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:43.700165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaef85-7f34-4b3b-89cc-15af2dba8ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50333c729f8742e4b78d007d13fe66a8, user_id=63497dd52a5c4cd58e8916d3ea348479, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:43.704815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceaef85-7f34-4b3b-89cc-15af2dba8ca8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:43.801447 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1510/3043] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:34:43 2022] PUT /identity/v3/projects/50333c729f8742e4b78d007d13fe66a8/users/63497dd52a5c4cd58e8916d3ea348479/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:43.807880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.812540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:43.816919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.817285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:43.824523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c74f15-73cb-46e2-8994-2d4aca7af146 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:43.865551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:43.866823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:43.949037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:43.949828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:43.950272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:43.950651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:44.015214 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1511/3044] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:44.026048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:44.029315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:44.109334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:44.111761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:44.130020 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1534/3045] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:44.152717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c95d7-4249-4349-9f72-7709fc6d2f36 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:44.161244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:44.161991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:44.167693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:44.167693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:44.181756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:44.183588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:44.202089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1512/3046] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:49.602595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:49.620190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd964fe0-7b60-4222-a9f3-3f546d14db99 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:49.636998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fad32a-2b18-4c4b-8808-f805998160a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:49.637222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fad32a-2b18-4c4b-8808-f805998160a6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:49.637323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fad32a-2b18-4c4b-8808-f805998160a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:49.637652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fad32a-2b18-4c4b-8808-f805998160a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:49.645233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2fad32a-2b18-4c4b-8808-f805998160a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:49.669461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fad32a-2b18-4c4b-8808-f805998160a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:49.671787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fad32a-2b18-4c4b-8808-f805998160a6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:49.717693 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1535/3047] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:50.063828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:50.065335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:50.100164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:50.129957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d29d7-3e96-4f2a-a5bb-af2a4be05907 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:50.138741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:50.139707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:50.140154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:50.140573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:50.143141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:50.240150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:50.251275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:50.267520 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1513/3048] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:54.383229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:54.384087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:54.384514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:54.430242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:54.434447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:54.650405 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1536/3049] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:34:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:54.664611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:54.668419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:54.871504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5118b-bdda-407c-8aaa-7a5b5d9a10d3 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:54.877623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:54.878228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:54.878511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:54.879444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:54.918332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:54.920884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:54.940458 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1514/3050] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:34:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:54.978628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:54.980838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:55.007299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3129254-6ea8-480e-99ed-0c706a8bb8e4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:55.013989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:55.014695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:55.014973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:55.015242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] PATH_INFO: `/v3/users/8b815207c9b44c53bbe617384fbed8c6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:55.016491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b815207c9b44c53bbe617384fbed8c6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:55.018816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:55.187491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:55.386335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b815207c9b44c53bbe617384fbed8c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:55.401565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b815207c9b44c53bbe617384fbed8c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:55.405112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b815207c9b44c53bbe617384fbed8c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:55.436588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b815207c9b44c53bbe617384fbed8c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:55.499346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98f7de90-8970-4865-b048-355f0f90787f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b815207c9b44c53bbe617384fbed8c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:55.511335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1537/3051] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:34:54 2022] DELETE /identity/v3/users/8b815207c9b44c53bbe617384fbed8c6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:57.507206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:57.527355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8353c2-c207-4a8e-b895-2728fe803d8c service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:57.720134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:57.723955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:57.723955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:57.723955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] PATH_INFO: `/v3/projects/fe0519cdc60d4673bed0904aa677e230` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:57.724390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0519cdc60d4673bed0904aa677e230)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:57.738648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:57.810307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:57.903519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf69ffc-706d-4148-afcb-0f30ce994b8b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:57.903982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf69ffc-706d-4148-afcb-0f30ce994b8b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:57.904072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf69ffc-706d-4148-afcb-0f30ce994b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:57.951240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0519cdc60d4673bed0904aa677e230', 'request_id': 'req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:57.952849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cbf69ffc-706d-4148-afcb-0f30ce994b8b None None] MFA Rules not processed for user `3fd1e93724564bf18a8d3a15c12169dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:57.957504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cbf69ffc-706d-4148-afcb-0f30ce994b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:58.006786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0519cdc60d4673bed0904aa677e230', 'request_id': 'req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:58.091397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0519cdc60d4673bed0904aa677e230', 'request_id': 'req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:58.138881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] The token cache is being invalidate because project fe0519cdc60d4673bed0904aa677e230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:34:58.140287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:58.141370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-571dbb91-fa93-46e4-b5df-1ce2a62c76ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:34:58.152006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1538/3053] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:58.152119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1515/3053] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:34:57 2022] DELETE /identity/v3/projects/fe0519cdc60d4673bed0904aa677e230 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:58.153000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbf029-0f7e-4680-b282-44f09a1eca59 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:58.153456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbf029-0f7e-4680-b282-44f09a1eca59 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:58.154680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbf029-0f7e-4680-b282-44f09a1eca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:58.204030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-17bbf029-0f7e-4680-b282-44f09a1eca59 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:58.208687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17bbf029-0f7e-4680-b282-44f09a1eca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:58.440955 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1539/3054] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:58.442762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34ec1-a6fb-426a-8bf6-0b57296b8e3f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:58.443049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34ec1-a6fb-426a-8bf6-0b57296b8e3f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:58.443349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34ec1-a6fb-426a-8bf6-0b57296b8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:58.490211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-40a34ec1-a6fb-426a-8bf6-0b57296b8e3f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:58.492362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-40a34ec1-a6fb-426a-8bf6-0b57296b8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:58.527109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1516/3055] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:58.528215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbf029-0f7e-4680-b282-44f09a1eca59 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:58.545193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbf029-0f7e-4680-b282-44f09a1eca59 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:58.555715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:58.556739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:58.557423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:58.557926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:58.558898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:34:58.559412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:58.562828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:58.607103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34ec1-a6fb-426a-8bf6-0b57296b8e3f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:58.608045 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1540/3056] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:34:58.619416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34ec1-a6fb-426a-8bf6-0b57296b8e3f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:58.626187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:58.626737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:58.627015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:58.627331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:58.628074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:58.631136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:58.737322 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1517/3057] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:34:58 2022] POST /identity/v3/projects => generated 401 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:34:58.741634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:58.757357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0129a-05e2-45e3-b187-5bdc45f64d69 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:58.812837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:58.877583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3125-9388-4503-8338-8908a296293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:58.879339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3125-9388-4503-8338-8908a296293c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:58.879755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3125-9388-4503-8338-8908a296293c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:58.881582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c3125-9388-4503-8338-8908a296293c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:58.887561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c3125-9388-4503-8338-8908a296293c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:58.898088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c3125-9388-4503-8338-8908a296293c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:59.027490 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1541/3058] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:34:58 2022] POST /identity/v3/users => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:34:59.040019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:59.073158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a96e7-55e8-4be6-81fc-1b8981b1102e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:59.111050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:59.116632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:59.116632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:59.116632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:59.118262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:59.125602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:59.157974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3125-9388-4503-8338-8908a296293c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:59.163900 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1518/3059] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:34:59.173662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c3125-9388-4503-8338-8908a296293c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:59.181497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c665a-9b6c-4f5d-ba15-5e7c2391d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:59.182417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c665a-9b6c-4f5d-ba15-5e7c2391d978 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:59.182801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c665a-9b6c-4f5d-ba15-5e7c2391d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:59.183173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c665a-9b6c-4f5d-ba15-5e7c2391d978 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:59.184073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c665a-9b6c-4f5d-ba15-5e7c2391d978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:59.186035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c665a-9b6c-4f5d-ba15-5e7c2391d978 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:59.200785 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1542/3060] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:34:59.204619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:59.233578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375a067-e7c5-445a-ad61-70f783a5ce3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:59.239417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:34:59.240475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:59.242140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:59.242648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] PATH_INFO: `/v3/projects/e09a0c5590a3483fb44face4a6c7c9c1/users/c98c85ffb28f4aba959a76d828e7c79e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:59.266118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09a0c5590a3483fb44face4a6c7c9c1, user_id=c98c85ffb28f4aba959a76d828e7c79e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:34:59.270916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:34:59.383294 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1519/3061] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:34:59 2022] PUT /identity/v3/projects/e09a0c5590a3483fb44face4a6c7c9c1/users/c98c85ffb28f4aba959a76d828e7c79e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:34:59.389530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3930e8-0afd-4b6c-b9b7-0e7dbc690036 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:34:59.390020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3930e8-0afd-4b6c-b9b7-0e7dbc690036 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:34:59.390427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3930e8-0afd-4b6c-b9b7-0e7dbc690036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:34:59.468368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c3930e8-0afd-4b6c-b9b7-0e7dbc690036 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:34:59.469809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c3930e8-0afd-4b6c-b9b7-0e7dbc690036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:59.709482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1543/3062] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:34:59.778586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:34:59.780589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:34:59.989689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095e95-6a4d-42a2-a499-2222810790a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:34:59.998245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adef2d-7f1a-4cf5-a0f6-76771515e8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:00.001267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adef2d-7f1a-4cf5-a0f6-76771515e8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:00.001267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adef2d-7f1a-4cf5-a0f6-76771515e8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:00.001267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adef2d-7f1a-4cf5-a0f6-76771515e8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:00.020136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adef2d-7f1a-4cf5-a0f6-76771515e8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:00.021701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adef2d-7f1a-4cf5-a0f6-76771515e8b4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:00.052143 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1520/3063] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:02.455151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:02.455675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:02.455886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:02.512145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] MFA Rules not processed for user `63497dd52a5c4cd58e8916d3ea348479`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:02.513659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:02.672156 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1544/3064] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:02.683703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5675e7-c203-476e-962e-f0bec0bc6109 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:02.683703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5675e7-c203-476e-962e-f0bec0bc6109 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:02.684120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5675e7-c203-476e-962e-f0bec0bc6109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:02.733337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6b5675e7-c203-476e-962e-f0bec0bc6109 None None] MFA Rules not processed for user `63497dd52a5c4cd58e8916d3ea348479`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:02.735027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b5675e7-c203-476e-962e-f0bec0bc6109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:02.771524 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1521/3065] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:02.782729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:02.786025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:02.930884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:03.017080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4015c-5fd1-4469-be20-bc4dd84f888c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:03.027866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:03.028802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:03.029446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:03.030015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:03.059915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:03.062042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:03.094845 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1545/3066] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:05.140879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906001-2ce0-48f0-8ffb-7c6817a2158c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:05.140879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906001-2ce0-48f0-8ffb-7c6817a2158c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:05.140879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906001-2ce0-48f0-8ffb-7c6817a2158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:05.205271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-60906001-2ce0-48f0-8ffb-7c6817a2158c None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:05.209375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60906001-2ce0-48f0-8ffb-7c6817a2158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:05.363439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:05.413537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1522/3067] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:35:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:35:05.438255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:05.438255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:05.751947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8a28-3e38-4522-a34b-9cda3fc6eb3f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:05.766443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c7c72-1a8e-4e09-8e13-31ba654c8bc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:05.768175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7c72-1a8e-4e09-8e13-31ba654c8bc5 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:05.768468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7c72-1a8e-4e09-8e13-31ba654c8bc5 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:05.768754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7c72-1a8e-4e09-8e13-31ba654c8bc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:05.795307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c7c72-1a8e-4e09-8e13-31ba654c8bc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:05.803948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c7c72-1a8e-4e09-8e13-31ba654c8bc5 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:05.832298 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1546/3068] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:35:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:09.207299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe224bb-698a-4363-a103-d6e3be4d6ded None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:09.216330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe224bb-698a-4363-a103-d6e3be4d6ded None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:09.216330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe224bb-698a-4363-a103-d6e3be4d6ded None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:09.216330 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1523/3069] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:35:09.258680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b412f6-07a9-412c-a838-f421e1469f9f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:09.259544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b412f6-07a9-412c-a838-f421e1469f9f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:09.260004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b412f6-07a9-412c-a838-f421e1469f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:09.428964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9b412f6-07a9-412c-a838-f421e1469f9f None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:09.437085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9b412f6-07a9-412c-a838-f421e1469f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:09.475960 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1547/3070] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:35:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:09.506392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe224bb-698a-4363-a103-d6e3be4d6ded None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:09.508611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abe224bb-698a-4363-a103-d6e3be4d6ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:09.544002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe224bb-698a-4363-a103-d6e3be4d6ded None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:09.558447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:09.563723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:09.564018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:09.567330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:09.600124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:09.602535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:09.659341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1524/3071] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:19.403509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=54 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:19.669968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:20.075715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62fe60-8a8f-4b09-a29e-70084861527f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:20.076259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62fe60-8a8f-4b09-a29e-70084861527f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:20.079607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62fe60-8a8f-4b09-a29e-70084861527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:20.150201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ab62fe60-8a8f-4b09-a29e-70084861527f None None] MFA Rules not processed for user `c98c85ffb28f4aba959a76d828e7c79e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:20.151987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab62fe60-8a8f-4b09-a29e-70084861527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:20.475572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1548/3072] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:21.171683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:21.173158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:21.224190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35024501-4817-46c7-8d23-9ee871c3515e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:21.250962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:21.251832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:21.251947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:21.265846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:21.303081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:21.304720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:21.345901 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1525/3073] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:21 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:28.560360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:28.561065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:28.561065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:28.600074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:28.604689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:28.622178 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1549/3074] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:35:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:28.680737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:28.703923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd7581-803a-495f-b559-5b8e87a75f5b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:28.729494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:28.731376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:28.738894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:28.739516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:28.783487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:28.786873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:28.830266 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1526/3075] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:35:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:32.055263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:32.056766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:32.093356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f30e3-d352-4ca4-aff5-02beb40eca1f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:32.113218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:32.114307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:32.114826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:32.115687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] PATH_INFO: `/v3/users/cfb4fc39da53465d9bf6262a60b9c922` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:32.118327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb4fc39da53465d9bf6262a60b9c922)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:32.121020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:32.388138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb4fc39da53465d9bf6262a60b9c922'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:32.407000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb4fc39da53465d9bf6262a60b9c922'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:32.408249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb4fc39da53465d9bf6262a60b9c922'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:32.449901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb4fc39da53465d9bf6262a60b9c922'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:32.526128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08124473-1165-4743-bc1f-069f775d7122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb4fc39da53465d9bf6262a60b9c922'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:32.535242 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1550/3076] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:35:32 2022] DELETE /identity/v3/users/cfb4fc39da53465d9bf6262a60b9c922 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:34.112585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:34.127234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd007-74dd-48f8-ac30-ae7adc455a94 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:34.288043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:34.289571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:34.290008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:34.290502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] PATH_INFO: `/v3/projects/9a43ee032d0f403db4cb4223c63b7f2e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:34.291857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a43ee032d0f403db4cb4223c63b7f2e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:34.293757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:34.473015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a43ee032d0f403db4cb4223c63b7f2e', 'request_id': 'req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:34.483758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a43ee032d0f403db4cb4223c63b7f2e', 'request_id': 'req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:34.623249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a43ee032d0f403db4cb4223c63b7f2e', 'request_id': 'req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:34.643603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] The token cache is being invalidate because project 9a43ee032d0f403db4cb4223c63b7f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:35:34.643603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:34.644538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc0331de-a95c-4bdf-a42b-0f8a97f2cfb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:34.653729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1527/3077] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:35:34 2022] DELETE /identity/v3/projects/9a43ee032d0f403db4cb4223c63b7f2e => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:34.658624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d37a5-924e-4f6e-8519-d17374041370 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:34.659544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d37a5-924e-4f6e-8519-d17374041370 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:34.660062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d37a5-924e-4f6e-8519-d17374041370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:34.709008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-587d37a5-924e-4f6e-8519-d17374041370 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:34.712059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-587d37a5-924e-4f6e-8519-d17374041370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:34.811718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:34.839411 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1551/3078] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:34.845834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3bef-1e95-4482-8bcc-0fa5a828d4cd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:34.846198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3bef-1e95-4482-8bcc-0fa5a828d4cd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:34.852741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3bef-1e95-4482-8bcc-0fa5a828d4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:34.879075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-116b3bef-1e95-4482-8bcc-0fa5a828d4cd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:34.880368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-116b3bef-1e95-4482-8bcc-0fa5a828d4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:34.907380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d37a5-924e-4f6e-8519-d17374041370 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:34.912784 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1528/3079] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:34.919802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d37a5-924e-4f6e-8519-d17374041370 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:34.925185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:34.926552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:34.926934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:34.927647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:34.928082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:35:34.928489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:34.930572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:34.960233 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1552/3080] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:35:34.963403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3bef-1e95-4482-8bcc-0fa5a828d4cd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:34.978120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3bef-1e95-4482-8bcc-0fa5a828d4cd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:34.984266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:34.985131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:34.985590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:34.986028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:34.998852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:35.007847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:35.136937 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1529/3081] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:35:34 2022] POST /identity/v3/projects => generated 403 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:35:35.138837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:35.166966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786433f-df3d-41a5-a1e9-61b2d178ef3e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:35.277685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:35.278543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:35.278884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:35.285847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:35.285847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:35.285847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:35.380850 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1553/3082] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:35:35 2022] POST /identity/v3/users => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:35.385068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:35.412468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38d5c5-61ef-4d39-a5bd-34cffbd47633 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:35.422265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:35.423299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:35.423677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:35.424057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:35.424831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:35.438421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:35.468062 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1530/3083] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:35:35.469288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:35.485976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a1d6a-5e77-4a85-bdf6-04e687ab286d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:35.492374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3204d73-a129-4baf-9a47-99f968729bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:35.493316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204d73-a129-4baf-9a47-99f968729bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:35.493672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204d73-a129-4baf-9a47-99f968729bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:35.493935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204d73-a129-4baf-9a47-99f968729bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:35.494755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3204d73-a129-4baf-9a47-99f968729bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:35.498321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3204d73-a129-4baf-9a47-99f968729bf6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:35.537868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1554/3084] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:35.539766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:35.553732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26346fe-7248-4528-bd56-4f8a5442e9f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:35.559038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:35.559721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:35.560001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:35.560281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] PATH_INFO: `/v3/projects/9c460a082fe34e6b9d2f3b73044d76e4/users/f4e090dfe8fc4621b5446053eb2cc5f3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:35.634293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c460a082fe34e6b9d2f3b73044d76e4, user_id=f4e090dfe8fc4621b5446053eb2cc5f3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:35.637471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:36.173516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:36.191342 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1531/3085] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:35:35 2022] PUT /identity/v3/projects/9c460a082fe34e6b9d2f3b73044d76e4/users/f4e090dfe8fc4621b5446053eb2cc5f3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:36.197706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:36.198826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:36.199253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:36.238341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:36.239756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:36.417895 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1555/3086] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:36.430446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:36.432772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:36.599273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995647ee-4614-4c6f-a664-89de70907660 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:36.613102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eac67-3026-4651-9c2c-e2d5a84d312c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:36.613967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eac67-3026-4651-9c2c-e2d5a84d312c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:36.616125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eac67-3026-4651-9c2c-e2d5a84d312c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:36.616413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eac67-3026-4651-9c2c-e2d5a84d312c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:36.664499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eac67-3026-4651-9c2c-e2d5a84d312c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:36.683941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eac67-3026-4651-9c2c-e2d5a84d312c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:36.735387 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1532/3087] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:36.765832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:36.767042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:36.788598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefce46a-a93d-4838-8c6c-5ee9b12aea4e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:36.804614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:36.808750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:36.809061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:36.809351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] PATH_INFO: `/v3/users/c98c85ffb28f4aba959a76d828e7c79e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:36.814001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98c85ffb28f4aba959a76d828e7c79e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:36.817820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:37.101265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98c85ffb28f4aba959a76d828e7c79e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:37.119212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98c85ffb28f4aba959a76d828e7c79e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:37.120134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98c85ffb28f4aba959a76d828e7c79e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:37.122153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:37.160169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98c85ffb28f4aba959a76d828e7c79e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:37.266277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98c85ffb28f4aba959a76d828e7c79e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:37.280969 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1556/3088] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:35:36 2022] DELETE /identity/v3/users/c98c85ffb28f4aba959a76d828e7c79e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:38.305306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:38.305773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:38.306132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:38.346189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:38.348464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:38.431306 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1533/3089] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:35:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:38.447120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:38.449331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:38.644380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b334afe-08fa-4f9c-a573-9f860bca9070 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:38.650612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b418f-f010-4fbf-8698-01767dec7de2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:38.651226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b418f-f010-4fbf-8698-01767dec7de2 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:38.651510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b418f-f010-4fbf-8698-01767dec7de2 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:38.651784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b418f-f010-4fbf-8698-01767dec7de2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:38.663621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b418f-f010-4fbf-8698-01767dec7de2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:38.665367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b418f-f010-4fbf-8698-01767dec7de2 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:38.675632 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1557/3090] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:35:38.706618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:38.709212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:38.907258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057aac8b-30d2-4f79-a67c-6478ce184cd5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:38.916082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:38.916605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:38.916810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:38.917083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] PATH_INFO: `/v3/projects/e09a0c5590a3483fb44face4a6c7c9c1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:38.918627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09a0c5590a3483fb44face4a6c7c9c1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:38.925005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:39.127335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09a0c5590a3483fb44face4a6c7c9c1', 'request_id': 'req-9c041def-0176-4110-aa97-bb8f0e61d2c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:39.129906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:39.159204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09a0c5590a3483fb44face4a6c7c9c1', 'request_id': 'req-9c041def-0176-4110-aa97-bb8f0e61d2c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:39.287641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09a0c5590a3483fb44face4a6c7c9c1', 'request_id': 'req-9c041def-0176-4110-aa97-bb8f0e61d2c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:39.304318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] The token cache is being invalidate because project e09a0c5590a3483fb44face4a6c7c9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:35:39.304641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:39.305844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c041def-0176-4110-aa97-bb8f0e61d2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:39.309763 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1534/3091] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:35:38 2022] DELETE /identity/v3/projects/e09a0c5590a3483fb44face4a6c7c9c1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:39.314930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8505-c20f-45a8-9985-4b0da8a231b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:39.316476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8505-c20f-45a8-9985-4b0da8a231b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:39.316925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8505-c20f-45a8-9985-4b0da8a231b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:39.354836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-734d8505-c20f-45a8-9985-4b0da8a231b4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:39.359305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-734d8505-c20f-45a8-9985-4b0da8a231b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:39.561476 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1558/3092] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:39.570356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc3431-166e-45f9-b337-db0a0627e3bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:39.570978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc3431-166e-45f9-b337-db0a0627e3bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:39.571454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc3431-166e-45f9-b337-db0a0627e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:39.634136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5bfc3431-166e-45f9-b337-db0a0627e3bc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:39.635464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bfc3431-166e-45f9-b337-db0a0627e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:39.681707 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1535/3093] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:39.684114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8505-c20f-45a8-9985-4b0da8a231b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:39.703736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8505-c20f-45a8-9985-4b0da8a231b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:39.724448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:39.725527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:39.726001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:39.728506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:39.729548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:35:39.730169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:39.735509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:39.767107 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1559/3094] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:35:39.771727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc3431-166e-45f9-b337-db0a0627e3bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:39.784901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc3431-166e-45f9-b337-db0a0627e3bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:39.791752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:39.792517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:39.793117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:39.793494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:39.796618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:39.798722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:39.912789 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1536/3095] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:35:39 2022] POST /identity/v3/projects => generated 395 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:39.913995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:39.931400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484598ae-d3db-49c9-9bb7-9d149d62601e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:40.180230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:40.212255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:40.212898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:40.213178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:40.213452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:40.214110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:40.216075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:40.355535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1560/3096] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:35:39 2022] POST /identity/v3/users => generated 298 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:40.361078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:40.379881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b5a4-7c18-4ea0-8d5c-21c8478640ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:40.398666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:40.399413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:40.399897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:40.400277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:40.401050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:40.403265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:40.458733 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1537/3097] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:40.459651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:40.505236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176aeed-b17c-40a7-b676-5a448e7abffd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:40.532853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0650a7-10bd-4a77-a4b8-6e05e66f0cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:40.539023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0650a7-10bd-4a77-a4b8-6e05e66f0cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:40.539023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0650a7-10bd-4a77-a4b8-6e05e66f0cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:40.539023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0650a7-10bd-4a77-a4b8-6e05e66f0cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:40.539023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0650a7-10bd-4a77-a4b8-6e05e66f0cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:40.544504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0650a7-10bd-4a77-a4b8-6e05e66f0cf6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:40.581998 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1561/3098] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:40.584226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:40.610196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e35f3-9378-480a-9fa0-8151fb1c7b9b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:40.640349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:40.641583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:40.644311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:40.644594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] PATH_INFO: `/v3/projects/c1fdd43b90ae4862bb1658e6c08cfb02/users/641f79ec2f6d4507a4c6a18b80e714b4/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:40.700726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fdd43b90ae4862bb1658e6c08cfb02, user_id=641f79ec2f6d4507a4c6a18b80e714b4, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:40.704190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:40.783075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1538/3099] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:35:40 2022] PUT /identity/v3/projects/c1fdd43b90ae4862bb1658e6c08cfb02/users/641f79ec2f6d4507a4c6a18b80e714b4/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:40.793589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:40.794173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:40.794597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:40.870806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] MFA Rules not processed for user `641f79ec2f6d4507a4c6a18b80e714b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:40.872280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:41.060414 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1562/3100] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:41.101767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:41.103738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:41.383126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8594cd-81cc-414f-acc9-b40b25e49952 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:41.402206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:41.402861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:41.403172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:41.403426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:41.433025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:41.435427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:41.477294 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1539/3101] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:41 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:35:46.753573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:46.755773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:46.943422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091b84d-e793-4906-a353-cc2c81df2067 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:46.958228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a82eaa-0ee3-4eb3-ac17-46078b2be196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:46.959136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82eaa-0ee3-4eb3-ac17-46078b2be196 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:46.959593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82eaa-0ee3-4eb3-ac17-46078b2be196 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:46.960117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82eaa-0ee3-4eb3-ac17-46078b2be196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:46.967610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8a82eaa-0ee3-4eb3-ac17-46078b2be196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:47.138367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a82eaa-0ee3-4eb3-ac17-46078b2be196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:47.139838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a82eaa-0ee3-4eb3-ac17-46078b2be196 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:47.172455 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1563/3102] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:51.342415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:51.354177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3468390-7fd9-4eaf-ad5f-b3ef29a7dc92 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:51.370521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:51.371387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:51.372082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:51.372516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] PATH_INFO: `/v3/users/641f79ec2f6d4507a4c6a18b80e714b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:51.373997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641f79ec2f6d4507a4c6a18b80e714b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:51.376227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:51.640204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641f79ec2f6d4507a4c6a18b80e714b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:51.641122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641f79ec2f6d4507a4c6a18b80e714b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:51.726875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641f79ec2f6d4507a4c6a18b80e714b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:51.727534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641f79ec2f6d4507a4c6a18b80e714b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:51.729236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:51.740730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641f79ec2f6d4507a4c6a18b80e714b4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:51.781934 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1540/3103] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:35:51 2022] DELETE /identity/v3/users/641f79ec2f6d4507a4c6a18b80e714b4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:51.783669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:51.784534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:51.785052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:51.829799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:51.833663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:51.844374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:52.031887 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1564/3104] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:35:52.042956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:52.045419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:52.193370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1238bb-f99e-4638-81e3-ddc516348f28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:52.197579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507c658-8b47-47b0-9a4f-325750aca4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:52.198766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c658-8b47-47b0-9a4f-325750aca4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:52.199390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c658-8b47-47b0-9a4f-325750aca4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:52.199829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c658-8b47-47b0-9a4f-325750aca4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:52.213964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507c658-8b47-47b0-9a4f-325750aca4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:52.215703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7507c658-8b47-47b0-9a4f-325750aca4b0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:52.231479 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1541/3105] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:53.056223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:53.058672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:53.090310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc93e5-e852-4a2d-92b7-b8b745e83592 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:53.107921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:53.108597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:53.108882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:53.112094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] PATH_INFO: `/v3/projects/c1fdd43b90ae4862bb1658e6c08cfb02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:53.114626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fdd43b90ae4862bb1658e6c08cfb02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:53.122926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:53.267265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fdd43b90ae4862bb1658e6c08cfb02', 'request_id': 'req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:53.275891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fdd43b90ae4862bb1658e6c08cfb02', 'request_id': 'req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:53.337117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fdd43b90ae4862bb1658e6c08cfb02', 'request_id': 'req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:53.390820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] The token cache is being invalidate because project c1fdd43b90ae4862bb1658e6c08cfb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:35:53.392030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:53.393919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfa8fc3b-6cb3-45e5-81c0-3d26e7d6bbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:53.398448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1565/3106] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:35:53 2022] DELETE /identity/v3/projects/c1fdd43b90ae4862bb1658e6c08cfb02 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:53.403139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13217a8a-4c98-4fe9-b56f-dcfcaaf35130 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:53.404307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13217a8a-4c98-4fe9-b56f-dcfcaaf35130 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:53.404661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13217a8a-4c98-4fe9-b56f-dcfcaaf35130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:53.435754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13217a8a-4c98-4fe9-b56f-dcfcaaf35130 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:53.437991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13217a8a-4c98-4fe9-b56f-dcfcaaf35130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:53.594650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1542/3107] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:53.602615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55474-1741-4820-8d72-f67a1957a7d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:53.603189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55474-1741-4820-8d72-f67a1957a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:53.603676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f55474-1741-4820-8d72-f67a1957a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:53.689003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c2f55474-1741-4820-8d72-f67a1957a7d0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:53.692822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2f55474-1741-4820-8d72-f67a1957a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:53.724243 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1566/3108] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:35:53.729741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13217a8a-4c98-4fe9-b56f-dcfcaaf35130 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:53.750430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13217a8a-4c98-4fe9-b56f-dcfcaaf35130 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:53.781208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:53.781434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:53.781672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:53.781949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:53.782965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:35:53.782965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:53.784725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:53.835684 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1543/3109] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:35:53.837253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f55474-1741-4820-8d72-f67a1957a7d0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:53.849625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f55474-1741-4820-8d72-f67a1957a7d0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:53.866347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:53.867033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:53.867328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:53.868648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:53.869398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:53.874497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:54.019453 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1567/3110] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:35:53 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:54.023631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:54.035904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd443-b694-475f-82a0-6ea3efa225b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:54.120316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:54.121224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:54.121695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:54.122218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:54.123333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:54.125851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:54.136706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:54.230292 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1544/3111] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:35:54 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:54.233968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:54.250640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973198b-8542-4a68-9711-9dc9a06a488a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:54.256926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:54.257990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:54.258607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:54.259173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:54.260820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:54.263107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:54.276100 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1568/3112] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:54.281000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:54.295178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49591-32ac-4c05-9fc5-ec3a84d867fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:54.305175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca1f41-6f45-4c53-bd54-8fb6cbd2107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:54.306850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1f41-6f45-4c53-bd54-8fb6cbd2107b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:54.307523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1f41-6f45-4c53-bd54-8fb6cbd2107b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:54.308280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1f41-6f45-4c53-bd54-8fb6cbd2107b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:54.311726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca1f41-6f45-4c53-bd54-8fb6cbd2107b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:54.315099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca1f41-6f45-4c53-bd54-8fb6cbd2107b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:54.344643 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1545/3113] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:54.349042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:54.369502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65251eda-0cc2-44bb-8b46-73ddbe3c6fca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:54.376317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:54.378009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:54.378624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:54.379186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] PATH_INFO: `/v3/projects/c069d291000f4cf1943ed424c176b956/users/dfe5957406304879a1adde2aa2c93c5c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:54.404977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c069d291000f4cf1943ed424c176b956, user_id=dfe5957406304879a1adde2aa2c93c5c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:54.411463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:54.509916 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1569/3114] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:35:54 2022] PUT /identity/v3/projects/c069d291000f4cf1943ed424c176b956/users/dfe5957406304879a1adde2aa2c93c5c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:54.523240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9edd-c9c7-4f1b-a6ec-2166cf0f1bd4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:54.524156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9edd-c9c7-4f1b-a6ec-2166cf0f1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:54.524514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f9edd-c9c7-4f1b-a6ec-2166cf0f1bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:54.618556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e34f9edd-c9c7-4f1b-a6ec-2166cf0f1bd4 None None] MFA Rules not processed for user `dfe5957406304879a1adde2aa2c93c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:54.623693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e34f9edd-c9c7-4f1b-a6ec-2166cf0f1bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:54.807795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1546/3115] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:35:54.821076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:54.823634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:54.910232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:54.973326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e59f3-eaa9-4110-9df8-c7b5b696de05 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:54.980482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b317fa-8067-4c14-b8dd-c03b8eb9a96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:54.980865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b317fa-8067-4c14-b8dd-c03b8eb9a96d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:54.981276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b317fa-8067-4c14-b8dd-c03b8eb9a96d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:54.981651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b317fa-8067-4c14-b8dd-c03b8eb9a96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:54.992828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b317fa-8067-4c14-b8dd-c03b8eb9a96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:54.995275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b317fa-8067-4c14-b8dd-c03b8eb9a96d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:55.008694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1570/3116] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:55.710958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f9edd-c9c7-4f1b-a6ec-2166cf0f1bd4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:55.795701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f9edd-c9c7-4f1b-a6ec-2166cf0f1bd4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:55.802662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:55.804007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:55.804299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:55.804573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] PATH_INFO: `/v3/users/dfe5957406304879a1adde2aa2c93c5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:55.806591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe5957406304879a1adde2aa2c93c5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:55.808800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:55.964938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe5957406304879a1adde2aa2c93c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:55.965615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe5957406304879a1adde2aa2c93c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:56.034639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe5957406304879a1adde2aa2c93c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:56.036269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe5957406304879a1adde2aa2c93c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:56.050782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe5957406304879a1adde2aa2c93c5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:56.061782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:56.081137 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1547/3117] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:35:55 2022] DELETE /identity/v3/users/dfe5957406304879a1adde2aa2c93c5c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:56.094094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:56.094660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:56.094660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:56.130539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:56.132042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:56.248185 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1571/3118] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:56.262636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:56.264256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:56.456529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d2c2f-2a8e-420f-b7b5-d906c412cfac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:56.468263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e3300-69f9-45c0-a942-a62c440fffcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:56.468263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3300-69f9-45c0-a942-a62c440fffcd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:56.468263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3300-69f9-45c0-a942-a62c440fffcd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:56.468263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3300-69f9-45c0-a942-a62c440fffcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:56.490103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e3300-69f9-45c0-a942-a62c440fffcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:56.492073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e3300-69f9-45c0-a942-a62c440fffcd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:56.504169 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1548/3119] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:56.967554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:56.969838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:56.990188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d431a6f-1958-4ea1-8b4d-8e5585b63aa7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:56.996911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:56.997828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:56.998125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.000733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] PATH_INFO: `/v3/projects/c069d291000f4cf1943ed424c176b956` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.003460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c069d291000f4cf1943ed424c176b956)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:57.006301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:57.092665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c069d291000f4cf1943ed424c176b956', 'request_id': 'req-4d7d8e17-c3c3-4175-aafc-538cdb113a14'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:57.099745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c069d291000f4cf1943ed424c176b956', 'request_id': 'req-4d7d8e17-c3c3-4175-aafc-538cdb113a14'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:57.148046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c069d291000f4cf1943ed424c176b956', 'request_id': 'req-4d7d8e17-c3c3-4175-aafc-538cdb113a14'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:57.161122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] The token cache is being invalidate because project c069d291000f4cf1943ed424c176b956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:35:57.161352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:57.161986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d7d8e17-c3c3-4175-aafc-538cdb113a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:57.163537 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1572/3120] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:35:56 2022] DELETE /identity/v3/projects/c069d291000f4cf1943ed424c176b956 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:57.168762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5975fe-88bc-4aa8-9f78-e15f81afb28a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:57.169304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5975fe-88bc-4aa8-9f78-e15f81afb28a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.169304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5975fe-88bc-4aa8-9f78-e15f81afb28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.190951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb5975fe-88bc-4aa8-9f78-e15f81afb28a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:57.193199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb5975fe-88bc-4aa8-9f78-e15f81afb28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:57.308947 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1549/3121] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:57.317719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df484-f33d-4c61-aa0d-12694723f6f0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:57.318012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df484-f33d-4c61-aa0d-12694723f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.318304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9df484-f33d-4c61-aa0d-12694723f6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.350124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ce9df484-f33d-4c61-aa0d-12694723f6f0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:57.351745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce9df484-f33d-4c61-aa0d-12694723f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:57.366252 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1573/3122] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:57.366730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5975fe-88bc-4aa8-9f78-e15f81afb28a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:57.398856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec05ef-dd3b-47b7-943d-a3e63957d8b0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:57.399602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec05ef-dd3b-47b7-943d-a3e63957d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.400042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec05ef-dd3b-47b7-943d-a3e63957d8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.426180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5975fe-88bc-4aa8-9f78-e15f81afb28a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:57.446986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:57.447812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:57.454227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.454728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.456818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:35:57.457964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:57.459943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:57.494125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1550/3123] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:35:57.495051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:57.515425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d44c8-6c12-46e1-94b3-2ea5af5de0b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:57.521372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff809f-9dea-4be0-81c5-1b4d5d132dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:57.522490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff809f-9dea-4be0-81c5-1b4d5d132dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:57.522928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff809f-9dea-4be0-81c5-1b4d5d132dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.523383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff809f-9dea-4be0-81c5-1b4d5d132dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.524226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff809f-9dea-4be0-81c5-1b4d5d132dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:57.526424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff809f-9dea-4be0-81c5-1b4d5d132dc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:57.664137 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1551/3124] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:35:57 2022] POST /identity/v3/projects => generated 359 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:57.672558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:57.673423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.674468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.707798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6bec05ef-dd3b-47b7-943d-a3e63957d8b0 None None] MFA Rules not processed for user `f4e090dfe8fc4621b5446053eb2cc5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:57.710384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6bec05ef-dd3b-47b7-943d-a3e63957d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:57.724743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:57.726452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:57.731530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:57.817607 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1574/3125] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:57.818782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec05ef-dd3b-47b7-943d-a3e63957d8b0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:57.881360 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1552/3126] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:57.882704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:57.885301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:57.901836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:57.913685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec05ef-dd3b-47b7-943d-a3e63957d8b0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:57.920230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:57.921013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:57.921368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:57.921715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:57.922600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:57.924771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:57.995021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66783a-1e02-43ef-83c6-bf158b08a294 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.008723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.009178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.009542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.009985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.010866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.015681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.042621 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1575/3127] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:35:57 2022] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:58.045609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.048681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:58.212831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c970f7f-81a5-49e9-a2d4-55bd42ba4a8f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.215051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.215955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.216565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.216880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.227357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.229723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.235987 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1553/3128] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:35:57 2022] POST /identity/v3/projects => generated 405 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:58.237330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.244417 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1576/3129] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:35:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:58.246164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.268792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecb2ee-40b9-4101-8c56-66b1af790a28 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.363788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:58.371745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90847-ffa9-4b2e-a1b3-b41d06c766bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.378351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.378962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.379247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.379626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.380282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.382163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.401786 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1554/3130] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:58.402732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.425000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.425000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.425000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.425000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.425571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.426821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868dfc-779f-4525-a7fe-eaa51928f4f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.429221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.456214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.460967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.463198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.463649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.464492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.477587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.523612 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1577/3131] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:35:58 2022] POST /identity/v3/users => generated 303 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:35:58.527898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.537049 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1555/3132] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:58.537521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.541853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41ed27-f3f2-48c9-844d-3525fd74620e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.549616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.550608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.551195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.551678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.552478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.554470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.570105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096fe9-b24e-4cff-a72c-dd4510e1ccd1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.570675 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1578/3133] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:58.573130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.587189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d50e65-7c02-4981-8828-6c03b12aabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.587928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50e65-7c02-4981-8828-6c03b12aabd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.588227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50e65-7c02-4981-8828-6c03b12aabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.588502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50e65-7c02-4981-8828-6c03b12aabd6 admin admin] PATH_INFO: `/v3/projects/35b89e86a40d4f3c986b1d216a9fe3bb/users/961c6c2a7cac4a5c8ea8a708ef9bebdd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.596652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed4742-6fa3-43d3-8a43-a197240e20c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.610265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.610902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.611181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.611993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.618714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.621081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.623997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d50e65-7c02-4981-8828-6c03b12aabd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b89e86a40d4f3c986b1d216a9fe3bb, user_id=961c6c2a7cac4a5c8ea8a708ef9bebdd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.630030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d50e65-7c02-4981-8828-6c03b12aabd6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.642005 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1579/3134] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:35:58.645846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:58.657831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae882c5-3f17-41b2-a194-4d700eea0bea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:58.671524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:58.672230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.672691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.672984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] PATH_INFO: `/v3/projects/b201693e6af64739b3ff64ae0b938f91/users/2ba6838531ce4d16a36ea3ef1fecb0b7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.691663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b201693e6af64739b3ff64ae0b938f91, user_id=2ba6838531ce4d16a36ea3ef1fecb0b7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:58.694473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:58.738339 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1556/3135] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:35:58 2022] PUT /identity/v3/projects/35b89e86a40d4f3c986b1d216a9fe3bb/users/961c6c2a7cac4a5c8ea8a708ef9bebdd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:58.752838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc282b-10ac-4752-b01f-5158fc3e1244 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:58.753907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc282b-10ac-4752-b01f-5158fc3e1244 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:58.756382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc282b-10ac-4752-b01f-5158fc3e1244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:58.816064 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1580/3136] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:35:58 2022] PUT /identity/v3/projects/b201693e6af64739b3ff64ae0b938f91/users/2ba6838531ce4d16a36ea3ef1fecb0b7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:35:58.833872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-32dc282b-10ac-4752-b01f-5158fc3e1244 None None] MFA Rules not processed for user `961c6c2a7cac4a5c8ea8a708ef9bebdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:58.835224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32dc282b-10ac-4752-b01f-5158fc3e1244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:58.949364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:59.008766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1557/3137] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:35:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:59.020797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:59.022652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:59.200289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a6f0-5551-4604-b799-c3f516dbb1db admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:59.207790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde2751-e065-4bbb-ba3c-65e1e6dd058c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:59.212816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde2751-e065-4bbb-ba3c-65e1e6dd058c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:59.212816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde2751-e065-4bbb-ba3c-65e1e6dd058c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:59.212816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde2751-e065-4bbb-ba3c-65e1e6dd058c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:59.224382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde2751-e065-4bbb-ba3c-65e1e6dd058c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:59.226569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde2751-e065-4bbb-ba3c-65e1e6dd058c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:59.257705 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1581/3138] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:35:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:35:59.322917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc282b-10ac-4752-b01f-5158fc3e1244 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:59.375742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b10f-5e2f-4fac-92bf-2f9e16a98e7c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:59.375742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b10f-5e2f-4fac-92bf-2f9e16a98e7c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:59.375742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b10f-5e2f-4fac-92bf-2f9e16a98e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:59.417766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ece1b10f-5e2f-4fac-92bf-2f9e16a98e7c None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:35:59.419382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ece1b10f-5e2f-4fac-92bf-2f9e16a98e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:35:59.532818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc282b-10ac-4752-b01f-5158fc3e1244 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:59.548702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:59.550098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:59.554243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:59.554721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] PATH_INFO: `/v3/users/961c6c2a7cac4a5c8ea8a708ef9bebdd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:59.558136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] RBAC: Authorizing `identity:delete_user(user_id=961c6c2a7cac4a5c8ea8a708ef9bebdd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:59.560545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:59.600835 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1582/3139] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:35:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:35:59.601255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1b10f-5e2f-4fac-92bf-2f9e16a98e7c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:35:59.627426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:59.759745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1b10f-5e2f-4fac-92bf-2f9e16a98e7c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:35:59.774407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb0b6c-6942-481f-bb03-5787f251dd15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:35:59.775015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0b6c-6942-481f-bb03-5787f251dd15 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:35:59.775290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0b6c-6942-481f-bb03-5787f251dd15 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:35:59.775559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb0b6c-6942-481f-bb03-5787f251dd15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:35:59.798438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0b6c-6942-481f-bb03-5787f251dd15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:35:59.800533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb0b6c-6942-481f-bb03-5787f251dd15 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:35:59.816528 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1583/3140] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:59.872815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961c6c2a7cac4a5c8ea8a708ef9bebdd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:59.873523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961c6c2a7cac4a5c8ea8a708ef9bebdd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:59.932913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961c6c2a7cac4a5c8ea8a708ef9bebdd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:59.933848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961c6c2a7cac4a5c8ea8a708ef9bebdd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:35:59.961475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961c6c2a7cac4a5c8ea8a708ef9bebdd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:00.003161 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1558/3141] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:35:59 2022] DELETE /identity/v3/users/961c6c2a7cac4a5c8ea8a708ef9bebdd => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:00.004860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:00.005156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:00.005435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:00.045116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:00.046436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:00.243944 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1584/3142] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:00.260751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:00.263172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:00.284980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:00.288275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:00.330897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627159-46f3-46bd-97b1-6458a2b60a18 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:00.344411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:00.345084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:00.345404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:00.345749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] PATH_INFO: `/v3/users/63497dd52a5c4cd58e8916d3ea348479` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:00.348830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63497dd52a5c4cd58e8916d3ea348479)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:00.351508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:00.481239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55cef4-8f9c-48c8-8727-2ddc69fb025b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:00.493550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:00.496573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:00.497106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:00.497527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:00.512057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:00.514375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:00.521819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:00.528238 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1559/3143] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:00.666880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63497dd52a5c4cd58e8916d3ea348479'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:00.683030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63497dd52a5c4cd58e8916d3ea348479'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:00.684070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63497dd52a5c4cd58e8916d3ea348479'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:00.711647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63497dd52a5c4cd58e8916d3ea348479'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:00.843410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63497dd52a5c4cd58e8916d3ea348479'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:00.843410 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1585/3144] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:00 2022] DELETE /identity/v3/users/63497dd52a5c4cd58e8916d3ea348479 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:36:01.441381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:01.442894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:01.466407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2541-2533-4e32-9f53-8730a2b2345e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:01.570014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:01.572777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:01.632325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:01.633660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:01.634224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:01.637340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:01.638040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] PATH_INFO: `/v3/projects/35b89e86a40d4f3c986b1d216a9fe3bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:01.649517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b89e86a40d4f3c986b1d216a9fe3bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:01.651961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:01.769374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac9ad8-7e82-4e16-85a1-9df8553922e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:01.785573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:01.786079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:01.789300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:01.789713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] PATH_INFO: `/v3/projects/50333c729f8742e4b78d007d13fe66a8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:01.791275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=50333c729f8742e4b78d007d13fe66a8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:01.793340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:01.832737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b89e86a40d4f3c986b1d216a9fe3bb', 'request_id': 'req-0415d714-0cad-4a1b-9fcf-f77dccf975ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:01.845711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b89e86a40d4f3c986b1d216a9fe3bb', 'request_id': 'req-0415d714-0cad-4a1b-9fcf-f77dccf975ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:01.954866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b89e86a40d4f3c986b1d216a9fe3bb', 'request_id': 'req-0415d714-0cad-4a1b-9fcf-f77dccf975ae'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:01.972343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] The token cache is being invalidate because project 35b89e86a40d4f3c986b1d216a9fe3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:01.972343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:01.972666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0415d714-0cad-4a1b-9fcf-f77dccf975ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:01.975110 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1560/3145] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:01 2022] DELETE /identity/v3/projects/35b89e86a40d4f3c986b1d216a9fe3bb => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:01.980410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d42b-a13a-456c-a573-5b2cd7426ecc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:01.980758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d42b-a13a-456c-a573-5b2cd7426ecc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:01.981239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d42b-a13a-456c-a573-5b2cd7426ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.006951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50333c729f8742e4b78d007d13fe66a8', 'request_id': 'req-98df31fc-9745-45d2-bf8b-90949f6b48bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:02.007924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bcb1d42b-a13a-456c-a573-5b2cd7426ecc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:02.012783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bcb1d42b-a13a-456c-a573-5b2cd7426ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:02.019668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50333c729f8742e4b78d007d13fe66a8', 'request_id': 'req-98df31fc-9745-45d2-bf8b-90949f6b48bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:02.091539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50333c729f8742e4b78d007d13fe66a8', 'request_id': 'req-98df31fc-9745-45d2-bf8b-90949f6b48bc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:02.114681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] The token cache is being invalidate because project 50333c729f8742e4b78d007d13fe66a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:02.115952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:02.116474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98df31fc-9745-45d2-bf8b-90949f6b48bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:02.120774 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1586/3146] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:01 2022] DELETE /identity/v3/projects/50333c729f8742e4b78d007d13fe66a8 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:02.125716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f9ef5-e32f-4aec-a322-b559edaf7f53 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.129487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f9ef5-e32f-4aec-a322-b559edaf7f53 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.129487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f9ef5-e32f-4aec-a322-b559edaf7f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.178106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9e1f9ef5-e32f-4aec-a322-b559edaf7f53 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:02.180491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e1f9ef5-e32f-4aec-a322-b559edaf7f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:02.192342 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1561/3147] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:02.195317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771225f-80d6-4921-937d-0778c255ec89 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.195617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771225f-80d6-4921-937d-0778c255ec89 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.196261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771225f-80d6-4921-937d-0778c255ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.208147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1587/3148] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:02.218166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ffe2-890e-48f5-b7f9-c4ee49f57b0f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.218166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ffe2-890e-48f5-b7f9-c4ee49f57b0f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.218166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ffe2-890e-48f5-b7f9-c4ee49f57b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.247327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6771225f-80d6-4921-937d-0778c255ec89 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:02.249076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6771225f-80d6-4921-937d-0778c255ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:02.269658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1732ffe2-890e-48f5-b7f9-c4ee49f57b0f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:02.269658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1732ffe2-890e-48f5-b7f9-c4ee49f57b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:02.277622 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1588/3149] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:02.278447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ffe2-890e-48f5-b7f9-c4ee49f57b0f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:02.286131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1562/3150] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:02.291801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771225f-80d6-4921-937d-0778c255ec89 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:02.320791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771225f-80d6-4921-937d-0778c255ec89 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:02.330684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ffe2-890e-48f5-b7f9-c4ee49f57b0f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:02.333181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:02.337516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.337516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.337516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.337516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:36:02.337516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:02.338574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:02.342444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:02.343302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.344037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.344037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.345245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:36:02.345508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:02.353492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:02.370738 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1589/3151] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:36:02.374887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:02.375978 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1563/3152] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:36:02.380846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:02.393056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a0a0-461c-451f-b524-d2dd4e6706a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:02.399555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:02.400626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.401127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.401629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.403058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:02.406789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:02.412596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019656db-6487-4767-843d-e3bddcc2736c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:02.434925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:02.435563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.435856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.436396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.437446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:02.444222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:02.479530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:02.621232 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1590/3153] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:02 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:02.622411 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1564/3154] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:02 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:02.626142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:02.627326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:02.805997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:02.815552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923e0c4-3bc9-4bc8-ab81-30480507f30a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:02.857308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03510666-baee-4d2c-a006-6a0838ce0acb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:02.872625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:02.874366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.874876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.877121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.878141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:02.882095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:02.986920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:02.987602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:02.987975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:02.988253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:02.989105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:02.991316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.050384 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1565/3155] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:02 2022] POST /identity/v3/users => generated 292 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:03.052752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.065373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552850b-bb34-45c4-be4f-7ae421e92bf5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.071978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.072670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.072952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.073223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.073887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.075648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.092450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1566/3156] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:03.098764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.106019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff571fb8-f44a-4704-8261-fb50cff9f4f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.112222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.112857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.113137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.113566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.114420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.115962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.125556 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1591/3157] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:02 2022] POST /identity/v3/users => generated 289 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:03.135170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.148781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65b2cd-c56a-4692-947d-3494afaaa685 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.152954 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1567/3158] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:03.156365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.157405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.157689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.159416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.159416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.163958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.166598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.179603 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1592/3159] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:03.181677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29450c1f-7b4c-4b87-bcaa-10c62d150c05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.183852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.193897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd718d-1423-49c3-8d73-e67e7321ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.194798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd718d-1423-49c3-8d73-e67e7321ff3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.195275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd718d-1423-49c3-8d73-e67e7321ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.195618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd718d-1423-49c3-8d73-e67e7321ff3f admin admin] PATH_INFO: `/v3/projects/6f06a13e0abd49e7a23ba3ce837418bd/users/95ebb57f540241b49112abdc3e90431a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.203292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5f416-d8ef-4534-95a7-5d5b03c22d02 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.210414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.211461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.211897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.212323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.213274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.215256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.229735 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1593/3160] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:36:03.234414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.252852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd718d-1423-49c3-8d73-e67e7321ff3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f06a13e0abd49e7a23ba3ce837418bd, user_id=95ebb57f540241b49112abdc3e90431a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.263183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd718d-1423-49c3-8d73-e67e7321ff3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.274971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca0c32-fcde-4824-866b-7980db3910a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.282347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3467a-0bae-4f09-9325-0b68974791b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.283292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3467a-0bae-4f09-9325-0b68974791b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.284551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3467a-0bae-4f09-9325-0b68974791b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.284882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3467a-0bae-4f09-9325-0b68974791b9 admin admin] PATH_INFO: `/v3/projects/ef289ee4f9954fc1bceaee4b381c3d3b/users/a857437becf14392bd1332824d86111c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.362904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3467a-0bae-4f09-9325-0b68974791b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef289ee4f9954fc1bceaee4b381c3d3b, user_id=a857437becf14392bd1332824d86111c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.367125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3467a-0bae-4f09-9325-0b68974791b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.395656 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1568/3161] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:03 2022] PUT /identity/v3/projects/6f06a13e0abd49e7a23ba3ce837418bd/users/95ebb57f540241b49112abdc3e90431a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:03.397215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe44c4-f1e5-44b1-962d-4d72ee46f97b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.397493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe44c4-f1e5-44b1-962d-4d72ee46f97b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.397773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe44c4-f1e5-44b1-962d-4d72ee46f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.428001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-afbe44c4-f1e5-44b1-962d-4d72ee46f97b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:03.428001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afbe44c4-f1e5-44b1-962d-4d72ee46f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:03.469663 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1594/3162] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:03 2022] PUT /identity/v3/projects/ef289ee4f9954fc1bceaee4b381c3d3b/users/a857437becf14392bd1332824d86111c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:03.475934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.476529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.480452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.510514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:03.512289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:03.577081 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1569/3163] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:03.578605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.578896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.579177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.623795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:03.624987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:03.646628 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1595/3164] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:03.647359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.650850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:03.691497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:03.743725 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1570/3165] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:03.745058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:03.746566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:03.770923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:03.782887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f504c-c141-430c-884b-c01ad8b619ff None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.791289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.792220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.792220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.792485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.815927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.819558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.844184 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1596/3166] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:03.892417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00737582-3cee-4833-9b08-3cf0b3944598 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:03.906490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee4ed-066d-4c7c-98b4-1a50baf972f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:03.907221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee4ed-066d-4c7c-98b4-1a50baf972f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:03.911298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee4ed-066d-4c7c-98b4-1a50baf972f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:03.911298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee4ed-066d-4c7c-98b4-1a50baf972f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:03.930146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee4ed-066d-4c7c-98b4-1a50baf972f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:03.934289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee4ed-066d-4c7c-98b4-1a50baf972f9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:03.964070 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1571/3167] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:06.988393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:06.990620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:07.015120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf8503-5cca-4417-9105-2a86f24bac5f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:07.018535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:07.019444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:07.019888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:07.020307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] PATH_INFO: `/v3/users/d0e1b26675df4407a678af7ac54892fe` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:07.021920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e1b26675df4407a678af7ac54892fe)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:07.026186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:07.332107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e1b26675df4407a678af7ac54892fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:07.356816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e1b26675df4407a678af7ac54892fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:07.359814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e1b26675df4407a678af7ac54892fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:07.378939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e1b26675df4407a678af7ac54892fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:07.474737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e1b26675df4407a678af7ac54892fe'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:07.494973 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1597/3168] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:06 2022] DELETE /identity/v3/users/d0e1b26675df4407a678af7ac54892fe => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:07.502632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:07.503812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:07.504436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:07.533668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:07.536597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:07.705934 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1572/3169] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:07.756602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:07.758362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:07.869490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d2427-1ab4-4f96-8f09-43bc4e5ffb6f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:07.875444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:07.876308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:07.878274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:07.879558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:07.892796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:07.894552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:07.909483 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1598/3170] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:08.929280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:08.930950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:08.955526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60341d8f-e421-4b1d-bd87-886473e0492f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:08.967730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:08.968630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:08.969058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:08.969524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] PATH_INFO: `/v3/projects/d82cf578b2864ab381b613144be6b00b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:08.976279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82cf578b2864ab381b613144be6b00b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:08.978405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:09.208515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82cf578b2864ab381b613144be6b00b', 'request_id': 'req-0986fad6-5bee-4c62-bedf-b69f55fef167'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.231456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82cf578b2864ab381b613144be6b00b', 'request_id': 'req-0986fad6-5bee-4c62-bedf-b69f55fef167'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.348424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82cf578b2864ab381b613144be6b00b', 'request_id': 'req-0986fad6-5bee-4c62-bedf-b69f55fef167'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.366424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] The token cache is being invalidate because project d82cf578b2864ab381b613144be6b00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:09.366722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.367849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.372741 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1573/3171] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:08 2022] DELETE /identity/v3/projects/d82cf578b2864ab381b613144be6b00b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:09.377865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:09.398406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20375366-0e82-4548-b6c7-7fa90fd56814 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:09.506313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:09.508740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:09.509434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:09.510177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] PATH_INFO: `/v3/users/3462419f57dc48ebbbc77d1c3956745d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:09.514350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3462419f57dc48ebbbc77d1c3956745d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:09.519080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:09.526542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:09.821392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3462419f57dc48ebbbc77d1c3956745d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.840016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3462419f57dc48ebbbc77d1c3956745d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.841631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3462419f57dc48ebbbc77d1c3956745d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.859042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3462419f57dc48ebbbc77d1c3956745d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.933182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:09.934697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:09.947055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:09.976472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3462419f57dc48ebbbc77d1c3956745d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:09.984043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1599/3172] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:09 2022] DELETE /identity/v3/users/3462419f57dc48ebbbc77d1c3956745d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:10.088648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986fad6-5bee-4c62-bedf-b69f55fef167 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:10.184683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:10.193896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:10.244401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:10.245368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:10.245874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:10.246388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:10.250655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:10.276235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:10.290455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:10.305521 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1574/3173] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:10.406592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57023924-a34d-4d12-ab12-c24175da143d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:10.414730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:10.415404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:10.415692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:10.415972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] PATH_INFO: `/v3/users/d5ed601492e2486bad8ba5b09515d52a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:10.417164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ed601492e2486bad8ba5b09515d52a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:10.421987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:10.710529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ed601492e2486bad8ba5b09515d52a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:10.719809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ed601492e2486bad8ba5b09515d52a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:10.721302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ed601492e2486bad8ba5b09515d52a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:10.736215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ed601492e2486bad8ba5b09515d52a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:10.869464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ed601492e2486bad8ba5b09515d52a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:10.878584 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1600/3174] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:10 2022] DELETE /identity/v3/users/d5ed601492e2486bad8ba5b09515d52a => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:11.196117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:11.220972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e84b-879f-49b5-8455-d6d1018642d0 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:11.306539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:11.307500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:11.308054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:11.308333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] PATH_INFO: `/v3/projects/9395a050de444357956d4ac79adefee6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:11.309776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9395a050de444357956d4ac79adefee6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:11.311922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:11.368811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:11.370453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:11.410882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec40dad-07fb-47ac-b090-a6ef4f13fe09 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:11.418763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:11.421147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:11.422540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:11.426950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] PATH_INFO: `/v3/projects/f1cedb363dae46b2acec56e1b75fef31` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:11.427372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cedb363dae46b2acec56e1b75fef31)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:11.433208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:11.468061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9395a050de444357956d4ac79adefee6', 'request_id': 'req-76266d11-f4bf-4b24-b2b0-8229f7361558'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.479689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9395a050de444357956d4ac79adefee6', 'request_id': 'req-76266d11-f4bf-4b24-b2b0-8229f7361558'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.564070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cedb363dae46b2acec56e1b75fef31', 'request_id': 'req-d1da214d-ae14-40c2-a927-cae33b323016'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.565803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9395a050de444357956d4ac79adefee6', 'request_id': 'req-76266d11-f4bf-4b24-b2b0-8229f7361558'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.574567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cedb363dae46b2acec56e1b75fef31', 'request_id': 'req-d1da214d-ae14-40c2-a927-cae33b323016'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.593472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] The token cache is being invalidate because project 9395a050de444357956d4ac79adefee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:11.593770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.598801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.604065 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1575/3175] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:11 2022] DELETE /identity/v3/projects/9395a050de444357956d4ac79adefee6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:11.605497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:11.607326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:11.651902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cedb363dae46b2acec56e1b75fef31', 'request_id': 'req-d1da214d-ae14-40c2-a927-cae33b323016'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.654948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:11.674891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] The token cache is being invalidate because project f1cedb363dae46b2acec56e1b75fef31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:11.675193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.686723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1da214d-ae14-40c2-a927-cae33b323016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:11.699720 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1601/3176] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:11 2022] DELETE /identity/v3/projects/f1cedb363dae46b2acec56e1b75fef31 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:36:11.717485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccb0c2-517e-4372-8f25-9ddb41bba677 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:11.717988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccb0c2-517e-4372-8f25-9ddb41bba677 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:11.719377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccb0c2-517e-4372-8f25-9ddb41bba677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:11.755396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76266d11-f4bf-4b24-b2b0-8229f7361558 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:11.811190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b9ccb0c2-517e-4372-8f25-9ddb41bba677 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:11.812733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9ccb0c2-517e-4372-8f25-9ddb41bba677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:11.848192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:11.849462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:11.849820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:11.850214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] PATH_INFO: `/v3/users/2302b2fd0f814069a8969175ee09f7f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:11.852897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2302b2fd0f814069a8969175ee09f7f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:11.855195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:11.893344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:11.931134 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1602/3177] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:12.012180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5943952-3c59-47cc-bcb2-79251539b680 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.012462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5943952-3c59-47cc-bcb2-79251539b680 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.013211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5943952-3c59-47cc-bcb2-79251539b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.034207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e5943952-3c59-47cc-bcb2-79251539b680 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:12.035456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5943952-3c59-47cc-bcb2-79251539b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:12.045915 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1603/3178] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:36:12.050983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5943952-3c59-47cc-bcb2-79251539b680 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:12.062782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5943952-3c59-47cc-bcb2-79251539b680 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:12.069870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:12.070554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.070887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.071265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.071984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:36:12.072326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:12.075129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:12.090576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1604/3179] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:36:12.096144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:12.109450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2302b2fd0f814069a8969175ee09f7f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.110602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2302b2fd0f814069a8969175ee09f7f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.128459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbea934-a246-4db2-b1ce-6f33737e08e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:12.133744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:12.134415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.134722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.135006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.135638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:12.137560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:12.229876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2302b2fd0f814069a8969175ee09f7f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.231405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2302b2fd0f814069a8969175ee09f7f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.240191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2302b2fd0f814069a8969175ee09f7f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.269935 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1605/3180] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:12 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:12.273544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:12.273963 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1576/3181] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:11 2022] DELETE /identity/v3/users/2302b2fd0f814069a8969175ee09f7f6 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:12.275713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:12.386016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5539b13-83c1-443f-9709-1bb1af6d9050 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:12.527045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:12.527942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.528287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.528636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.529606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:12.533733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:12.623739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:12.625405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:12.649504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4222fb8-e379-4abf-b81e-a2f08fff6904 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:12.649735 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1606/3182] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:12 2022] POST /identity/v3/users => generated 291 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:12.654950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:12.657157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:12.663097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.664590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.667980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] PATH_INFO: `/v3/projects/78fa68afc03e4e81a50ccc146aaf6f68` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.671579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fa68afc03e4e81a50ccc146aaf6f68)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:12.682264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:12.684030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7433c2-adae-4032-9536-fdc3f5e36037 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:12.691746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:12.692797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.693656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.694208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.695014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:12.697067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:12.712805 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1607/3183] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:12.716860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:12.733097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075269a-05c3-495c-b23b-23af9eb6a82f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:12.738899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:12.739591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.739958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.740290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.741075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:12.743067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:12.755905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1608/3184] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:12.763149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:12.776482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c35338-686a-408a-b6c1-976f4a881cbe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:12.784434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719a977-a779-4844-bf32-106a45db8b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:12.785172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a977-a779-4844-bf32-106a45db8b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.785407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a977-a779-4844-bf32-106a45db8b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.785700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a977-a779-4844-bf32-106a45db8b1f admin admin] PATH_INFO: `/v3/projects/bd7c3553f1f34f86ad2a6fa9e4bb214a/users/195f89e4994b4c0ebc19dead688b7ba1/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:12.805735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719a977-a779-4844-bf32-106a45db8b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7c3553f1f34f86ad2a6fa9e4bb214a, user_id=195f89e4994b4c0ebc19dead688b7ba1, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:12.825298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719a977-a779-4844-bf32-106a45db8b1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:12.825454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fa68afc03e4e81a50ccc146aaf6f68', 'request_id': 'req-8203598d-05f8-4e86-8041-1f95db59c890'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.843216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fa68afc03e4e81a50ccc146aaf6f68', 'request_id': 'req-8203598d-05f8-4e86-8041-1f95db59c890'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.965129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fa68afc03e4e81a50ccc146aaf6f68', 'request_id': 'req-8203598d-05f8-4e86-8041-1f95db59c890'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.967847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:12.982572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] The token cache is being invalidate because project 78fa68afc03e4e81a50ccc146aaf6f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:12.982873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.983588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8203598d-05f8-4e86-8041-1f95db59c890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:12.989209 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1577/3185] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:12 2022] DELETE /identity/v3/projects/78fa68afc03e4e81a50ccc146aaf6f68 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:12.990743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ddd6-da8f-4a58-9482-135d759bb1ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:12.991028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ddd6-da8f-4a58-9482-135d759bb1ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:12.991301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ddd6-da8f-4a58-9482-135d759bb1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.011019 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1609/3186] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:12 2022] PUT /identity/v3/projects/bd7c3553f1f34f86ad2a6fa9e4bb214a/users/195f89e4994b4c0ebc19dead688b7ba1/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:13.012667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aacdb1-1fb3-4810-b932-8dc81d7b342e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.012959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aacdb1-1fb3-4810-b932-8dc81d7b342e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.013256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aacdb1-1fb3-4810-b932-8dc81d7b342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.028434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2a41ddd6-da8f-4a58-9482-135d759bb1ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:13.029201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:13.029667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a41ddd6-da8f-4a58-9482-135d759bb1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:13.052772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07aacdb1-1fb3-4810-b932-8dc81d7b342e None None] MFA Rules not processed for user `195f89e4994b4c0ebc19dead688b7ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:13.054000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07aacdb1-1fb3-4810-b932-8dc81d7b342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:13.102404 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1578/3187] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:13.108030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7336044-ca09-48e6-aca1-241f9ed9bfb6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.108558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7336044-ca09-48e6-aca1-241f9ed9bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.109123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7336044-ca09-48e6-aca1-241f9ed9bfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.129989 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1610/3188] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:36:13.131717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7336044-ca09-48e6-aca1-241f9ed9bfb6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:13.132982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7336044-ca09-48e6-aca1-241f9ed9bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:13.140710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.140998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.141282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.149808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1579/3189] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:36:13.150893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7336044-ca09-48e6-aca1-241f9ed9bfb6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:13.160927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7336044-ca09-48e6-aca1-241f9ed9bfb6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:13.166044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] MFA Rules not processed for user `195f89e4994b4c0ebc19dead688b7ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:13.166237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:13.167007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:13.167731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.168157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.168504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.169162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:36:13.169466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:13.171140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:13.175966 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1611/3190] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:36:13.187266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:13.188943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:13.190925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1580/3191] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:36:13.195939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:13.216115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974e613-5dba-4740-9aad-b18cde3355c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:13.223504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:13.224580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.225579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.226145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.227546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:13.230172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:13.282300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce355089-d337-4ad5-8476-ed9c532cc737 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:13.288223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:13.289636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.289636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.289636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.300060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:13.303735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:13.314894 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1612/3192] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:36:13.352248 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1581/3193] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/projects => generated 409 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:13.355988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:13.371267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d810-c09e-41c6-bcc8-3fd66d69ac4f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:13.454301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:13.456108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.456398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.457659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.457908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:13.460084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:13.558086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1613/3194] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/users => generated 305 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:13.559943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:13.571434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c56bd4-ffff-459d-a134-82a1cd32c6df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:13.576461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:13.577310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.577545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.577822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.578507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:13.580703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:13.594591 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1582/3195] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:13.596034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:13.607399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d94026-6b35-4057-9da9-da21f2cf472d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:13.613526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8d4fd-ee86-4876-9602-8dc1cc7e37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:13.614387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d4fd-ee86-4876-9602-8dc1cc7e37d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.614767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d4fd-ee86-4876-9602-8dc1cc7e37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.615141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d4fd-ee86-4876-9602-8dc1cc7e37d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.616092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8d4fd-ee86-4876-9602-8dc1cc7e37d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:13.617728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8d4fd-ee86-4876-9602-8dc1cc7e37d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:13.646043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1614/3196] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:13.647029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:13.658547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3710e4-0154-4082-8efc-a7aa3b766a9f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:13.666366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86caf4-bb34-4332-989d-a686e3f4d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:13.667256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86caf4-bb34-4332-989d-a686e3f4d795 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.667710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86caf4-bb34-4332-989d-a686e3f4d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.668399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86caf4-bb34-4332-989d-a686e3f4d795 admin admin] PATH_INFO: `/v3/projects/c178ce5f53bc41a796780ce1d548b73b/users/6090ab43327644faa896f1c8f7ed6d6b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.686884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86caf4-bb34-4332-989d-a686e3f4d795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c178ce5f53bc41a796780ce1d548b73b, user_id=6090ab43327644faa896f1c8f7ed6d6b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:13.690614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86caf4-bb34-4332-989d-a686e3f4d795 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:13.730649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8bb1-ded0-4661-a02d-114846ef5ef0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.734100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8bb1-ded0-4661-a02d-114846ef5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.734373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8bb1-ded0-4661-a02d-114846ef5ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.806633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-663b8bb1-ded0-4661-a02d-114846ef5ef0 None None] MFA Rules not processed for user `2ba6838531ce4d16a36ea3ef1fecb0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:13.807881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-663b8bb1-ded0-4661-a02d-114846ef5ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:13.841938 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1583/3197] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:13 2022] PUT /identity/v3/projects/c178ce5f53bc41a796780ce1d548b73b/users/6090ab43327644faa896f1c8f7ed6d6b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:13.853852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410148e8-dd1a-4e19-b134-1b2e7bb829d2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.854472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410148e8-dd1a-4e19-b134-1b2e7bb829d2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.854755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410148e8-dd1a-4e19-b134-1b2e7bb829d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:13.937133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-410148e8-dd1a-4e19-b134-1b2e7bb829d2 None None] MFA Rules not processed for user `6090ab43327644faa896f1c8f7ed6d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:13.938457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-410148e8-dd1a-4e19-b134-1b2e7bb829d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:13.959295 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1615/3198] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:13.977663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583326-ae47-4ad5-b6e7-d595e3bd2259 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:13.977894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583326-ae47-4ad5-b6e7-d595e3bd2259 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:13.982591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59583326-ae47-4ad5-b6e7-d595e3bd2259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.009625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59583326-ae47-4ad5-b6e7-d595e3bd2259 None None] MFA Rules not processed for user `f4e090dfe8fc4621b5446053eb2cc5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:14.010966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59583326-ae47-4ad5-b6e7-d595e3bd2259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:14.071487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1584/3199] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:36:14.076043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410148e8-dd1a-4e19-b134-1b2e7bb829d2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:14.098555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.117387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1616/3200] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:14.125950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.129156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59583326-ae47-4ad5-b6e7-d595e3bd2259 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:14.166089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410148e8-dd1a-4e19-b134-1b2e7bb829d2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:14.171348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:14.171982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.172324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.172519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.173324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:14.176101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:14.259350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59583326-ae47-4ad5-b6e7-d595e3bd2259 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:14.268097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:14.268799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.269405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.269405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.271493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:14.286893 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1585/3201] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:14 2022] POST /identity/v3/projects => generated 407 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:14.287405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:14.288765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:14.288886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:14.304093 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1617/3202] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:14 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:36:14.393542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1581-d461-420e-93e0-72405cd63d41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:14.399285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:14.402847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.402847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.402847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.402847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:14.404352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:14.451706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.521000 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1586/3203] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:14 2022] POST /identity/v3/users => generated 310 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:14.524805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:14.539141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a01dd-b11c-46be-a0ce-644395b5f21a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:14.546367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:14.547620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.548566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.549037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.549924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:14.552005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:14.567994 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1618/3204] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:14.572332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:14.583300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feeeff-1f2a-4eab-b593-659621ba3d80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:14.588672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:14.589316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.589606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.589883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] PATH_INFO: `/v3/projects/95f6bd44770f4a50ba1994e8f6646ccc/users/553c47e4e08c4e2bbf4a30c352690e9f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.609953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f6bd44770f4a50ba1994e8f6646ccc, user_id=553c47e4e08c4e2bbf4a30c352690e9f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:14.612991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:14.714921 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1587/3205] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:14 2022] PUT /identity/v3/projects/95f6bd44770f4a50ba1994e8f6646ccc/users/553c47e4e08c4e2bbf4a30c352690e9f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:14.719952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:14.733117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d50e4-5d71-4739-b206-15790f432e29 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:14.801280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97f6a2-2bdd-499b-b2fc-2b0be60f9db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:14.802167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f6a2-2bdd-499b-b2fc-2b0be60f9db8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.802683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f6a2-2bdd-499b-b2fc-2b0be60f9db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.803143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97f6a2-2bdd-499b-b2fc-2b0be60f9db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.804056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97f6a2-2bdd-499b-b2fc-2b0be60f9db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:14.806476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97f6a2-2bdd-499b-b2fc-2b0be60f9db8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:14.825313 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1619/3206] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:14.826529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:14.837638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f0dce-f16e-44d3-8c68-4266eff56229 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:14.843295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:14.843647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.843914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.844601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] PATH_INFO: `/v3/projects/95f6bd44770f4a50ba1994e8f6646ccc/users/553c47e4e08c4e2bbf4a30c352690e9f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.847251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f6bd44770f4a50ba1994e8f6646ccc, user_id=553c47e4e08c4e2bbf4a30c352690e9f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:14.850261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:14.864120 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1588/3207] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:14 2022] PUT /identity/v3/projects/95f6bd44770f4a50ba1994e8f6646ccc/users/553c47e4e08c4e2bbf4a30c352690e9f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:14.868654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.883633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75426a7d-69f2-4281-8bf4-c3711edaee61 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:14.884216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75426a7d-69f2-4281-8bf4-c3711edaee61 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:14.884494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75426a7d-69f2-4281-8bf4-c3711edaee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:14.944025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-75426a7d-69f2-4281-8bf4-c3711edaee61 None None] MFA Rules not processed for user `553c47e4e08c4e2bbf4a30c352690e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:14.945874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75426a7d-69f2-4281-8bf4-c3711edaee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:15.116968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1620/3208] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:14 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:15.124396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:15.235187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b18e18-bc04-4c63-9d17-83b32e545192 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:15.254781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:15.255454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:15.255741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:15.256020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] PATH_INFO: `/v3/users/6090ab43327644faa896f1c8f7ed6d6b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:15.257390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6090ab43327644faa896f1c8f7ed6d6b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:15.259520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:15.523910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6090ab43327644faa896f1c8f7ed6d6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:15.525159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6090ab43327644faa896f1c8f7ed6d6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:15.661595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6090ab43327644faa896f1c8f7ed6d6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:15.662245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6090ab43327644faa896f1c8f7ed6d6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:15.679488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6090ab43327644faa896f1c8f7ed6d6b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:15.715022 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1589/3209] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:15 2022] DELETE /identity/v3/users/6090ab43327644faa896f1c8f7ed6d6b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:15.716835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:15.717351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:15.717449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:15.739478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:15.767711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:15.772363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:15.915912 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1621/3210] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:16.009165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:16.010933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:16.149724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb2581-2411-43f6-b2ae-2e924b24043e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:16.159585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:16.160722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:16.161299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:16.161754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:16.188059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:16.192303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:16.217633 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1590/3211] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:16.722438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:18.354377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:18.356589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:18.375914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045aa39-cb28-4948-8d24-a185653a2dd1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:18.391308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:18.393510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:18.395526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:18.396605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] PATH_INFO: `/v3/projects/c178ce5f53bc41a796780ce1d548b73b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:18.400517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c178ce5f53bc41a796780ce1d548b73b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:18.406791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:18.602563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c178ce5f53bc41a796780ce1d548b73b', 'request_id': 'req-ced61190-bd8f-49b4-a175-f15502805a33'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:18.613607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c178ce5f53bc41a796780ce1d548b73b', 'request_id': 'req-ced61190-bd8f-49b4-a175-f15502805a33'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:18.712806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c178ce5f53bc41a796780ce1d548b73b', 'request_id': 'req-ced61190-bd8f-49b4-a175-f15502805a33'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:18.747895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] The token cache is being invalidate because project c178ce5f53bc41a796780ce1d548b73b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:18.748471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:18.754922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:18.760633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:18.766017 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1622/3212] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:18 2022] DELETE /identity/v3/projects/c178ce5f53bc41a796780ce1d548b73b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:18.777134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529d36c-7de4-4113-a77d-ddf7b1fdc7f5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:18.914235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:18.915066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:18.915447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:18.915825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] PATH_INFO: `/v3/users/553c47e4e08c4e2bbf4a30c352690e9f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:18.917615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553c47e4e08c4e2bbf4a30c352690e9f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:18.919577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:19.233131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553c47e4e08c4e2bbf4a30c352690e9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:19.233896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553c47e4e08c4e2bbf4a30c352690e9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:19.342720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553c47e4e08c4e2bbf4a30c352690e9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:19.343356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553c47e4e08c4e2bbf4a30c352690e9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:19.358664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ae234bb-4ac4-48c3-a3fb-3a7fcefdacb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553c47e4e08c4e2bbf4a30c352690e9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:19.398521 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1591/3213] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:18 2022] DELETE /identity/v3/users/553c47e4e08c4e2bbf4a30c352690e9f => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:21.813542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:21.816124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:21.833769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced61190-bd8f-49b4-a175-f15502805a33 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:21.900389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:21.953101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136a8c-f1bc-46fa-96a2-0ff8e75b34f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:21.954118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136a8c-f1bc-46fa-96a2-0ff8e75b34f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:21.956162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136a8c-f1bc-46fa-96a2-0ff8e75b34f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:21.961924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:21.965598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:21.965951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:21.966268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] PATH_INFO: `/v3/projects/95f6bd44770f4a50ba1994e8f6646ccc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:21.971534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f6bd44770f4a50ba1994e8f6646ccc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:21.983147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:22.018504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-82136a8c-f1bc-46fa-96a2-0ff8e75b34f5 None None] MFA Rules not processed for user `95ebb57f540241b49112abdc3e90431a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:22.019761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82136a8c-f1bc-46fa-96a2-0ff8e75b34f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.150147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:22.168487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1592/3214] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:22.172046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a37bc-7eff-426a-b7a6-1088c0360997 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.172339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a37bc-7eff-426a-b7a6-1088c0360997 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.172613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a37bc-7eff-426a-b7a6-1088c0360997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.198929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f6bd44770f4a50ba1994e8f6646ccc', 'request_id': 'req-22feaaa9-2327-49d8-a424-41afffb78519'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:22.214642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a01a37bc-7eff-426a-b7a6-1088c0360997 None None] MFA Rules not processed for user `95ebb57f540241b49112abdc3e90431a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:22.215642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a01a37bc-7eff-426a-b7a6-1088c0360997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.228106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f6bd44770f4a50ba1994e8f6646ccc', 'request_id': 'req-22feaaa9-2327-49d8-a424-41afffb78519'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:22.323473 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1593/3215] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:22.323673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a75ee1-baac-4dc8-9468-ba49c302d419 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.323868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a75ee1-baac-4dc8-9468-ba49c302d419 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.324092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a75ee1-baac-4dc8-9468-ba49c302d419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.353852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f6bd44770f4a50ba1994e8f6646ccc', 'request_id': 'req-22feaaa9-2327-49d8-a424-41afffb78519'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:22.359485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d1a75ee1-baac-4dc8-9468-ba49c302d419 None None] MFA Rules not processed for user `a857437becf14392bd1332824d86111c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:22.360755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1a75ee1-baac-4dc8-9468-ba49c302d419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.371582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] The token cache is being invalidate because project 95f6bd44770f4a50ba1994e8f6646ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:22.371905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:22.373466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:22.381762 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1623/3216] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:21 2022] DELETE /identity/v3/projects/95f6bd44770f4a50ba1994e8f6646ccc => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:22.382750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:22.387166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.530033 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1594/3217] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:22.532249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5f42-7951-43d7-863c-63379c6db940 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.532532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5f42-7951-43d7-863c-63379c6db940 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.534398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5f42-7951-43d7-863c-63379c6db940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.577181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feaaa9-2327-49d8-a424-41afffb78519 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:22.580745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-18fe5f42-7951-43d7-863c-63379c6db940 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:22.581989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18fe5f42-7951-43d7-863c-63379c6db940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.590617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e0a0-d1e0-4397-a72b-d8ec6e4f6332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:22.591221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e0a0-d1e0-4397-a72b-d8ec6e4f6332 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.591543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e0a0-d1e0-4397-a72b-d8ec6e4f6332 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.591814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e0a0-d1e0-4397-a72b-d8ec6e4f6332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.594915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8846e0a0-d1e0-4397-a72b-d8ec6e4f6332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.619675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e0a0-d1e0-4397-a72b-d8ec6e4f6332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:22.621450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e0a0-d1e0-4397-a72b-d8ec6e4f6332 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:22.645636 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1624/3218] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:22.647058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a8bba-e648-4492-81fb-6c5deb82bb38 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.647348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a8bba-e648-4492-81fb-6c5deb82bb38 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.647621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a8bba-e648-4492-81fb-6c5deb82bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.686347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8b1a8bba-e648-4492-81fb-6c5deb82bb38 None None] MFA Rules not processed for user `a857437becf14392bd1332824d86111c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:22.687555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b1a8bba-e648-4492-81fb-6c5deb82bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.709497 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1625/3219] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:22.729501 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1595/3220] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:22.733738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec030-83d3-46f9-b113-00eff4a472aa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.733738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec030-83d3-46f9-b113-00eff4a472aa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.733738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec030-83d3-46f9-b113-00eff4a472aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.766871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7d3ec030-83d3-46f9-b113-00eff4a472aa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:22.768121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d3ec030-83d3-46f9-b113-00eff4a472aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.802212 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1626/3221] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:22.806094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5f42-7951-43d7-863c-63379c6db940 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:22.819728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5f42-7951-43d7-863c-63379c6db940 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:22.825487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:22.826165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.837340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.837340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.837340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:36:22.837340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:22.837340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:22.847883 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1596/3222] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:36:22.852036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec030-83d3-46f9-b113-00eff4a472aa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:22.864011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec030-83d3-46f9-b113-00eff4a472aa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:22.872267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:22.872267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.872267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.872267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.873393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:22.877117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:22.891335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:22.893354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:22.920640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07f414-9641-4ac3-8f1b-154fadc9bc8e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:22.933252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:22.933963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:22.934880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:22.936285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:22.957128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:22.959187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:22.977440 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1597/3223] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:23.061737 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1627/3224] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:22 2022] POST /identity/v3/projects => generated 389 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:23.065869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:23.087177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afce2c-8ed5-479d-8bf3-8720a618d8a9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:23.244145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:23.245352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:23.245352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:23.245634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:23.246289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:23.248228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:23.409521 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1598/3225] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:23 2022] POST /identity/v3/users => generated 295 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:23.413671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:23.432789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbefc33-d903-44c7-ae2f-b000752fe955 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:23.457409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:23.458101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:23.458375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:23.459827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:23.459827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:23.461152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:23.491502 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1628/3226] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:23.495641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:23.515892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25309c-3087-47be-b2a2-ab45e8532051 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:23.535135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:23.535776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:23.536082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:23.536353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:23.537010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:23.538710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:23.561026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1599/3227] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:23.565085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:23.581760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec984cb-a1e7-433e-ad23-f48c888f4e09 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:23.597633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07125f2-ede2-40f2-aaa2-e0de5cd7b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:23.597633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07125f2-ede2-40f2-aaa2-e0de5cd7b0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:23.597937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07125f2-ede2-40f2-aaa2-e0de5cd7b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:23.598042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07125f2-ede2-40f2-aaa2-e0de5cd7b0a6 admin admin] PATH_INFO: `/v3/projects/24101d17c114495b853d2423b8089fa4/users/a88f259340ff4f218db9b0350e6f37af/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:23.605012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:23.669431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07125f2-ede2-40f2-aaa2-e0de5cd7b0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24101d17c114495b853d2423b8089fa4, user_id=a88f259340ff4f218db9b0350e6f37af, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:23.671295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:23.673234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:23.688367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07125f2-ede2-40f2-aaa2-e0de5cd7b0a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:23.807461 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1629/3228] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:23 2022] PUT /identity/v3/projects/24101d17c114495b853d2423b8089fa4/users/a88f259340ff4f218db9b0350e6f37af/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:23.819619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163daf3c-253d-4c5f-9322-db226f3a6621 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:23.850209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:23.904522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0637-203a-4e8a-9326-e2ab0425ef96 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:23.905497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0637-203a-4e8a-9326-e2ab0425ef96 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:23.905923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0637-203a-4e8a-9326-e2ab0425ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:23.975904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:23.976503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:23.976904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:23.977014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:23.983549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7bcf0637-203a-4e8a-9326-e2ab0425ef96 None None] MFA Rules not processed for user `a88f259340ff4f218db9b0350e6f37af`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:23.986290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7bcf0637-203a-4e8a-9326-e2ab0425ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:23.987304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:24.013440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:24.014975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:24.036846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1600/3229] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:24.165931 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1630/3230] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:36:24.170600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:24.261773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8be82-d16c-46bc-921d-802941de5ce6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:24.269216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:24.270289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:24.271478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:24.271984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:24.272868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:24.275120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:24.398282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf0637-203a-4e8a-9326-e2ab0425ef96 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:24.409395 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1601/3231] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:24 2022] POST /identity/v3/projects => generated 387 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:24.418473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf0637-203a-4e8a-9326-e2ab0425ef96 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:24.479892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:24.556876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:24.558188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:24.558499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:24.558779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:24.559430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:24.561403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:24.827008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:24.838306 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1631/3232] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:24 2022] POST /identity/v3/users => generated 300 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:24.859650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7e35f-ddbd-4f91-bbb4-c2e15b356fcc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:24.898988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:24.901034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:24.901325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:24.904392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:24.911310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:24.940282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:25.044558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:25.067100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27486e-bd0d-44b6-b849-906a4efe9149 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:25.068777 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1602/3233] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:25.088069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:25.103783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:25.103947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:25.104239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] PATH_INFO: `/v3/projects/9260510163da4488886e1514e29bf3aa/users/435704098c1a41a1872dc1e0a059fb56/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:25.168968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9260510163da4488886e1514e29bf3aa, user_id=435704098c1a41a1872dc1e0a059fb56, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:25.172363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:25.326686 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1632/3234] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:25 2022] PUT /identity/v3/projects/9260510163da4488886e1514e29bf3aa/users/435704098c1a41a1872dc1e0a059fb56/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:36:25.329053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:25.349429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83df7-17e1-488a-997c-d026e70e4fde admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:25.503306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c64138-7921-4f49-9891-6c3c04c6cfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:25.506323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64138-7921-4f49-9891-6c3c04c6cfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:25.506795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64138-7921-4f49-9891-6c3c04c6cfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:25.508371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64138-7921-4f49-9891-6c3c04c6cfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:25.509382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c64138-7921-4f49-9891-6c3c04c6cfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:25.514273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c64138-7921-4f49-9891-6c3c04c6cfd0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:25.560182 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1603/3235] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:25.561070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:25.578894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150695-14a1-4975-b8e9-9a8898590640 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:25.609657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:25.610386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:25.610695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:25.610979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] PATH_INFO: `/v3/projects/9260510163da4488886e1514e29bf3aa/users/435704098c1a41a1872dc1e0a059fb56/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:25.626144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9260510163da4488886e1514e29bf3aa, user_id=435704098c1a41a1872dc1e0a059fb56, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:25.639508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:25.713452 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1633/3236] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:25 2022] PUT /identity/v3/projects/9260510163da4488886e1514e29bf3aa/users/435704098c1a41a1872dc1e0a059fb56/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:25.715553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3afc-a007-4dc9-bd1a-b13212badd09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:25.738923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3afc-a007-4dc9-bd1a-b13212badd09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:25.738923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3afc-a007-4dc9-bd1a-b13212badd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:25.832050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1f8e3afc-a007-4dc9-bd1a-b13212badd09 None None] MFA Rules not processed for user `435704098c1a41a1872dc1e0a059fb56`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:25.832050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f8e3afc-a007-4dc9-bd1a-b13212badd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:25.981383 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1604/3237] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:25.995501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:26.064137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:26.166706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b6a2-b852-4788-960f-b90705205611 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:26.193131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:26.194918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:26.196076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:26.196517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:26.347470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:26.349488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:26.363405 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1634/3238] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:29.012706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e3afc-a007-4dc9-bd1a-b13212badd09 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:29.039769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e3afc-a007-4dc9-bd1a-b13212badd09 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:29.057694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4be639-424b-4881-aba0-b92000acc9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:29.058861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be639-424b-4881-aba0-b92000acc9c9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:29.059744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be639-424b-4881-aba0-b92000acc9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:29.060830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4be639-424b-4881-aba0-b92000acc9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:29.081001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4be639-424b-4881-aba0-b92000acc9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:29.082897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4be639-424b-4881-aba0-b92000acc9c9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:29.111541 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1605/3239] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:35.055724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:35.072982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700739d-01cd-4aa4-9503-bf5d122e0d3a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:35.081251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:35.087570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:35.087570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:35.087570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:35.087570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:35.158500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:35.160193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:35.171793 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1635/3240] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:35 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:35.784903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16979-6130-49a1-8661-dbea6df4c3c1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:35.785383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16979-6130-49a1-8661-dbea6df4c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:35.785470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf16979-6130-49a1-8661-dbea6df4c3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:35.805858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9bf16979-6130-49a1-8661-dbea6df4c3c1 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:35.807113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bf16979-6130-49a1-8661-dbea6df4c3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:35.830345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:35.878316 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1606/3241] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:36:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:35.904638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:35.906049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:35.995021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:35.996447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f92a3-9ad5-4994-9cee-35b411378050 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:36.002999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7670e-e154-4215-b7e3-190ea31411fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:36.004217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7670e-e154-4215-b7e3-190ea31411fd service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:36.004645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7670e-e154-4215-b7e3-190ea31411fd service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:36.005010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7670e-e154-4215-b7e3-190ea31411fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:36.026998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7670e-e154-4215-b7e3-190ea31411fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:36.028798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7670e-e154-4215-b7e3-190ea31411fd service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:36.042373 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1636/3242] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:36:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:37.221268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16979-6130-49a1-8661-dbea6df4c3c1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:37.341353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf16979-6130-49a1-8661-dbea6df4c3c1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:37.353175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:37.353850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:37.354172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:37.354599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] PATH_INFO: `/v3/users/a88f259340ff4f218db9b0350e6f37af` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:37.356610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88f259340ff4f218db9b0350e6f37af)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:37.359267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:37.617478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88f259340ff4f218db9b0350e6f37af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:37.619497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88f259340ff4f218db9b0350e6f37af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:37.736574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88f259340ff4f218db9b0350e6f37af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:37.737415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88f259340ff4f218db9b0350e6f37af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:37.746393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88f259340ff4f218db9b0350e6f37af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:37.801441 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1607/3243] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:37 2022] DELETE /identity/v3/users/a88f259340ff4f218db9b0350e6f37af => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:37.806199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:37.807113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:37.807579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:37.833444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:37.835057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:37.919480 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1637/3244] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:37.933903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:37.935461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:38.038871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7111b-e3d9-4ded-8f7f-7cd2f05c8d87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:38.042801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:38.043663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:38.044026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:38.044351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:38.053732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:38.065439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:38.067815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:38.079601 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1608/3245] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:38.523015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:38.526617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:38.547253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510f600-a26c-4615-b00f-4a8e4e0a3083 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:38.556736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:38.572570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:38.572789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:38.576088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] PATH_INFO: `/v3/projects/24101d17c114495b853d2423b8089fa4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:38.578111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24101d17c114495b853d2423b8089fa4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:38.598509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:38.792549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24101d17c114495b853d2423b8089fa4', 'request_id': 'req-c861a1fa-13b4-403f-91e0-2ea5594d2189'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:38.804257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24101d17c114495b853d2423b8089fa4', 'request_id': 'req-c861a1fa-13b4-403f-91e0-2ea5594d2189'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:38.886664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24101d17c114495b853d2423b8089fa4', 'request_id': 'req-c861a1fa-13b4-403f-91e0-2ea5594d2189'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:38.901366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] The token cache is being invalidate because project 24101d17c114495b853d2423b8089fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:38.903485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:38.904421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:38.907110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1638/3246] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:38 2022] DELETE /identity/v3/projects/24101d17c114495b853d2423b8089fa4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:38.911962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:38.936173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c399-4fd4-43db-85ae-13773ffb9f81 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:39.066163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:39.067161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:39.068248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:39.068248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] PATH_INFO: `/v3/users/435704098c1a41a1872dc1e0a059fb56` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:39.069254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=435704098c1a41a1872dc1e0a059fb56)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:39.072511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:39.344674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435704098c1a41a1872dc1e0a059fb56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:39.346615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435704098c1a41a1872dc1e0a059fb56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:39.427710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435704098c1a41a1872dc1e0a059fb56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:39.428429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435704098c1a41a1872dc1e0a059fb56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:39.437674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cbe05620-c618-4a1b-ac06-ccbbc8f6e8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435704098c1a41a1872dc1e0a059fb56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:39.463829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1609/3247] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:36:38 2022] DELETE /identity/v3/users/435704098c1a41a1872dc1e0a059fb56 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:40.008041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:40.009559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:40.067838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a1fa-13b4-403f-91e0-2ea5594d2189 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:40.152403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:40.153039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:40.153316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:40.153585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] PATH_INFO: `/v3/projects/9260510163da4488886e1514e29bf3aa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:40.154806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9260510163da4488886e1514e29bf3aa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:40.158516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:40.181127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:40.309767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9260510163da4488886e1514e29bf3aa', 'request_id': 'req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:40.316995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9260510163da4488886e1514e29bf3aa', 'request_id': 'req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:40.456382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9260510163da4488886e1514e29bf3aa', 'request_id': 'req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:40.472164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] The token cache is being invalidate because project 9260510163da4488886e1514e29bf3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:36:40.472518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:40.473160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f09cf301-6c59-4d6c-ae43-2cd05ccace7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:36:40.475939 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1639/3248] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:40 2022] DELETE /identity/v3/projects/9260510163da4488886e1514e29bf3aa => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:40.488955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baaa3-aa9f-4fb4-87f8-6aa193dbb3b6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:40.488955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baaa3-aa9f-4fb4-87f8-6aa193dbb3b6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:40.488955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0baaa3-aa9f-4fb4-87f8-6aa193dbb3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:40.519868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e0baaa3-aa9f-4fb4-87f8-6aa193dbb3b6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:40.521234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e0baaa3-aa9f-4fb4-87f8-6aa193dbb3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:40.598829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1610/3249] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:40.608911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324922e-5c0d-4da2-97ee-7b7a68b2b107 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:40.609275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324922e-5c0d-4da2-97ee-7b7a68b2b107 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:40.815828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324922e-5c0d-4da2-97ee-7b7a68b2b107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:40.815828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2324922e-5c0d-4da2-97ee-7b7a68b2b107 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:40.815828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2324922e-5c0d-4da2-97ee-7b7a68b2b107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:40.815828 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1640/3250] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:40.823755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0baaa3-aa9f-4fb4-87f8-6aa193dbb3b6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:40.835371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0baaa3-aa9f-4fb4-87f8-6aa193dbb3b6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:40.840476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:40.841110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:40.841389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:40.841714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:40.842367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:36:40.844501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:40.844501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:40.854317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:40.858093 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1611/3251] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:36:40.862709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324922e-5c0d-4da2-97ee-7b7a68b2b107 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:40.872614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324922e-5c0d-4da2-97ee-7b7a68b2b107 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:40.877306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:40.877987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:40.878360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:40.878702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:40.879406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:40.881399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:40.961683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:40.967061 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1641/3252] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:40 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:40.978759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a582aad-db8d-47e4-bb01-691159b1fdf6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:41.155471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:41.156105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:41.156390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:41.156664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:41.157316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:41.161877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:41.287736 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1612/3253] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:40 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:41.297400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:41.328518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43584c80-6ffc-4633-a6f3-662824832a0a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:41.335643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:41.336330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:41.336612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:41.336889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:41.337742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:41.339484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:41.364037 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1642/3254] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:41.365685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:41.377745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a105f4-6b37-4cdd-892e-737166193a21 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:41.394973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f9366-2ea3-4990-9d80-c661578eab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:41.396377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f9366-2ea3-4990-9d80-c661578eab95 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:41.396377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f9366-2ea3-4990-9d80-c661578eab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:41.396377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f9366-2ea3-4990-9d80-c661578eab95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:41.397416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f9366-2ea3-4990-9d80-c661578eab95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:41.402024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f9366-2ea3-4990-9d80-c661578eab95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:41.447647 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1613/3255] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:41.449260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:41.474302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a4fcc-5547-435e-a067-666132c2b7e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:41.479596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:41.480282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:41.482385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:41.482385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] PATH_INFO: `/v3/projects/500c1691c5bb4729ba86089d20dedf27/users/97fcf7685853432ab0173f0cfac41863/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:41.518237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=500c1691c5bb4729ba86089d20dedf27, user_id=97fcf7685853432ab0173f0cfac41863, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:41.518237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:41.623790 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1643/3256] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:41 2022] PUT /identity/v3/projects/500c1691c5bb4729ba86089d20dedf27/users/97fcf7685853432ab0173f0cfac41863/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:41.626278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f12a-fb1f-4b2d-8132-7247dc5d74a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:41.627244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f12a-fb1f-4b2d-8132-7247dc5d74a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:41.628022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f12a-fb1f-4b2d-8132-7247dc5d74a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:41.671789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c793f12a-fb1f-4b2d-8132-7247dc5d74a5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:41.675849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c793f12a-fb1f-4b2d-8132-7247dc5d74a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:41.853622 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1614/3257] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:41.873612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:41.876082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:41.988623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f12b87-2ff1-42c2-b725-4083a9b2f06f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:41.996768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:41.996768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:41.996768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:41.996768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:42.007881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:42.009394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:42.021115 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1644/3258] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:36:51.831585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:52.016011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:54.942016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d019fa-adb6-467d-88e2-46fae65b80bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:54.942509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d019fa-adb6-467d-88e2-46fae65b80bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:54.942602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d019fa-adb6-467d-88e2-46fae65b80bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:55.003438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-60d019fa-adb6-467d-88e2-46fae65b80bc None None] MFA Rules not processed for user `97fcf7685853432ab0173f0cfac41863`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:36:55.005900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60d019fa-adb6-467d-88e2-46fae65b80bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:55.150207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:55.150737 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1615/3259] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:36:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:36:55.164151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae18e-cbd1-4e28-9f42-f4607fcc5eb1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:55.175774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:55.177279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:55.177630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:55.177980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:55.178793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:55.183648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:55.354629 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1645/3260] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:36:55 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:36:55.356220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d019fa-adb6-467d-88e2-46fae65b80bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:55.373502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d019fa-adb6-467d-88e2-46fae65b80bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:55.607667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:55.608326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:55.611511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:55.611860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:55.612585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:55.620807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:56.039053 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1616/3261] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:36:55 2022] POST /identity/v3/users => generated 298 bytes in 683 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:36:56.040099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:56.072742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55251b7b-b329-4109-9205-59c43f2c1a50 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:56.093637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:56.094315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:56.094605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:56.094920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:56.096809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:56.104403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:56.162998 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1646/3262] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:56.163837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:56.179284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8a0f-39a6-4726-9f49-c4f734303c42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:56.197936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:56.198678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:56.198945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:56.199226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] PATH_INFO: `/v3/projects/839ea251cbf14e1ea20d69d823d0dd12/users/c98e22c79e144f43b84c006ecc2ad91f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:56.234175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839ea251cbf14e1ea20d69d823d0dd12, user_id=c98e22c79e144f43b84c006ecc2ad91f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:56.237663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:56.367779 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1617/3263] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:56 2022] PUT /identity/v3/projects/839ea251cbf14e1ea20d69d823d0dd12/users/c98e22c79e144f43b84c006ecc2ad91f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:36:56.371796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:56.386135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394438-bef7-41d5-abd2-14702ae3b57a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:56.580831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:56.584761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:56.584761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:56.584761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:56.584761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:56.584761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:56.609734 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1647/3264] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:36:56.611751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:56.629662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728c81-7414-4a69-a537-13b75a8d19f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:56.646499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:56.647271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:56.653591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:56.653591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] PATH_INFO: `/v3/projects/839ea251cbf14e1ea20d69d823d0dd12/users/c98e22c79e144f43b84c006ecc2ad91f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:56.653591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839ea251cbf14e1ea20d69d823d0dd12, user_id=c98e22c79e144f43b84c006ecc2ad91f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:56.658513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:56.688860 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1618/3265] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:36:56 2022] PUT /identity/v3/projects/839ea251cbf14e1ea20d69d823d0dd12/users/c98e22c79e144f43b84c006ecc2ad91f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:36:58.511157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:36:58.513954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:58.687962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb8289-3a4a-44f0-9359-53080797534b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:36:58.892708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1911-a38b-4504-977e-f5d6c5681704 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:36:58.894902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1911-a38b-4504-977e-f5d6c5681704 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:36:58.895773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1911-a38b-4504-977e-f5d6c5681704 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:36:58.896172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1911-a38b-4504-977e-f5d6c5681704 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:36:58.902763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe1f1911-a38b-4504-977e-f5d6c5681704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:36:58.926382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:58.931423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f1911-a38b-4504-977e-f5d6c5681704 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:36:58.940667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f1911-a38b-4504-977e-f5d6c5681704 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:36:58.980072 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1648/3266] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:36:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:00.586475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:00.588922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:00.652618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:00.653645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:00.654181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:00.700956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:00.706682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:00.750797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:00.812570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998fa98-b2f6-4951-af40-7537ad027632 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:00.835158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:00.836102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:00.836102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:00.836365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] PATH_INFO: `/v3/users/f4e090dfe8fc4621b5446053eb2cc5f3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:00.847937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e090dfe8fc4621b5446053eb2cc5f3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:00.856428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:00.920085 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1649/3267] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:37:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:00.921531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:00.925926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:01.114275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54f614-6708-405f-ae30-3c022fb6b517 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:01.135836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:01.136487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:01.136774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:01.137051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:01.167886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:01.177793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:01.211560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e090dfe8fc4621b5446053eb2cc5f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:01.211745 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1650/3268] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:37:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:01.213394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e090dfe8fc4621b5446053eb2cc5f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:01.324510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e090dfe8fc4621b5446053eb2cc5f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:01.325178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e090dfe8fc4621b5446053eb2cc5f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:01.346817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e090dfe8fc4621b5446053eb2cc5f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:01.423200 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1619/3269] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:00 2022] DELETE /identity/v3/users/f4e090dfe8fc4621b5446053eb2cc5f3 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:02.375803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:02.391723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5637db-e541-485d-8229-6d90c4d22625 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:02.616812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:02.617521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:02.617809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:02.618108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] PATH_INFO: `/v3/projects/9c460a082fe34e6b9d2f3b73044d76e4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:02.620877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c460a082fe34e6b9d2f3b73044d76e4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:02.629222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:02.824908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:02.858713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c460a082fe34e6b9d2f3b73044d76e4', 'request_id': 'req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:02.873221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c460a082fe34e6b9d2f3b73044d76e4', 'request_id': 'req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:02.958372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:02.960179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:02.970613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c460a082fe34e6b9d2f3b73044d76e4', 'request_id': 'req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:02.987213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] The token cache is being invalidate because project 9c460a082fe34e6b9d2f3b73044d76e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:02.987970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:02.991172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:02.998332 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1651/3270] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:02 2022] DELETE /identity/v3/projects/9c460a082fe34e6b9d2f3b73044d76e4 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:03.002410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:03.004028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:03.112383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f292a-b482-4ff7-84f2-75b7f1cc49e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:03.120532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:03.121429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:03.121803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:03.122279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] PATH_INFO: `/v3/users/2ba6838531ce4d16a36ea3ef1fecb0b7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:03.123625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba6838531ce4d16a36ea3ef1fecb0b7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:03.125915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:03.128837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15af7-ecd7-43af-af93-5f0dc646566a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:03.239870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537fd03-a1b6-4ddd-95d4-da8f68c420bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:03.240650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fd03-a1b6-4ddd-95d4-da8f68c420bb service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:03.247104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fd03-a1b6-4ddd-95d4-da8f68c420bb service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:03.248001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fd03-a1b6-4ddd-95d4-da8f68c420bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:03.256320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d537fd03-a1b6-4ddd-95d4-da8f68c420bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:03.274976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:03.280660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537fd03-a1b6-4ddd-95d4-da8f68c420bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:03.281333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537fd03-a1b6-4ddd-95d4-da8f68c420bb service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:03.317546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1620/3271] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:37:03.382861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba6838531ce4d16a36ea3ef1fecb0b7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:03.395478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba6838531ce4d16a36ea3ef1fecb0b7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:03.396533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba6838531ce4d16a36ea3ef1fecb0b7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:03.413797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba6838531ce4d16a36ea3ef1fecb0b7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:03.484012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba6838531ce4d16a36ea3ef1fecb0b7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:03.494414 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1652/3272] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:03 2022] DELETE /identity/v3/users/2ba6838531ce4d16a36ea3ef1fecb0b7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:37:03.885758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:03.886315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:03.886528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:03.931539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:03.932819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:03.977950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:03.979717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:04.122985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:04.126984 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1621/3273] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:37:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:04.133774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:04.135438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:04.179890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05569-cd00-47e7-8dd5-690fbd5b0651 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:04.192146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:04.192645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.192923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.193199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] PATH_INFO: `/v3/projects/b201693e6af64739b3ff64ae0b938f91` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.196576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b201693e6af64739b3ff64ae0b938f91)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:04.201209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:04.249230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b286b0d-fd4b-424f-be32-b6da05523797 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:04.269944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54224a1a-893e-46a0-a241-5021fefa3ecf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:04.274457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224a1a-893e-46a0-a241-5021fefa3ecf service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.275247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224a1a-893e-46a0-a241-5021fefa3ecf service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.275570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224a1a-893e-46a0-a241-5021fefa3ecf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.300826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54224a1a-893e-46a0-a241-5021fefa3ecf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:04.304333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54224a1a-893e-46a0-a241-5021fefa3ecf service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:04.318477 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1622/3274] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:37:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:04.340779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b201693e6af64739b3ff64ae0b938f91', 'request_id': 'req-ec5bcb15-10f1-472b-aa8d-cddb63888c53'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:04.349576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b201693e6af64739b3ff64ae0b938f91', 'request_id': 'req-ec5bcb15-10f1-472b-aa8d-cddb63888c53'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:04.458479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b201693e6af64739b3ff64ae0b938f91', 'request_id': 'req-ec5bcb15-10f1-472b-aa8d-cddb63888c53'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:04.502129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] The token cache is being invalidate because project b201693e6af64739b3ff64ae0b938f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:04.502520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:04.503892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec5bcb15-10f1-472b-aa8d-cddb63888c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:04.507078 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1653/3275] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:03 2022] DELETE /identity/v3/projects/b201693e6af64739b3ff64ae0b938f91 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:04.511659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724465-e44d-4221-be95-ce301f9eb7c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.514247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724465-e44d-4221-be95-ce301f9eb7c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.514247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92724465-e44d-4221-be95-ce301f9eb7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.539400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-92724465-e44d-4221-be95-ce301f9eb7c5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:04.540651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92724465-e44d-4221-be95-ce301f9eb7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:04.625046 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1623/3276] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:04.627889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e86f-aa7f-4220-adb4-bcb5e84d02b5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.627889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e86f-aa7f-4220-adb4-bcb5e84d02b5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.627889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e86f-aa7f-4220-adb4-bcb5e84d02b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.656692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d4d4e86f-aa7f-4220-adb4-bcb5e84d02b5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:04.658421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d4d4e86f-aa7f-4220-adb4-bcb5e84d02b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:04.667893 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1654/3277] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:04.675678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92724465-e44d-4221-be95-ce301f9eb7c5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:04.686318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92724465-e44d-4221-be95-ce301f9eb7c5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:04.699300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:04.699947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.700228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.700503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.701200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:37:04.701506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:04.703163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:04.720412 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1624/3278] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:04.724872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e86f-aa7f-4220-adb4-bcb5e84d02b5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:04.736759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e86f-aa7f-4220-adb4-bcb5e84d02b5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:04.741852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:04.742810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.744945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.744945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.744945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:04.746414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:04.807371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:04.809714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:04.840976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52397e9a-d3d6-4d69-9529-48ea690621fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:04.860179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:04.862505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.862896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.863273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] PATH_INFO: `/v3/users/95ebb57f540241b49112abdc3e90431a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.864772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ebb57f540241b49112abdc3e90431a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:04.866993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:04.871520 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1655/3279] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:04 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:04.872519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:04.897960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:04.976171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718644d-70b3-43cf-81a2-8f9efa0162f4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:04.982541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:04.983168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:04.983476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:04.983749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:04.984571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:04.987421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:05.090639 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1656/3280] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:04 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:05.095325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:05.099277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ebb57f540241b49112abdc3e90431a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.100061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ebb57f540241b49112abdc3e90431a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.106216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1de39-480f-4524-9ac6-ad96292e9fe6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:05.125957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:05.127242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.127576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.127914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:05.128758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:05.130474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:05.144495 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1657/3281] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:37:05.146062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:05.150566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:05.162826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3a028-5e1f-4c39-95e0-cf968e0c37de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:05.167522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:05.168349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.168625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.168903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:05.169546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:05.171161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:05.174487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ebb57f540241b49112abdc3e90431a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.179308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ebb57f540241b49112abdc3e90431a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.183397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fe7ff40-c69f-41ac-95a9-64369233646c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ebb57f540241b49112abdc3e90431a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.183521 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1658/3282] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:37:05.187644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:05.197751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031be03-1662-4004-92bc-38bcfe222b5d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:05.206089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688449c-39c2-4195-b0a7-4d55bd864e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:05.207019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688449c-39c2-4195-b0a7-4d55bd864e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.207300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688449c-39c2-4195-b0a7-4d55bd864e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.208067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688449c-39c2-4195-b0a7-4d55bd864e0d admin admin] PATH_INFO: `/v3/projects/7fee16a7b3d6491a80df96be6f70d62e/users/ad91f505a8c646549e4c752a5bbb4ba1/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:05.217021 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1625/3283] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:04 2022] DELETE /identity/v3/users/95ebb57f540241b49112abdc3e90431a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:05.228023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688449c-39c2-4195-b0a7-4d55bd864e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fee16a7b3d6491a80df96be6f70d62e, user_id=ad91f505a8c646549e4c752a5bbb4ba1, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:05.232000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688449c-39c2-4195-b0a7-4d55bd864e0d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:05.345769 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1659/3284] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:05 2022] PUT /identity/v3/projects/7fee16a7b3d6491a80df96be6f70d62e/users/ad91f505a8c646549e4c752a5bbb4ba1/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:37:05.348921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.349387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.350279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:05.389074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.389440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.389791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:05.398007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:05.399528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:05.413124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] MFA Rules not processed for user `1d5d823540f041a283fe2c9b283514d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:05.413124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:05.539576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1660/3285] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:05.589407 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1626/3286] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:05.608235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:05.613891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:05.621898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:05.627932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:05.638627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11772b80-4f4b-44d3-8960-0423e0e6c054 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:05.644461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:05.645161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.645853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.646156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] PATH_INFO: `/v3/projects/6f06a13e0abd49e7a23ba3ce837418bd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:05.656344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f06a13e0abd49e7a23ba3ce837418bd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:05.667477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:05.717638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2942f-4215-4ecb-aa87-30b1275181e1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:05.734325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc763970-77b1-46e8-b9bf-5c766c93b41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:05.734964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763970-77b1-46e8-b9bf-5c766c93b41c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.735313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763970-77b1-46e8-b9bf-5c766c93b41c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.735629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763970-77b1-46e8-b9bf-5c766c93b41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:05.752097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc763970-77b1-46e8-b9bf-5c766c93b41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:05.756141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc763970-77b1-46e8-b9bf-5c766c93b41c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:05.761696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:05.769305 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1661/3287] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:05.831596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f06a13e0abd49e7a23ba3ce837418bd', 'request_id': 'req-63e27a50-acd6-4477-b7e7-933f1f061195'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.840065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f06a13e0abd49e7a23ba3ce837418bd', 'request_id': 'req-63e27a50-acd6-4477-b7e7-933f1f061195'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.949293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f06a13e0abd49e7a23ba3ce837418bd', 'request_id': 'req-63e27a50-acd6-4477-b7e7-933f1f061195'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.974760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] The token cache is being invalidate because project 6f06a13e0abd49e7a23ba3ce837418bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:05.975052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.975807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63e27a50-acd6-4477-b7e7-933f1f061195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:05.977536 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1627/3288] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:05 2022] DELETE /identity/v3/projects/6f06a13e0abd49e7a23ba3ce837418bd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:37:05.984039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e4208-2f20-4224-8107-1a69f4cf2109 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:05.984390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e4208-2f20-4224-8107-1a69f4cf2109 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:05.984587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e4208-2f20-4224-8107-1a69f4cf2109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.006178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-104e4208-2f20-4224-8107-1a69f4cf2109 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:06.007700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-104e4208-2f20-4224-8107-1a69f4cf2109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:06.093632 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1662/3289] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:06.101618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23c199-e0dc-4ca3-ae2a-f000edfeb06d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.101820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23c199-e0dc-4ca3-ae2a-f000edfeb06d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.102117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23c199-e0dc-4ca3-ae2a-f000edfeb06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.131623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c23c199-e0dc-4ca3-ae2a-f000edfeb06d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:06.132949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c23c199-e0dc-4ca3-ae2a-f000edfeb06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:06.146550 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1628/3290] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:06.149144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e4208-2f20-4224-8107-1a69f4cf2109 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:06.160200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e4208-2f20-4224-8107-1a69f4cf2109 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:06.166601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:06.167006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.167367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.167971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.168922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:37:06.169306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:06.171380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:06.190391 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1663/3291] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:06.191638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23c199-e0dc-4ca3-ae2a-f000edfeb06d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:06.198322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:06.205245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23c199-e0dc-4ca3-ae2a-f000edfeb06d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:06.219269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:06.220404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.220904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.221413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.222421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:06.229068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:06.358573 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1629/3292] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:06 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:37:06.363603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:06.384496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78310ca9-b476-4331-a092-59b0eae7fbb8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:06.518850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:06.519793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.520276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.520746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.521557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:06.524419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:06.643912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:06.654653 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1664/3293] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:06 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:06.663496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945797c-51ee-4f98-a252-5ce0ce0380df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:06.672303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:06.673630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.673922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.674292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.675031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:06.676752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:06.692645 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1630/3294] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:06.693856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:06.720310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce46553-f5c8-4083-ab4f-4a34abe64e59 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:06.734269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c587f7-c935-49ce-baeb-ec888de8bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:06.741072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c587f7-c935-49ce-baeb-ec888de8bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.741072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c587f7-c935-49ce-baeb-ec888de8bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.741072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c587f7-c935-49ce-baeb-ec888de8bdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.741072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c587f7-c935-49ce-baeb-ec888de8bdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:06.742554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c587f7-c935-49ce-baeb-ec888de8bdc9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:06.788797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1665/3295] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:06.793620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:06.808591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a2662-604d-4192-9207-e6555955dab2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:06.829232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:06.831043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.831474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.831755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] PATH_INFO: `/v3/projects/d78fb68eedc84dfcb7c5cc2aeaa24f92/users/45ab9411460b4292b1ea5719d352ccca/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:06.886306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78fb68eedc84dfcb7c5cc2aeaa24f92, user_id=45ab9411460b4292b1ea5719d352ccca, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:06.892818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:06.989703 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1631/3296] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:06 2022] PUT /identity/v3/projects/d78fb68eedc84dfcb7c5cc2aeaa24f92/users/45ab9411460b4292b1ea5719d352ccca/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:06.995102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17bd6-722c-4505-b5f9-7c962591625f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:06.995676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17bd6-722c-4505-b5f9-7c962591625f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:06.996247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17bd6-722c-4505-b5f9-7c962591625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:07.020303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:07.060954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ced17bd6-722c-4505-b5f9-7c962591625f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:07.061518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ced17bd6-722c-4505-b5f9-7c962591625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:07.238348 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1666/3297] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:07.319143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:07.321576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:07.397390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d947e-ba67-4ad9-a0f7-6bc654865dd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:07.402305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:07.403212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:07.403725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:07.404238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:07.439078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:07.441158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:07.503138 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1632/3298] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:08.255075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:08.255749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:08.256734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:08.311507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:08.314099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:08.437827 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1667/3299] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:08.468148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:08.469787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:08.642441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33f213-ab45-48f1-88e3-f3ebeb70a7ff service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:08.658355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d4055-9d6e-4b3b-baf4-4e4b1a68d52f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:08.659162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4055-9d6e-4b3b-baf4-4e4b1a68d52f service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:08.661190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4055-9d6e-4b3b-baf4-4e4b1a68d52f service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:08.661576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d4055-9d6e-4b3b-baf4-4e4b1a68d52f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:08.671671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d4055-9d6e-4b3b-baf4-4e4b1a68d52f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:08.673725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d4055-9d6e-4b3b-baf4-4e4b1a68d52f service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:08.690302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1633/3300] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:12.876190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:12.886370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:12.889889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166c81-3bd2-4b87-ab86-24b4f9c69326 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:12.890563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166c81-3bd2-4b87-ab86-24b4f9c69326 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:12.891017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c166c81-3bd2-4b87-ab86-24b4f9c69326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:12.923804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2c166c81-3bd2-4b87-ab86-24b4f9c69326 None None] MFA Rules not processed for user `a857437becf14392bd1332824d86111c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:12.926542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c166c81-3bd2-4b87-ab86-24b4f9c69326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:13.057542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:13.089094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:13.152541 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1634/3301] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:13.174700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f9183-315b-4fa7-95a0-ef577dc14cd3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:13.197979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:13.198933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:13.198933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:13.200637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:13.205693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:13.341324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664675-d3e5-4409-b235-84734e14984e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:13.341602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664675-d3e5-4409-b235-84734e14984e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:13.342076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664675-d3e5-4409-b235-84734e14984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:13.352278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:13.354207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:13.378543 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1668/3302] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:13.478303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d6664675-d3e5-4409-b235-84734e14984e None None] MFA Rules not processed for user `c98e22c79e144f43b84c006ecc2ad91f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:13.482980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6664675-d3e5-4409-b235-84734e14984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:13.645257 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1635/3303] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:14.293227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:14.317140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2395cf-c674-4ae0-a4d3-6c7a8aaf7b44 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:14.340276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb10bf-b58e-4349-ad66-ddd88bc7fd2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:14.341266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb10bf-b58e-4349-ad66-ddd88bc7fd2c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:14.341778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb10bf-b58e-4349-ad66-ddd88bc7fd2c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:14.342463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb10bf-b58e-4349-ad66-ddd88bc7fd2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:14.348075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53bb10bf-b58e-4349-ad66-ddd88bc7fd2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:14.561995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb10bf-b58e-4349-ad66-ddd88bc7fd2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:14.563899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb10bf-b58e-4349-ad66-ddd88bc7fd2c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:14.592367 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1669/3304] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:15.559410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6664675-d3e5-4409-b235-84734e14984e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:15.561521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6664675-d3e5-4409-b235-84734e14984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:15.588879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6664675-d3e5-4409-b235-84734e14984e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:15.595952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7724cbe-84d0-43fa-8def-4e4fa53efd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:15.598744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7724cbe-84d0-43fa-8def-4e4fa53efd03 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:15.599037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7724cbe-84d0-43fa-8def-4e4fa53efd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:15.600676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7724cbe-84d0-43fa-8def-4e4fa53efd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:15.606912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7724cbe-84d0-43fa-8def-4e4fa53efd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:15.809456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7724cbe-84d0-43fa-8def-4e4fa53efd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:15.817605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7724cbe-84d0-43fa-8def-4e4fa53efd03 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:15.880229 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1636/3305] 10.222.0.27 () {60 vars in 1396 bytes} [Tue Oct 18 13:37:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:24.581457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=64 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:25.617433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429733-dc35-475a-85cc-fda86dae2607 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:25.618007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429733-dc35-475a-85cc-fda86dae2607 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:25.619729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429733-dc35-475a-85cc-fda86dae2607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:25.664695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8b429733-dc35-475a-85cc-fda86dae2607 None None] MFA Rules not processed for user `97fcf7685853432ab0173f0cfac41863`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:25.668834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b429733-dc35-475a-85cc-fda86dae2607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:25.701391 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1670/3306] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:25.855700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=69 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:28.492243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422c08a-3001-4a83-8443-1a06d3f3de47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:28.495403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422c08a-3001-4a83-8443-1a06d3f3de47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:28.495737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422c08a-3001-4a83-8443-1a06d3f3de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:28.594665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a422c08a-3001-4a83-8443-1a06d3f3de47 None None] MFA Rules not processed for user `ad91f505a8c646549e4c752a5bbb4ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:28.596120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a422c08a-3001-4a83-8443-1a06d3f3de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:28.822948 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1637/3307] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:35.653182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:35.861995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:35.862323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:35.862606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:35.940633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] MFA Rules not processed for user `45ab9411460b4292b1ea5719d352ccca`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:35.944225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:36.125132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:36.129216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:36.129216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:36.132220 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1671/3308] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:36.177418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] MFA Rules not processed for user `45ab9411460b4292b1ea5719d352ccca`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:36.180126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:36.195482 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1638/3309] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:36.337938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:36.340045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:36.396996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141e986-086e-4a8a-8f53-7ffd47796664 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:36.414606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:36.425535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:36.425792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:36.426226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:36.451234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:36.452011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:36.480867 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1672/3310] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:37.805292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:37.806938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:37.851268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826ab5-89da-4a66-90ed-203e7290d8af None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:37.911152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:37.911863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:37.913364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:37.913655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] PATH_INFO: `/v3/users/ad91f505a8c646549e4c752a5bbb4ba1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:37.916783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad91f505a8c646549e4c752a5bbb4ba1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:37.920449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:38.176723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad91f505a8c646549e4c752a5bbb4ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:38.177577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad91f505a8c646549e4c752a5bbb4ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:38.284991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad91f505a8c646549e4c752a5bbb4ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:38.285734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad91f505a8c646549e4c752a5bbb4ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:38.295491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b9ea98f-c29a-4e39-b8b4-9a0438a86ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad91f505a8c646549e4c752a5bbb4ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:38.342893 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1639/3311] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:37 2022] DELETE /identity/v3/users/ad91f505a8c646549e4c752a5bbb4ba1 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:38.850418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:38.867781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa223cd7-cb47-43de-92ca-8608e2a0eee8 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:38.941771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:38.942832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:38.943319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:38.943790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] PATH_INFO: `/v3/projects/7fee16a7b3d6491a80df96be6f70d62e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:38.946176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fee16a7b3d6491a80df96be6f70d62e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:38.949695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:39.133295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fee16a7b3d6491a80df96be6f70d62e', 'request_id': 'req-9f588573-da2b-4fd5-b20b-23144394f813'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:39.145621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fee16a7b3d6491a80df96be6f70d62e', 'request_id': 'req-9f588573-da2b-4fd5-b20b-23144394f813'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:39.253180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fee16a7b3d6491a80df96be6f70d62e', 'request_id': 'req-9f588573-da2b-4fd5-b20b-23144394f813'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:39.272984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] The token cache is being invalidate because project 7fee16a7b3d6491a80df96be6f70d62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:39.273404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:39.274368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f588573-da2b-4fd5-b20b-23144394f813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:39.285494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1673/3312] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:38 2022] DELETE /identity/v3/projects/7fee16a7b3d6491a80df96be6f70d62e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:39.287583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9d87-4024-4070-bbf9-c79f7ebc3d47 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:39.288054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9d87-4024-4070-bbf9-c79f7ebc3d47 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:39.288183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9d87-4024-4070-bbf9-c79f7ebc3d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:39.323063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-74ae9d87-4024-4070-bbf9-c79f7ebc3d47 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:39.324728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74ae9d87-4024-4070-bbf9-c79f7ebc3d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:39.429330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:39.466971 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1640/3313] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:39.475917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d5be-f775-4e41-9a2c-a8f6f5405672 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:39.476209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d5be-f775-4e41-9a2c-a8f6f5405672 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:39.476485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d5be-f775-4e41-9a2c-a8f6f5405672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:39.505051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:39.531356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3f56d5be-f775-4e41-9a2c-a8f6f5405672 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:39.535987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3f56d5be-f775-4e41-9a2c-a8f6f5405672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:39.547379 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1674/3314] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:39.553450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae9d87-4024-4070-bbf9-c79f7ebc3d47 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:39.594722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae9d87-4024-4070-bbf9-c79f7ebc3d47 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:39.629127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:39.630683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:39.631430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:39.631858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:39.634406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:37:39.657236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:39.666761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:39.699030 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1641/3315] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:39.703046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56d5be-f775-4e41-9a2c-a8f6f5405672 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:39.715448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56d5be-f775-4e41-9a2c-a8f6f5405672 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:39.729559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c190db-ee9d-42b7-9b05-b33743a8184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:39.730311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c190db-ee9d-42b7-9b05-b33743a8184a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:39.730596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c190db-ee9d-42b7-9b05-b33743a8184a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:39.730907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c190db-ee9d-42b7-9b05-b33743a8184a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:39.731560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c190db-ee9d-42b7-9b05-b33743a8184a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:39.733551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c190db-ee9d-42b7-9b05-b33743a8184a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:39.902160 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1675/3316] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:39 2022] POST /identity/v3/projects => generated 391 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:39.906966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:39.920767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f5ddc-cf1b-4539-9e44-84b79b0ed528 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:40.018667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191d9c-987c-4389-9647-f97cb5e107f1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.022075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191d9c-987c-4389-9647-f97cb5e107f1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.023166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191d9c-987c-4389-9647-f97cb5e107f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.057705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:40.059534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.063558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.063558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.064644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:40.069289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:40.100389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a3191d9c-987c-4389-9647-f97cb5e107f1 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:40.101959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3191d9c-987c-4389-9647-f97cb5e107f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:40.200833 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1642/3317] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:39 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:37:40.205170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:40.223443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28044e15-3382-4116-852a-14b491b51970 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:40.238256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:40.241590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.241590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.241590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.242358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:40.244522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:40.246351 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1676/3318] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:37:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:37:40.260012 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1643/3319] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:40.263228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3191d9c-987c-4389-9647-f97cb5e107f1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:40.271903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:40.279213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:40.284984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3191d9c-987c-4389-9647-f97cb5e107f1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:40.294454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:40.303354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.303678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.303916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.304593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:40.306334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:40.332217 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1677/3320] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:40.333117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:40.356418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3ba10-c41a-4490-ab1b-cab85e8591e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:40.363235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:40.364318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.364815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.365328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] PATH_INFO: `/v3/projects/1ef94919c66a4761b69805ea35ac9ee2/users/e66c674bace74f1b816fdfbc01a558ca/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.405387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef94919c66a4761b69805ea35ac9ee2, user_id=e66c674bace74f1b816fdfbc01a558ca, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:40.408724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:40.422625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce43fa-c439-4981-b3a8-35ccfef7c91f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:40.435851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec8dc1-482c-41ae-a9bc-816c7611dacf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:40.436515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec8dc1-482c-41ae-a9bc-816c7611dacf service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.436792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec8dc1-482c-41ae-a9bc-816c7611dacf service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.437063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec8dc1-482c-41ae-a9bc-816c7611dacf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.450463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec8dc1-482c-41ae-a9bc-816c7611dacf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:40.452288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec8dc1-482c-41ae-a9bc-816c7611dacf service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:40.470683 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1644/3321] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:40.494436 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1678/3322] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:40 2022] PUT /identity/v3/projects/1ef94919c66a4761b69805ea35ac9ee2/users/e66c674bace74f1b816fdfbc01a558ca/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:40.510285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31711eb-6b94-422a-ae99-4611c67fa2dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.510651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31711eb-6b94-422a-ae99-4611c67fa2dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.511128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31711eb-6b94-422a-ae99-4611c67fa2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.559270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e31711eb-6b94-422a-ae99-4611c67fa2dd None None] MFA Rules not processed for user `e66c674bace74f1b816fdfbc01a558ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:40.560746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e31711eb-6b94-422a-ae99-4611c67fa2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:40.653812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:40.694526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1645/3323] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:40.695471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:40.819764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafae9b-9f5e-4cac-b83a-a2e051c2b46b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:40.834368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:40.834886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:40.835167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:40.835449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:40.836153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:40.838248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:41.018337 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1679/3324] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:40 2022] POST /identity/v3/projects => generated 389 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:41.021811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31711eb-6b94-422a-ae99-4611c67fa2dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:41.047499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31711eb-6b94-422a-ae99-4611c67fa2dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:41.194733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:41.194733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:41.194733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:41.194733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:41.195881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:41.195881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:41.355394 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1646/3325] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:41 2022] POST /identity/v3/users => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:41.358673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:41.389484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8db00e-7e68-453e-8a67-171d81aefb89 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:41.412656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:41.415433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:41.418337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:41.419197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:41.420128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:41.422048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:41.446302 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1680/3326] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:41.450612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:41.466721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383769b9-2aaa-4353-ba60-3254d390d653 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:41.476784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:41.477868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:41.478517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:41.479009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] PATH_INFO: `/v3/projects/c44137fdc39247f893211da7cd2e00db/users/1e10b648999345cd937ba23a75649acc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:41.504272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44137fdc39247f893211da7cd2e00db, user_id=1e10b648999345cd937ba23a75649acc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:41.507483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:41.617986 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1647/3327] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:41 2022] PUT /identity/v3/projects/c44137fdc39247f893211da7cd2e00db/users/1e10b648999345cd937ba23a75649acc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:41.623340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:41.633841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1151e-360f-4a15-98cd-103998528711 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:41.716493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:41.812285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51db6-9e78-4881-9fff-e5e818f4db62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:41.814012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51db6-9e78-4881-9fff-e5e818f4db62 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:41.814324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51db6-9e78-4881-9fff-e5e818f4db62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:41.814764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51db6-9e78-4881-9fff-e5e818f4db62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:41.815744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51db6-9e78-4881-9fff-e5e818f4db62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:41.817435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51db6-9e78-4881-9fff-e5e818f4db62 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:41.832340 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1681/3328] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:41.836329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:41.850514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788a0de-8434-4543-840c-68353dbbe0a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:41.860295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:41.860932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:41.861214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:41.863673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] PATH_INFO: `/v3/projects/c44137fdc39247f893211da7cd2e00db/users/1e10b648999345cd937ba23a75649acc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:41.870084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44137fdc39247f893211da7cd2e00db, user_id=1e10b648999345cd937ba23a75649acc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:41.875940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:41.909614 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1648/3329] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:41 2022] PUT /identity/v3/projects/c44137fdc39247f893211da7cd2e00db/users/1e10b648999345cd937ba23a75649acc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:41.921125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de18e4-9c71-4955-9cb5-305dea950650 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:41.921646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de18e4-9c71-4955-9cb5-305dea950650 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:41.923204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de18e4-9c71-4955-9cb5-305dea950650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:41.987726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-39de18e4-9c71-4955-9cb5-305dea950650 None None] MFA Rules not processed for user `1e10b648999345cd937ba23a75649acc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:41.989401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39de18e4-9c71-4955-9cb5-305dea950650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:42.107058 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1682/3330] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:42.109241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.122639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9204-fc08-4077-8cfd-3c204c8505f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.128415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.129252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.129692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.130179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.131007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.132333 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:42.132333 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:42.132333 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:42.133797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:42.262820 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1649/3331] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:37:42 2022] POST /identity/v3/domains => generated 276 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:42.266655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de18e4-9c71-4955-9cb5-305dea950650 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.288984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de18e4-9c71-4955-9cb5-305dea950650 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.413206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.414239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.414685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.414967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.415660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d87ca0cfe3364bfface357dec291a7a4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.417549 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:42.417549 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:42.417549 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:42.418169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:42.565517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.569384 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1683/3332] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:37:42 2022] PUT /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config => generated 138 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:42.580866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f7ac-d45a-4687-b91d-794d7277fa55 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.587312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.588284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.588844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.589563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.591201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d87ca0cfe3364bfface357dec291a7a4, group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.592608 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:42.592608 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:42.592608 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:42.594526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:42.610843 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1650/3333] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:37:42 2022] GET /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/identity => generated 45 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:42.612001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.629645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33e0e8-1c4d-43a2-8f13-86c893261b91 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.646685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.647374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.647654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.647932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/identity/driver` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.651457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d87ca0cfe3364bfface357dec291a7a4, group=identity, option=driver)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.652474 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:42.652474 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:42.652474 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:42.653370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:42.667453 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1684/3334] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 18 13:37:42 2022] GET /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/identity/driver => generated 31 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:42.668637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.679640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666377e8-425b-4cf3-b960-dff6afe81baa tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.685418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.686079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.686401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.686791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/ldap` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.687895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d87ca0cfe3364bfface357dec291a7a4, group=ldap)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.690373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:42.699856 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1651/3335] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:37:42 2022] GET /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/ldap => generated 106 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:42.704341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.716156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8e6a4-ae21-4ebd-ad89-72465e689012 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.723870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.724788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.725366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.725648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/ldap/url` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.727536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d87ca0cfe3364bfface357dec291a7a4, group=ldap, option=url)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.729312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:42.731023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:42.756295 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1685/3336] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:37:42 2022] GET /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/ldap/url => generated 46 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:42.757455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.784014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda1d6b-f033-48a6-9e91-e0d80cc4ff6b tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.798766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.800122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.800711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.801214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/ldap/user_tree_dn` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.804271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d87ca0cfe3364bfface357dec291a7a4, group=ldap, option=user_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.806725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:42.817683 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1652/3337] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 18 13:37:42 2022] GET /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config/ldap/user_tree_dn => generated 63 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:42.821648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:42.861913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c8b8c-f38d-4691-bdf7-d24cf531ab45 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:42.892353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:42.893026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:42.893342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:42.893623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:42.902414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d87ca0cfe3364bfface357dec291a7a4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:42.903505 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:42.903505 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:42.903505 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:42.904425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:43.029566 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1686/3338] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:37:42 2022] DELETE /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4/config => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:43.035716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:43.055186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5181e7-ffe4-4ba4-a7f2-acb7ea2f0ba8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:43.067265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:43.074712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:43.074712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:43.074712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:43.074712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d87ca0cfe3364bfface357dec291a7a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:43.076032 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:43.076032 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:43.076032 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:43.076032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:43.134772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.139682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.251950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.252874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.257583 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1653/3339] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:37:43 2022] PATCH /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4 => generated 277 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:43.261721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:43.268473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:43.293807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470d4b-4460-4e8d-8683-666167effd57 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:43.389270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:43.390441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:43.391596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:43.392025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:43.416021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d87ca0cfe3364bfface357dec291a7a4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:43.417853 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:43.417853 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:43.417853 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:43.420135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:43.453828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.475302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.616034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4', 'request_id': 'req-079ab41e-fe48-4854-b9df-b9d281c37104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.626313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4', 'request_id': 'req-079ab41e-fe48-4854-b9df-b9d281c37104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.711595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4', 'request_id': 'req-079ab41e-fe48-4854-b9df-b9d281c37104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.741986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] The token cache is being invalidate because project d87ca0cfe3364bfface357dec291a7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:43.742906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.743624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.760611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4', 'request_id': 'req-079ab41e-fe48-4854-b9df-b9d281c37104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.761424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4', 'request_id': 'req-079ab41e-fe48-4854-b9df-b9d281c37104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.767143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd87ca0cfe3364bfface357dec291a7a4', 'request_id': 'req-079ab41e-fe48-4854-b9df-b9d281c37104'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:43.779370 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1687/3340] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:37:43 2022] DELETE /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:43.781959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:43.794564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b8106-9dcd-4306-b205-838cb57145fb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:43.805770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:43.891250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:43.892834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:43.893340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:43.898777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:43.899606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:43.901587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.002358 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1654/3341] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:37:43 2022] POST /identity/v3/domains => generated 276 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:44.006771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.008829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:44.025404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ab41e-fe48-4854-b9df-b9d281c37104 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:44.130612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:44.132479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:44.132898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:44.133407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:44.134224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:44.136938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.277078 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1688/3342] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:37:44 2022] PUT /identity/v3/domains/886b933d3a074a09923045a03c198c00/config => generated 138 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:44.281155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.310588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9a80-ee53-4e13-a933-39266bed1e6d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:44.329707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:44.332603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:44.332603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:44.333516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:44.334914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:44.338086 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:44.338086 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:44.338086 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:44.343774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.505089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1655/3343] 10.222.0.27 () {60 vars in 1271 bytes} [Tue Oct 18 13:37:44 2022] PATCH /identity/v3/domains/886b933d3a074a09923045a03c198c00/config => generated 141 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:44.510310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.523920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0dbe-dc91-4b28-84b6-6d0372087041 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:44.529164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:44.529912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:44.530245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:44.530532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:44.535850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:44.535850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.539826 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1689/3344] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:44 2022] GET /identity/v3/domains/886b933d3a074a09923045a03c198c00/config => generated 141 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:44.543766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.555322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ffa99-0ee2-4a2d-a30c-7a867d81607a tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:44.561388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:44.563307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:44.563307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:44.563307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:44.563885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:44.565126 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:44.565126 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:44.565126 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:44.566036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.636212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:44.694719 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1656/3345] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:37:44 2022] DELETE /identity/v3/domains/886b933d3a074a09923045a03c198c00/config => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:44.696159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.708177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423c69-0fd3-4f4b-ba85-414ff414e5e7 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:44.714003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:44.715142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:44.715799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:44.716911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:44.720357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:44.723555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Could not find any options in domain configuration for domain 886b933d3a074a09923045a03c198c00.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 886b933d3a074a09923045a03c198c00. Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 18 13:37:44.737430 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 886b933d3a074a09923045a03c198c00. Oct 18 13:37:44.738561 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:37:44.745483 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1690/3346] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:44 2022] GET /identity/v3/domains/886b933d3a074a09923045a03c198c00/config => generated 151 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:37:44.747166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.765515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552cbb-26ba-4732-89ab-ffd00263b9d4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:44.771576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:44.772378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:44.772769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:44.773172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:44.774561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:44.777724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.788440 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1657/3347] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:37:44 2022] DELETE /identity/v3/domains/886b933d3a074a09923045a03c198c00/config => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:44.794434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.808422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40350e87-b768-4a0a-b128-637475b14ea9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:44.815099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:44.816336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:44.816977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:44.817539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:44.819125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:44.820491 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:44.820491 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:44.820491 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:44.822490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:44.857527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '886b933d3a074a09923045a03c198c00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:44.858427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '886b933d3a074a09923045a03c198c00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:44.975655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '886b933d3a074a09923045a03c198c00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:44.976464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '886b933d3a074a09923045a03c198c00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:44.989357 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1691/3348] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:37:44 2022] PATCH /identity/v3/domains/886b933d3a074a09923045a03c198c00 => generated 277 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:44.999257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:44.999257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:45.012692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc1357-415e-4978-8dac-9575def99631 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:45.126510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:45.127517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:45.128077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:45.128689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:45.148022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=886b933d3a074a09923045a03c198c00)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:45.161721 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:45.161721 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:45.161721 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:45.163730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:45.200665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '886b933d3a074a09923045a03c198c00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.232577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '886b933d3a074a09923045a03c198c00'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.341551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886b933d3a074a09923045a03c198c00', 'request_id': 'req-cac2ac03-42d9-4a76-8fd9-024df240eeee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.352025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886b933d3a074a09923045a03c198c00', 'request_id': 'req-cac2ac03-42d9-4a76-8fd9-024df240eeee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.419070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886b933d3a074a09923045a03c198c00', 'request_id': 'req-cac2ac03-42d9-4a76-8fd9-024df240eeee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.434136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] The token cache is being invalidate because project 886b933d3a074a09923045a03c198c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:45.434442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.435100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.444762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '886b933d3a074a09923045a03c198c00', 'request_id': 'req-cac2ac03-42d9-4a76-8fd9-024df240eeee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.445537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '886b933d3a074a09923045a03c198c00', 'request_id': 'req-cac2ac03-42d9-4a76-8fd9-024df240eeee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.446409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '886b933d3a074a09923045a03c198c00', 'request_id': 'req-cac2ac03-42d9-4a76-8fd9-024df240eeee'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:45.465213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:45.466345 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1658/3349] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:37:44 2022] DELETE /identity/v3/domains/886b933d3a074a09923045a03c198c00 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:45.478175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fdf04-adde-4a16-b464-5cc88d502d46 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:45.499085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:45.575527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:45.576594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:45.577144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:45.577597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:45.579416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:45.580853 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:45.580853 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:45.580853 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:45.582511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:45.780276 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1692/3350] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:37:45 2022] POST /identity/v3/domains => generated 277 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:45.784653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:45.786440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:45.828917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2ac03-42d9-4a76-8fd9-024df240eeee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:45.931859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:45.932554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:45.932830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:45.933112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:45.933819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:45.934870 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:45.934870 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:45.934870 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:45.935774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.078010 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1659/3351] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:37:45 2022] PUT /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config => generated 138 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:46.082821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.103760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea13bb4-2dff-434c-82af-c224981e9801 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:46.116207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:46.117317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:46.117754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:46.118262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:46.119624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241, group=identity)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:46.120828 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:46.120828 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:46.120828 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:46.122135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.261503 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1693/3352] 10.222.0.27 () {60 vars in 1297 bytes} [Tue Oct 18 13:37:46 2022] PATCH /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity => generated 177 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:46.266310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.280983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71e959-65cd-4ccc-8c78-d820da34bd88 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:46.295578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:46.296278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:46.296738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:46.298889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity/driver` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:46.300765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241, group=identity, option=driver)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:46.303678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.432296 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1660/3353] 10.222.0.27 () {60 vars in 1318 bytes} [Tue Oct 18 13:37:46 2022] PATCH /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity/driver => generated 177 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:46.438906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.482162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fb070-0041-4e38-9acb-4add414205b6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:46.482162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:46.482852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:46.483223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:46.483717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity/driver` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:46.485124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241, group=identity, option=driver)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:46.487482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.610787 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1694/3354] 10.222.0.27 () {58 vars in 1299 bytes} [Tue Oct 18 13:37:46 2022] DELETE /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity/driver => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:46.615307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.626786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03f46d-53c9-4c6d-824e-6c27bd41438f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:46.631559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:46.632343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:46.632727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:46.633101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity/driver` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:46.634574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241, group=identity, option=driver)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:46.636336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Could not find option driver in group identity in domain configuration for domain 32955c28908b4dec87b8c6c7727ba241.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 32955c28908b4dec87b8c6c7727ba241. Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:37:46.646235 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 32955c28908b4dec87b8c6c7727ba241. Oct 18 13:37:46.649166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:46.656051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.662113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1661/3355] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Oct 18 13:37:46 2022] GET /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity/driver => generated 171 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:37:46.670820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:46.675492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ca7b8-ffbd-4d57-892d-94e8b5b9eb67 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:46.691405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:46.692290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:46.692727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:46.693157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:46.694442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241, group=identity)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:46.697983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.810117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.811543 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1695/3356] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 18 13:37:46 2022] DELETE /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:46.825542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231aa3-15ff-40a1-bce5-f614f45aeee4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:46.832936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:46.835209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:46.835674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:46.836116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:46.839819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241, group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:46.849040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Could not find group identity in domain configuration for domain 32955c28908b4dec87b8c6c7727ba241.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 32955c28908b4dec87b8c6c7727ba241. Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:37:46.862557 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 32955c28908b4dec87b8c6c7727ba241. Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:46.864147 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1662/3357] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 18 13:37:46 2022] GET /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config/identity => generated 154 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:37:46.865307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.877084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e29263-ba40-40ec-a51c-be1ab7be9add tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:46.887201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:46.888071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:46.888360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:46.888641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241/config` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:46.889272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=32955c28908b4dec87b8c6c7727ba241)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:46.891985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:46.945715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:46.947844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:46.981197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1696/3358] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:37:46 2022] DELETE /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241/config => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:46.986392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:47.009554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ce4d-5fee-43d9-b451-09588f27971e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:47.045730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:47.047209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:47.051379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:47.051379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:47.051379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=32955c28908b4dec87b8c6c7727ba241)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:47.053222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:47.103803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '32955c28908b4dec87b8c6c7727ba241'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.105311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '32955c28908b4dec87b8c6c7727ba241'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.133253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12a12e-2e8f-4823-8c2c-06db241816c3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:47.208427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '32955c28908b4dec87b8c6c7727ba241'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.210620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '32955c28908b4dec87b8c6c7727ba241'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.217165 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1697/3359] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:37:46 2022] PATCH /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241 => generated 278 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:47.221973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:47.227149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:47.285896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:47.291981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:47.291981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:47.291981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] PATH_INFO: `/v3/users/3fd1e93724564bf18a8d3a15c12169dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:47.294886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd1e93724564bf18a8d3a15c12169dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:47.301632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:47.318456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:47.326521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707849-e23f-42ec-9f17-37fe8a53d1f8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:47.326521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:47.326521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:47.327277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:47.327277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:47.341563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=32955c28908b4dec87b8c6c7727ba241)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:47.343656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:47.377397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '32955c28908b4dec87b8c6c7727ba241'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.393448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '32955c28908b4dec87b8c6c7727ba241'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.573202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32955c28908b4dec87b8c6c7727ba241', 'request_id': 'req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.587595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32955c28908b4dec87b8c6c7727ba241', 'request_id': 'req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.665437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32955c28908b4dec87b8c6c7727ba241', 'request_id': 'req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.691898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] The token cache is being invalidate because project 32955c28908b4dec87b8c6c7727ba241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:47.692304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.693019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.697203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd1e93724564bf18a8d3a15c12169dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.699088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd1e93724564bf18a8d3a15c12169dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.703841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '32955c28908b4dec87b8c6c7727ba241', 'request_id': 'req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.704881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '32955c28908b4dec87b8c6c7727ba241', 'request_id': 'req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.710736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '32955c28908b4dec87b8c6c7727ba241', 'request_id': 'req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.732111 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1698/3360] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:37:47 2022] DELETE /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:47.733515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:47.735726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:47.835920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd1e93724564bf18a8d3a15c12169dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.837250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd1e93724564bf18a8d3a15c12169dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.850897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd1e93724564bf18a8d3a15c12169dc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:47.898956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1faa2-c098-4fbb-9bc8-1c3d8404047d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:47.904877 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1663/3361] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:46 2022] DELETE /identity/v3/users/3fd1e93724564bf18a8d3a15c12169dc => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:47.944873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:47.944873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:47.944873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:47.947598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:47.949661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:47.951042 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:47.951042 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:37:47.951042 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:37:47.952569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:47.957625 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1699/3362] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Oct 18 13:37:47 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:37:47.961796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:47.969547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:48.172568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c18937-e96f-407c-bfbc-e2b2976bf129 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.185630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.186736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.187999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.192537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.192537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.193757 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:37:48.193757 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:37:48.193757 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:37:48.196280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.200526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1664/3363] 10.222.0.27 () {58 vars in 1200 bytes} [Tue Oct 18 13:37:47 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.204999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.223932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cd820-eb9d-4bae-9af7-a8484ee48656 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.239813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.240491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.240780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.241061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.247737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.247737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.250839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.257813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1700/3364] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.265082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34d53-ada9-494e-8d70-2efdd45f1f89 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.271148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.271810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.272736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.272736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.273129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.274819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.278107 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1665/3365] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.280091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.291561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddea62-aa56-4958-a1a6-470f9137b613 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.297009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.297738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.298173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.298468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.299047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.300653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.305597 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1701/3366] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:48.306739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.324207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c3e4-41f3-42b8-a1ba-fff05189c529 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.332940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.334435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.335078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.335973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.337176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.339511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.341726 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1666/3367] 10.222.0.27 () {58 vars in 1200 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.346081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.375041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037f05-0dec-46a9-a1cd-3eaef50a9317 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.396850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.396850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.396850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.397283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.397283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.400703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.409915 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1702/3368] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:48.410122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.420276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d853b-cc4c-4af2-b996-599057af0666 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.437874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.439235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.439645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.440309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.442158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.448003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:48.448236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.450289 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1667/3369] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.455757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.470732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce5d09-1164-4b0a-a9db-69b580ad04a2 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.477128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.477957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.478337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.478726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.479838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.481179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.483043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1703/3370] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.497257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.509640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f072-ac74-4d8b-ae1b-5f886a878c63 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.522796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.528300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:48.547685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.548763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.549541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.551860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.553356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.566369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.567275 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1668/3371] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.570834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.584585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80e495-1350-4569-bea8-34a89a37eda9 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.592553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.593469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.594000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.594510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.595293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.597083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.600182 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1669/3372] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.603297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.624636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca67e23-c2b8-494f-89cf-f9cf7aee95ff tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.632215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.632969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.633251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.633709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.634508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.636268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.638126 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1670/3373] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.639665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:48.643202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.655631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969d0ad-f57f-4f8f-bb1c-276f9b3ef043 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.662402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.663530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.664040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.664347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.665044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.667179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.668929 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1671/3374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.672656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.688831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef0ecc-4c05-498f-ada8-425691206615 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.691558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1176b36-697b-4aa5-972d-48d1253203e8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.694343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.695703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.695703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.695703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] PATH_INFO: `/v3/projects/fa2e6c5545cd41cc99079ee7f2a9ff6c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.701294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.701863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.702228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.702695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.703917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.705433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2e6c5545cd41cc99079ee7f2a9ff6c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.708441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.712997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.714170 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1672/3375] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:48.718187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.732325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa71a9-79db-470f-a9e5-fde30f21f2b3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.739240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.740804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.741214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.741603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.742350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.744470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.746349 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1673/3376] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.750523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.762842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea865f0-a93f-46ad-ab12-df2f9f66e3b1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.770280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.771177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.771554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.771933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.772624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.775825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.778111 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1674/3377] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:48.786271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.819376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc747e5-343d-484e-8fc1-3a4314afe502 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.825314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.826033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.826393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.826985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.827593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.830078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.834237 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1675/3378] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.835398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.851638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29908ba-fcd0-4757-b162-b0162db8c520 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.857862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.858842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.860189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.861425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.862257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.864153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.868326 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1676/3379] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:48.877010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.906534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101588-2297-4214-8855-bdfa0f62a769 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.912954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:48.913985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:48.914464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:48.914850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:48.915603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:48.917300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:48.919159 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1677/3380] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:48.930142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:48.944655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5de83-f718-4a7d-857f-9e7ec29afdb8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:48.945323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'request_id': 'req-c2d99793-18bb-452f-ba3d-3593112a0b74'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:48.954155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'request_id': 'req-c2d99793-18bb-452f-ba3d-3593112a0b74'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.047429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.049488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2e6c5545cd41cc99079ee7f2a9ff6c', 'request_id': 'req-c2d99793-18bb-452f-ba3d-3593112a0b74'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.055470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.058467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.060515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.065088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.068265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] The token cache is being invalidate because project fa2e6c5545cd41cc99079ee7f2a9ff6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:49.068589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.069141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.069608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.071346 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1678/3381] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:37:48 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.076707 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1704/3382] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:48 2022] DELETE /identity/v3/projects/fa2e6c5545cd41cc99079ee7f2a9ff6c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:49.076902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.077949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.081385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:49.082352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:49.112319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7626016-6206-464a-8d06-f0e614972015 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.123782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.131455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.131455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.131455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.131455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.131849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.131849 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1679/3383] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.133886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.147436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d859-590e-43e4-b4c7-76649a40ddfb tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.152658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.153571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.153895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.154217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.154810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.158730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.160500 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1680/3384] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:49.164062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.176079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830100f7-d88a-4b39-80a4-35d9f78de321 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.182648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.184004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.184530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.185053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.185864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.188524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.194607 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1681/3385] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:49.197620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.205053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d99793-18bb-452f-ba3d-3593112a0b74 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.213782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217801-440d-4092-90dc-356113280f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.217514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81598e62-e5f1-4789-99fa-a13f8a5a500f tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.220478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217801-440d-4092-90dc-356113280f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.220949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217801-440d-4092-90dc-356113280f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.221246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17217801-440d-4092-90dc-356113280f49 admin admin] PATH_INFO: `/v3/users/abec6e005f9f4bde9117e874cbb75d96` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.223682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.224676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.225218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.225771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.226654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.228745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217801-440d-4092-90dc-356113280f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abec6e005f9f4bde9117e874cbb75d96)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.229447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.231774 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1682/3386] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.233562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17217801-440d-4092-90dc-356113280f49 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.236383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.249004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c3df-c229-4ba9-8eb0-5af223aa0211 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.258497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.260544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.261198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.261837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.262698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.268181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.272827 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1683/3387] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.274682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.301272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fb7bb-6360-44b8-8d07-d43409f12c6c tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.316725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.316725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.316725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.317471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.317471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.317471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.319358 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1684/3388] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.323355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.341409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05963d9-be41-4ed8-be45-b19e892ae366 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.347740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.349164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.349814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.350496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.351625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.353535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.355673 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1685/3389] 10.222.0.27 () {58 vars in 1290 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:49.361110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.377865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a965b-9810-4bbd-9e4e-e236e4989d35 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.387240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.388173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.388662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.389149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.390834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.393041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.394864 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1686/3390] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.399490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.413031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204fe67-e4d3-4bdd-a1f5-c5f5a3e9b4e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.419313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.420578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.420916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.421354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.422929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.424566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.426455 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1687/3391] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.430993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.454443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8d575-d964-4e61-97a9-f801a80ff691 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.461994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.462932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.463313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.463674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.464672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.466520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.468015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1688/3392] 10.222.0.27 () {58 vars in 1308 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:49.472849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.497307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66aec-74ea-45bf-ba41-dcee7861af44 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.504412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.505133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.505592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.506441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.506573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.508345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.512634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1689/3393] 10.222.0.27 () {58 vars in 1290 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:49.513806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.530912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c79c2-4028-4c45-9887-d62c4f7fb635 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.539357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.540083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.540365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.540878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.541503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.543595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.548138 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1690/3394] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:49.549446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.561723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c626b-52b4-4e5d-93cc-5d7af31ca7c8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.567712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.569154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.569437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.569773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.570575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.572507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.572706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-17217801-440d-4092-90dc-356113280f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abec6e005f9f4bde9117e874cbb75d96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.574427 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1691/3395] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.577943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.587071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-17217801-440d-4092-90dc-356113280f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abec6e005f9f4bde9117e874cbb75d96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.588264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-17217801-440d-4092-90dc-356113280f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abec6e005f9f4bde9117e874cbb75d96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.614950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856a08-49fe-4a0d-846d-e9f5fa8d4679 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.622299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-17217801-440d-4092-90dc-356113280f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abec6e005f9f4bde9117e874cbb75d96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.623815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.624477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.624766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.625085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.625682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.627339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.632952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1692/3396] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.633868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.639762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:49.667060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d2bb-947a-4993-af31-86dfc49de897 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.672638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.674689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.675134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.675520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.676274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.677954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.679561 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1693/3397] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.684077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.698365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815df6-8031-4486-b547-7559ca3eafd8 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.701364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.703709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.704217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.704700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.705509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.707613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.709224 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1694/3398] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.713307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.720313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-17217801-440d-4092-90dc-356113280f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abec6e005f9f4bde9117e874cbb75d96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:49.728497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856e9b-76b7-4783-a590-86e1b7cd9580 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.736298 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1705/3399] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:49 2022] DELETE /identity/v3/users/abec6e005f9f4bde9117e874cbb75d96 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:49.744485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.745168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.745454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.745736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.746398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.748082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.749283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1695/3400] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.753289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217801-440d-4092-90dc-356113280f49 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.880257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17217801-440d-4092-90dc-356113280f49 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.887318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.888324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.888825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.889298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.890152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.892562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.895213 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1706/3401] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.899264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.921483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c80178-0404-411b-af63-b85d25e4e6c1 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.937697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.938401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.938692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.938975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.939573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.941166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.945259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1696/3402] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.948505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:49.958922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeafe2-5169-4437-9113-d78c3c7ba4c0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:49.980596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:49.981555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:49.982225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:49.982714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:49.983487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:49.985342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:49.986691 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1707/3403] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:49.990782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.005019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bd603-e638-4eb1-a82f-a959c8d8d470 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.011513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.012216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.012730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.013085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.014217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.016475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.021283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1697/3404] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 13:37:49 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:50.023122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.025676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:50.037793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4558cb-703b-4b55-b42d-a6569a9f9ca3 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.044887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.045620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.045972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.046343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.047068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.049869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.051863 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1708/3405] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:50.057706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.070635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae04f-d9d3-4d70-aafd-6ba523c9217e tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.075907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.076962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.076962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.077391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.078040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.080263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.081528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1698/3406] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:50.094268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.098433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.103114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.105512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddcee9-c1e2-4950-af89-69524e8e6ba6 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.122959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:50.127868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.128549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.128826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.129278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.130028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.134988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.136135 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1709/3407] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.140019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.166066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba3db8-d7e2-4915-bba7-0c3d491a02bf tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.173904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.174847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.175208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.175559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.176229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.178551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.179749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1710/3408] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.183783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.204559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291ba9-76fb-4490-ae5e-3a4b7d785fe4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.212031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382fc84-4322-409d-8017-f6c4f4cf1fee tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.214441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.215025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.215482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.215769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.216367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.219170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.219828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.220710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.221169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.221611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] PATH_INFO: `/v3/users/195f89e4994b4c0ebc19dead688b7ba1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.222981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195f89e4994b4c0ebc19dead688b7ba1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.224645 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1711/3409] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.225484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.226897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.238911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4d593-df6d-4cba-a5ee-79c48e53ace0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.245212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.245879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.246364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.250893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.254429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.257213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.258596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1712/3410] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.266531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.297790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2e31f-7a33-4075-bd24-1fdafaeaa1d5 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.303764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.304424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.304704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.304977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.305559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.307194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.310675 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1713/3411] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:50.310675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.313117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.327025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89505aa-0ec9-4663-9534-ce3058c0c3cc tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.332555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.333186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.333472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.333748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] PATH_INFO: `/v3/projects/7a1545dd358d4b7fb9126628d5241b18` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.335771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1545dd358d4b7fb9126628d5241b18)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.337550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.480739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195f89e4994b4c0ebc19dead688b7ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.481478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195f89e4994b4c0ebc19dead688b7ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.514207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1545dd358d4b7fb9126628d5241b18', 'request_id': 'req-295d7338-828a-4015-a450-0e6340856f87'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.525266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1545dd358d4b7fb9126628d5241b18', 'request_id': 'req-295d7338-828a-4015-a450-0e6340856f87'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.550313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195f89e4994b4c0ebc19dead688b7ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.551053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195f89e4994b4c0ebc19dead688b7ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.559135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195f89e4994b4c0ebc19dead688b7ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.578569 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1699/3412] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:50 2022] DELETE /identity/v3/users/195f89e4994b4c0ebc19dead688b7ba1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:50.579505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.580933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.636624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1545dd358d4b7fb9126628d5241b18', 'request_id': 'req-295d7338-828a-4015-a450-0e6340856f87'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.656041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97b88-a047-48ce-9882-9646150ad363 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.660891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.661395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] The token cache is being invalidate because project 7a1545dd358d4b7fb9126628d5241b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:50.661546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.661762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.661909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.662215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.662812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.663353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-295d7338-828a-4015-a450-0e6340856f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:50.664608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.665858 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1714/3413] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:50 2022] DELETE /identity/v3/projects/7a1545dd358d4b7fb9126628d5241b18 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:50.669086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1700/3414] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.670239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.671563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e04f-f6ba-4abe-be55-70143aba111c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.672888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e04f-f6ba-4abe-be55-70143aba111c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.673021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.673474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e04f-f6ba-4abe-be55-70143aba111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.689409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9170f0f-c0fd-4487-ab68-3dbb2df5eb08 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.695774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae97fd-748d-4048-b67e-14623a03ed25 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.696656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae97fd-748d-4048-b67e-14623a03ed25 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.696944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae97fd-748d-4048-b67e-14623a03ed25 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.697347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae97fd-748d-4048-b67e-14623a03ed25 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.698039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae97fd-748d-4048-b67e-14623a03ed25 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.699173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8e03e04f-f6ba-4abe-be55-70143aba111c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:50.700057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae97fd-748d-4048-b67e-14623a03ed25 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.701119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8e03e04f-f6ba-4abe-be55-70143aba111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.701663 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1701/3415] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.703081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434813-d251-40d5-89bc-47ea16225520 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.703361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434813-d251-40d5-89bc-47ea16225520 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.711473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c434813-d251-40d5-89bc-47ea16225520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.726455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8c434813-d251-40d5-89bc-47ea16225520 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:50.727783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c434813-d251-40d5-89bc-47ea16225520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.799338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:50.808952 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1715/3416] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:50.808952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03e04f-f6ba-4abe-be55-70143aba111c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.810360 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1702/3417] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:50.816996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03e04f-f6ba-4abe-be55-70143aba111c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.818346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ff80-14aa-4124-b09d-6c8f10ed7f6b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.818635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ff80-14aa-4124-b09d-6c8f10ed7f6b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.818912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ff80-14aa-4124-b09d-6c8f10ed7f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.828157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.828830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.829293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.829574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.830234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.832097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.836301 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1716/3418] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.837365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.839080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.842561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0323ff80-14aa-4124-b09d-6c8f10ed7f6b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:50.844554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0323ff80-14aa-4124-b09d-6c8f10ed7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:50.854766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1703/3419] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:37:50.858880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323ff80-14aa-4124-b09d-6c8f10ed7f6b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.872461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323ff80-14aa-4124-b09d-6c8f10ed7f6b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.885286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.886556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.886845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.887419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.888780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.890475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.892115 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1704/3420] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.893250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.908934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d2f36-779f-4bb3-b9bc-555d839280e4 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.916037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.916235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46a8b8-152c-4209-a09a-443929aef8ae tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.917102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.917465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.917828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.918594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:37:50.919109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.920464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.920691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.921077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.921453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.921788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.932799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.934434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.940903 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1705/3421] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:50.940903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.953891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e2fc0-65a9-4559-bb3b-fbd4f69d4016 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.959642 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1717/3422] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:50.959642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.960433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.961227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.961601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.961971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.962688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.964742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.967500 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1706/3423] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:37:50.970818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96600b7b-6288-41d6-bd44-147cf59c6ffc service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.972078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:50.976867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.980286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.981080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.981080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.981868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.983841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:50.985087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c04d6b-6213-451f-a3d8-59155fc9aeb0 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:50.990997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:50.995217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:50.995217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:50.995217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:50.995217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:50.996126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:51.002471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1707/3424] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 18 13:37:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 18 13:37:51.005695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.020074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56414df-f5d8-4d15-b863-e466175120cd tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.026105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.026105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.026105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.026581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/32955c28908b4dec87b8c6c7727ba241` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.037491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Could not find domain: 32955c28908b4dec87b8c6c7727ba241.: keystone.exception.DomainNotFound: Could not find domain: 32955c28908b4dec87b8c6c7727ba241. Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 32955c28908b4dec87b8c6c7727ba241. Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:37:51.048675 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:37:51.052066 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:37:51.053042 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 32955c28908b4dec87b8c6c7727ba241. Oct 18 13:37:51.054450 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.054450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1708/3425] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:37:51 2022] PATCH /identity/v3/domains/32955c28908b4dec87b8c6c7727ba241 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 13:37:51.054450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.073214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e160c-a502-421c-ab79-abe67c7f2e96 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.083845 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1718/3426] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:50 2022] POST /identity/v3/projects => generated 411 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:51.089007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.090327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.091951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.092238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.093019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/886b933d3a074a09923045a03c198c00` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Could not find domain: 886b933d3a074a09923045a03c198c00.: keystone.exception.DomainNotFound: Could not find domain: 886b933d3a074a09923045a03c198c00. Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 886b933d3a074a09923045a03c198c00. Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:37:51.139652 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:37:51.141124 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:37:51.142103 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:37:51.143100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:37:51.143100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:37:51.143100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 886b933d3a074a09923045a03c198c00. Oct 18 13:37:51.143100 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.143100 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1709/3427] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:37:51 2022] PATCH /identity/v3/domains/886b933d3a074a09923045a03c198c00 => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:37:51.143100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.167955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f4f7b-dae5-438f-b6ed-fae1b610ef69 tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.216474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbdd8e-75cf-4974-b21b-36e9b2ecd7ad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.227399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.230087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.230600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.231816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.233069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:51.235314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:51.294664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e10b648999345cd937ba23a75649acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c44137fdc39247f893211da7cd2e00db', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.295593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.295878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.296203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] PATH_INFO: `/v3/domains/d87ca0cfe3364bfface357dec291a7a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.309692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Could not find domain: d87ca0cfe3364bfface357dec291a7a4.: keystone.exception.DomainNotFound: Could not find domain: d87ca0cfe3364bfface357dec291a7a4. Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d87ca0cfe3364bfface357dec291a7a4. Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:37:51.319728 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:37:51.320870 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:37:51.322372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d87ca0cfe3364bfface357dec291a7a4. Oct 18 13:37:51.323369 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:37:51.323369 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1710/3428] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:37:51 2022] PATCH /identity/v3/domains/d87ca0cfe3364bfface357dec291a7a4 => generated 112 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:37:51.326079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.329489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:51.348868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac7036-56c4-43c3-868d-d823cd5c994d tempest-DomainConfigurationTestJSON-811564373 tempest-DomainConfigurationTestJSON-811564373-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.354099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.354754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.355301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.355574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] PATH_INFO: `/v3/users/e66c674bace74f1b816fdfbc01a558ca` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.357436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66c674bace74f1b816fdfbc01a558ca)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:51.359717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:51.404191 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1719/3429] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:51 2022] POST /identity/v3/users => generated 306 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:51.409041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.419944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905248-02fd-4663-8053-bdd9f9376cbc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.425350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.426459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.426459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.426866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.427546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:51.429662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:51.444567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1720/3430] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:51.444567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.447295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:51.466396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f35cd4-16b6-489c-ba51-2614ccb72b82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.477564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.478900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.479451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.480021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] PATH_INFO: `/v3/projects/bd7c3553f1f34f86ad2a6fa9e4bb214a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.482078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7c3553f1f34f86ad2a6fa9e4bb214a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:51.485976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:51.606355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66c674bace74f1b816fdfbc01a558ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.607911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66c674bace74f1b816fdfbc01a558ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.662530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'request_id': 'req-438c3cae-b55f-4c6b-bac9-2967cbca42b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.672095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'request_id': 'req-438c3cae-b55f-4c6b-bac9-2967cbca42b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.688364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66c674bace74f1b816fdfbc01a558ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.690387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66c674bace74f1b816fdfbc01a558ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.712042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66c674bace74f1b816fdfbc01a558ca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.761246 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1711/3431] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:51 2022] DELETE /identity/v3/users/e66c674bace74f1b816fdfbc01a558ca => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:51.762354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:51.765041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:51.781364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7c3553f1f34f86ad2a6fa9e4bb214a', 'request_id': 'req-438c3cae-b55f-4c6b-bac9-2967cbca42b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.797895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] The token cache is being invalidate because project bd7c3553f1f34f86ad2a6fa9e4bb214a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:51.798231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.800807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-438c3cae-b55f-4c6b-bac9-2967cbca42b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:51.805010 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1721/3432] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:51 2022] DELETE /identity/v3/projects/bd7c3553f1f34f86ad2a6fa9e4bb214a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:51.806595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efe828-5530-4595-95da-973d6bca6b4d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.808010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efe828-5530-4595-95da-973d6bca6b4d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.809994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efe828-5530-4595-95da-973d6bca6b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.821498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:51.861919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-93efe828-5530-4595-95da-973d6bca6b4d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:51.869721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93efe828-5530-4595-95da-973d6bca6b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:51.925560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101f74b-2d83-4629-b6d8-164292391248 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:51.939646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550ee05-9699-42da-95cc-20644a2b9410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:51.940511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550ee05-9699-42da-95cc-20644a2b9410 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.940614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550ee05-9699-42da-95cc-20644a2b9410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.940815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550ee05-9699-42da-95cc-20644a2b9410 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:51.941660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550ee05-9699-42da-95cc-20644a2b9410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:51.943334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550ee05-9699-42da-95cc-20644a2b9410 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:51.966441 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1712/3433] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:51.967948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:51.974216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:51.974721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.020478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:52.022297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:52.041213 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1713/3434] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:52.042450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.044719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:52.063292 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1722/3435] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:52.067850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.068198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.068709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.069969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5e130-ba9a-42f5-9bdb-fc05dba2059b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.083588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.085132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.085132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.085132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] PATH_INFO: `/v3/projects/2ca4cc1ec1fa44159bd24c7e1d67b907/users/1fbc5130642349b4a985d88f4515040f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.096592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:52.098690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:52.114101 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1723/3436] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:52.114101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.120499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca4cc1ec1fa44159bd24c7e1d67b907, user_id=1fbc5130642349b4a985d88f4515040f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.122097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.123543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:52.211274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ec91-ff42-42d7-a18f-38dd3ed986fe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.215631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6786d-c644-40f7-b2f1-e04194d9e1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.216419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6786d-c644-40f7-b2f1-e04194d9e1bb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.216815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6786d-c644-40f7-b2f1-e04194d9e1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.217194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6786d-c644-40f7-b2f1-e04194d9e1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.232816 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1714/3437] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:52 2022] PUT /identity/v3/projects/2ca4cc1ec1fa44159bd24c7e1d67b907/users/1fbc5130642349b4a985d88f4515040f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:52.233883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.239661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6786d-c644-40f7-b2f1-e04194d9e1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.241116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6786d-c644-40f7-b2f1-e04194d9e1bb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.266813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1724/3438] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:52.268147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5374b99-d368-4b39-847e-1da81b14c2dd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.268429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5374b99-d368-4b39-847e-1da81b14c2dd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.268701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5374b99-d368-4b39-847e-1da81b14c2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.312190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f5374b99-d368-4b39-847e-1da81b14c2dd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:52.315340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f5374b99-d368-4b39-847e-1da81b14c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:52.365148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548b32-a925-4822-bfc4-2866aa0a2787 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.379437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.380124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.380394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.380680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.381309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:37:52.381608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.383760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.408487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1715/3439] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:37:52.412802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.423995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b47e54-9d0a-4f5e-8fc3-3488c092400f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.427968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1725/3440] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:52.428867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.429515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.429796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.430104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.430845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.432948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.438620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5374b99-d368-4b39-847e-1da81b14c2dd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.451896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:52.523218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5374b99-d368-4b39-847e-1da81b14c2dd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.527841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.528718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.529177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.529598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.541253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.543094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.545530 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1716/3441] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:52 2022] POST /identity/v3/projects => generated 397 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:37:52.553613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.558479 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1726/3442] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:52.650699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fbe02-9e48-4dbe-b88c-bc0d3d88e5cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.655753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.656415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.656692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.656965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.657608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.659743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.748993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.751612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:52.787647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4b8f8-35c6-4019-a706-8083c8e0e86b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.796364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.797560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.797841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.798156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] PATH_INFO: `/v3/projects/1ef94919c66a4761b69805ea35ac9ee2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.802911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1717/3443] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:52 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:52.807610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef94919c66a4761b69805ea35ac9ee2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.807610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.807819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.834321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e62284-0168-425d-9033-914315e77d72 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.843221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.843975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.844316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.845097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.846082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.855673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.877098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1718/3444] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:37:52.878780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.894416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f9716-ad9b-4406-9e3d-02b49c8d7643 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.895790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.896559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.896955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.897356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.898262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.900075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.915272 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1719/3445] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:52.916576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:52.930798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c3c0d-3247-4d76-ae06-a5dd119a4b64 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:52.939735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56b999-2f71-407d-900a-2b318c10f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:52.941615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56b999-2f71-407d-900a-2b318c10f0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:52.942767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56b999-2f71-407d-900a-2b318c10f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:52.943279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56b999-2f71-407d-900a-2b318c10f0c0 admin admin] PATH_INFO: `/v3/projects/492ae07762e74609848c683e321e505c/users/8d9440081a95401e88b836fca9b85742/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:52.963888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56b999-2f71-407d-900a-2b318c10f0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492ae07762e74609848c683e321e505c, user_id=8d9440081a95401e88b836fca9b85742, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:52.968398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef94919c66a4761b69805ea35ac9ee2', 'request_id': 'req-2c941534-4850-4e31-bd44-2a8372f72c00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:52.969661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56b999-2f71-407d-900a-2b318c10f0c0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:52.985246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef94919c66a4761b69805ea35ac9ee2', 'request_id': 'req-2c941534-4850-4e31-bd44-2a8372f72c00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.055923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef94919c66a4761b69805ea35ac9ee2', 'request_id': 'req-2c941534-4850-4e31-bd44-2a8372f72c00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.073481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] The token cache is being invalidate because project 1ef94919c66a4761b69805ea35ac9ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:53.073850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.075546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1720/3446] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:52 2022] PUT /identity/v3/projects/492ae07762e74609848c683e321e505c/users/8d9440081a95401e88b836fca9b85742/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:53.075702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.080604 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1727/3447] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:52 2022] DELETE /identity/v3/projects/1ef94919c66a4761b69805ea35ac9ee2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:37:53.086604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:53.088075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:53.088336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:53.089010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:53.089346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:53.170283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] MFA Rules not processed for user `8d9440081a95401e88b836fca9b85742`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:53.172661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:53.255407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c941534-4850-4e31-bd44-2a8372f72c00 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:53.322470 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1721/3448] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:53.374517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:53.413959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:53.414913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:53.417385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:53.417863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] PATH_INFO: `/v3/users/1e10b648999345cd937ba23a75649acc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:53.422242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e10b648999345cd937ba23a75649acc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:53.427092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:53.436038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:53.437672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:53.648106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae78e39-d1a6-40e3-b6b0-31ffad816b9a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:53.654868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:53.655558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:53.655837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:53.656721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:53.667910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:53.672240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:53.694837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1722/3449] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:53.753252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:53.753252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:53.772357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e10b648999345cd937ba23a75649acc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.778745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:53.782414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76252ba-1650-4b03-bd3a-6ea4b498cf43 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:53.793049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e10b648999345cd937ba23a75649acc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.794451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:53.796283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e10b648999345cd937ba23a75649acc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.797551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:53.798027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:53.799276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] PATH_INFO: `/v3/users/8d9440081a95401e88b836fca9b85742` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:53.802525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9440081a95401e88b836fca9b85742)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:53.807415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:53.848222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e10b648999345cd937ba23a75649acc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.972015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e361e50-d8a0-474a-a524-8842860f2aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e10b648999345cd937ba23a75649acc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:53.991681 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1728/3450] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:53 2022] DELETE /identity/v3/users/1e10b648999345cd937ba23a75649acc => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:54.096768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9440081a95401e88b836fca9b85742'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:54.097638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9440081a95401e88b836fca9b85742'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:54.192768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9440081a95401e88b836fca9b85742'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:54.193403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9440081a95401e88b836fca9b85742'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:54.205674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9440081a95401e88b836fca9b85742'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:54.255775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:54.291086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1723/3451] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:37:53 2022] DELETE /identity/v3/users/8d9440081a95401e88b836fca9b85742 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:54.295748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:54.296034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:54.296407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:54.338377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:54.340658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:54.495678 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1729/3452] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:54.539784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:54.541636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:54.628486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534b71-042d-485c-8013-1f089bbcf179 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:54.635122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:54.636089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:54.636583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:54.637017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:54.650010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:54.658134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:54.658134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:54.667487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1724/3453] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:37:55.359732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:55.752703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:56.086395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:56.088081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:56.108196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7ea4d-625d-40b3-8c59-f6d9058636fa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:56.124603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:56.126106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:56.131187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:56.131187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] PATH_INFO: `/v3/projects/c44137fdc39247f893211da7cd2e00db` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:56.133051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44137fdc39247f893211da7cd2e00db)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:56.135290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:56.324060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44137fdc39247f893211da7cd2e00db', 'request_id': 'req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:56.344213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44137fdc39247f893211da7cd2e00db', 'request_id': 'req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:56.393053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:56.394618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:56.409227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44137fdc39247f893211da7cd2e00db', 'request_id': 'req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:56.425335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] The token cache is being invalidate because project c44137fdc39247f893211da7cd2e00db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:56.425550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:56.428304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd1a64-3e99-40a1-a3c2-47405dd6af9c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:56.429350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4afda4ca-0535-4c3a-be03-b5ea07f2ae13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:56.434532 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1730/3454] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:56 2022] DELETE /identity/v3/projects/c44137fdc39247f893211da7cd2e00db => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:56.436351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af48b2-1f1e-42c7-b1bb-8cda616d27c2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:56.436479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af48b2-1f1e-42c7-b1bb-8cda616d27c2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:56.439103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af48b2-1f1e-42c7-b1bb-8cda616d27c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:56.549857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b3af48b2-1f1e-42c7-b1bb-8cda616d27c2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:56.551989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3af48b2-1f1e-42c7-b1bb-8cda616d27c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:56.564021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:56.604919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:56.605811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:56.605811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:56.607019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] PATH_INFO: `/v3/projects/492ae07762e74609848c683e321e505c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:56.611089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492ae07762e74609848c683e321e505c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:56.613760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:56.769251 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1731/3455] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:56.770907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d2829-184d-46bd-a625-3c7d8c736c5b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:56.771197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d2829-184d-46bd-a625-3c7d8c736c5b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:56.771474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d2829-184d-46bd-a625-3c7d8c736c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:56.811076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492ae07762e74609848c683e321e505c', 'request_id': 'req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:56.822500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-128d2829-184d-46bd-a625-3c7d8c736c5b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:56.824614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-128d2829-184d-46bd-a625-3c7d8c736c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:56.847770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492ae07762e74609848c683e321e505c', 'request_id': 'req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:56.982006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1732/3456] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:56.986542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d2829-184d-46bd-a625-3c7d8c736c5b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.002170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492ae07762e74609848c683e321e505c', 'request_id': 'req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:57.010501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d2829-184d-46bd-a625-3c7d8c736c5b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.026259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] The token cache is being invalidate because project 492ae07762e74609848c683e321e505c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:37:57.026615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:57.030637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-99e454e8-2fd5-4ce9-a7a9-bd0ef39b4497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:37:57.033831 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1725/3457] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:56 2022] DELETE /identity/v3/projects/492ae07762e74609848c683e321e505c => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:57.045570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:57.045570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.045570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.045570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.046248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7260-abf6-493a-b710-0347897d11ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.046248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7260-abf6-493a-b710-0347897d11ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.046248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7260-abf6-493a-b710-0347897d11ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.047362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:37:57.047362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:57.051557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:57.087789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1733/3458] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:37:57.092369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.094824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:57.097167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:57.098940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-04be7260-abf6-493a-b710-0347897d11ee None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:57.100202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04be7260-abf6-493a-b710-0347897d11ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:57.120046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348b41c-2e60-4779-83ce-ebd7b5e3ed6b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.129678 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1726/3459] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:57.131487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872de58-8fd3-4f42-9c7e-8f0e00291626 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.133082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872de58-8fd3-4f42-9c7e-8f0e00291626 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.133736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872de58-8fd3-4f42-9c7e-8f0e00291626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.137860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:57.138528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.145772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.145772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.145772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:57.146100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:57.198481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0872de58-8fd3-4f42-9c7e-8f0e00291626 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:57.199897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0872de58-8fd3-4f42-9c7e-8f0e00291626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:57.253907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1727/3460] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:57.255300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872de58-8fd3-4f42-9c7e-8f0e00291626 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.267951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872de58-8fd3-4f42-9c7e-8f0e00291626 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.286309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:57.286939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.287225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.290302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.290819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:37:57.291135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:57.295671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:57.309524 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1734/3461] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:57 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:57.318606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.353807 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1728/3462] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:37:57.354773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.387889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3b4ed-7981-42e7-91d8-e00ada0a3b77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.545260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d03f-e960-48c1-8558-3fcb0e64ad44 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.565860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:57.567941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.568225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.568503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.569211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:57.571136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:57.610755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:57.611464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.611669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.611933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.615233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:57.622640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:57.736971 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1735/3463] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:57 2022] POST /identity/v3/users => generated 288 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:37:57.740822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.758745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b70f3-de3a-4a8f-b239-11ae8029f9aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.777469 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1729/3464] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:57 2022] POST /identity/v3/projects => generated 397 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:57.784772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.786896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:57.787537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.787818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.788095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.788755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:57.790413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:57.834410 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1736/3465] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:37:57.835448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:57.864276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627a52-9d10-44d6-bfb9-1ca8431a1f5a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.871565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:57.904526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:57.940217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681ae99-c6e5-4a4d-814d-30dde3c4940a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:57.954025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:57.954702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:57.954990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:57.955266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:57.955905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:57.958110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.019945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.022416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.027872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.027872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.027872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.028807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.061648 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1737/3466] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:58.065427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:58.099540 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1730/3467] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:57 2022] POST /identity/v3/users => generated 299 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:58.099540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:58.102639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:58.110152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b21033-f4e7-4bbd-bd39-0d33abc85fe5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:58.124359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.125314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.128190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.128653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] PATH_INFO: `/v3/projects/89abff0de1b1459c9457a1dff8bfbe28/users/75a9cc3c85194a019f0c5bfaa6bc1ed7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.168798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89abff0de1b1459c9457a1dff8bfbe28, user_id=75a9cc3c85194a019f0c5bfaa6bc1ed7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.177592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.227845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4aa37-cb8b-4536-aba8-67a25f1fefb4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:58.240006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13417214-8f07-4dd7-b017-4064434a7c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.242200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417214-8f07-4dd7-b017-4064434a7c9c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.242522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417214-8f07-4dd7-b017-4064434a7c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.242804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13417214-8f07-4dd7-b017-4064434a7c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.247482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13417214-8f07-4dd7-b017-4064434a7c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:58.279009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417214-8f07-4dd7-b017-4064434a7c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.298234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13417214-8f07-4dd7-b017-4064434a7c9c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.298632 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1738/3468] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:58 2022] PUT /identity/v3/projects/89abff0de1b1459c9457a1dff8bfbe28/users/75a9cc3c85194a019f0c5bfaa6bc1ed7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:58.298632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:58.308356 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1731/3469] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:37:58.310898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f336-b371-4daa-90f9-f0e526451b61 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.311252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f336-b371-4daa-90f9-f0e526451b61 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.311587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f336-b371-4daa-90f9-f0e526451b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.374420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f067f336-b371-4daa-90f9-f0e526451b61 None None] MFA Rules not processed for user `75a9cc3c85194a019f0c5bfaa6bc1ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:58.377134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f067f336-b371-4daa-90f9-f0e526451b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:58.476535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ac4d-74f0-43f3-974f-d389fb194a7a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:58.489971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.490762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.491087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.491360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.492086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.498304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.526980 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1739/3470] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:58.533490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:58.560727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176e6c-318d-4a16-9bd0-496732207d9e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:58.569416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1732/3471] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:58.572236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f336-b371-4daa-90f9-f0e526451b61 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:58.579290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.581190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.581707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.581996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.584081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.588107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.607558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f336-b371-4daa-90f9-f0e526451b61 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:58.614134 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1740/3472] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:58.615183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:58.634977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10070e9-65a5-4318-9195-6e570130ec67 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:58.639679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.640382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.640667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.640939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.641547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890eab3-fe93-4b2d-a51c-46f7433a222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.642246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890eab3-fe93-4b2d-a51c-46f7433a222e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.642514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890eab3-fe93-4b2d-a51c-46f7433a222e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.642711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.642823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890eab3-fe93-4b2d-a51c-46f7433a222e admin admin] PATH_INFO: `/v3/projects/143e7978937c43f6a2cad3c84ad1df82/users/aa254131e6f84fedaca07789aeeae097/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.653522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.666157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890eab3-fe93-4b2d-a51c-46f7433a222e admin admin] RBAC: Authorizing `identity:create_grant(project_id=143e7978937c43f6a2cad3c84ad1df82, user_id=aa254131e6f84fedaca07789aeeae097, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.668895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890eab3-fe93-4b2d-a51c-46f7433a222e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.739025 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1741/3473] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:58 2022] PUT /identity/v3/projects/143e7978937c43f6a2cad3c84ad1df82/users/aa254131e6f84fedaca07789aeeae097/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:58.752020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.753783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.754006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.776096 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1733/3474] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:37:58 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:37:58.779811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:58.830897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] MFA Rules not processed for user `aa254131e6f84fedaca07789aeeae097`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:58.834070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:58.883715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:58.907796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:58.925178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aabd2d-ccc9-410f-9385-2c3f3bb2067e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:58.940587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:58.941430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:58.941774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:58.942201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:58.942958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:58.945190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:58.991569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1742/3475] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:37:59.005918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:59.013330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:59.064417 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1734/3476] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:37:58 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:37:59.067018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:59.094894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ddc23-c243-4db0-b927-09661033b874 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:59.118469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:59.119474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:59.119935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:59.120398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:59.121185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:59.123008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:59.165525 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1735/3477] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:37:59.175767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:59.197350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d26a-6f68-481f-8e3c-a256f03c9a92 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:59.214042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fecaa8-4ab1-49d6-8da3-f4d017696bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:59.215040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecaa8-4ab1-49d6-8da3-f4d017696bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:59.215434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecaa8-4ab1-49d6-8da3-f4d017696bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:59.215811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecaa8-4ab1-49d6-8da3-f4d017696bdb admin admin] PATH_INFO: `/v3/projects/e95dd6b901474ad6b63688d47f70bc31/users/cc7a9a99cbd7475b9342e446fba1e2c2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:59.253191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fecaa8-4ab1-49d6-8da3-f4d017696bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95dd6b901474ad6b63688d47f70bc31, user_id=cc7a9a99cbd7475b9342e446fba1e2c2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:59.254932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb8919-0720-4cf7-a1a0-e2369ecd77f7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:59.256604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fecaa8-4ab1-49d6-8da3-f4d017696bdb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:59.285742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:59.286678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:59.287139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:59.287586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:59.303386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:59.305633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:59.338211 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1743/3478] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:37:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:37:59.391763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:59.392072 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1736/3479] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:59 2022] PUT /identity/v3/projects/e95dd6b901474ad6b63688d47f70bc31/users/cc7a9a99cbd7475b9342e446fba1e2c2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:59.412591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8487d6-42d9-4567-a379-2926d04b636f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:59.445341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591beb0-4751-438c-bc7a-a8202111ddbe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:59.446005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591beb0-4751-438c-bc7a-a8202111ddbe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:59.446465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591beb0-4751-438c-bc7a-a8202111ddbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:59.493868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2591beb0-4751-438c-bc7a-a8202111ddbe None None] MFA Rules not processed for user `aa254131e6f84fedaca07789aeeae097`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:59.503745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2591beb0-4751-438c-bc7a-a8202111ddbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:37:59.594166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:59.594853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:59.595218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:59.595596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:59.596354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:59.598962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:59.625061 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1744/3480] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:37:59.628955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:37:59.658181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e79ca-989f-418d-b786-bd284c6a904c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:37:59.669927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:37:59.670789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:59.671221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:59.671740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] PATH_INFO: `/v3/projects/e95dd6b901474ad6b63688d47f70bc31/users/cc7a9a99cbd7475b9342e446fba1e2c2/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:59.681681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95dd6b901474ad6b63688d47f70bc31, user_id=cc7a9a99cbd7475b9342e446fba1e2c2, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:37:59.684599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:37:59.701795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1737/3481] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:37:59.710172 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1745/3482] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:37:59 2022] PUT /identity/v3/projects/e95dd6b901474ad6b63688d47f70bc31/users/cc7a9a99cbd7475b9342e446fba1e2c2/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:37:59.722243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480596bc-e7fa-45ab-b235-304a1d2d3046 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:37:59.722525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480596bc-e7fa-45ab-b235-304a1d2d3046 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:37:59.722798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480596bc-e7fa-45ab-b235-304a1d2d3046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:37:59.864453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-480596bc-e7fa-45ab-b235-304a1d2d3046 None None] MFA Rules not processed for user `cc7a9a99cbd7475b9342e446fba1e2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:37:59.865969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-480596bc-e7fa-45ab-b235-304a1d2d3046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:00.049780 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1738/3483] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:37:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:00.054954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:00.078415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e829a-b644-4e09-8d16-916d4229963e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:00.090020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:00.090488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:00.091279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:00.091570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:00.092358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:00.094880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:00.230455 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1746/3484] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:00 2022] POST /identity/v3/projects => generated 333 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:00.234988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480596bc-e7fa-45ab-b235-304a1d2d3046 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:00.245479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480596bc-e7fa-45ab-b235-304a1d2d3046 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:00.343447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:00.425671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:00.426865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:00.427392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:00.427929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:00.428997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:00.432040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:00.501155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:00.543745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:00.556229 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1739/3485] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:38:00 2022] POST /identity/v3/projects => generated 332 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:00.563139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:00.643369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de990-8c48-4107-b61c-13329bee9dd7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:00.722584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18329b7b-01c9-44a3-8c35-42cbc0d50473 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:00.738675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:00.739583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:00.740072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:00.740529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:00.741320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:00.743553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:00.798506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:00.799317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:00.799691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:00.802095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] PATH_INFO: `/v3/users/aa254131e6f84fedaca07789aeeae097` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:00.804319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa254131e6f84fedaca07789aeeae097)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:00.809523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:00.918866 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1740/3486] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:00 2022] POST /identity/v3/projects => generated 357 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:00.920116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:01.053765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b72341-53d3-45e1-b775-dc2777f29e4a tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:01.066344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:01.067067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:01.067419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:01.067767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:01.068557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:01.069982 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:01.069982 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:01.069982 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:01.071349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:01.096934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa254131e6f84fedaca07789aeeae097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.108808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1741/3487] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:38:00 2022] GET /identity/v3/projects => generated 7618 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:01.109047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa254131e6f84fedaca07789aeeae097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.110844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:01.111337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa254131e6f84fedaca07789aeeae097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.113240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:01.135366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa254131e6f84fedaca07789aeeae097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.138165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0f890-995f-4970-95c1-cb905726c2f8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:01.146148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:01.147232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:01.149436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:01.149963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:01.150931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:01.151445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:01.155736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:01.189907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1742/3488] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Oct 18 13:38:01 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:01.190924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:01.211899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c12ae25-e91b-448a-b0a4-09663267f238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa254131e6f84fedaca07789aeeae097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.214096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12995e1-aa9c-4e82-8a76-d6b26132fb47 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:01.224218 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1747/3489] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:00 2022] DELETE /identity/v3/users/aa254131e6f84fedaca07789aeeae097 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:01.225009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:01.227024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:01.227639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:01.228071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:01.228560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:01.228828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:01.229428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:01.230048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Adding query filter params (parent_id=1af18a01391d4fb4ab60447ad448a98c) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:01.232116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:01.236459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:01.262103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:01.287075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1743/3490] 10.222.0.27 () {58 vars in 1216 bytes} [Tue Oct 18 13:38:01 2022] GET /identity/v3/projects?parent_id=1af18a01391d4fb4ab60447ad448a98c => generated 497 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:01.287873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:01.289486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:01.290372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:01.328846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1db3-13c7-44f3-b1cc-5b553f455f8b tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:01.429039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:01.522796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1748/3491] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:01.526643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:01.527686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:01.528190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:01.528675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects/11bd36985a1a4dd39826ae9ffeed32e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:01.532992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11bd36985a1a4dd39826ae9ffeed32e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:01.535935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:01.571150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:01.572696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:01.701359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bd36985a1a4dd39826ae9ffeed32e5', 'request_id': 'req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.720502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bd36985a1a4dd39826ae9ffeed32e5', 'request_id': 'req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.743484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33335b2-71d0-4c83-bd02-2367f0e8d75e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:01.849075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bd36985a1a4dd39826ae9ffeed32e5', 'request_id': 'req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.870890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] The token cache is being invalidate because project 11bd36985a1a4dd39826ae9ffeed32e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:01.871581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.872550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:01.874249 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1744/3492] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:01 2022] DELETE /identity/v3/projects/11bd36985a1a4dd39826ae9ffeed32e5 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:01.878616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:01.881070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:01.884682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:01.885568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:01.885916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:01.886230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:01.888959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:01.982515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:01.985856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:02.024429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb0a8-3ea7-488f-b46f-50c1326b8dc7 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:02.025755 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1749/3493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:02.029741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:02.030951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:02.031317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:02.031660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects/1af18a01391d4fb4ab60447ad448a98c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:02.033106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1af18a01391d4fb4ab60447ad448a98c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:02.035327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:02.200043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:02.230472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af18a01391d4fb4ab60447ad448a98c', 'request_id': 'req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.246300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af18a01391d4fb4ab60447ad448a98c', 'request_id': 'req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.366987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af18a01391d4fb4ab60447ad448a98c', 'request_id': 'req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.384573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] The token cache is being invalidate because project 1af18a01391d4fb4ab60447ad448a98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:02.388629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.389847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.395528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1745/3494] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:01 2022] DELETE /identity/v3/projects/1af18a01391d4fb4ab60447ad448a98c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:02.398333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:02.418996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791639-a718-4236-8b6c-f7d778aa6095 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:02.573727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:02.592090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7a9a99cbd7475b9342e446fba1e2c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e95dd6b901474ad6b63688d47f70bc31', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:02.592958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:02.593434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:02.593821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] PATH_INFO: `/v3/projects/e0e1a6f35031472dad154da905ec2f4b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:02.595235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e0e1a6f35031472dad154da905ec2f4b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:02.597550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:02.775027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e1a6f35031472dad154da905ec2f4b', 'request_id': 'req-a5dc270c-40bb-465f-a674-4187db8f0fd8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.788710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e1a6f35031472dad154da905ec2f4b', 'request_id': 'req-a5dc270c-40bb-465f-a674-4187db8f0fd8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.890530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e1a6f35031472dad154da905ec2f4b', 'request_id': 'req-a5dc270c-40bb-465f-a674-4187db8f0fd8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.909634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] The token cache is being invalidate because project e0e1a6f35031472dad154da905ec2f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:02.910291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.913615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5dc270c-40bb-465f-a674-4187db8f0fd8 tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:02.922623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:02.924383 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1750/3495] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:02 2022] DELETE /identity/v3/projects/e0e1a6f35031472dad154da905ec2f4b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:02.926031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:03.144513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874ce63-9a6a-49c1-9c4a-62d7c8141e1e tempest-ListProjectsTestJSON-2119799681 tempest-ListProjectsTestJSON-2119799681-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:03.264502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:03.265769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:03.266210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:03.267903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] PATH_INFO: `/v3/users/75a9cc3c85194a019f0c5bfaa6bc1ed7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:03.270941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a9cc3c85194a019f0c5bfaa6bc1ed7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:03.271169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:03.542002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a9cc3c85194a019f0c5bfaa6bc1ed7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:03.542002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a9cc3c85194a019f0c5bfaa6bc1ed7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:03.623666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a9cc3c85194a019f0c5bfaa6bc1ed7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:03.624374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a9cc3c85194a019f0c5bfaa6bc1ed7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:03.636847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a9cc3c85194a019f0c5bfaa6bc1ed7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:03.673351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:03.732630 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1746/3496] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:02 2022] DELETE /identity/v3/users/75a9cc3c85194a019f0c5bfaa6bc1ed7 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:03.737202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:03.737599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:03.738127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:03.768608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:03.769849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:03.875891 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1751/3497] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:03.884995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:03.886738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:03.932314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:03.934011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:03.965332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f141-0e14-442c-9e9c-c390c0cc054d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:03.996727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:03.997591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:03.997979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:03.998383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] PATH_INFO: `/v3/projects/143e7978937c43f6a2cad3c84ad1df82` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:04.001881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=143e7978937c43f6a2cad3c84ad1df82)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:04.004399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:04.053925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9a9a6-4fcc-43af-a757-2defd86c2da1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:04.071833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a5a30-edb9-46c0-b172-81782a2d15e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:04.072667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a5a30-edb9-46c0-b172-81782a2d15e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:04.073360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a5a30-edb9-46c0-b172-81782a2d15e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:04.073970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a5a30-edb9-46c0-b172-81782a2d15e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:04.092758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a5a30-edb9-46c0-b172-81782a2d15e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:04.094669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a5a30-edb9-46c0-b172-81782a2d15e1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:04.128805 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1747/3498] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:04.199068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143e7978937c43f6a2cad3c84ad1df82', 'request_id': 'req-ac398cb2-cb8b-49bc-b4d4-891363294f1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:04.214332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143e7978937c43f6a2cad3c84ad1df82', 'request_id': 'req-ac398cb2-cb8b-49bc-b4d4-891363294f1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:04.306877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143e7978937c43f6a2cad3c84ad1df82', 'request_id': 'req-ac398cb2-cb8b-49bc-b4d4-891363294f1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:04.349553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] The token cache is being invalidate because project 143e7978937c43f6a2cad3c84ad1df82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:04.351881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:04.354274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ac398cb2-cb8b-49bc-b4d4-891363294f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:04.357148 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1752/3499] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:03 2022] DELETE /identity/v3/projects/143e7978937c43f6a2cad3c84ad1df82 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:04.363164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472452c-aa8d-4d5c-86a7-f3d7d2df2273 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:04.363563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472452c-aa8d-4d5c-86a7-f3d7d2df2273 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:04.363984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472452c-aa8d-4d5c-86a7-f3d7d2df2273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:04.423690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c472452c-aa8d-4d5c-86a7-f3d7d2df2273 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:04.426362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c472452c-aa8d-4d5c-86a7-f3d7d2df2273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:04.622646 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1748/3500] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:04.631535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1b8a2-488e-43ff-aa6a-e85c11ee0101 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:04.631817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1b8a2-488e-43ff-aa6a-e85c11ee0101 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:04.632097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1b8a2-488e-43ff-aa6a-e85c11ee0101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:04.648765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:04.676223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-05b1b8a2-488e-43ff-aa6a-e85c11ee0101 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:04.677471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-05b1b8a2-488e-43ff-aa6a-e85c11ee0101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:04.704067 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1753/3501] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:04.707112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472452c-aa8d-4d5c-86a7-f3d7d2df2273 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:04.730450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472452c-aa8d-4d5c-86a7-f3d7d2df2273 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:04.745061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:04.745996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:04.746375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:04.746713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:04.747449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:04.747818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:04.749585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:04.786435 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1749/3502] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:04.791078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1b8a2-488e-43ff-aa6a-e85c11ee0101 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:04.810123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1b8a2-488e-43ff-aa6a-e85c11ee0101 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:04.818652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:04.819584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:04.820054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:04.820517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:04.821375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:04.823579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:04.945462 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1754/3503] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:04 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:04.946580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:04.967082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca75a-595b-4ae9-a35b-d8e7fa9550a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:05.153724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:05.155520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:05.156429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:05.156718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:05.157383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:05.160936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:05.271938 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1750/3504] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:04 2022] POST /identity/v3/users => generated 291 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:05.273616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:05.286140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b0061-7ee0-485d-b8c5-51d6209aada3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:05.294916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:05.295556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:05.298510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:05.298806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:05.299524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:05.301150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:05.314884 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1755/3505] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:05.316457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:05.324482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:05.329698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4b04e-f87e-45b0-bcf3-7373cfb106da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:05.336245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee2c05-d54e-4688-8490-c5c57667eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:05.337433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee2c05-d54e-4688-8490-c5c57667eb44 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:05.337433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee2c05-d54e-4688-8490-c5c57667eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:05.337433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee2c05-d54e-4688-8490-c5c57667eb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:05.338101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee2c05-d54e-4688-8490-c5c57667eb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:05.339787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee2c05-d54e-4688-8490-c5c57667eb44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:05.358763 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1751/3506] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:05.360677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:05.395761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08edcc-b85a-4c23-a31b-d1caf893f542 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:05.408610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:05.409300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:05.409576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:05.409847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] PATH_INFO: `/v3/projects/2a9860ff5bca4afc9a272f5d3781f3e7/users/1704f764cb274f168e13a15f433affba/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:05.431360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9860ff5bca4afc9a272f5d3781f3e7, user_id=1704f764cb274f168e13a15f433affba, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:05.435510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:05.535066 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1756/3507] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:05 2022] PUT /identity/v3/projects/2a9860ff5bca4afc9a272f5d3781f3e7/users/1704f764cb274f168e13a15f433affba/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:05.537979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:05.538347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:05.538742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:05.571482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:05.573168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:05.587426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:05.591280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:05.729110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d529fb-c0b2-44b2-a498-afcbe04bd25f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:05.742455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:05.744528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:05.744528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:05.744528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] PATH_INFO: `/v3/projects/89abff0de1b1459c9457a1dff8bfbe28` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:05.746448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89abff0de1b1459c9457a1dff8bfbe28)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:05.751055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:05.768353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1752/3508] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:05.880579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:05.883681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:05.945695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89abff0de1b1459c9457a1dff8bfbe28', 'request_id': 'req-dd3c083f-1f37-4010-b82a-fd756c28e76e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:05.965687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89abff0de1b1459c9457a1dff8bfbe28', 'request_id': 'req-dd3c083f-1f37-4010-b82a-fd756c28e76e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.040304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9faa30-1508-480e-a117-7ffddaee1d41 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:06.049802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89abff0de1b1459c9457a1dff8bfbe28', 'request_id': 'req-dd3c083f-1f37-4010-b82a-fd756c28e76e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.070223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] The token cache is being invalidate because project 89abff0de1b1459c9457a1dff8bfbe28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:06.071843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.074436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.077127 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1757/3509] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:05 2022] DELETE /identity/v3/projects/89abff0de1b1459c9457a1dff8bfbe28 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:06.080918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:06.083127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:06.125844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752681f-6f2f-4d6f-8b54-4f8a0cf0ed9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:06.126680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752681f-6f2f-4d6f-8b54-4f8a0cf0ed9b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:06.126781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752681f-6f2f-4d6f-8b54-4f8a0cf0ed9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:06.127704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752681f-6f2f-4d6f-8b54-4f8a0cf0ed9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:06.128925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2752681f-6f2f-4d6f-8b54-4f8a0cf0ed9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:06.206791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:06.250023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c083f-1f37-4010-b82a-fd756c28e76e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:06.264066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:06.267438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752681f-6f2f-4d6f-8b54-4f8a0cf0ed9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:06.269894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752681f-6f2f-4d6f-8b54-4f8a0cf0ed9b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:06.273967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:06.274321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:06.274597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] PATH_INFO: `/v3/users/cc7a9a99cbd7475b9342e446fba1e2c2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:06.276201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7a9a99cbd7475b9342e446fba1e2c2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:06.278742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:06.283790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:06.291091 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1753/3510] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:06.552012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7a9a99cbd7475b9342e446fba1e2c2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.571894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7a9a99cbd7475b9342e446fba1e2c2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.577355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7a9a99cbd7475b9342e446fba1e2c2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.603148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7a9a99cbd7475b9342e446fba1e2c2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.715454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92987e43-81eb-4601-ac92-3be55984ce0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7a9a99cbd7475b9342e446fba1e2c2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:06.726413 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1758/3511] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:06 2022] DELETE /identity/v3/users/cc7a9a99cbd7475b9342e446fba1e2c2 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:07.166139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:07.166932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:07.167416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:07.210151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] MFA Rules not processed for user `1fbc5130642349b4a985d88f4515040f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:07.211663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:07.313941 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1754/3512] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:07 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:07.325706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:07.326203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:07.327282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:07.379330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] MFA Rules not processed for user `1fbc5130642349b4a985d88f4515040f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:07.384114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:07.403263 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1759/3513] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:07 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:07.417106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:07.418935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:07.598551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9db2-c2a3-4338-96df-c6ea466f231e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:07.616565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963b488-b349-402d-b1a0-a537726829f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:07.616565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b488-b349-402d-b1a0-a537726829f5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:07.616565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b488-b349-402d-b1a0-a537726829f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:07.616565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963b488-b349-402d-b1a0-a537726829f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:07.624005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963b488-b349-402d-b1a0-a537726829f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:07.626601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963b488-b349-402d-b1a0-a537726829f5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:07.640167 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1755/3514] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:07 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:08.153566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:08.159077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:08.282964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91787602-f28c-46e6-a0b2-d2179eb250b7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:08.289560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:08.290314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:08.290832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:08.291276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] PATH_INFO: `/v3/projects/e95dd6b901474ad6b63688d47f70bc31` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:08.292940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95dd6b901474ad6b63688d47f70bc31)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:08.295695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:08.435439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:08.448425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95dd6b901474ad6b63688d47f70bc31', 'request_id': 'req-39fc10a1-893d-4cf5-a96a-c60d4124ee61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:08.456084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95dd6b901474ad6b63688d47f70bc31', 'request_id': 'req-39fc10a1-893d-4cf5-a96a-c60d4124ee61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:08.555082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95dd6b901474ad6b63688d47f70bc31', 'request_id': 'req-39fc10a1-893d-4cf5-a96a-c60d4124ee61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:08.583306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] The token cache is being invalidate because project e95dd6b901474ad6b63688d47f70bc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:08.583787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:08.588315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-39fc10a1-893d-4cf5-a96a-c60d4124ee61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:08.588903 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1760/3515] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:08 2022] DELETE /identity/v3/projects/e95dd6b901474ad6b63688d47f70bc31 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:08.593020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721061-330c-45e1-ada3-f4f38b817cc0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:08.594557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721061-330c-45e1-ada3-f4f38b817cc0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:08.595101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39721061-330c-45e1-ada3-f4f38b817cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:08.631714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-39721061-330c-45e1-ada3-f4f38b817cc0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:08.633182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39721061-330c-45e1-ada3-f4f38b817cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:08.775780 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1756/3516] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:08.783328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2dc0-64ba-4fd4-8162-7afc6223185b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:08.783616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2dc0-64ba-4fd4-8162-7afc6223185b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:08.784277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2dc0-64ba-4fd4-8162-7afc6223185b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:08.828529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-127b2dc0-64ba-4fd4-8162-7afc6223185b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:08.829761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-127b2dc0-64ba-4fd4-8162-7afc6223185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:08.878189 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1761/3517] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:08.883538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721061-330c-45e1-ada3-f4f38b817cc0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:08.919035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39721061-330c-45e1-ada3-f4f38b817cc0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:08.926963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:08.927599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:08.929510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:08.929879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:08.930715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:08.931035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:08.933196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:08.954891 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1757/3518] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:08.956878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b2dc0-64ba-4fd4-8162-7afc6223185b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:08.969181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b2dc0-64ba-4fd4-8162-7afc6223185b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:08.976339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:08.977172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:08.977662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:08.978188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:08.979019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:08.981559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:09.062517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:09.065315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:09.079074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:09.089671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16453a-4cf6-4fa7-a204-fe1eaea466d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:09.096054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:09.096826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:09.097778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:09.098195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] PATH_INFO: `/v3/users/1d5d823540f041a283fe2c9b283514d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:09.099473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5d823540f041a283fe2c9b283514d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:09.101642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:09.135229 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1762/3519] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:08 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:09.137409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:09.228014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12681-6395-49d6-8b11-c4978102277c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:09.232986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:09.237295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:09.238113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:09.238317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:09.239185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:09.241409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:09.351653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5d823540f041a283fe2c9b283514d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:09.353283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5d823540f041a283fe2c9b283514d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:09.355913 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1763/3520] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:09 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:09.357208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:09.362066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:09.413169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eecc31-09d1-4f39-98e1-61abbcb6e5b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:09.430037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:09.432586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:09.432947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:09.434580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:09.436219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:09.441115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:09.458076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5d823540f041a283fe2c9b283514d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:09.458076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5d823540f041a283fe2c9b283514d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:09.468718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1764/3521] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:09.469970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:09.478893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5d823540f041a283fe2c9b283514d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:09.486360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd05d49-534f-441e-a421-f664409caf0f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:09.491031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05141b25-9084-4733-a28e-e69366eabb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:09.491714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05141b25-9084-4733-a28e-e69366eabb69 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:09.491989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05141b25-9084-4733-a28e-e69366eabb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:09.492263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05141b25-9084-4733-a28e-e69366eabb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:09.493010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05141b25-9084-4733-a28e-e69366eabb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:09.495941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05141b25-9084-4733-a28e-e69366eabb69 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:09.504106 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1758/3522] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:09 2022] DELETE /identity/v3/users/1d5d823540f041a283fe2c9b283514d1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:09.512639 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1765/3523] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:09.521513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:09.621142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2ba8-b5db-4e93-9c08-554856021a6a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:09.650077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:09.650871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:09.651060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:09.651373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] PATH_INFO: `/v3/projects/0509710439ef4844b5672db09015ba81/users/d3e14df2975944209c3f304c50eb9a60/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:09.688301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0509710439ef4844b5672db09015ba81, user_id=d3e14df2975944209c3f304c50eb9a60, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:09.692596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:09.844865 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1759/3524] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:09 2022] PUT /identity/v3/projects/0509710439ef4844b5672db09015ba81/users/d3e14df2975944209c3f304c50eb9a60/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:09.845279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450501-8cb6-4b50-b6af-4139fded8b33 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:09.845563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450501-8cb6-4b50-b6af-4139fded8b33 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:09.845838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05450501-8cb6-4b50-b6af-4139fded8b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:09.876066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-05450501-8cb6-4b50-b6af-4139fded8b33 None None] MFA Rules not processed for user `d3e14df2975944209c3f304c50eb9a60`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:09.877297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-05450501-8cb6-4b50-b6af-4139fded8b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:09.938791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:09.942351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:10.025100 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1766/3525] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:10.029811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450501-8cb6-4b50-b6af-4139fded8b33 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.051668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:10.060803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:10.067464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc28c27-bfa8-4c82-867a-da7a008ea01e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:10.073952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:10.075284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.075284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.075813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] PATH_INFO: `/v3/projects/ec92fae78dea4886be2b6988e6eb1edb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.077098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec92fae78dea4886be2b6988e6eb1edb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:10.079325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:10.134905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05450501-8cb6-4b50-b6af-4139fded8b33 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:10.146093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:10.148666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.149219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.149722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.151314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:10.154000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:10.245211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec92fae78dea4886be2b6988e6eb1edb', 'request_id': 'req-a2ba7d55-3ee8-4a16-867b-1465a96ad777'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:10.258557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec92fae78dea4886be2b6988e6eb1edb', 'request_id': 'req-a2ba7d55-3ee8-4a16-867b-1465a96ad777'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:10.277022 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1767/3526] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:10 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:10.279001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.344346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec92fae78dea4886be2b6988e6eb1edb', 'request_id': 'req-a2ba7d55-3ee8-4a16-867b-1465a96ad777'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:10.363199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] The token cache is being invalidate because project ec92fae78dea4886be2b6988e6eb1edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:10.366744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:10.369772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2ba7d55-3ee8-4a16-867b-1465a96ad777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:10.373567 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1760/3527] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:09 2022] DELETE /identity/v3/projects/ec92fae78dea4886be2b6988e6eb1edb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:10.379246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2e755-d80b-4327-b224-2861397037c1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.381259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2e755-d80b-4327-b224-2861397037c1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.381259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2e755-d80b-4327-b224-2861397037c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.403813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39dcf9-d01a-4d00-a70d-34f88787912a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:10.413833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00b2e755-d80b-4327-b224-2861397037c1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:10.414085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:10.414909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.415341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.415777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.415897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00b2e755-d80b-4327-b224-2861397037c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:10.416933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:10.425439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:10.428075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1761/3528] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:10.436859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6451-c0e9-41d6-a5ff-cf95ec06467e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.448427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6451-c0e9-41d6-a5ff-cf95ec06467e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.448427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6451-c0e9-41d6-a5ff-cf95ec06467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.500293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-305c6451-c0e9-41d6-a5ff-cf95ec06467e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:10.503124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-305c6451-c0e9-41d6-a5ff-cf95ec06467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:10.519592 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1762/3529] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:10.523412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6451-c0e9-41d6-a5ff-cf95ec06467e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.536080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6451-c0e9-41d6-a5ff-cf95ec06467e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:10.542283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:10.543434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.543434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.543754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.545345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:10.545762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:10.548298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:10.562581 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1763/3530] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:10.566959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.597086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1768/3531] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:10 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:10.600950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.604068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:10.607845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3230-890f-4d7e-8522-b94db8dbf1d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:10.627703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:10.629169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.629805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.630326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.631133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b73e3-7469-46fe-9a65-cb9a70d2ee3f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:10.631446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:10.633849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:10.637957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:10.638733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.639017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.639369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.640686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:10.648413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:10.666225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1769/3532] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:10.667693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.680443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8d3f4-9680-4fbd-80be-ace5524f62e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:10.691733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:10.692567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:10.692852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:10.693151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] PATH_INFO: `/v3/projects/d179fda74f7148adab2ae3fceded47d6/users/ceb25feb6d3e4ee6815caa44ff8d22df/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:10.735701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d179fda74f7148adab2ae3fceded47d6, user_id=ceb25feb6d3e4ee6815caa44ff8d22df, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:10.739913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:10.809956 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1764/3533] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:10 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:10.813854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.834887 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1770/3534] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:10 2022] PUT /identity/v3/projects/d179fda74f7148adab2ae3fceded47d6/users/ceb25feb6d3e4ee6815caa44ff8d22df/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:10.836300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:10.965870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a10d8-0dbf-4da1-afbb-a86d38827978 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:11.064407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c726b-5998-4148-b2b8-2dd49c42316a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:11.078937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:11.082616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.082616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.082814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.084754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:11.084997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:11.085731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.086193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.086620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.086876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:11.087592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:11.089658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:11.111287 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1771/3535] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:11.112573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:11.128416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c12449-75b7-48fa-aff1-53890cc6ee51 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:11.148993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896543c-8e74-435d-9ace-bd555c880bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:11.158364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896543c-8e74-435d-9ace-bd555c880bba admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.158655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896543c-8e74-435d-9ace-bd555c880bba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.158948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896543c-8e74-435d-9ace-bd555c880bba admin admin] PATH_INFO: `/v3/projects/d179fda74f7148adab2ae3fceded47d6/users/ceb25feb6d3e4ee6815caa44ff8d22df/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.164847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896543c-8e74-435d-9ace-bd555c880bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d179fda74f7148adab2ae3fceded47d6, user_id=ceb25feb6d3e4ee6815caa44ff8d22df, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:11.171661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896543c-8e74-435d-9ace-bd555c880bba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:11.215113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1765/3536] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:10 2022] POST /identity/v3/users => generated 291 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:11.216330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:11.230184 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1772/3537] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:11 2022] PUT /identity/v3/projects/d179fda74f7148adab2ae3fceded47d6/users/ceb25feb6d3e4ee6815caa44ff8d22df/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:11.233884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b317-82d8-42da-adf3-ff1c2385821b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.235212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b317-82d8-42da-adf3-ff1c2385821b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.237246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b317-82d8-42da-adf3-ff1c2385821b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.238560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099474d-cc63-485d-911f-513bea0748f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:11.293398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2239b317-82d8-42da-adf3-ff1c2385821b None None] MFA Rules not processed for user `ceb25feb6d3e4ee6815caa44ff8d22df`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:11.294682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2239b317-82d8-42da-adf3-ff1c2385821b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:11.440247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:11.440914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.441188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.441458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.442146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:11.443769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:11.490756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1766/3538] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:11.494880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:11.515813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0e918-258f-4694-b0a8-b5ae8aae617e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:11.524678 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1773/3539] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:11.533672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b317-82d8-42da-adf3-ff1c2385821b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:11.538895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:11.539546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.539834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.540113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.540789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:11.542560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:11.564846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1767/3540] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:11.568878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:11.575541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b317-82d8-42da-adf3-ff1c2385821b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:11.584877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff8b1f-c448-497a-85b8-9a6b64eb3615 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:11.590213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:11.591653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.591948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.592233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.592911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:11.595394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:11.595970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54f9c4-fd89-40af-88d2-124a7f25e221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:11.596623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f9c4-fd89-40af-88d2-124a7f25e221 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.596905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f9c4-fd89-40af-88d2-124a7f25e221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.597185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f9c4-fd89-40af-88d2-124a7f25e221 admin admin] PATH_INFO: `/v3/projects/17da40534ba847b18b2f0cde9b822b24/users/658e3ac336ac4342bd204a74515fcd96/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.648516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54f9c4-fd89-40af-88d2-124a7f25e221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17da40534ba847b18b2f0cde9b822b24, user_id=658e3ac336ac4342bd204a74515fcd96, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:11.653333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54f9c4-fd89-40af-88d2-124a7f25e221 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:11.764632 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1774/3541] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:38:11 2022] POST /identity/v3/domains => generated 276 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:11.766721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:11.805781 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1768/3542] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:11 2022] PUT /identity/v3/projects/17da40534ba847b18b2f0cde9b822b24/users/658e3ac336ac4342bd204a74515fcd96/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:11.807360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:11.807646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:11.807921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:11.898031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:11.899845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:11.936461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c4e12-abb9-4c72-b970-27ce49c99b3f tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.097649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.098786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.099075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.099358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.100622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.103510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.141103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:12.163077 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1769/3543] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:12.205623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.207046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:12.279730 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1775/3544] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:11 2022] POST /identity/v3/users => generated 347 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:12.281261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.313931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115839be-888f-4b94-a722-df09e6f973e7 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.328521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.329284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.329572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.329850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.330594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.333261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.345457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234bf44-71fa-4d7c-86af-bf4560d4ed43 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.349673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.351693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.352155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.352650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.372013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:12.385206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.393474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.402037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1770/3545] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:12.451074 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1776/3546] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:12 2022] POST /identity/v3/users => generated 322 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:12.456518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.479198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728e919-1040-41cb-b058-ac3a0d2a436c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.486902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.487561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.487844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.488120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users/2614f88940364eb7869ff4a16ac9ac2d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.508342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:get_user(user_id=2614f88940364eb7869ff4a16ac9ac2d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.511203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.524151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1771/3547] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:38:12 2022] GET /identity/v3/users/2614f88940364eb7869ff4a16ac9ac2d => generated 347 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:12.529529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.545310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b067687-5233-4e76-9f68-9eee299c4641 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.560171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.560805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.561092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.561374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.562654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Adding query filter params (domain_id=659387453cfc48198ce25cfaacc563ff) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:12.571513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.571513 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:12.571513 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:12.571513 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:12.571513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.608449 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1777/3548] 10.222.0.27 () {58 vars in 1207 bytes} [Tue Oct 18 13:38:12 2022] GET /identity/v3/users?domain_id=659387453cfc48198ce25cfaacc563ff => generated 484 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:12.609431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.626305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c8243-0803-4a98-9db1-363849b1294d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.637691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.638456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.638908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.640764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.641086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.642385 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:12.642385 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:12.642385 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:12.643900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.707236 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1772/3549] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:12 2022] GET /identity/v3/users => generated 8882 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:12.712216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.732924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cae7f-92e9-4bb2-a8b8-0b2b93a071d8 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.749895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.753935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.753935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.753935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.753935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1882267209) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:12.753935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.761140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.808806 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1778/3550] 10.222.0.27 () {58 vars in 1189 bytes} [Tue Oct 18 13:38:12 2022] GET /identity/v3/users?name=tempest-test_user-1882267209 => generated 475 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:12.813709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.832544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f2e9-651d-4147-a2f8-e4afdbc75348 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.843585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.844471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.844471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.844763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.845492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:12.845851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:12.848135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:12.903388 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1773/3551] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 18 13:38:12 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:12.905121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:12.929808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31ee1-255d-4bf0-a479-c18c1395f976 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:12.945543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:12.946287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:12.947139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:12.947434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users/af5dadda82e949bc83cd747c312d3793` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:12.999139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:delete_user(user_id=af5dadda82e949bc83cd747c312d3793)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:13.007681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:13.160102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5dadda82e949bc83cd747c312d3793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.207466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5dadda82e949bc83cd747c312d3793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.208372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5dadda82e949bc83cd747c312d3793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.230956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5dadda82e949bc83cd747c312d3793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.321225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5dadda82e949bc83cd747c312d3793'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.331629 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1779/3552] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:12 2022] DELETE /identity/v3/users/af5dadda82e949bc83cd747c312d3793 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:13.334677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:13.340771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:13.373979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8fea4-ee3d-4d5d-b2bc-bf8554e6ee6d tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:13.537393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:13.538194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:13.539032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:13.539032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/users/2614f88940364eb7869ff4a16ac9ac2d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:13.539989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2614f88940364eb7869ff4a16ac9ac2d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:13.547361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:13.575393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:13.697279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2614f88940364eb7869ff4a16ac9ac2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.697973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2614f88940364eb7869ff4a16ac9ac2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.764549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2614f88940364eb7869ff4a16ac9ac2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.766306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2614f88940364eb7869ff4a16ac9ac2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.781452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2614f88940364eb7869ff4a16ac9ac2d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:13.856525 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1774/3553] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:13 2022] DELETE /identity/v3/users/2614f88940364eb7869ff4a16ac9ac2d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:13.860882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:13.877204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36327c9-0ec3-4f8d-84a0-25a63a405a8a tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:13.967328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:13.968751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:13.969091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:13.969376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/domains/659387453cfc48198ce25cfaacc563ff` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:13.971522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=659387453cfc48198ce25cfaacc563ff)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:13.980142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:14.013610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '659387453cfc48198ce25cfaacc563ff'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.016960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '659387453cfc48198ce25cfaacc563ff'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.049374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:14.174532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '659387453cfc48198ce25cfaacc563ff'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.176292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '659387453cfc48198ce25cfaacc563ff'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.183790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:14.185626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:14.190270 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1780/3554] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:38:13 2022] PATCH /identity/v3/domains/659387453cfc48198ce25cfaacc563ff => generated 277 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:14.199500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53517316-0b2d-471c-8663-e2ac5acd2842 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:14.322003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceb25feb6d3e4ee6815caa44ff8d22df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd179fda74f7148adab2ae3fceded47d6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:14.322710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:14.323100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:14.323381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] PATH_INFO: `/v3/domains/659387453cfc48198ce25cfaacc563ff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:14.341479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=659387453cfc48198ce25cfaacc563ff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:14.343849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:14.383134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '659387453cfc48198ce25cfaacc563ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.400952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '659387453cfc48198ce25cfaacc563ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.514711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659387453cfc48198ce25cfaacc563ff', 'request_id': 'req-d02b384b-0885-462e-aa07-560abafeb9b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.525229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659387453cfc48198ce25cfaacc563ff', 'request_id': 'req-d02b384b-0885-462e-aa07-560abafeb9b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.574182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:14.587559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659387453cfc48198ce25cfaacc563ff', 'request_id': 'req-d02b384b-0885-462e-aa07-560abafeb9b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.611395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] The token cache is being invalidate because project 659387453cfc48198ce25cfaacc563ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:14.612043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.614497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.625499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '659387453cfc48198ce25cfaacc563ff', 'request_id': 'req-d02b384b-0885-462e-aa07-560abafeb9b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.628779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '659387453cfc48198ce25cfaacc563ff', 'request_id': 'req-d02b384b-0885-462e-aa07-560abafeb9b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.630762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d02b384b-0885-462e-aa07-560abafeb9b9 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '659387453cfc48198ce25cfaacc563ff', 'request_id': 'req-d02b384b-0885-462e-aa07-560abafeb9b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:14.641612 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1775/3555] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:14 2022] DELETE /identity/v3/domains/659387453cfc48198ce25cfaacc563ff => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:14.645978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:14.651636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:14.746474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06317a-b043-4c61-9579-20ed0ec87068 tempest-UsersV3TestJSON-914812020 tempest-UsersV3TestJSON-914812020-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:14.854222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:14.857055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:14.858122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:14.859432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] PATH_INFO: `/v3/users/d3e14df2975944209c3f304c50eb9a60` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:14.864334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e14df2975944209c3f304c50eb9a60)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:14.868816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:15.159337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e14df2975944209c3f304c50eb9a60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:15.165506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:15.171913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e14df2975944209c3f304c50eb9a60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:15.175453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e14df2975944209c3f304c50eb9a60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:15.191421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e14df2975944209c3f304c50eb9a60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:15.300783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e14df2975944209c3f304c50eb9a60'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:15.315085 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1781/3556] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:14 2022] DELETE /identity/v3/users/d3e14df2975944209c3f304c50eb9a60 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:15.316566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:15.316855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:15.317133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:15.350741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:15.354857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:15.542188 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1776/3557] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:15.576945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:15.581641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:15.727283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49832e-ea5c-479f-9a25-c0d38f16f5e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:15.742327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:15.743382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:15.743929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:15.744705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:15.766773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:15.770435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:15.806434 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1782/3558] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:16.330785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:17.096202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:17.304645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:17.306736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:17.317406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:17.322025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:17.326165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76278-9f79-42f4-91c3-d22a0ea1503b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:17.338431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:17.339488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:17.340006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:17.340505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] PATH_INFO: `/v3/projects/0509710439ef4844b5672db09015ba81` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:17.341983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0509710439ef4844b5672db09015ba81)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:17.346151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:17.373186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42300d-44f1-4f09-8c6d-ee6d112df55f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:17.392350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:17.393480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:17.393975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:17.394510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] PATH_INFO: `/v3/users/45ab9411460b4292b1ea5719d352ccca` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:17.397161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ab9411460b4292b1ea5719d352ccca)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:17.403009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:17.535375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0509710439ef4844b5672db09015ba81', 'request_id': 'req-ad420c73-de34-495a-b13b-1a92af627fbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.542841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0509710439ef4844b5672db09015ba81', 'request_id': 'req-ad420c73-de34-495a-b13b-1a92af627fbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.646430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0509710439ef4844b5672db09015ba81', 'request_id': 'req-ad420c73-de34-495a-b13b-1a92af627fbb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.675749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] The token cache is being invalidate because project 0509710439ef4844b5672db09015ba81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:17.676380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.678040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.686225 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1777/3559] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:17 2022] DELETE /identity/v3/projects/0509710439ef4844b5672db09015ba81 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:17.687552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ab9411460b4292b1ea5719d352ccca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.688715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:17.693920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:17.716190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ab9411460b4292b1ea5719d352ccca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.716190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ab9411460b4292b1ea5719d352ccca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.760967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ab9411460b4292b1ea5719d352ccca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:17.890600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad420c73-de34-495a-b13b-1a92af627fbb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:17.896867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:17.897554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:17.897829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:17.898140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] PATH_INFO: `/v3/users/ceb25feb6d3e4ee6815caa44ff8d22df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:17.903407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb25feb6d3e4ee6815caa44ff8d22df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:17.905442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:17.997471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ab9411460b4292b1ea5719d352ccca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:18.005156 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1783/3560] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:17 2022] DELETE /identity/v3/users/45ab9411460b4292b1ea5719d352ccca => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:18.196586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb25feb6d3e4ee6815caa44ff8d22df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:18.198021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb25feb6d3e4ee6815caa44ff8d22df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:18.301372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb25feb6d3e4ee6815caa44ff8d22df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:18.309649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb25feb6d3e4ee6815caa44ff8d22df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:18.316073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1829b809-0159-4a73-9586-cf38dcbe1947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb25feb6d3e4ee6815caa44ff8d22df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:18.337514 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1778/3561] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:17 2022] DELETE /identity/v3/users/ceb25feb6d3e4ee6815caa44ff8d22df => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:18.913688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:18.915298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:19.031475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:19.052116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa9ae5-0b18-4ae8-8104-a641a565c47a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:19.199378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:19.200650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:19.202007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:19.202007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] PATH_INFO: `/v3/projects/d78fb68eedc84dfcb7c5cc2aeaa24f92` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:19.206426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78fb68eedc84dfcb7c5cc2aeaa24f92)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:19.210964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:19.443862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'request_id': 'req-d09a5689-7516-46d6-a177-58bd62cb9ae3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:19.459916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'request_id': 'req-d09a5689-7516-46d6-a177-58bd62cb9ae3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:19.555486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78fb68eedc84dfcb7c5cc2aeaa24f92', 'request_id': 'req-d09a5689-7516-46d6-a177-58bd62cb9ae3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:19.570253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] The token cache is being invalidate because project d78fb68eedc84dfcb7c5cc2aeaa24f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:19.570872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:19.571727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d09a5689-7516-46d6-a177-58bd62cb9ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:19.584352 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1784/3562] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:18 2022] DELETE /identity/v3/projects/d78fb68eedc84dfcb7c5cc2aeaa24f92 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:19.589151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba836e-2d0d-4c81-bfd7-26d9d86b910e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:19.589151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba836e-2d0d-4c81-bfd7-26d9d86b910e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:19.589151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba836e-2d0d-4c81-bfd7-26d9d86b910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:19.608964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71ba836e-2d0d-4c81-bfd7-26d9d86b910e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:19.610638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71ba836e-2d0d-4c81-bfd7-26d9d86b910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:19.680496 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1779/3563] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:19.688714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758abc56-378a-4e11-b6fc-0c4029a1f476 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:19.689005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758abc56-378a-4e11-b6fc-0c4029a1f476 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:19.689283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758abc56-378a-4e11-b6fc-0c4029a1f476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:19.703839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:19.713483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-758abc56-378a-4e11-b6fc-0c4029a1f476 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:19.714843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-758abc56-378a-4e11-b6fc-0c4029a1f476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:19.723896 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1785/3564] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:19.728397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba836e-2d0d-4c81-bfd7-26d9d86b910e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:19.739331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba836e-2d0d-4c81-bfd7-26d9d86b910e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:19.744846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:19.745486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:19.745757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:19.746291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:19.747136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:19.747692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:19.750137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:19.773901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758abc56-378a-4e11-b6fc-0c4029a1f476 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:19.778254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1780/3565] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:19.783680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758abc56-378a-4e11-b6fc-0c4029a1f476 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:19.791146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:19.791995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:19.792492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:19.792923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:19.794522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:19.797781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:19.935914 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1786/3566] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:19 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:19.937786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:19.957685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640571b-bc0d-4a91-90a9-6f3696e3cdad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:20.092652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:20.094315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.094810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.095428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.096482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:20.098829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:20.277376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:20.281622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:20.335206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619e668-1772-4377-b5bc-ac2b0224457b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:20.352842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:20.355288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.357005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.358214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] PATH_INFO: `/v3/projects/d179fda74f7148adab2ae3fceded47d6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.361345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d179fda74f7148adab2ae3fceded47d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:20.370711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:20.459621 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1781/3567] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:19 2022] POST /identity/v3/users => generated 287 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:20.466799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:20.484469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4983-95ad-410e-9468-cc2c4bbba196 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:20.490332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:20.491336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.491784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.492915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.493864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:20.496611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:20.516818 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1782/3568] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:38:20.520707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:20.533051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14168f-b062-4db3-bbf0-0db9140547da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:20.537777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:20.538420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.538728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.540060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.540878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:20.542713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:20.554744 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1783/3569] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:20.558518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:20.569825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd179fda74f7148adab2ae3fceded47d6', 'request_id': 'req-0ab715e9-ffc2-4a50-a183-563ae0628b53'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:20.570678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572812da-694a-43cf-a2b4-56fe12e7cf03 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:20.577430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd179fda74f7148adab2ae3fceded47d6', 'request_id': 'req-0ab715e9-ffc2-4a50-a183-563ae0628b53'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:20.650865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd179fda74f7148adab2ae3fceded47d6', 'request_id': 'req-0ab715e9-ffc2-4a50-a183-563ae0628b53'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:20.680312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed0bfb-2235-4032-ae4c-6f9fb1a0aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:20.681760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed0bfb-2235-4032-ae4c-6f9fb1a0aa44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.682382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed0bfb-2235-4032-ae4c-6f9fb1a0aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.682610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] The token cache is being invalidate because project d179fda74f7148adab2ae3fceded47d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:20.682901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:20.683590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0ab715e9-ffc2-4a50-a183-563ae0628b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:20.683823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed0bfb-2235-4032-ae4c-6f9fb1a0aa44 admin admin] PATH_INFO: `/v3/projects/34c7d8a7682f4d75b980c0d60de4d6fe/users/548f86671c744430829ba6cc2d6463b6/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.685721 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1787/3570] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:20 2022] DELETE /identity/v3/projects/d179fda74f7148adab2ae3fceded47d6 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:20.690617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755570-ec58-4150-8bb2-ccd6c5f994c0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.692204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755570-ec58-4150-8bb2-ccd6c5f994c0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.692204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755570-ec58-4150-8bb2-ccd6c5f994c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.719151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed0bfb-2235-4032-ae4c-6f9fb1a0aa44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c7d8a7682f4d75b980c0d60de4d6fe, user_id=548f86671c744430829ba6cc2d6463b6, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:20.725323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed0bfb-2235-4032-ae4c-6f9fb1a0aa44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:20.740266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bf755570-ec58-4150-8bb2-ccd6c5f994c0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:20.741645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf755570-ec58-4150-8bb2-ccd6c5f994c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:20.753005 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1788/3571] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:20.763866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8c06-bb88-4ccf-beef-cb8e2125e5f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.772074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8c06-bb88-4ccf-beef-cb8e2125e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.772512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8c06-bb88-4ccf-beef-cb8e2125e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.815589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4cae8c06-bb88-4ccf-beef-cb8e2125e5f7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:20.820723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cae8c06-bb88-4ccf-beef-cb8e2125e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:20.831062 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1789/3572] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:20.841662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1784/3573] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:20 2022] PUT /identity/v3/projects/34c7d8a7682f4d75b980c0d60de4d6fe/users/548f86671c744430829ba6cc2d6463b6/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:20.848050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8c06-bb88-4ccf-beef-cb8e2125e5f7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:20.859819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4911f-bf3b-4b4a-a28b-115577253d7e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:20.860470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4911f-bf3b-4b4a-a28b-115577253d7e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:20.862394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4911f-bf3b-4b4a-a28b-115577253d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:20.881239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8c06-bb88-4ccf-beef-cb8e2125e5f7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:20.903593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eee4911f-bf3b-4b4a-a28b-115577253d7e None None] MFA Rules not processed for user `548f86671c744430829ba6cc2d6463b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:20.905968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eee4911f-bf3b-4b4a-a28b-115577253d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:21.003203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae32316-e0f7-4ef3-b043-df50a48bd3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:21.004547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae32316-e0f7-4ef3-b043-df50a48bd3fa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.005013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae32316-e0f7-4ef3-b043-df50a48bd3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.005456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae32316-e0f7-4ef3-b043-df50a48bd3fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.006406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae32316-e0f7-4ef3-b043-df50a48bd3fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:21.006968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae32316-e0f7-4ef3-b043-df50a48bd3fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:21.009182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae32316-e0f7-4ef3-b043-df50a48bd3fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:21.034131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1785/3574] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:21.034362 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1790/3575] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:21.036929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4911f-bf3b-4b4a-a28b-115577253d7e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:21.045136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264484-8f29-4b3a-9a90-14a9729c3a1c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.047902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264484-8f29-4b3a-9a90-14a9729c3a1c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.048343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264484-8f29-4b3a-9a90-14a9729c3a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.065702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4911f-bf3b-4b4a-a28b-115577253d7e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:21.079441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:21.080427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.080560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.080739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.081390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:21.083596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:21.091720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e9264484-8f29-4b3a-9a90-14a9729c3a1c None None] MFA Rules not processed for user `548f86671c744430829ba6cc2d6463b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:21.097047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9264484-8f29-4b3a-9a90-14a9729c3a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:21.119183 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1791/3576] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:21.241748 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1786/3577] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:21 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:21.246190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264484-8f29-4b3a-9a90-14a9729c3a1c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:21.269150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264484-8f29-4b3a-9a90-14a9729c3a1c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:21.417855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:21.418888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.419330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.419771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.420655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:21.423954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:21.567437 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1792/3578] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:21 2022] POST /identity/v3/users => generated 284 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:21.575722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:21.584440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:21.587014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:21.597528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc0b31-8f2c-416d-a174-98db310b5268 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:21.618953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:21.620395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.622104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.622483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.623516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:21.634522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:21.665456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1787/3579] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:21.674024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:21.690107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:21.692736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8ded-be00-4140-8288-fb4c4041f355 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:21.706087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:21.707400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.707906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.708424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.712450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:21.723447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:21.751069 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1788/3580] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:21.755671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:21.784262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f660ed-6122-4de6-ae60-e8d017874f8c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:21.801607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd3659-28ab-4d72-a1ac-3397324b86a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:21.805500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3659-28ab-4d72-a1ac-3397324b86a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.805500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3659-28ab-4d72-a1ac-3397324b86a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.805500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3659-28ab-4d72-a1ac-3397324b86a4 admin admin] PATH_INFO: `/v3/projects/0fd902b184c44864a3bb287d05b79de8/users/1992101f39874ac28c820e634d5fd9ff/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.826496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af404a3-1c0f-400c-be9e-987da08959a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:21.836101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266271f8-7dee-416e-87df-933f2e5c80d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:21.836748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266271f8-7dee-416e-87df-933f2e5c80d4 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.837405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266271f8-7dee-416e-87df-933f2e5c80d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.837688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266271f8-7dee-416e-87df-933f2e5c80d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:21.840224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd3659-28ab-4d72-a1ac-3397324b86a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd902b184c44864a3bb287d05b79de8, user_id=1992101f39874ac28c820e634d5fd9ff, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:21.846970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd3659-28ab-4d72-a1ac-3397324b86a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:21.928060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266271f8-7dee-416e-87df-933f2e5c80d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:21.950357 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1789/3581] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:21 2022] PUT /identity/v3/projects/0fd902b184c44864a3bb287d05b79de8/users/1992101f39874ac28c820e634d5fd9ff/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:21.953773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266271f8-7dee-416e-87df-933f2e5c80d4 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:21.962801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b752-9ff4-4a85-b129-7662a2c667d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:21.962801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b752-9ff4-4a85-b129-7662a2c667d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:21.963019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b752-9ff4-4a85-b129-7662a2c667d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:22.005043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1793/3582] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:22.007495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611003-7881-4fd3-8054-bdfc0e866bb8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:22.011346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611003-7881-4fd3-8054-bdfc0e866bb8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:22.011637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611003-7881-4fd3-8054-bdfc0e866bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:22.069074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:22.076199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1f77b752-9ff4-4a85-b129-7662a2c667d1 None None] MFA Rules not processed for user `1992101f39874ac28c820e634d5fd9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:22.077789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f77b752-9ff4-4a85-b129-7662a2c667d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:22.129455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5d611003-7881-4fd3-8054-bdfc0e866bb8 None None] MFA Rules not processed for user `1704f764cb274f168e13a15f433affba`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:22.135962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d611003-7881-4fd3-8054-bdfc0e866bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:22.280191 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1790/3583] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:22.280191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77b752-9ff4-4a85-b129-7662a2c667d1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:22.295334 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1794/3584] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:22.298347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:22.298846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:22.299280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:22.329429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] MFA Rules not processed for user `1704f764cb274f168e13a15f433affba`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:22.335369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:22.346787 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1795/3585] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:22.357799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:22.360830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:22.441988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77b752-9ff4-4a85-b129-7662a2c667d1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:22.454962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:22.455630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:22.455918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:22.456191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:22.456848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:22.458796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:22.591609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1791/3586] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:22 2022] POST /identity/v3/projects => generated 365 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:22.591609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:22.649278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93342c7-7c21-47e6-a2d9-110eaf66782a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:22.826647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898f26a-35ca-40c5-b4a3-d60f9ddea1b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:22.847266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e97b7d-b2b3-4648-a2d8-710b5a19e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:22.847992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97b7d-b2b3-4648-a2d8-710b5a19e4fd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:22.848236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:22.848376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97b7d-b2b3-4648-a2d8-710b5a19e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:22.848878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:22.849728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:22.849852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97b7d-b2b3-4648-a2d8-710b5a19e4fd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:22.849936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:22.850027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e97b7d-b2b3-4648-a2d8-710b5a19e4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:22.860906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e97b7d-b2b3-4648-a2d8-710b5a19e4fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:23.023720 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1792/3587] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:22 2022] POST /identity/v3/users => generated 289 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:23.026485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:23.027783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aec0a9-2b03-4ac6-9546-ef2ac9449301 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:23.028282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:23.030563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aec0a9-2b03-4ac6-9546-ef2ac9449301 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:23.031117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aec0a9-2b03-4ac6-9546-ef2ac9449301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:23.052750 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1796/3588] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:23.062450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:23.093381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42aec0a9-2b03-4ac6-9546-ef2ac9449301 None None] MFA Rules not processed for user `548f86671c744430829ba6cc2d6463b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:23.096692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42aec0a9-2b03-4ac6-9546-ef2ac9449301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:23.111233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b9ef-7104-4709-9070-16f38ebfa832 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:23.127075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:23.127986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:23.128449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:23.128901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:23.129707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:23.131518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:23.162564 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1797/3589] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:23.163760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:23.204173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c17d-5d5c-4bf4-967d-eed007918b38 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:23.220689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:23.221544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:23.221954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:23.222350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] PATH_INFO: `/v3/projects/2f971a6b78e84ae7ba7243deda0f8bf7/users/43d336a1859d4d05bb9ba8b4bb5f5541/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:23.272943 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1793/3590] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:23.279513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f971a6b78e84ae7ba7243deda0f8bf7, user_id=43d336a1859d4d05bb9ba8b4bb5f5541, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:23.282479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:23.375895 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1798/3591] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:23 2022] PUT /identity/v3/projects/2f971a6b78e84ae7ba7243deda0f8bf7/users/43d336a1859d4d05bb9ba8b4bb5f5541/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:23.379934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aec0a9-2b03-4ac6-9546-ef2ac9449301 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:23.396803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aec0a9-2b03-4ac6-9546-ef2ac9449301 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:23.547910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5451408-7aac-419c-af80-ef6e4e4ae202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:23.548589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451408-7aac-419c-af80-ef6e4e4ae202 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:23.549663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451408-7aac-419c-af80-ef6e4e4ae202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:23.549950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5451408-7aac-419c-af80-ef6e4e4ae202 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:23.550748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5451408-7aac-419c-af80-ef6e4e4ae202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:23.552532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5451408-7aac-419c-af80-ef6e4e4ae202 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:23.578885 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1794/3592] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:23.582875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:23.595824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bd555-e0e0-485c-a0b6-778f580214c3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:23.602197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:23.603253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:23.603772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:23.605507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] PATH_INFO: `/v3/projects/2f971a6b78e84ae7ba7243deda0f8bf7/users/43d336a1859d4d05bb9ba8b4bb5f5541/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:23.611082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f971a6b78e84ae7ba7243deda0f8bf7, user_id=43d336a1859d4d05bb9ba8b4bb5f5541, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:23.617787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:23.644847 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1799/3593] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:23 2022] PUT /identity/v3/projects/2f971a6b78e84ae7ba7243deda0f8bf7/users/43d336a1859d4d05bb9ba8b4bb5f5541/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:23.648685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00efa-5311-47d3-bcc7-56e793d3f55f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:23.649293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00efa-5311-47d3-bcc7-56e793d3f55f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:23.650579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00efa-5311-47d3-bcc7-56e793d3f55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:23.719628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ff00efa-5311-47d3-bcc7-56e793d3f55f None None] MFA Rules not processed for user `43d336a1859d4d05bb9ba8b4bb5f5541`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:23.724366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ff00efa-5311-47d3-bcc7-56e793d3f55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:23.824049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:23.867271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:23.922043 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1795/3594] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:23.926805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:23.944263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234df70-1b38-43b4-b6f0-50c6d7a4a596 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:23.978663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:23.981355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:23.984109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:23.985950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:23.991663 n-d-858383-13 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 13:38:23.993937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:24.002508 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:24.002508 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:24.002508 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:24.003340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:24.189677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00efa-5311-47d3-bcc7-56e793d3f55f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:24.195910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1800/3595] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:38:23 2022] POST /identity/v3/policies => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:24.201122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00efa-5311-47d3-bcc7-56e793d3f55f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:24.243103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:24.244100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:24.244824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:24.245251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies/1bd6d0f9a41f424796aa60444457756d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:24.249566 n-d-858383-13 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 13:38:24.250370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=1bd6d0f9a41f424796aa60444457756d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:24.251701 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:24.251701 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:24.251701 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:24.252685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:24.370556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:24.383470 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1796/3596] 10.222.0.27 () {60 vars in 1252 bytes} [Tue Oct 18 13:38:24 2022] PATCH /identity/v3/policies/1bd6d0f9a41f424796aa60444457756d => generated 235 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:24.390027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5501-6293-4a69-b2b7-e007d95b55dd tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:24.426539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:24.426539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:24.426539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:24.426801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies/1bd6d0f9a41f424796aa60444457756d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:24.426801 n-d-858383-13 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 13:38:24.426801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=1bd6d0f9a41f424796aa60444457756d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:24.442545 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:24.442545 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:24.442545 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:24.443391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:24.510999 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1801/3597] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:24 2022] GET /identity/v3/policies/1bd6d0f9a41f424796aa60444457756d => generated 235 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:38:24.517124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:24.534368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beb118-5f35-4428-8e62-4c019fb9ffb4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:24.556285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:24.556958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:24.557246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:24.557538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies/1bd6d0f9a41f424796aa60444457756d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:24.558354 n-d-858383-13 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 13:38:24.566823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1bd6d0f9a41f424796aa60444457756d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:24.570753 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:24.570753 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:24.570753 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:24.571673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:24.727040 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1797/3598] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:24 2022] DELETE /identity/v3/policies/1bd6d0f9a41f424796aa60444457756d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:24.733820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:24.753091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4e5c7-f13a-4a41-8cf1-306ee635afa4 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:24.770882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:24.771521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:24.771787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:24.772066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:24.773211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:24.791508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:24.965749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1802/3599] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:38:24 2022] POST /identity/v3/policies => generated 230 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:24.967619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:24.995521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9170-3162-47db-a3f8-9749aaba79b9 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:25.015251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:25.016254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:25.016708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:25.017153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:25.018382 n-d-858383-13 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 13:38:25.019593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:25.038498 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:25.038498 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:25.038498 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:25.043952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:25.200655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:25.208849 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1798/3600] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:38:24 2022] POST /identity/v3/policies => generated 229 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:25.222353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187cd4c-76c6-4c03-978a-3b356b2f6c87 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:25.233690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:25.235767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:25.237211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:25.242724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:25.259193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:25.267882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:25.374814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:25.375044 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1803/3601] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:38:25 2022] POST /identity/v3/policies => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:25.388414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20afb6-8a4e-40ff-ba53-a8714c4fc082 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:25.401790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:25.402734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:25.403177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:25.408491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:25.408491 n-d-858383-13 devstack@keystone.service[82161]: WARNING oslo_log.versionutils [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 13:38:25.408491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:25.408491 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:25.408491 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:25.408491 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:25.409374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:25.432131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1799/3602] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:38:25 2022] GET /identity/v3/policies => generated 764 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:38:25.437250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:25.459194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f5c2-2a04-46b3-a666-b93ea689ee82 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:25.477493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:25.477493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:25.477493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:25.478009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies/04b6c249964b461fadb48a4025b12368` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:25.480421 n-d-858383-13 devstack@keystone.service[82160]: WARNING oslo_log.versionutils [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 13:38:25.481696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=04b6c249964b461fadb48a4025b12368)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:25.485687 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:25.485687 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:25.485687 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:25.488161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:25.635673 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1804/3603] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:25 2022] DELETE /identity/v3/policies/04b6c249964b461fadb48a4025b12368 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:25.640374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:25.661537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77e6d7-ebaa-4cc3-acf8-7e3da7c6e03d tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:25.678515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:25.678515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:25.678515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:25.678773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies/d7767125b84f4a6bb473efb9a63a9825` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:25.679227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d7767125b84f4a6bb473efb9a63a9825)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:25.685689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:25.844312 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1800/3604] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:25 2022] DELETE /identity/v3/policies/d7767125b84f4a6bb473efb9a63a9825 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:25.844438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:25.861475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874711-0dc7-4fcc-b516-f864e276293f tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:25.901153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafafb26-1216-48ef-aa68-d8968b10f1b8 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d336a1859d4d05bb9ba8b4bb5f5541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f971a6b78e84ae7ba7243deda0f8bf7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:25.901829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafb26-1216-48ef-aa68-d8968b10f1b8 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:25.902298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafb26-1216-48ef-aa68-d8968b10f1b8 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:25.902418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafafb26-1216-48ef-aa68-d8968b10f1b8 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] PATH_INFO: `/v3/policies/b19ee05660044a49beb91a417207bf3f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:25.903512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafafb26-1216-48ef-aa68-d8968b10f1b8 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b19ee05660044a49beb91a417207bf3f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:25.905951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafafb26-1216-48ef-aa68-d8968b10f1b8 tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:25.909490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:26.043193 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1805/3605] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:25 2022] DELETE /identity/v3/policies/b19ee05660044a49beb91a417207bf3f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:26.048292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:26.227278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce9fda-087d-44ae-b9fb-114028bedf5a tempest-PoliciesTestJSON-54080400 tempest-PoliciesTestJSON-54080400-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:26.271344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:26.274316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:26.274774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:26.276316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] PATH_INFO: `/v3/users/1992101f39874ac28c820e634d5fd9ff` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:26.289050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1992101f39874ac28c820e634d5fd9ff)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:26.293210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:26.629996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1992101f39874ac28c820e634d5fd9ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:26.630421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1992101f39874ac28c820e634d5fd9ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:26.722739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1992101f39874ac28c820e634d5fd9ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:26.725591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1992101f39874ac28c820e634d5fd9ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:26.755696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1992101f39874ac28c820e634d5fd9ff'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:26.801582 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1801/3606] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:26 2022] DELETE /identity/v3/users/1992101f39874ac28c820e634d5fd9ff => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:26.806550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59178f5-e4e0-4dc3-9120-8f82c5c03b70 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:26.807844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59178f5-e4e0-4dc3-9120-8f82c5c03b70 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:26.808338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59178f5-e4e0-4dc3-9120-8f82c5c03b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:26.864066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e59178f5-e4e0-4dc3-9120-8f82c5c03b70 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:26.867289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e59178f5-e4e0-4dc3-9120-8f82c5c03b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:27.035050 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1806/3607] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:27.045833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:27.048504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:27.173651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aeb9a-6037-45e7-8768-937e0723b2b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:27.179461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:27.180571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:27.181119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:27.181609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:27.196254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:27.198439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:27.212028 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1802/3608] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:27.263777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:27.858196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:27.925438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5dc9b-76ae-4fab-a85e-95a9dd3051a8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:27.925438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5dc9b-76ae-4fab-a85e-95a9dd3051a8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:27.925966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5dc9b-76ae-4fab-a85e-95a9dd3051a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:27.989527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:27.990997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:28.039274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:28.055669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-13e5dc9b-76ae-4fab-a85e-95a9dd3051a8 None None] MFA Rules not processed for user `658e3ac336ac4342bd204a74515fcd96`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:28.062249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc174d0-2576-4594-a8e3-e3d3db084f8e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:28.062742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13e5dc9b-76ae-4fab-a85e-95a9dd3051a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:28.087067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:28.094714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:28.095198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:28.095969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] PATH_INFO: `/v3/projects/0fd902b184c44864a3bb287d05b79de8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:28.098840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd902b184c44864a3bb287d05b79de8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:28.101764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:28.307447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd902b184c44864a3bb287d05b79de8', 'request_id': 'req-a8872f36-f791-483c-9e72-832222b3f6aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:28.330780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd902b184c44864a3bb287d05b79de8', 'request_id': 'req-a8872f36-f791-483c-9e72-832222b3f6aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:28.354214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1807/3609] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:28.366747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:28.368672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:28.370132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:28.406998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] MFA Rules not processed for user `658e3ac336ac4342bd204a74515fcd96`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:28.412958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:28.449097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd902b184c44864a3bb287d05b79de8', 'request_id': 'req-a8872f36-f791-483c-9e72-832222b3f6aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:28.482921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] The token cache is being invalidate because project 0fd902b184c44864a3bb287d05b79de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:28.491224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:28.504798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:28.518539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1803/3610] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:27 2022] DELETE /identity/v3/projects/0fd902b184c44864a3bb287d05b79de8 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:28.519683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:28.527635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:28.645124 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1808/3611] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:28.703322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8872f36-f791-483c-9e72-832222b3f6aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:28.734857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:28.734857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:28.734857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:28.734857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] PATH_INFO: `/v3/users/43d336a1859d4d05bb9ba8b4bb5f5541` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:28.735386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d336a1859d4d05bb9ba8b4bb5f5541)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:28.743713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:28.759577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:28.761504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:28.925279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19258-0501-4e2d-bda5-0b1e6f64032f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:28.956468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:28.956468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:28.956468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:28.956468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:28.957742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:28.972556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:28.974235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:28.986436 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1809/3612] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:38:29.128364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d336a1859d4d05bb9ba8b4bb5f5541'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:29.129475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d336a1859d4d05bb9ba8b4bb5f5541'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:29.240522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d336a1859d4d05bb9ba8b4bb5f5541'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:29.241442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d336a1859d4d05bb9ba8b4bb5f5541'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:29.250789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2f54fb64-9f73-4eb3-9d7b-49de2ae34ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d336a1859d4d05bb9ba8b4bb5f5541'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:29.295388 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1804/3613] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:28 2022] DELETE /identity/v3/users/43d336a1859d4d05bb9ba8b4bb5f5541 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:30.588238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:30.659606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:30.676929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff391a-e3e2-4e4b-9bfc-b2b50b82ff33 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:30.904580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:30.905516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:30.905809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:30.909192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] PATH_INFO: `/v3/projects/2f971a6b78e84ae7ba7243deda0f8bf7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:30.915202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f971a6b78e84ae7ba7243deda0f8bf7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:30.924432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:31.193827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f971a6b78e84ae7ba7243deda0f8bf7', 'request_id': 'req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:31.218507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f971a6b78e84ae7ba7243deda0f8bf7', 'request_id': 'req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:31.314526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f971a6b78e84ae7ba7243deda0f8bf7', 'request_id': 'req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:31.335464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] The token cache is being invalidate because project 2f971a6b78e84ae7ba7243deda0f8bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:31.335772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:31.343168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c1a6ff9d-31c6-4a5e-bcae-52b7bf2c5b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:31.344822 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1810/3614] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:30 2022] DELETE /identity/v3/projects/2f971a6b78e84ae7ba7243deda0f8bf7 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:31.349765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddff8a-df20-4b09-8943-b10842b5dd84 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:31.351134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddff8a-df20-4b09-8943-b10842b5dd84 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:31.351608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddff8a-df20-4b09-8943-b10842b5dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:31.398951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e2ddff8a-df20-4b09-8943-b10842b5dd84 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:31.400165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e2ddff8a-df20-4b09-8943-b10842b5dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:31.556842 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1805/3615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:31.558099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8d9c8-241c-4ad4-bdee-e567b2fa9157 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:31.558560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8d9c8-241c-4ad4-bdee-e567b2fa9157 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:31.559059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8d9c8-241c-4ad4-bdee-e567b2fa9157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:31.586474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2be8d9c8-241c-4ad4-bdee-e567b2fa9157 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:31.598764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2be8d9c8-241c-4ad4-bdee-e567b2fa9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:31.623688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddff8a-df20-4b09-8943-b10842b5dd84 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:31.644373 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1811/3616] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:31.645225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddff8a-df20-4b09-8943-b10842b5dd84 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:31.658555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:31.660537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:31.661512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:31.661941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:31.662829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:31.663403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:31.665475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:31.704846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1806/3617] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:31.709309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8d9c8-241c-4ad4-bdee-e567b2fa9157 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:31.720980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8d9c8-241c-4ad4-bdee-e567b2fa9157 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:31.732150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:31.733265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:31.733715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:31.735367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:31.736175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:31.741560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:31.938120 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1812/3618] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:31 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:31.942416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:31.960646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c250cb-014d-45d5-999b-8f4ab3d565fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:32.135144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:32.144348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:32.144651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:32.144930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:32.147606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:32.159529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:32.321900 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1807/3619] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:31 2022] POST /identity/v3/users => generated 285 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:32.325756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:32.341006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475f861-053f-4dfe-a22a-6b1fb8b65044 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:32.354139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:32.355126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:32.355636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:32.356118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:32.358897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:32.361573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:32.388077 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1813/3620] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:32.391485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:32.405584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eead62-66e2-4e1f-b6d4-3e899313fd36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:32.422587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a2e0-6b78-4c6c-bab7-3da43b4fa18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:32.423728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a2e0-6b78-4c6c-bab7-3da43b4fa18b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:32.424217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a2e0-6b78-4c6c-bab7-3da43b4fa18b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:32.424907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a2e0-6b78-4c6c-bab7-3da43b4fa18b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:32.425842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0a2e0-6b78-4c6c-bab7-3da43b4fa18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:32.428123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0a2e0-6b78-4c6c-bab7-3da43b4fa18b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:32.459884 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1808/3621] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:32.464426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:32.484493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1564-1cc6-4171-9107-7062eaf20618 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:32.502245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:32.503189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:32.503545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:32.504365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] PATH_INFO: `/v3/projects/d27d939df7464e73b50d24f85b180a4a/users/479141e0b2bf42d1b19a51606d5e56b0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:32.542192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27d939df7464e73b50d24f85b180a4a, user_id=479141e0b2bf42d1b19a51606d5e56b0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:32.544994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:32.586342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:32.692763 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1814/3622] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:32 2022] PUT /identity/v3/projects/d27d939df7464e73b50d24f85b180a4a/users/479141e0b2bf42d1b19a51606d5e56b0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:32.704157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7deb7b-990b-41fb-962a-d7c358a61955 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:32.704439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7deb7b-990b-41fb-962a-d7c358a61955 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:32.705495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7deb7b-990b-41fb-962a-d7c358a61955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:32.816439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bc7deb7b-990b-41fb-962a-d7c358a61955 None None] MFA Rules not processed for user `479141e0b2bf42d1b19a51606d5e56b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:32.821205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc7deb7b-990b-41fb-962a-d7c358a61955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:32.978296 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1809/3623] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:32.984683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:33.019371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:33.187534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865d1f5-0b4b-4a52-9235-1aeceb032bb2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:33.204841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:33.204841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:33.204841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:33.204841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:33.205395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:33.206800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:33.327383 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1815/3624] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:32 2022] POST /identity/v3/projects => generated 367 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:33.331674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7deb7b-990b-41fb-962a-d7c358a61955 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:33.362216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7deb7b-990b-41fb-962a-d7c358a61955 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:33.536490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:33.537865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:33.538379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:33.538814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:33.539628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:33.543822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:33.693366 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1810/3625] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:33 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:33.697813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:33.737691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce11327-6e63-4dee-8b1f-d9db64fde1c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:33.772765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:33.777001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:33.777001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:33.777001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:33.779084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:33.780780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:33.812815 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1816/3626] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:33.816676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:33.830309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b11b-75e4-46b0-9e91-7c1f8162d5fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:33.846845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:33.849937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:33.849937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:33.849937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] PATH_INFO: `/v3/projects/7fea94e5d2e040dd9659e14889a3f521/users/6ff1a97e1f824b028d5df5d96a82090d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:33.918167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fea94e5d2e040dd9659e14889a3f521, user_id=6ff1a97e1f824b028d5df5d96a82090d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:33.921473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:34.015561 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1811/3627] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:33 2022] PUT /identity/v3/projects/7fea94e5d2e040dd9659e14889a3f521/users/6ff1a97e1f824b028d5df5d96a82090d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:34.019585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:34.048511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1904-6332-4b06-87fd-3fa04d13988c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:34.197424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf881e9-2566-4621-aa56-f204136ae323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:34.198465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf881e9-2566-4621-aa56-f204136ae323 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:34.198960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf881e9-2566-4621-aa56-f204136ae323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:34.200392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf881e9-2566-4621-aa56-f204136ae323 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:34.202494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf881e9-2566-4621-aa56-f204136ae323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:34.207072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf881e9-2566-4621-aa56-f204136ae323 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:34.245623 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1817/3628] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:34.247089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:34.259866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3f74-40ad-4449-a5d1-c8e71452878f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:34.279580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:34.280915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:34.283216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:34.283611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] PATH_INFO: `/v3/projects/7fea94e5d2e040dd9659e14889a3f521/users/6ff1a97e1f824b028d5df5d96a82090d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:34.288170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fea94e5d2e040dd9659e14889a3f521, user_id=6ff1a97e1f824b028d5df5d96a82090d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:34.292969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:34.323089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1812/3629] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:34 2022] PUT /identity/v3/projects/7fea94e5d2e040dd9659e14889a3f521/users/6ff1a97e1f824b028d5df5d96a82090d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:34.333555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6989-a511-448f-8081-e74443d74069 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:34.333962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6989-a511-448f-8081-e74443d74069 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:34.334742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6989-a511-448f-8081-e74443d74069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:34.439640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-11fa6989-a511-448f-8081-e74443d74069 None None] MFA Rules not processed for user `6ff1a97e1f824b028d5df5d96a82090d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:34.441040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-11fa6989-a511-448f-8081-e74443d74069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:34.671387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1818/3630] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:34.672879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:34.691374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc82eb-23d9-40af-9a01-466df4a69a46 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:34.700490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:34.701278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:34.706760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:34.706760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:34.706760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:34.710814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:34.882777 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1813/3631] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:34 2022] POST /identity/v3/projects => generated 358 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:34.887135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa6989-a511-448f-8081-e74443d74069 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:34.914976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa6989-a511-448f-8081-e74443d74069 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:35.064294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:35.064997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:35.065406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:35.065763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:35.066697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:35.068685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:35.203019 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1819/3632] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:34 2022] POST /identity/v3/users => generated 413 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:35.207245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:35.233411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8507dc-9735-4dfe-af37-a224ec69a93f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:35.251649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:35.252476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:35.255710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:35.255710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/users/72cd35f99e2b44669da296596c2efa57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:35.302994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_user(user_id=72cd35f99e2b44669da296596c2efa57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:35.305371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:35.307223 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1814/3633] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:38:35 2022] GET /identity/v3/users/72cd35f99e2b44669da296596c2efa57 => generated 413 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:35.312437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:35.328872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85d998-abc1-4ce3-99b4-8661db9c8201 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:35.344384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:35.345017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:35.352196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:35.352516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/users/72cd35f99e2b44669da296596c2efa57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:35.359990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_user(user_id=72cd35f99e2b44669da296596c2efa57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:35.362216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:35.608704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cd35f99e2b44669da296596c2efa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:35.627036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cd35f99e2b44669da296596c2efa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:35.635206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cd35f99e2b44669da296596c2efa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:35.660317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cd35f99e2b44669da296596c2efa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:35.796748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cd35f99e2b44669da296596c2efa57'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:35.810910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1820/3634] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:35 2022] DELETE /identity/v3/users/72cd35f99e2b44669da296596c2efa57 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:35.815371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:35.817308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:35.831178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf622888-c834-4f2c-a5b0-5d20483d0733 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:35.926893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:35.929904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:35.929904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:35.929904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/4525b86a83a1407d8a75256abb9f75df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:35.931409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4525b86a83a1407d8a75256abb9f75df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:35.955605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:36.247283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4525b86a83a1407d8a75256abb9f75df', 'request_id': 'req-c512ecfc-be68-4ad6-95b0-135052037ac4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:36.263712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4525b86a83a1407d8a75256abb9f75df', 'request_id': 'req-c512ecfc-be68-4ad6-95b0-135052037ac4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:36.320691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:36.380374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4525b86a83a1407d8a75256abb9f75df', 'request_id': 'req-c512ecfc-be68-4ad6-95b0-135052037ac4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:36.403803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 4525b86a83a1407d8a75256abb9f75df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:36.404164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:36.405283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:36.412777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:36.422271 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1815/3635] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:35 2022] DELETE /identity/v3/projects/4525b86a83a1407d8a75256abb9f75df => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:36.433822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8920615-d628-4eed-ac44-78f65fcaa5fa tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:36.593032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:36.593932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:36.594395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:36.594877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:36.595706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:36.597910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:36.635096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:36.722903 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1821/3636] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:36 2022] POST /identity/v3/projects => generated 347 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:36.724060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:36.725873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:36.753130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ecfc-be68-4ad6-95b0-135052037ac4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:36.881232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:36.900483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:36.900483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:36.900483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:36.900483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:36.900483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:36.901302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:36.937092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1816/3637] 10.222.0.27 () {58 vars in 1160 bytes} [Tue Oct 18 13:38:36 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:38:36.941253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:36.956698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e4a5-b599-41e6-bde8-64f90fcd7d5d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:36.968849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:36.969567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:36.969911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:36.970220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:36.971048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:36.973903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:37.008275 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1822/3638] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:38:36 2022] GET /identity/v3/domains => generated 828 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:37.012821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:37.038283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe7775-4865-4c6d-a08e-2b5bbb2b0470 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:37.055388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:37.056407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:37.056862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:37.057295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/8db7ad8d4ee24f01a6c753080d6866df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:37.059124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:update_project(project_id=8db7ad8d4ee24f01a6c753080d6866df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:37.062485 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:37.062485 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:37.062485 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:37.064002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:37.098844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:37.099781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:37.270568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:37.272862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:37.285903 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1817/3639] 10.222.0.27 () {60 vars in 1252 bytes} [Tue Oct 18 13:38:37 2022] PATCH /identity/v3/projects/8db7ad8d4ee24f01a6c753080d6866df => generated 361 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:37.289701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:37.291697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:37.322891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780d4dc-2f93-4b49-90a6-7ef89b714ebf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:37.506223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:37.509883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:37.511749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:37.512408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/8db7ad8d4ee24f01a6c753080d6866df` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:37.563498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8db7ad8d4ee24f01a6c753080d6866df)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:37.571517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:37.679278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:37.734911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:37.943034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df', 'request_id': 'req-62a36902-02bb-4dde-9911-74d97bca4089'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:37.956189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df', 'request_id': 'req-62a36902-02bb-4dde-9911-74d97bca4089'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.070213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df', 'request_id': 'req-62a36902-02bb-4dde-9911-74d97bca4089'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.093122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 8db7ad8d4ee24f01a6c753080d6866df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:38.093422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.096704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.129908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df', 'request_id': 'req-62a36902-02bb-4dde-9911-74d97bca4089'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.133193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df', 'request_id': 'req-62a36902-02bb-4dde-9911-74d97bca4089'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.144447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8db7ad8d4ee24f01a6c753080d6866df', 'request_id': 'req-62a36902-02bb-4dde-9911-74d97bca4089'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.166255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1823/3640] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:37 2022] DELETE /identity/v3/projects/8db7ad8d4ee24f01a6c753080d6866df => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:38.168068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:38.184661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5a4f-a745-4418-8f94-b9de95fdcec9 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:38.354025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:38.355225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:38.355837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:38.356321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:38.357233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:38.361048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:38.490644 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1818/3641] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:38 2022] POST /identity/v3/projects => generated 360 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:38.501572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:38.503322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:38.526366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a36902-02bb-4dde-9911-74d97bca4089 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:38.659008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:38.660125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:38.660662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:38.661102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/6c119d545a0340edb87a77bbdc21897e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:38.663270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=6c119d545a0340edb87a77bbdc21897e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:38.667434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:38.671838 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1824/3642] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:38 2022] GET /identity/v3/projects/6c119d545a0340edb87a77bbdc21897e => generated 360 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:38.676301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:38.695245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72075202-2166-4b26-bf90-2b47947ae37c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:38.708998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:38.709137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:38.709947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:38.710261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/6c119d545a0340edb87a77bbdc21897e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:38.711462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c119d545a0340edb87a77bbdc21897e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:38.713891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:38.902275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c119d545a0340edb87a77bbdc21897e', 'request_id': 'req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.916863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c119d545a0340edb87a77bbdc21897e', 'request_id': 'req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:38.997522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c119d545a0340edb87a77bbdc21897e', 'request_id': 'req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:39.014106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:39.018685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 6c119d545a0340edb87a77bbdc21897e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:39.018972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:39.021739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:39.024562 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1819/3643] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:38 2022] DELETE /identity/v3/projects/6c119d545a0340edb87a77bbdc21897e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:39.029546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:39.031735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:39.052649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76337a0-11c5-4dc8-9ef2-670dcd92d571 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:39.175634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:39.176506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:39.177068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:39.177507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:39.178382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:39.180427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:39.346965 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1825/3644] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:39 2022] POST /identity/v3/projects => generated 361 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:39.351129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:39.417478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:39.432075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c735a4-3ed6-4d37-8f99-6dcbdffe6d54 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:39.615027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:39.615938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:39.616324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:39.616707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/e5391f4dd6d64fd7b48331136a297b22` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:39.618235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=e5391f4dd6d64fd7b48331136a297b22)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:39.620727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:39.622705 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1820/3645] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:39 2022] GET /identity/v3/projects/e5391f4dd6d64fd7b48331136a297b22 => generated 361 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:39.627096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:39.699412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbc704-4b92-4026-8dbf-2e1733a5c430 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:39.709509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:39.710356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:39.710752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:39.711136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/e5391f4dd6d64fd7b48331136a297b22` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:39.714867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e5391f4dd6d64fd7b48331136a297b22)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:39.720838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:39.941428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5391f4dd6d64fd7b48331136a297b22', 'request_id': 'req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:39.969497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5391f4dd6d64fd7b48331136a297b22', 'request_id': 'req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:40.111425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5391f4dd6d64fd7b48331136a297b22', 'request_id': 'req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:40.130941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project e5391f4dd6d64fd7b48331136a297b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:40.131462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:40.133766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:40.140789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1826/3646] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:39 2022] DELETE /identity/v3/projects/e5391f4dd6d64fd7b48331136a297b22 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:40.145854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:40.147930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:40.173362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c5583-f741-4ca5-828f-2db35f484ae7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:40.316702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:40.317438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:40.317830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:40.318256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:40.319006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:40.323799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:40.497776 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1821/3647] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:38:40 2022] POST /identity/v3/projects => generated 345 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:40.502355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:40.517785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f39f42-bdcf-4ac4-b68c-8914bb5701df tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:40.630100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:40.632170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:40.634680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:40.635792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/4f1443838fa74bc8b793e3864d768728` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:40.637409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f1443838fa74bc8b793e3864d768728)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:40.640677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:40.642931 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1827/3648] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:40 2022] GET /identity/v3/projects/4f1443838fa74bc8b793e3864d768728 => generated 345 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:40.654165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:40.666794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa217543-62c4-48b5-8f49-33edb6a90ddf tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:40.674752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:40.677868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:40.677868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:40.677868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/4f1443838fa74bc8b793e3864d768728` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:40.678742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f1443838fa74bc8b793e3864d768728)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:40.681123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:40.898443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1443838fa74bc8b793e3864d768728', 'request_id': 'req-db5f6cc9-0046-4552-921a-081d5946671e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:40.914134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1443838fa74bc8b793e3864d768728', 'request_id': 'req-db5f6cc9-0046-4552-921a-081d5946671e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:41.034723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1443838fa74bc8b793e3864d768728', 'request_id': 'req-db5f6cc9-0046-4552-921a-081d5946671e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:41.054833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 4f1443838fa74bc8b793e3864d768728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:41.055295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:41.056178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:41.058279 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1822/3649] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:40 2022] DELETE /identity/v3/projects/4f1443838fa74bc8b793e3864d768728 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:41.063515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:41.065666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:41.088775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972129dd-4e42-42cb-aeeb-7b664b390e8c tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:41.106798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:41.163917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:41.164873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:41.165374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:41.165870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:41.166833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:41.168664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:41.280901 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1828/3650] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:38:41 2022] POST /identity/v3/domains => generated 277 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:41.284517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:41.300616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f6cc9-0046-4552-921a-081d5946671e tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:41.363494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:41.425954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:41.427334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:41.428892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:41.429360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:41.431837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:41.435743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:41.631456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1823/3651] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:41 2022] POST /identity/v3/projects => generated 405 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:41.635797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:41.652936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9d17a-56eb-455e-872e-b1062481d870 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:41.791813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:41.792475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:41.792971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:41.806329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/8a4b5cc2188244a2be41f5a66a30ff57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:41.808084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a4b5cc2188244a2be41f5a66a30ff57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:41.810407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:41.813695 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1829/3652] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:41 2022] GET /identity/v3/projects/8a4b5cc2188244a2be41f5a66a30ff57 => generated 405 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:41.817326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:41.831688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe3d0a-583f-462d-981a-2fe9139e7706 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:41.849256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:41.849999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:41.850487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:41.850885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/8a4b5cc2188244a2be41f5a66a30ff57` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:41.852625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a4b5cc2188244a2be41f5a66a30ff57)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:41.854773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:42.074965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4b5cc2188244a2be41f5a66a30ff57', 'request_id': 'req-33a592ce-073a-48e1-b90d-5bca26e0e0e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.090100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4b5cc2188244a2be41f5a66a30ff57', 'request_id': 'req-33a592ce-073a-48e1-b90d-5bca26e0e0e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.172539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4b5cc2188244a2be41f5a66a30ff57', 'request_id': 'req-33a592ce-073a-48e1-b90d-5bca26e0e0e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.196849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 8a4b5cc2188244a2be41f5a66a30ff57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:42.197533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.199725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.204889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1824/3653] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:41 2022] DELETE /identity/v3/projects/8a4b5cc2188244a2be41f5a66a30ff57 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:42.213769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:42.213769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:42.225390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d670-04ff-4e88-8473-eee199e9f6f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:42.301603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:42.302680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:42.303216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:42.303719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains/166c51293ace467495195b06bc35d119` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:42.305328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=166c51293ace467495195b06bc35d119)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:42.307259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:42.335363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '166c51293ace467495195b06bc35d119'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.336459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '166c51293ace467495195b06bc35d119'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.500196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '166c51293ace467495195b06bc35d119'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.501294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '166c51293ace467495195b06bc35d119'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.505242 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1830/3654] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:38:42 2022] PATCH /identity/v3/domains/166c51293ace467495195b06bc35d119 => generated 278 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:42.509099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:42.521261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a592ce-073a-48e1-b90d-5bca26e0e0e7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:42.668942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:42.669468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:42.669864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:42.669864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:42.670105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains/166c51293ace467495195b06bc35d119` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:42.671315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:42.691442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=166c51293ace467495195b06bc35d119)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:42.693109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:42.776124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '166c51293ace467495195b06bc35d119'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.782681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8488-a18c-4b06-8844-62e877eb0298 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:42.799681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:42.800815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:42.802433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:42.804027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:42.810871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:42.810997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:42.820144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '166c51293ace467495195b06bc35d119'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:42.948493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:42.950273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:42.969407 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1831/3655] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:38:42.981857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:42.997411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166c51293ace467495195b06bc35d119', 'request_id': 'req-c30d5340-ee23-4734-a2b3-40805b140949'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.010638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166c51293ace467495195b06bc35d119', 'request_id': 'req-c30d5340-ee23-4734-a2b3-40805b140949'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.088869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166c51293ace467495195b06bc35d119', 'request_id': 'req-c30d5340-ee23-4734-a2b3-40805b140949'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.123397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 166c51293ace467495195b06bc35d119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:43.123898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.125784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.157344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '166c51293ace467495195b06bc35d119', 'request_id': 'req-c30d5340-ee23-4734-a2b3-40805b140949'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.158255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '166c51293ace467495195b06bc35d119', 'request_id': 'req-c30d5340-ee23-4734-a2b3-40805b140949'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.158760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '166c51293ace467495195b06bc35d119', 'request_id': 'req-c30d5340-ee23-4734-a2b3-40805b140949'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:43.191476 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1825/3656] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:42 2022] DELETE /identity/v3/domains/166c51293ace467495195b06bc35d119 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:43.196200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:43.197707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:43.227892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd63ef9-5dc5-48b6-a91a-8fa4eee0a8af service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:43.373131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:43.374346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:43.374636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:43.374913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:43.375602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:43.377925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:43.482407 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1832/3657] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:38:43 2022] POST /identity/v3/domains => generated 276 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:43.486508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:43.488347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:43.512949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d5340-ee23-4734-a2b3-40805b140949 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:43.676721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:43.677355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:43.677804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:43.678392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:43.679216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:43.681394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:43.908441 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1826/3658] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:43 2022] POST /identity/v3/projects => generated 408 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:43.912175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:43.931990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67eef4-83d8-4b2c-88f9-413a109f7e55 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:44.055765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:44.056583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:44.056985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:44.057698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:44.061335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:44.063493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:44.184581 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1833/3659] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:43 2022] POST /identity/v3/projects => generated 403 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:44.188553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:44.211401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cee9f-f9d8-4e4c-bc1d-5534f0f33c3f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:44.285004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:44.285894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:44.286152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:44.286442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/0f66cc06fa054ab5a57df7844a7cfd70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:44.288055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f66cc06fa054ab5a57df7844a7cfd70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:44.289950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:44.476023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f66cc06fa054ab5a57df7844a7cfd70', 'request_id': 'req-878b01a9-a94f-4eb5-9b70-946e73a99bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.497477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f66cc06fa054ab5a57df7844a7cfd70', 'request_id': 'req-878b01a9-a94f-4eb5-9b70-946e73a99bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.575564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f66cc06fa054ab5a57df7844a7cfd70', 'request_id': 'req-878b01a9-a94f-4eb5-9b70-946e73a99bca'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.610713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:44.619231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 0f66cc06fa054ab5a57df7844a7cfd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:44.620110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.621366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.625936 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1827/3660] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:44 2022] DELETE /identity/v3/projects/0f66cc06fa054ab5a57df7844a7cfd70 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:44.629601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:44.631384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:44.651200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c97117-7a1c-4008-857a-c4a665e26d50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:44.731769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:44.734128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:44.734607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:44.735863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/dac5ea134ab241629095d8e093458b46` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:44.737620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dac5ea134ab241629095d8e093458b46)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:44.741288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:44.765849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:44.871602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac5ea134ab241629095d8e093458b46', 'request_id': 'req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.895062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac5ea134ab241629095d8e093458b46', 'request_id': 'req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.963110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac5ea134ab241629095d8e093458b46', 'request_id': 'req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:44.995634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project dac5ea134ab241629095d8e093458b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:44.995634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.003664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.011465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:45.012404 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1834/3661] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:44 2022] DELETE /identity/v3/projects/dac5ea134ab241629095d8e093458b46 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:45.025188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b01a9-a94f-4eb5-9b70-946e73a99bca tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:45.133226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:45.134396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:45.134691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:45.135225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains/92cc3bf38cd14f2e80fa7afd7de63cb8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:45.136500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=92cc3bf38cd14f2e80fa7afd7de63cb8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:45.138725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:45.165375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.166225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.289923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.292227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.299698 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1828/3662] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:38:45 2022] PATCH /identity/v3/domains/92cc3bf38cd14f2e80fa7afd7de63cb8 => generated 277 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:45.310540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:45.313877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:45.331542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424ce0c-9115-4ef3-a1ec-667a33aa38d0 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:45.445311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:45.447577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:45.452639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:45.452639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains/92cc3bf38cd14f2e80fa7afd7de63cb8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:45.468251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=92cc3bf38cd14f2e80fa7afd7de63cb8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:45.470312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:45.503366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.519170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.641274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8', 'request_id': 'req-22ac6818-2301-40bf-952a-228911c08f48'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.657462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8', 'request_id': 'req-22ac6818-2301-40bf-952a-228911c08f48'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.757288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8', 'request_id': 'req-22ac6818-2301-40bf-952a-228911c08f48'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.775626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 92cc3bf38cd14f2e80fa7afd7de63cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:45.776191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.779941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.802871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8', 'request_id': 'req-22ac6818-2301-40bf-952a-228911c08f48'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.803785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8', 'request_id': 'req-22ac6818-2301-40bf-952a-228911c08f48'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.814141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '92cc3bf38cd14f2e80fa7afd7de63cb8', 'request_id': 'req-22ac6818-2301-40bf-952a-228911c08f48'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:45.835326 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1835/3663] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:45 2022] DELETE /identity/v3/domains/92cc3bf38cd14f2e80fa7afd7de63cb8 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:45.836737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:45.838446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:45.859600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac6c4-29d1-4319-b8f0-72da959558d6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:46.010876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:46.011529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:46.011815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:46.012098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:46.012774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:46.015329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:46.185840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:46.272224 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1829/3664] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:45 2022] POST /identity/v3/projects => generated 377 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:46.277270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:46.281230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:46.306253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac6818-2301-40bf-952a-228911c08f48 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:46.317959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:46.425114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:46.425114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:46.425368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:46.425855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/f7c451bc069a487bbf3927178fc0e589` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:46.427429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=f7c451bc069a487bbf3927178fc0e589)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:46.430242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:46.435830 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1836/3665] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:46 2022] GET /identity/v3/projects/f7c451bc069a487bbf3927178fc0e589 => generated 377 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:46.438502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:46.469364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079830c1-1e65-4b36-8cb8-78712e5e9104 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:46.477845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:46.478778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:46.479186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:46.479562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:46.480899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:46.483293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:46.509306 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1830/3666] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:38:46 2022] GET /identity/v3/projects => generated 6969 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:46.513682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:46.528947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665735a-e81f-42f9-bedb-a36b534354a3 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:46.535494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:46.541678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:46.541977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:46.542293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/f7c451bc069a487bbf3927178fc0e589` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:46.543951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7c451bc069a487bbf3927178fc0e589)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:46.546305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:46.755540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c451bc069a487bbf3927178fc0e589', 'request_id': 'req-6539a8e4-8e40-426b-a552-9c341fa436f7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:46.776466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c451bc069a487bbf3927178fc0e589', 'request_id': 'req-6539a8e4-8e40-426b-a552-9c341fa436f7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:46.919850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c451bc069a487bbf3927178fc0e589', 'request_id': 'req-6539a8e4-8e40-426b-a552-9c341fa436f7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:46.939671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project f7c451bc069a487bbf3927178fc0e589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:46.946283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:46.950293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:46.954719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1837/3667] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:46 2022] DELETE /identity/v3/projects/f7c451bc069a487bbf3927178fc0e589 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:46.958464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:46.960627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:46.996500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8ad96-6011-4beb-9acd-4b32e963b72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:47.085621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:47.086210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:47.086495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:47.086771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:47.087425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:47.091226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:47.242572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:47.244967 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1831/3668] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:38:46 2022] POST /identity/v3/projects => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:47.258661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a8e4-8e40-426b-a552-9c341fa436f7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:47.394147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:47.394814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:47.395112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:47.395372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/3678f863510e46b992c25c3aed5b063d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:47.398697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:update_project(project_id=3678f863510e46b992c25c3aed5b063d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:47.402009 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:47.402009 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:47.402009 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:47.403902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:47.503525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:47.558987 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1838/3669] 10.222.0.27 () {60 vars in 1252 bytes} [Tue Oct 18 13:38:47 2022] PATCH /identity/v3/projects/3678f863510e46b992c25c3aed5b063d => generated 361 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:38:47.563184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:47.579591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73b285-674d-4c85-bd0d-d01170236df6 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:47.590528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:47.591421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:47.591867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:47.592957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/3678f863510e46b992c25c3aed5b063d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:47.620831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=3678f863510e46b992c25c3aed5b063d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:47.623101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:47.632697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:47.648847 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1832/3670] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:47 2022] GET /identity/v3/projects/3678f863510e46b992c25c3aed5b063d => generated 348 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:47.649315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0db63c-b1b5-4084-bfff-7d5a14819f50 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:47.662981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:47.663782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:47.664233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:47.664519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/3678f863510e46b992c25c3aed5b063d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:47.665711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3678f863510e46b992c25c3aed5b063d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:47.667667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:47.923608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3678f863510e46b992c25c3aed5b063d', 'request_id': 'req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:47.941721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3678f863510e46b992c25c3aed5b063d', 'request_id': 'req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:48.059753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3678f863510e46b992c25c3aed5b063d', 'request_id': 'req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:48.071384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 3678f863510e46b992c25c3aed5b063d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:48.071683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:48.072354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:48.078220 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1839/3671] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:47 2022] DELETE /identity/v3/projects/3678f863510e46b992c25c3aed5b063d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:48.079110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:48.082260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:48.101869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b099-f3a3-4051-95a0-ff600b8e6649 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:48.178948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:48.179948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:48.180469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:48.182480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:48.184076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:48.186468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:48.329252 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1833/3672] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:48 2022] POST /identity/v3/projects => generated 361 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:48.333286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:48.349003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0936-2fe4-4d98-9b63-1f7b03bbf72f tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:48.484854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:48.485512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:48.485797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:48.486092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/41b8ca47125f40dcabc101c1b1705a38` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:48.493102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:48.493268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:update_project(project_id=41b8ca47125f40dcabc101c1b1705a38)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:48.495746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:48.636101 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1840/3673] 10.222.0.27 () {60 vars in 1252 bytes} [Tue Oct 18 13:38:48 2022] PATCH /identity/v3/projects/41b8ca47125f40dcabc101c1b1705a38 => generated 373 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:48.636707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:48.658392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30215f20-1212-44e8-a526-f9ee5c90b0bd tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:48.664820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:48.665626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:48.665850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:48.666152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/41b8ca47125f40dcabc101c1b1705a38` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:48.696563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=41b8ca47125f40dcabc101c1b1705a38)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:48.699844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:48.702902 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1834/3674] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:48 2022] GET /identity/v3/projects/41b8ca47125f40dcabc101c1b1705a38 => generated 360 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:48.707162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:48.735940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd412ac5-0a40-4f48-8d4d-6be6e71f99f2 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:48.742726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:48.743646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:48.745465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:48.745465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/41b8ca47125f40dcabc101c1b1705a38` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:48.746490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41b8ca47125f40dcabc101c1b1705a38)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:48.750117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:48.909014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b8ca47125f40dcabc101c1b1705a38', 'request_id': 'req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:48.921403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b8ca47125f40dcabc101c1b1705a38', 'request_id': 'req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:49.039803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b8ca47125f40dcabc101c1b1705a38', 'request_id': 'req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:49.057125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project 41b8ca47125f40dcabc101c1b1705a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:49.057552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:49.058755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:49.064275 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1841/3675] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:48 2022] DELETE /identity/v3/projects/41b8ca47125f40dcabc101c1b1705a38 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:49.065755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:49.068237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:49.082592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb6f6-3908-4325-bf0d-efcc5fe24394 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:49.176792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:49.176792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:49.177402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:49.177776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:49.178662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:49.181054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:49.335500 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1835/3676] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:49 2022] POST /identity/v3/projects => generated 355 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:49.337129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:49.351801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bfdea-b31a-4b00-88c4-cec5ee001cb7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:49.443129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:49.444038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:49.445178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:49.445637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/b62d2938a3ee4e268bbcef8e9c7d146f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:49.447348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:update_project(project_id=b62d2938a3ee4e268bbcef8e9c7d146f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:49.449598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:49.568128 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1842/3677] 10.222.0.27 () {60 vars in 1252 bytes} [Tue Oct 18 13:38:49 2022] PATCH /identity/v3/projects/b62d2938a3ee4e268bbcef8e9c7d146f => generated 369 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:49.568803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:49.581256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6138d7e-53fe-407a-91e1-b28bb12551fe tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:49.586552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:49.588254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:49.588254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:49.588254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/b62d2938a3ee4e268bbcef8e9c7d146f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:49.604412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:get_project(project_id=b62d2938a3ee4e268bbcef8e9c7d146f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:49.607264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:49.609850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:49.610868 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1836/3678] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:38:49 2022] GET /identity/v3/projects/b62d2938a3ee4e268bbcef8e9c7d146f => generated 356 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:49.615224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:49.629795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cf2a1-0efc-4014-a7f3-401cad905e86 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:49.635371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:49.636294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:49.636638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:49.644562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/projects/b62d2938a3ee4e268bbcef8e9c7d146f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:49.644562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b62d2938a3ee4e268bbcef8e9c7d146f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:49.644562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:49.796504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62d2938a3ee4e268bbcef8e9c7d146f', 'request_id': 'req-eb416596-97ac-4e39-aff4-d09759d9d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:49.805780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62d2938a3ee4e268bbcef8e9c7d146f', 'request_id': 'req-eb416596-97ac-4e39-aff4-d09759d9d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:49.946809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62d2938a3ee4e268bbcef8e9c7d146f', 'request_id': 'req-eb416596-97ac-4e39-aff4-d09759d9d94b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:49.990268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] The token cache is being invalidate because project b62d2938a3ee4e268bbcef8e9c7d146f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:49.993328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:50.010520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:50.018034 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1843/3679] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:49 2022] DELETE /identity/v3/projects/b62d2938a3ee4e268bbcef8e9c7d146f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:50.022433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:50.024823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:50.053866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbe80-518d-4cec-8de2-fb8e668ed8d7 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:50.224309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:50.227561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:50.228137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:50.228666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains/92cc3bf38cd14f2e80fa7afd7de63cb8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:50.243133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Could not find domain: 92cc3bf38cd14f2e80fa7afd7de63cb8.: keystone.exception.DomainNotFound: Could not find domain: 92cc3bf38cd14f2e80fa7afd7de63cb8. Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 92cc3bf38cd14f2e80fa7afd7de63cb8. Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:38:50.250830 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:38:50.258571 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 92cc3bf38cd14f2e80fa7afd7de63cb8. Oct 18 13:38:50.259789 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:38:50.261142 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1837/3680] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:38:50 2022] PATCH /identity/v3/domains/92cc3bf38cd14f2e80fa7afd7de63cb8 => generated 112 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:38:50.261274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:50.276687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb416596-97ac-4e39-aff4-d09759d9d94b tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:50.289298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5144ad-b7cb-4bc7-a92a-a94ed9e8201d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ff1a97e1f824b028d5df5d96a82090d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fea94e5d2e040dd9659e14889a3f521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:50.290118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5144ad-b7cb-4bc7-a92a-a94ed9e8201d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:50.290631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5144ad-b7cb-4bc7-a92a-a94ed9e8201d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:50.293487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5144ad-b7cb-4bc7-a92a-a94ed9e8201d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] PATH_INFO: `/v3/domains/166c51293ace467495195b06bc35d119` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:50.299163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5144ad-b7cb-4bc7-a92a-a94ed9e8201d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3f5144ad-b7cb-4bc7-a92a-a94ed9e8201d tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Could not find domain: 166c51293ace467495195b06bc35d119.: keystone.exception.DomainNotFound: Could not find domain: 166c51293ace467495195b06bc35d119. Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 166c51293ace467495195b06bc35d119. Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:38:50.314740 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:38:50.316061 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 166c51293ace467495195b06bc35d119. Oct 18 13:38:50.317253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:50.321677 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1844/3681] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:38:50 2022] PATCH /identity/v3/domains/166c51293ace467495195b06bc35d119 => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 13:38:50.325409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:50.327999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:50.465671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1626154-e019-4223-8ad4-50d3bd4aaba4 tempest-ProjectsTestJSON-975281095 tempest-ProjectsTestJSON-975281095-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:50.475337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:50.476528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:50.476953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:50.477387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] PATH_INFO: `/v3/users/479141e0b2bf42d1b19a51606d5e56b0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:50.478712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] RBAC: Authorizing `identity:delete_user(user_id=479141e0b2bf42d1b19a51606d5e56b0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:50.483959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:50.692853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479141e0b2bf42d1b19a51606d5e56b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:50.693614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479141e0b2bf42d1b19a51606d5e56b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:50.820144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479141e0b2bf42d1b19a51606d5e56b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:50.822177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479141e0b2bf42d1b19a51606d5e56b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:50.832810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479141e0b2bf42d1b19a51606d5e56b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:50.872640 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1838/3682] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:50 2022] DELETE /identity/v3/users/479141e0b2bf42d1b19a51606d5e56b0 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:50.872746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:50.872746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:50.872746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:50.890639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:50.892410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:50.892837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:50.976151 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1845/3683] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:50.990642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:50.990642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:51.063609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c0a18-2bc6-41d4-a32b-c702483a688f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:51.069644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:51.070377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:51.072956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:51.072956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:51.081893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:51.084135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:51.131743 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1839/3684] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:51.565763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:51.568267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:51.581916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd25bd-006e-440a-b7da-c8432379f0bd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:51.595005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:51.597213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:51.597786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:51.600156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] PATH_INFO: `/v3/users/a857437becf14392bd1332824d86111c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:51.601737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a857437becf14392bd1332824d86111c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:51.603960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:51.874596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a857437becf14392bd1332824d86111c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:51.882854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a857437becf14392bd1332824d86111c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:51.884060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a857437becf14392bd1332824d86111c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:51.902884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a857437becf14392bd1332824d86111c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:52.060169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a857437becf14392bd1332824d86111c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:52.069048 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1846/3685] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:51 2022] DELETE /identity/v3/users/a857437becf14392bd1332824d86111c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:52.086016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:52.401706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:52.413223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56942978-af49-4fd8-a685-a170a783f112 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:52.488644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:52.490583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:52.490871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:52.491147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] PATH_INFO: `/v3/projects/ef289ee4f9954fc1bceaee4b381c3d3b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:52.493262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef289ee4f9954fc1bceaee4b381c3d3b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:52.495288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:52.637556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:52.642936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'request_id': 'req-39aafb16-1814-4607-93e4-7923678e0c51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:52.645140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:52.652419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'request_id': 'req-39aafb16-1814-4607-93e4-7923678e0c51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:52.675148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb1e52-0b6f-47bd-b1b4-76892d7358b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:52.717980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef289ee4f9954fc1bceaee4b381c3d3b', 'request_id': 'req-39aafb16-1814-4607-93e4-7923678e0c51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:52.737926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] The token cache is being invalidate because project ef289ee4f9954fc1bceaee4b381c3d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:52.738497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:52.739364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39aafb16-1814-4607-93e4-7923678e0c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:52.742276 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1840/3686] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:52 2022] DELETE /identity/v3/projects/ef289ee4f9954fc1bceaee4b381c3d3b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:52.749951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c59b19-13d9-4171-806e-e4498b3358de None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:52.756246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c59b19-13d9-4171-806e-e4498b3358de None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:52.756246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c59b19-13d9-4171-806e-e4498b3358de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:52.756449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:52.756449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:52.756449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:52.756449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] PATH_INFO: `/v3/projects/d27d939df7464e73b50d24f85b180a4a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:52.757667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27d939df7464e73b50d24f85b180a4a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:52.760060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:52.776802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-93c59b19-13d9-4171-806e-e4498b3358de None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:52.778401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93c59b19-13d9-4171-806e-e4498b3358de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:52.792453 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1841/3687] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:52.800523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3835d-14b5-4f18-8141-9bf5f5109f1e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:52.800920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3835d-14b5-4f18-8141-9bf5f5109f1e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:52.801509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3835d-14b5-4f18-8141-9bf5f5109f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:52.823169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-28c3835d-14b5-4f18-8141-9bf5f5109f1e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:52.824532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28c3835d-14b5-4f18-8141-9bf5f5109f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:52.852523 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1842/3688] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:52.855146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3835d-14b5-4f18-8141-9bf5f5109f1e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:52.877344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3835d-14b5-4f18-8141-9bf5f5109f1e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:52.890959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:52.891591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:52.892475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:52.893191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:52.893726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:52.896032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:52.899472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:52.928513 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1843/3689] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:52.958082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:52.982455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27d939df7464e73b50d24f85b180a4a', 'request_id': 'req-e99fa3a5-29e1-4106-881e-90a9b57f89e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.005783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9ce8c-35fc-44fc-9182-a20653ef37f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:53.018244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27d939df7464e73b50d24f85b180a4a', 'request_id': 'req-e99fa3a5-29e1-4106-881e-90a9b57f89e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.097672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27d939df7464e73b50d24f85b180a4a', 'request_id': 'req-e99fa3a5-29e1-4106-881e-90a9b57f89e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.122498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] The token cache is being invalidate because project d27d939df7464e73b50d24f85b180a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:53.124093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.125011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.127190 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1847/3690] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:52 2022] DELETE /identity/v3/projects/d27d939df7464e73b50d24f85b180a4a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:53.134263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:53.134263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:53.154883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:53.158293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:53.158293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:53.158490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:53.158776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:53.159421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:53.162677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:53.252427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fa3a5-29e1-4106-881e-90a9b57f89e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:53.258879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:53.259870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:53.260573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:53.261058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] PATH_INFO: `/v3/users/6ff1a97e1f824b028d5df5d96a82090d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:53.262375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff1a97e1f824b028d5df5d96a82090d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:53.265913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:53.329232 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1844/3691] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:52 2022] POST /identity/v3/projects => generated 371 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:53.335565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:53.337824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:53.479313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79e4e-2f31-4b5f-85d0-fb615aa028ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:53.488229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:53.489279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:53.489799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:53.490340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:53.491499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:53.494899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:53.558309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff1a97e1f824b028d5df5d96a82090d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.570569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff1a97e1f824b028d5df5d96a82090d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.571706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff1a97e1f824b028d5df5d96a82090d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.596241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff1a97e1f824b028d5df5d96a82090d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.627012 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1845/3692] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:53 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:53.628463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:53.632696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:53.675771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff1a97e1f824b028d5df5d96a82090d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:53.715378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1848/3693] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:38:53 2022] DELETE /identity/v3/users/6ff1a97e1f824b028d5df5d96a82090d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:53.721485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:53.726303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:53.828836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056de726-151a-4829-be3d-5768ac52d746 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:53.882831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09cab8-2f3f-4e29-8a40-8e0e584791c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:53.894754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:53.895386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:53.895665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:53.895936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:53.896587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:53.899979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:53.931225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1849/3694] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:53.936623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:53.961070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775dd06-f916-4366-8dc0-397e89ef6c39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:53.964456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775dd06-f916-4366-8dc0-397e89ef6c39 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:53.964456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775dd06-f916-4366-8dc0-397e89ef6c39 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:53.964456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775dd06-f916-4366-8dc0-397e89ef6c39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:53.964725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f775dd06-f916-4366-8dc0-397e89ef6c39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:53.965361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb6b2-2c40-4d4c-983f-0f00dd464592 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:53.977286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:53.978197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:53.978552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:53.978900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:53.980107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:53.984979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:54.014870 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1850/3695] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:54.018743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:54.035217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428f5cb-fa6d-4bee-a85f-b6126a9ac1ca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:54.062764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:54.063618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:54.064482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:54.064482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] PATH_INFO: `/v3/projects/d8df77eeb5c845b7a0c2a0f8d9176ae7/users/7b04175119a54aa884d4210800594a5a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:54.093962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775dd06-f916-4366-8dc0-397e89ef6c39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:54.094692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775dd06-f916-4366-8dc0-397e89ef6c39 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:54.098624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8df77eeb5c845b7a0c2a0f8d9176ae7, user_id=7b04175119a54aa884d4210800594a5a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:54.103927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:54.117425 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1846/3696] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:54.211985 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1851/3697] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:54 2022] PUT /identity/v3/projects/d8df77eeb5c845b7a0c2a0f8d9176ae7/users/7b04175119a54aa884d4210800594a5a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:54.232084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d741-fd66-47c5-b017-0f61810b71aa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:54.232381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d741-fd66-47c5-b017-0f61810b71aa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:54.233552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d741-fd66-47c5-b017-0f61810b71aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:54.335043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bed9d741-fd66-47c5-b017-0f61810b71aa None None] MFA Rules not processed for user `7b04175119a54aa884d4210800594a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:54.337944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bed9d741-fd66-47c5-b017-0f61810b71aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:54.510087 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1847/3698] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:54.515435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:54.670549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5218c6-4f8e-4cb9-9f94-f3fa9b1aa739 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:54.684140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:54.684829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:54.685137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:54.685574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:54.686725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:54.689143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:54.703866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:54.876898 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1852/3699] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:54 2022] POST /identity/v3/projects => generated 371 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:54.881324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9d741-fd66-47c5-b017-0f61810b71aa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:54.903890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9d741-fd66-47c5-b017-0f61810b71aa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:54.931003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:54.933788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:55.058271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36254635-158b-486c-b2f2-e21c98e4691d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:55.061650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:55.069515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:55.072871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.072871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.072871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.076439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:55.079986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:55.080704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.080934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.081185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.081857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:55.084096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:55.219194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:55.225576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:55.240362 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1848/3700] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:54 2022] POST /identity/v3/users => generated 292 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:55.243649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:55.259523 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1853/3701] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:38:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:38:55.282240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e674645-0958-4fe4-a071-c42d1880016b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:55.301263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:55.301909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.302218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.302495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.303158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:55.304776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:55.337484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1849/3702] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:55.341792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:55.374413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996355-187f-41da-b555-f022a5954bee service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:55.380255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:55.381985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.381985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.381985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] PATH_INFO: `/v3/projects/80484a078561483885d3ad26f2d82552/users/96302a04764a47bba6baa40ba7935bdf/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.400893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:55.402848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:55.407633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80484a078561483885d3ad26f2d82552, user_id=96302a04764a47bba6baa40ba7935bdf, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:55.410860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:55.419234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6df6f2-2e6b-4dc3-81e1-f76fd8095151 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:55.425530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:55.428850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.428850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.428850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] PATH_INFO: `/v3/projects/7fea94e5d2e040dd9659e14889a3f521` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.428850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fea94e5d2e040dd9659e14889a3f521)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:55.431328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:55.506008 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1854/3703] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:55 2022] PUT /identity/v3/projects/80484a078561483885d3ad26f2d82552/users/96302a04764a47bba6baa40ba7935bdf/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:55.511894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:55.584434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fea94e5d2e040dd9659e14889a3f521', 'request_id': 'req-a0d3d696-322c-4755-b34f-d9344cf9cd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:55.606489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fea94e5d2e040dd9659e14889a3f521', 'request_id': 'req-a0d3d696-322c-4755-b34f-d9344cf9cd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:55.675755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7bd8c-fc15-4550-a308-16fdcb2cc785 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:55.726549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fea94e5d2e040dd9659e14889a3f521', 'request_id': 'req-a0d3d696-322c-4755-b34f-d9344cf9cd87'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:55.747851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] The token cache is being invalidate because project 7fea94e5d2e040dd9659e14889a3f521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:38:55.749183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:55.753058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a0d3d696-322c-4755-b34f-d9344cf9cd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:55.760567 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1850/3704] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:55 2022] DELETE /identity/v3/projects/7fea94e5d2e040dd9659e14889a3f521 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:55.762351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6710b-5646-4a61-803d-720050bb2688 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.762640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6710b-5646-4a61-803d-720050bb2688 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.762919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6710b-5646-4a61-803d-720050bb2688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.809073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:55.809468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.809750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.813546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.813546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:55.813546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:55.822716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57a6710b-5646-4a61-803d-720050bb2688 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:55.824087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57a6710b-5646-4a61-803d-720050bb2688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:55.833359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1855/3705] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:55.837679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:55.839736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:55.851382 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1851/3706] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:55.860993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfabac-1a9d-4c93-aaac-30e09f18f3c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.861278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfabac-1a9d-4c93-aaac-30e09f18f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.861726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfabac-1a9d-4c93-aaac-30e09f18f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.865125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b7b37-7486-4847-bfe2-d1ce3a7deb71 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:55.875979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190370a-a845-43ed-8ea7-7025fec1bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:55.877078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190370a-a845-43ed-8ea7-7025fec1bd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.877727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190370a-a845-43ed-8ea7-7025fec1bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.878560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190370a-a845-43ed-8ea7-7025fec1bd72 admin admin] PATH_INFO: `/v3/projects/80484a078561483885d3ad26f2d82552/users/96302a04764a47bba6baa40ba7935bdf/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:55.898306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190370a-a845-43ed-8ea7-7025fec1bd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80484a078561483885d3ad26f2d82552, user_id=96302a04764a47bba6baa40ba7935bdf, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:55.898306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190370a-a845-43ed-8ea7-7025fec1bd72 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:55.906220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9dfabac-1a9d-4c93-aaac-30e09f18f3c6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:55.906674 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1856/3707] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:55 2022] PUT /identity/v3/projects/80484a078561483885d3ad26f2d82552/users/96302a04764a47bba6baa40ba7935bdf/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:55.907470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9dfabac-1a9d-4c93-aaac-30e09f18f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:55.931644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97c4e-c79f-4447-a201-55ab5e596efd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:55.932162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97c4e-c79f-4447-a201-55ab5e596efd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:55.932814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97c4e-c79f-4447-a201-55ab5e596efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.008843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2cd97c4e-c79f-4447-a201-55ab5e596efd None None] MFA Rules not processed for user `96302a04764a47bba6baa40ba7935bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:56.013590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2cd97c4e-c79f-4447-a201-55ab5e596efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:56.074618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1852/3708] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:56.082556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfabac-1a9d-4c93-aaac-30e09f18f3c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.107307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfabac-1a9d-4c93-aaac-30e09f18f3c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.123934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.125341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.127735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:56.135060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.135060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.135060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:56.135060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.135060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.167271 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1857/3709] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:56.173089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97c4e-c79f-4447-a201-55ab5e596efd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.178691 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1853/3710] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:56.179777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.193102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97c4e-c79f-4447-a201-55ab5e596efd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.194278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32bf39-0cb1-4d89-b184-a4526f9c676e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.200575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.201331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.201663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.202378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.203180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.204935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.205590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.206449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.206916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.207253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.208601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.210869 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:56.210869 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:56.210869 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:56.212234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.332882 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1858/3711] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:56 2022] POST /identity/v3/services => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:56.334030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.359659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffff35-afdf-4937-bd90-683b7349c1ab tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.365176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.365949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.366334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.366618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.367452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.370343 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:56.370343 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:56.370343 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:56.371275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.384374 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1854/3712] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:56 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:56.389235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.514292 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1502301748. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:38:56.514292 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:38:56.514292 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:56.524242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1014b79-7b3d-4746-9317-b9895d538871 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.550752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.551631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.552260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.552516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.554028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.556962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.675473 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1859/3713] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:38:56 2022] POST /identity/v3/endpoints => generated 360 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:56.685370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.727064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabdbf4-6c33-4867-8fd4-c142eaf0e867 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.751081 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1855/3714] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:56 2022] POST /identity/v3/users => generated 286 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:56.756025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.792441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37b0b-db10-449d-9783-d9d97fa053b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.835511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:56.840133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.840976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.841262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.841536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.842251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.844183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.873778 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1856/3715] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:56.873974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.874915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.877674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.878474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.878666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-1502301748` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.879483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1502301748)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.884832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.895365 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1860/3716] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:38:56 2022] GET /identity/v3/regions/tempest-region-1502301748 => generated 180 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:56.895547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df2258-de99-457d-ac64-1f38604e480d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.896596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.913131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.913764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.914041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.914346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.915002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.916592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.938859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75d81f-d0c2-4f12-b0ea-b18a17d96880 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.939557 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1857/3717] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:38:56.943855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:56.948052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.949275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.949632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.950332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:56.952423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:56.954871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:56.968823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68213cd-7169-4613-ad95-589f744fbd47 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:56.979715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef3fc0-7d2e-4e1c-ba58-00d295f6465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:56.980443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3fc0-7d2e-4e1c-ba58-00d295f6465f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:56.980805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3fc0-7d2e-4e1c-ba58-00d295f6465f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:56.980938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3fc0-7d2e-4e1c-ba58-00d295f6465f admin admin] PATH_INFO: `/v3/projects/21c685fe95cb492eaa9afe81ae14ce57/users/4a3851837bd34f539d31d83acc1be81a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.015370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3fc0-7d2e-4e1c-ba58-00d295f6465f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c685fe95cb492eaa9afe81ae14ce57, user_id=4a3851837bd34f539d31d83acc1be81a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:57.018097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3fc0-7d2e-4e1c-ba58-00d295f6465f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:57.070457 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1861/3718] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:56 2022] POST /identity/v3/services => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:57.073037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:57.128723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb29a1-a93b-4efe-a5bb-1f10c1c2614b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:57.137484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1858/3719] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:56 2022] PUT /identity/v3/projects/21c685fe95cb492eaa9afe81ae14ce57/users/4a3851837bd34f539d31d83acc1be81a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:57.140394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de2c5-f872-4210-bfff-c761fdb3498e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:57.140930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de2c5-f872-4210-bfff-c761fdb3498e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:57.141436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de2c5-f872-4210-bfff-c761fdb3498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.197456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4f6de2c5-f872-4210-bfff-c761fdb3498e None None] MFA Rules not processed for user `4a3851837bd34f539d31d83acc1be81a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:57.198184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f6de2c5-f872-4210-bfff-c761fdb3498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:57.319303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:57.320556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:57.321094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:57.321593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.322542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:57.324410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:57.357092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1859/3720] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:57 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:57.360470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de2c5-f872-4210-bfff-c761fdb3498e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:57.469350 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-615400950. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:38:57.469350 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:38:57.469350 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:57.504495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de2c5-f872-4210-bfff-c761fdb3498e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:57.524770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:57.526572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:57.526718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:57.526962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.527898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:57.531329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:57.595414 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1862/3721] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:38:57 2022] POST /identity/v3/endpoints => generated 361 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:57.599254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:57.646914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a727a8-6f6a-4f70-948d-bcda8f0de094 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:57.658916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:57.659633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:57.659923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:57.660200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-615400950` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.660861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-615400950)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:57.661368 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1860/3722] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:57 2022] POST /identity/v3/projects => generated 371 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:57.662020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:57.664265 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1863/3723] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:38:57 2022] GET /identity/v3/regions/tempest-region-615400950 => generated 178 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:57.668273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:57.669500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:57.676575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:57.704549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b4c2-6698-41c4-8b8e-21454bfa233f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:57.795881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c2b3c-a354-4027-8cea-6845f23ce71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:57.796565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2b3c-a354-4027-8cea-6845f23ce71c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:57.797036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2b3c-a354-4027-8cea-6845f23ce71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:57.797319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2b3c-a354-4027-8cea-6845f23ce71c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.797976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c2b3c-a354-4027-8cea-6845f23ce71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:57.800654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c2b3c-a354-4027-8cea-6845f23ce71c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:57.839895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5984-ce71-4e67-83f5-c4de4d5eed87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:57.851049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:57.851049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:57.851049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:57.851332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.851332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:57.851332 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:57.851332 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:57.851332 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:57.851332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:57.949908 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1864/3724] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:57 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:57.951643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88a6b-6eb0-4a9a-bf63-5a0508b7f358 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:57.972809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88a6b-6eb0-4a9a-bf63-5a0508b7f358 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:57.972809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa88a6b-6eb0-4a9a-bf63-5a0508b7f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:57.987130 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-252695950. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:38:57.987130 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:38:57.987130 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:58.015190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7aa88a6b-6eb0-4a9a-bf63-5a0508b7f358 None None] MFA Rules not processed for user `658e3ac336ac4342bd204a74515fcd96`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:58.016968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7aa88a6b-6eb0-4a9a-bf63-5a0508b7f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:58.105958 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1861/3725] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:38:57 2022] POST /identity/v3/endpoints => generated 359 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:58.113935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.114103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1865/3726] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:57 2022] POST /identity/v3/auth/tokens => generated 3889 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:38:58.114103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa88a6b-6eb0-4a9a-bf63-5a0508b7f358 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.153243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7f66f-c0bc-4d6d-99d0-d4419f5f505f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.166394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.167025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.167307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.167582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.168623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.169849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.174650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa88a6b-6eb0-4a9a-bf63-5a0508b7f358 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.191556 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1862/3727] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:58.207111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.225436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.225719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.226009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.226319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-252695950` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.226985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-252695950)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.228084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.233661 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1866/3728] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:38:58 2022] GET /identity/v3/regions/tempest-region-252695950 => generated 178 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:58.237910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.249328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c7c63-4993-4586-a9d4-6beec53af3e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.260310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4525a06-ccf0-4aa4-a61f-d5b3a9cf7eb6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.264642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.265328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.265611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.265889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] PATH_INFO: `/v3/projects/6da91885d8ef4b5c9d02b81a33d4e09d/users/483b44dedcb740b190af4eede9f3377b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.268950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.270042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.270817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.271512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.273355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.275832 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:58.275832 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:58.275832 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:58.284863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.303335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1867/3729] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 18 13:38:58 2022] GET /identity/v3/endpoints => generated 4394 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:58.306717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da91885d8ef4b5c9d02b81a33d4e09d, user_id=483b44dedcb740b190af4eede9f3377b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.307211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.313445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.324963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e1432-b16b-4af8-998e-eb7468b99748 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.342365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.343291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.343291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.343497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints/7b52e4945af6400097cd8e8b001f2e02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.362284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=7b52e4945af6400097cd8e8b001f2e02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.362829 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:58.362829 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:58.362829 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:58.363628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.365350 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1868/3730] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:58 2022] GET /identity/v3/endpoints/7b52e4945af6400097cd8e8b001f2e02 => generated 359 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:38:58.369371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.391282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11e24-78da-4387-9d1a-e41e1c9f70bd tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.397840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.399380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.402017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.402840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints/7b52e4945af6400097cd8e8b001f2e02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.412861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7b52e4945af6400097cd8e8b001f2e02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.419299 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:58.419299 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:58.419299 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:58.422512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.424672 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1863/3731] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:58 2022] PUT /identity/v3/projects/6da91885d8ef4b5c9d02b81a33d4e09d/users/483b44dedcb740b190af4eede9f3377b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:58.433508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.524906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7b52e4945af6400097cd8e8b001f2e02', 'request_id': 'req-08385bc2-befe-46fb-96e1-a0ace1410eee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:38:58.547098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1869/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:58 2022] DELETE /identity/v3/endpoints/7b52e4945af6400097cd8e8b001f2e02 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:58.553917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.561328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f60af-f418-4b47-bbf2-37ced8197816 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.586371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.586371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.586371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.586371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.586799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.586799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.592490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385bc2-befe-46fb-96e1-a0ace1410eee tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.599211 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1864/3733] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:38:58.602918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.615678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9c33d-2b50-48c5-b9fa-7084611a7527 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.620781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3c93a-384e-42ea-bab2-cfc3d04018db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.621453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c93a-384e-42ea-bab2-cfc3d04018db admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.621730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c93a-384e-42ea-bab2-cfc3d04018db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.622005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3c93a-384e-42ea-bab2-cfc3d04018db admin admin] PATH_INFO: `/v3/projects/6da91885d8ef4b5c9d02b81a33d4e09d/users/483b44dedcb740b190af4eede9f3377b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.627682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3c93a-384e-42ea-bab2-cfc3d04018db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da91885d8ef4b5c9d02b81a33d4e09d, user_id=483b44dedcb740b190af4eede9f3377b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.631197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3c93a-384e-42ea-bab2-cfc3d04018db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.658313 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1865/3734] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:38:58 2022] PUT /identity/v3/projects/6da91885d8ef4b5c9d02b81a33d4e09d/users/483b44dedcb740b190af4eede9f3377b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:38:58.664757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3b68-e2e2-4270-b6a5-f8666bcc5fd9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.673589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3b68-e2e2-4270-b6a5-f8666bcc5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.673589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3b68-e2e2-4270-b6a5-f8666bcc5fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.723077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-62ba3b68-e2e2-4270-b6a5-f8666bcc5fd9 None None] MFA Rules not processed for user `483b44dedcb740b190af4eede9f3377b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:38:58.725162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-62ba3b68-e2e2-4270-b6a5-f8666bcc5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:38:58.731925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.733429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.733809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.734201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.735566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.741165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.761734 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1870/3735] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 18 13:38:58 2022] GET /identity/v3/endpoints => generated 4048 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:58.771408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.812522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238dd6f-d8e8-4aef-918d-2902cdf04e28 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.904084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.905273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.905757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.906034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints/7b52e4945af6400097cd8e8b001f2e02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.914297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Could not find endpoint: 7b52e4945af6400097cd8e8b001f2e02.: keystone.exception.EndpointNotFound: Could not find endpoint: 7b52e4945af6400097cd8e8b001f2e02. Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:38:58.940479 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 7b52e4945af6400097cd8e8b001f2e02. Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:38:58.941705 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:38:58.942838 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 7b52e4945af6400097cd8e8b001f2e02. Oct 18 13:38:58.943934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:38:58.946918 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1866/3736] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:38:58 2022] POST /identity/v3/auth/tokens => generated 3946 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:38:58.948221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1871/3737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:58 2022] DELETE /identity/v3/endpoints/7b52e4945af6400097cd8e8b001f2e02 => generated 114 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:38:58.952800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.954917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba3b68-e2e2-4270-b6a5-f8666bcc5fd9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:58.968309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7042a74-52cc-4d65-8fbb-c89155fd4816 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.974227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba3b68-e2e2-4270-b6a5-f8666bcc5fd9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:58.982234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483b44dedcb740b190af4eede9f3377b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da91885d8ef4b5c9d02b81a33d4e09d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.982952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:58.983759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.984096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.984288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:58.984502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-252695950` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.984939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:58.985232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-252695950)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.985601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:58.986690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:58.987088 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:58.987088 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:38:58.987088 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:58.988099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:58.990218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.119298 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-252695950. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:38:59.119298 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:38:59.119298 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:38:59.128234 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1872/3738] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:38:58 2022] DELETE /identity/v3/regions/tempest-region-252695950 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:38:59.136044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.149638 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1867/3739] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:58 2022] POST /identity/v3/projects => generated 359 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:59.157010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.161633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c9485-d7a8-46dc-8b59-8f4366a51af4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.252505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.253133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.253419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.253696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.257646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.260176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.275007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b6449-0662-4384-a149-368198b490dd tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.303163 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1873/3740] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 18 13:38:59 2022] GET /identity/v3/endpoints => generated 4048 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:59.310112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.332099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483b44dedcb740b190af4eede9f3377b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da91885d8ef4b5c9d02b81a33d4e09d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.332732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.343281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.343281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.343781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd85dd-764b-43b4-a253-7771a2b2d428 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.344208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.344208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.350158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.350783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.351071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.351350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.352017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Adding query filter params (service_id=93837ad182dc42d696d4b2bdeb982c0e) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:59.352326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.353930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.382192 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1874/3741] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:38:59 2022] GET /identity/v3/endpoints?service_id=93837ad182dc42d696d4b2bdeb982c0e => generated 502 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:59.385799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.397604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14918e-dbd3-4d17-980d-2c44e5cc27a5 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.402672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.403978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.404333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.405117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.405778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Adding query filter params (service_id=4e8ca7952818430fbb2b124d166a49fc) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:59.406107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.407777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.413892 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1875/3742] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:38:59 2022] GET /identity/v3/endpoints?service_id=4e8ca7952818430fbb2b124d166a49fc => generated 503 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:38:59.417493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.428546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a46ca0-f4d9-430c-abab-a2346f03a6a2 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.455075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.455870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.455989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.456266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.456935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:59.457251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.458955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.473660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:59.481215 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1876/3743] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 18 13:38:59 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:59.485262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.506864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67257134-a07a-4855-9f6c-166e1d6770f7 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.518675 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1868/3744] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:38:59 2022] POST /identity/v3/users => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:38:59.519592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.520428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.520982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.521431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.522325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:59.523047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.523542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.525326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.558606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa171bb3-c6e2-43cd-bca2-2135633c5f6c tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.559259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1877/3745] 10.222.0.27 () {58 vars in 1171 bytes} [Tue Oct 18 13:38:59 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:38:59.567014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.574771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483b44dedcb740b190af4eede9f3377b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da91885d8ef4b5c9d02b81a33d4e09d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.575620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.576808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.577303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.578518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:38:59.579030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.581749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c1a0e-93aa-491c-9f36-bb9452900351 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.586039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.597111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.597364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.597647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.597926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.598707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.601768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.690110 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1869/3746] 10.222.0.27 () {58 vars in 1157 bytes} [Tue Oct 18 13:38:59 2022] GET /identity/v3/users?domain_id=default => generated 8596 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:38:59.694601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.696263 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1878/3747] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:38:59 2022] POST /identity/v3/services => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:38:59.700180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:38:59.730755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:59.743173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd86ca-b0b6-4997-babe-5812b6fdc26f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.768756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd35ec2-da06-472f-8c8a-73feca439b4e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:38:59.785051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.785717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.786003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.786316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.786997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.788612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.796465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483b44dedcb740b190af4eede9f3377b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da91885d8ef4b5c9d02b81a33d4e09d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:38:59.798308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:38:59.799786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:38:59.800411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] PATH_INFO: `/v3/users/50435ceca3d746609cd75e671798d4a5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:38:59.849152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorizing `identity:update_user(user_id=50435ceca3d746609cd75e671798d4a5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:38:59.851401 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:38:59.851401 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:38:59.851401 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:38:59.852758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:38:59.930677 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1934134193. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:38:59.930677 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:38:59.930677 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:00.008373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '50435ceca3d746609cd75e671798d4a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.064294 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1879/3748] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:38:59 2022] POST /identity/v3/endpoints => generated 361 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:00.069189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:00.148512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84134876-bc65-45fb-93ab-60a10575e02c tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:00.160229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:00.160838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invalidating the token cache because user 50435ceca3d746609cd75e671798d4a5 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:00.161372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.161752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:00.162226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-091e9da5-1004-45cb-aa40-2f0b78276c96 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.166954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:00.166954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-1934134193` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:00.167168 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1870/3749] 10.222.0.27 () {60 vars in 1244 bytes} [Tue Oct 18 13:38:59 2022] PATCH /identity/v3/users/50435ceca3d746609cd75e671798d4a5 => generated 488 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:00.167271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1934134193)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:00.170084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:00.170694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:00.171056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:00.175128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:00.181474 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1880/3750] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:39:00 2022] GET /identity/v3/regions/tempest-region-1934134193 => generated 180 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:00.186130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:00.188237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:00.229020 n-d-858383-13 devstack@keystone.service[82161]: WARNING keystone.auth.plugins.core [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] User is disabled: 50435ceca3d746609cd75e671798d4a5: AssertionError: User is disabled: 50435ceca3d746609cd75e671798d4a5 Oct 18 13:39:00.238188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570dd3f-e496-49af-b180-d8b724c80ae6 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:00.242476 n-d-858383-13 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 13:39:00.250312 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1871/3751] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 81 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 18 13:39:00.255708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:00.274956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:00.276731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:00.284445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:00.285155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:00.286628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints/96e4cb50ae094b4db0fbcad92422540b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:00.310706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=96e4cb50ae094b4db0fbcad92422540b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:00.326773 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:00.326773 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:00.326773 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:00.326773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:00.362497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb276-bd9d-4335-972e-4d4f0a41ed44 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:00.379035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483b44dedcb740b190af4eede9f3377b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da91885d8ef4b5c9d02b81a33d4e09d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:00.379902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:00.380295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:00.380683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] PATH_INFO: `/v3/users/50435ceca3d746609cd75e671798d4a5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:00.403273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorizing `identity:delete_user(user_id=50435ceca3d746609cd75e671798d4a5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:00.405765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:00.475832 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1996323900. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:39:00.475832 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:39:00.475832 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:00.732540 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1881/3752] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Oct 18 13:39:00 2022] PATCH /identity/v3/endpoints/96e4cb50ae094b4db0fbcad92422540b => generated 364 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:00.734625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:00.735629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50435ceca3d746609cd75e671798d4a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.736680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50435ceca3d746609cd75e671798d4a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.799761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a71a-9c0c-464b-b9ff-7c7c38b36562 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:00.818282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:00.818282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:00.818282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:00.818615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-1996323900` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:00.818615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1996323900)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:00.818615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:00.818615 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1882/3753] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:39:00 2022] GET /identity/v3/regions/tempest-region-1996323900 => generated 180 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:00.820072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:00.822220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:00.837785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f834-11f4-4f8e-9bf7-c077a99e49ca tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:00.843751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:00.844901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:00.845032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:00.845367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints/96e4cb50ae094b4db0fbcad92422540b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:00.865775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=96e4cb50ae094b4db0fbcad92422540b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:00.869229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:00.871750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50435ceca3d746609cd75e671798d4a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.872396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50435ceca3d746609cd75e671798d4a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.893108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50435ceca3d746609cd75e671798d4a5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:00.946537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1872/3754] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:00 2022] DELETE /identity/v3/users/50435ceca3d746609cd75e671798d4a5 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:00.949686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:00.951153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:01.023486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '96e4cb50ae094b4db0fbcad92422540b', 'request_id': 'req-4d557270-25a1-4a35-95e9-aeaaf17e628f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:01.043167 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1883/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:00 2022] DELETE /identity/v3/endpoints/96e4cb50ae094b4db0fbcad92422540b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:01.043167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:01.084871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:01.105426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d557270-25a1-4a35-95e9-aeaaf17e628f tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:01.145188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf035-8096-43da-818d-8d8e29f4b036 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:01.186757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483b44dedcb740b190af4eede9f3377b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da91885d8ef4b5c9d02b81a33d4e09d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:01.186757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:01.186757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:01.187135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] PATH_INFO: `/v3/projects/56899858bafc4aabb2ea52556a2f2153` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:01.187135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56899858bafc4aabb2ea52556a2f2153)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:01.187135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:01.283597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:01.285155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:01.286470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:01.287038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-1996323900` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:01.289419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1996323900)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:01.292378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:01.349969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56899858bafc4aabb2ea52556a2f2153', 'request_id': 'req-6cf23f4c-52dd-4002-95cc-ede8448c688f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:01.360972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56899858bafc4aabb2ea52556a2f2153', 'request_id': 'req-6cf23f4c-52dd-4002-95cc-ede8448c688f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:01.440512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56899858bafc4aabb2ea52556a2f2153', 'request_id': 'req-6cf23f4c-52dd-4002-95cc-ede8448c688f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:01.441840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:01.463272 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1884/3756] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:39:01 2022] DELETE /identity/v3/regions/tempest-region-1996323900 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:01.466413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:01.479933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] The token cache is being invalidate because project 56899858bafc4aabb2ea52556a2f2153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:01.479933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:01.481671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:01.489592 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1873/3757] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:00 2022] DELETE /identity/v3/projects/56899858bafc4aabb2ea52556a2f2153 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:01.495793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:01.499210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:01.523608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528acbc-686e-47c0-b5ff-ecc8cf555e37 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:01.693264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23f4c-52dd-4002-95cc-ede8448c688f tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:01.698697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:01.699560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:01.699717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:01.699882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-1934134193` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:01.700741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1934134193)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:01.703011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:01.731939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '483b44dedcb740b190af4eede9f3377b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6da91885d8ef4b5c9d02b81a33d4e09d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:01.732609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:01.733066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:01.734226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:01.734881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:01.737007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Could not find domain: 04ab78bf2bfa43f2b5aeb73f9aee59fa.: keystone.exception.DomainNotFound: Could not find domain: 04ab78bf2bfa43f2b5aeb73f9aee59fa. Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 04ab78bf2bfa43f2b5aeb73f9aee59fa. Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:39:01.754165 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:39:01.755423 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:39:01.756740 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:39:01.758472 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:39:01.758472 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:39:01.758472 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 04ab78bf2bfa43f2b5aeb73f9aee59fa. Oct 18 13:39:01.758472 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:39:01.771143 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1874/3758] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:01 2022] POST /identity/v3/users => generated 112 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:39:01.772765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:01.784655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:01.820130 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1885/3759] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:39:01 2022] DELETE /identity/v3/regions/tempest-region-1934134193 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:01.830730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:01.838770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:01.903770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1f0a8-a663-4cc3-8103-a6e56a8b16f4 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:01.913492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:01.916143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:01.916947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:01.917282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/services/1f28a03a434d4e7c82e326b2f3bbec53` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:01.919701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1f28a03a434d4e7c82e326b2f3bbec53)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:01.920819 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:01.920819 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:01.920819 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:01.928066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:02.009725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dde573-8a77-4918-9d49-4550d1dabef4 tempest-UsersNegativeTest-1303894684 tempest-UsersNegativeTest-1303894684-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:02.045530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:02.046197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:02.046477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:02.046748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] PATH_INFO: `/v3/users/4a3851837bd34f539d31d83acc1be81a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:02.047890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3851837bd34f539d31d83acc1be81a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:02.052038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:02.066462 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1886/3760] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:01 2022] DELETE /identity/v3/services/1f28a03a434d4e7c82e326b2f3bbec53 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:02.067224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:02.139936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549af5e7-275d-47e3-acb3-8206362a978e tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:02.159900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:02.160336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:02.160828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:02.161115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints/e59734de652343a4ab2589405fd238fe` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:02.179855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e59734de652343a4ab2589405fd238fe)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:02.181531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:02.324944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e59734de652343a4ab2589405fd238fe', 'request_id': 'req-1bbcf762-d5e3-4042-9b15-c2a6365642af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:02.344410 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1887/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:02 2022] DELETE /identity/v3/endpoints/e59734de652343a4ab2589405fd238fe => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:02.348607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:02.400290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcf762-d5e3-4042-9b15-c2a6365642af tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:02.401000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3851837bd34f539d31d83acc1be81a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:02.403570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3851837bd34f539d31d83acc1be81a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:02.415260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:02.415979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:02.416272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:02.416554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-615400950` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:02.417153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-615400950)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:02.419263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:02.522773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3851837bd34f539d31d83acc1be81a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:02.529401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3851837bd34f539d31d83acc1be81a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:02.531655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d18936ac-111e-4866-8b19-b8cb081d8b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3851837bd34f539d31d83acc1be81a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:02.569320 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1875/3762] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:01 2022] DELETE /identity/v3/users/4a3851837bd34f539d31d83acc1be81a => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:02.578198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:02.579174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:02.579456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:02.579729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:02.584589 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1888/3763] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:39:02 2022] DELETE /identity/v3/regions/tempest-region-615400950 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:02.585542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:02.601626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:02.614965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:02.616153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:02.731716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8fab5-b9d7-43a2-bc84-f7782781210a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:02.947731 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1876/3764] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:02 2022] POST /identity/v3/auth/tokens => generated 3687 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:03.035304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:03.036857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:03.071013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:03.071811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:03.071932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:03.072190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/services/4e8ca7952818430fbb2b124d166a49fc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:03.072785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4e8ca7952818430fbb2b124d166a49fc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:03.074476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:03.196369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9da729-da8f-4073-8e63-31abc7b22c00 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:03.200937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:03.207541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:03.207685 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1889/3765] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:02 2022] DELETE /identity/v3/services/4e8ca7952818430fbb2b124d166a49fc => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:03.207685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:03.207913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:03.207913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:03.234956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:03.245899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:03.260113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71addc7b-dc0f-44ab-9bab-880de23bd307 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:03.267309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:03.269861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:03.270205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:03.270489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:03.273529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1877/3766] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:03 2022] GET /identity/v3/auth/tokens => generated 3687 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:03.274455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:03.286512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:03.326864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c079504-bfdf-48f6-a1dc-e70b0783a484 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:03.367661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:03.368083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:03.368461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:03.369137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/endpoints/69442c6a387743d59105471eba7534a6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:03.387187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=69442c6a387743d59105471eba7534a6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:03.388231 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:03.388231 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:39:03.388231 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:39:03.389948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:03.479225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '69442c6a387743d59105471eba7534a6', 'request_id': 'req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:03.484520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:03.492771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:03.496001 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1878/3767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:03 2022] DELETE /identity/v3/endpoints/69442c6a387743d59105471eba7534a6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:03.501360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:03.549915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfd099-4dbe-4013-ae1b-7c18ae2fa91a tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:03.550794 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1890/3768] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:03 2022] GET /identity/v3/auth/tokens => generated 3504 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:03.557257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:03.558326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:03.559577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:03.560183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/regions/tempest-region-1502301748` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:03.566156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1502301748)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:03.566156 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:03.566156 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:39:03.566156 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:39:03.566156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:03.685451 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1502301748. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:39:03.685451 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:39:03.685451 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:39:03.718502 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1879/3769] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:39:03 2022] DELETE /identity/v3/regions/tempest-region-1502301748 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:03.722558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:03.752663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01eb4-ea1d-4f9f-840f-c2fab2183ce8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:03.803602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96302a04764a47bba6baa40ba7935bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80484a078561483885d3ad26f2d82552', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:03.804761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:03.805986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:03.807680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] PATH_INFO: `/v3/services/93837ad182dc42d696d4b2bdeb982c0e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:03.808584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorizing `identity:delete_service(service_id=93837ad182dc42d696d4b2bdeb982c0e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:03.814216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:03.894794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:04.012822 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1891/3770] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:03 2022] DELETE /identity/v3/services/93837ad182dc42d696d4b2bdeb982c0e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:04.017304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:04.019570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:04.084530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93041d4-45f1-4c07-aad3-13efa73ff223 tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:04.089489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:04.092528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:04.133895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:04.134809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:04.135268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:04.135700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] PATH_INFO: `/v3/users/7b04175119a54aa884d4210800594a5a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:04.139771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b04175119a54aa884d4210800594a5a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:04.141878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:04.154006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215620c-e2f8-44d1-9e12-774a43d7346b tempest-EndPointsTestJSON-1802597361 tempest-EndPointsTestJSON-1802597361-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:04.169911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:04.170795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:04.171082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:04.171362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] PATH_INFO: `/v3/users/677fe6a60f0742b3820c41beccc07d11` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:04.175885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677fe6a60f0742b3820c41beccc07d11)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:04.193979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:04.412636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b04175119a54aa884d4210800594a5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.413672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b04175119a54aa884d4210800594a5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.500078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677fe6a60f0742b3820c41beccc07d11'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.506373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b04175119a54aa884d4210800594a5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.508837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b04175119a54aa884d4210800594a5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.517562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677fe6a60f0742b3820c41beccc07d11'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.518384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677fe6a60f0742b3820c41beccc07d11'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.522800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cede321c-5904-429d-ab22-47d73518f312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b04175119a54aa884d4210800594a5a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.553478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677fe6a60f0742b3820c41beccc07d11'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.593730 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1880/3771] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:04 2022] DELETE /identity/v3/users/7b04175119a54aa884d4210800594a5a => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:04.593730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:04.593730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:04.593730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:04.657894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677fe6a60f0742b3820c41beccc07d11'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:04.665319 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1892/3772] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:04 2022] DELETE /identity/v3/users/677fe6a60f0742b3820c41beccc07d11 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:04.666211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:04.667575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:04.687306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:04.704268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:04.862293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393b1c3-be8a-4fd4-aa61-47b7fdc27c18 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:04.873776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:04.875323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:04.875470 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1881/3773] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:04.875732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:04.876141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] PATH_INFO: `/v3/projects/21c685fe95cb492eaa9afe81ae14ce57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:04.879414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c685fe95cb492eaa9afe81ae14ce57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:04.882395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:04.934205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:04.936848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:04.994297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:05.103279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c685fe95cb492eaa9afe81ae14ce57', 'request_id': 'req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.117743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c685fe95cb492eaa9afe81ae14ce57', 'request_id': 'req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.188276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf4c0a-50a4-4458-baec-514907056f82 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:05.211718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c685fe95cb492eaa9afe81ae14ce57', 'request_id': 'req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.228669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] The token cache is being invalidate because project 21c685fe95cb492eaa9afe81ae14ce57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:05.229108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.230085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a6bd1b6c-8779-4f51-be86-a93c3348a9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.231983 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1893/3774] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:04 2022] DELETE /identity/v3/projects/21c685fe95cb492eaa9afe81ae14ce57 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:05.234149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:05.234731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:05.235166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:05.264882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] MFA Rules not processed for user `97fcf7685853432ab0173f0cfac41863`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:05.266377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:05.289761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:05.290609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:05.290965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:05.291323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:05.299951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:05.423210 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1894/3775] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:05.424116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:05.430041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:05.478561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:05.480013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:05.505615 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1882/3776] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:39:05.508227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:05.511957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:05.540586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5ea14-c2c3-420f-ae1b-7ace8c11e1c7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:05.556815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:05.558981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:05.559263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:05.559541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] PATH_INFO: `/v3/projects/b3f57afe938f4118aed9e3b1f6b2bcdc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:05.562787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f57afe938f4118aed9e3b1f6b2bcdc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:05.569830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:05.590449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f692f-e5b4-418c-be9d-650144ebd380 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:05.601787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:05.602577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:05.607917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:05.612797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] PATH_INFO: `/v3/users/483b44dedcb740b190af4eede9f3377b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:05.614171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483b44dedcb740b190af4eede9f3377b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:05.616540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:05.657648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:05.924072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483b44dedcb740b190af4eede9f3377b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.926652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'request_id': 'req-720a766f-f397-425c-8549-5627b6384c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.941134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483b44dedcb740b190af4eede9f3377b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.943737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483b44dedcb740b190af4eede9f3377b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.947331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'request_id': 'req-720a766f-f397-425c-8549-5627b6384c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:05.973399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483b44dedcb740b190af4eede9f3377b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.104706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f57afe938f4118aed9e3b1f6b2bcdc', 'request_id': 'req-720a766f-f397-425c-8549-5627b6384c90'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.131370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] The token cache is being invalidate because project b3f57afe938f4118aed9e3b1f6b2bcdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:06.131732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.132569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.135903 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1883/3777] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:05 2022] DELETE /identity/v3/projects/b3f57afe938f4118aed9e3b1f6b2bcdc => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:06.140231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:06.145554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:06.232690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a766f-f397-425c-8549-5627b6384c90 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:06.234536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483b44dedcb740b190af4eede9f3377b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.243335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1895/3778] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:05 2022] DELETE /identity/v3/users/483b44dedcb740b190af4eede9f3377b => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:06.257326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:06.258477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:06.258761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:06.259035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] PATH_INFO: `/v3/users/06c97740a7924fbe93edb7cc45157637` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:06.263208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c97740a7924fbe93edb7cc45157637)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:06.267629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:06.620626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c97740a7924fbe93edb7cc45157637'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.621451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c97740a7924fbe93edb7cc45157637'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.713625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c97740a7924fbe93edb7cc45157637'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.714309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c97740a7924fbe93edb7cc45157637'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.723070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c97740a7924fbe93edb7cc45157637'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:06.751695 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1884/3779] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:06 2022] DELETE /identity/v3/users/06c97740a7924fbe93edb7cc45157637 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:06.877281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:06.877707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:07.009316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805a39b-d21e-45f2-94b2-0ee924ca81a4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:07.058857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:07.062237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:07.102212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:07.103272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:07.104050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:07.104541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] PATH_INFO: `/v3/projects/6da91885d8ef4b5c9d02b81a33d4e09d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:07.106163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da91885d8ef4b5c9d02b81a33d4e09d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:07.110492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:07.246647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a796-705c-41b8-9e5e-d54dad4cfd55 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:07.253004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:07.254330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:07.254817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:07.255591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] PATH_INFO: `/v3/projects/d8df77eeb5c845b7a0c2a0f8d9176ae7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:07.256619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8df77eeb5c845b7a0c2a0f8d9176ae7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:07.260671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:07.288171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da91885d8ef4b5c9d02b81a33d4e09d', 'request_id': 'req-12703ee4-68b1-425a-af6f-3d74eaac235b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.292458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:07.295707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da91885d8ef4b5c9d02b81a33d4e09d', 'request_id': 'req-12703ee4-68b1-425a-af6f-3d74eaac235b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.378108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da91885d8ef4b5c9d02b81a33d4e09d', 'request_id': 'req-12703ee4-68b1-425a-af6f-3d74eaac235b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.394990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] The token cache is being invalidate because project 6da91885d8ef4b5c9d02b81a33d4e09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:07.395696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.397112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.404872 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1896/3780] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:06 2022] DELETE /identity/v3/projects/6da91885d8ef4b5c9d02b81a33d4e09d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:07.405773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:07.409319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:07.411562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8df77eeb5c845b7a0c2a0f8d9176ae7', 'request_id': 'req-6dffc219-f17c-40e6-b16a-400bac24a253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.423517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8df77eeb5c845b7a0c2a0f8d9176ae7', 'request_id': 'req-6dffc219-f17c-40e6-b16a-400bac24a253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.531821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8df77eeb5c845b7a0c2a0f8d9176ae7', 'request_id': 'req-6dffc219-f17c-40e6-b16a-400bac24a253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.548483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] The token cache is being invalidate because project d8df77eeb5c845b7a0c2a0f8d9176ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:07.549630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.551113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6dffc219-f17c-40e6-b16a-400bac24a253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.557535 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1885/3781] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:07 2022] DELETE /identity/v3/projects/d8df77eeb5c845b7a0c2a0f8d9176ae7 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:07.559572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:07.561912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:07.562217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:07.617341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12703ee4-68b1-425a-af6f-3d74eaac235b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:07.627304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:07.628477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:07.780560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:07.780560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:07.780560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:07.780560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] PATH_INFO: `/v3/projects/649a444e9851468394cd8cedde88bf28` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:07.781382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649a444e9851468394cd8cedde88bf28)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:07.784417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:07.813657 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1886/3782] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:07.813657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:07.813657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:07.838226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119649d4-f7c0-49d4-8ed5-85d81dcadd44 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:07.847181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:07.847839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:07.848124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:07.848399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] PATH_INFO: `/v3/users/96302a04764a47bba6baa40ba7935bdf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:07.861998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96302a04764a47bba6baa40ba7935bdf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:07.869858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:07.941405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649a444e9851468394cd8cedde88bf28', 'request_id': 'req-050a67a9-8be4-46f7-a465-78eaf3d72f15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:07.955434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649a444e9851468394cd8cedde88bf28', 'request_id': 'req-050a67a9-8be4-46f7-a465-78eaf3d72f15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.056871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649a444e9851468394cd8cedde88bf28', 'request_id': 'req-050a67a9-8be4-46f7-a465-78eaf3d72f15'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.078426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] The token cache is being invalidate because project 649a444e9851468394cd8cedde88bf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:08.078725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.080202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-050a67a9-8be4-46f7-a465-78eaf3d72f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.108169 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1897/3783] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:07 2022] DELETE /identity/v3/projects/649a444e9851468394cd8cedde88bf28 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:08.114429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93bb7-87ff-427e-a499-b028fd84971f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.114429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93bb7-87ff-427e-a499-b028fd84971f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.114429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93bb7-87ff-427e-a499-b028fd84971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.124224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96302a04764a47bba6baa40ba7935bdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.125160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96302a04764a47bba6baa40ba7935bdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.135918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aee93bb7-87ff-427e-a499-b028fd84971f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:08.137164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aee93bb7-87ff-427e-a499-b028fd84971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:08.167724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:08.190858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96302a04764a47bba6baa40ba7935bdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.191778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96302a04764a47bba6baa40ba7935bdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.202692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96302a04764a47bba6baa40ba7935bdf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:08.261070 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1898/3784] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:08.262428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1887/3785] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:07 2022] DELETE /identity/v3/users/96302a04764a47bba6baa40ba7935bdf => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:08.263334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.264384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8846f-473c-46c2-843e-ce3c1306ba84 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.264662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8846f-473c-46c2-843e-ce3c1306ba84 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.264932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8846f-473c-46c2-843e-ce3c1306ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.301345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48d8846f-473c-46c2-843e-ce3c1306ba84 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:08.303219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48d8846f-473c-46c2-843e-ce3c1306ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:08.379131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5194710-c38a-4793-85df-1e61910413e6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.385203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.385827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.386184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.386409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.387061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:08.387363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.389075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:08.403658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1899/3786] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:08.407989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c3c1-3f1c-4aa5-9770-3ab184826692 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.407989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c3c1-3f1c-4aa5-9770-3ab184826692 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.409921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c3c1-3f1c-4aa5-9770-3ab184826692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.414535 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1888/3787] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:08.431014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.436841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9356c3c1-3f1c-4aa5-9770-3ab184826692 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:08.438567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9356c3c1-3f1c-4aa5-9770-3ab184826692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:08.448980 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1900/3788] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:08.454248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c3c1-3f1c-4aa5-9770-3ab184826692 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.459717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ededb-1f2d-420d-a117-7bd9098a28f1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.466442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.467466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.467912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.468426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.469323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.472242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:08.480935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c3c1-3f1c-4aa5-9770-3ab184826692 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.486768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.490342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.490342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.490342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.490342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:08.490342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.491082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:08.510117 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1901/3789] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:08.513134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.524582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7366-3a45-4d81-bbf1-b5989c854812 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.529863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.531648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.531995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.532338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.533391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.535779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:08.606096 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1889/3790] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:08 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:08.610669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.641260 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1902/3791] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:08 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:08.648461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.721136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a67a81-de94-4d1e-9e45-9e87c2beb4b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.746332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8f79f-c61c-4b53-a7fd-154c02c52c65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.752273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.752907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.753245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.753518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.754679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.757041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:08.798319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.799326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.799865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.800532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.801574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.804121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:08.925432 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1890/3792] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:08 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:08.925636 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1903/3793] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:08 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:08.926660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.933787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:08.948002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24730b18-2dd3-46be-aa3f-f40981b058bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.953125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242eb22-e8d8-429a-a43b-bcf318606d67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:08.959312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.961905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:08.962074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.962476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.962849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.963566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:08.964335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.964706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:08.965503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:08.967572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:08.968547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:08.971757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.003052 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1904/3794] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:09.004869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.005000 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1891/3795] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:09.007163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.024462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9673e0c-e558-4d7e-825a-52ec336f2656 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.026100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc330aa9-3592-4699-8012-eab3127f68b0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.036232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.036691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.036691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.036847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.037763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.038469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.038803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.039288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.040244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.040979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.042600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.046086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.060841 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1905/3796] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:09.063706 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1892/3797] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:09.065084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.067662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.076509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bcce2-5498-4e01-aa06-e647ad0f2aee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.078126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7de87b-b8ca-4ea8-ac0f-ed778ea690b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.081723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.082480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.082761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.083039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] PATH_INFO: `/v3/projects/3a05d2088ea04234aade7f9496271e5e/users/7be6bc3eadcc40248b7b958b11e3df83/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.084053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe44de-a977-4499-9681-5c185de2299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.085241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe44de-a977-4499-9681-5c185de2299e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.085241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe44de-a977-4499-9681-5c185de2299e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.085575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe44de-a977-4499-9681-5c185de2299e admin admin] PATH_INFO: `/v3/projects/fc7d921cf98c41e092f10fda507c0624/users/f278334f3cd646a89ec99502f0bfe636/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.101924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a05d2088ea04234aade7f9496271e5e, user_id=7be6bc3eadcc40248b7b958b11e3df83, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.104645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.105117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe44de-a977-4499-9681-5c185de2299e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7d921cf98c41e092f10fda507c0624, user_id=f278334f3cd646a89ec99502f0bfe636, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.108713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe44de-a977-4499-9681-5c185de2299e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.184827 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1906/3798] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:09 2022] PUT /identity/v3/projects/3a05d2088ea04234aade7f9496271e5e/users/7be6bc3eadcc40248b7b958b11e3df83/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:09.187156 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1893/3799] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:09 2022] PUT /identity/v3/projects/fc7d921cf98c41e092f10fda507c0624/users/f278334f3cd646a89ec99502f0bfe636/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:09.190524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.200619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530b65d-77e0-4965-a626-d60af46c6946 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.202167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530b65d-77e0-4965-a626-d60af46c6946 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.202669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530b65d-77e0-4965-a626-d60af46c6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.203422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:09.295153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2530b65d-77e0-4965-a626-d60af46c6946 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:09.299890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2530b65d-77e0-4965-a626-d60af46c6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:09.366656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:09.390475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa198e-3983-4270-ac55-97d9e8218b11 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.432386 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1894/3800] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:09.434111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.434624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.435320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.473284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] MFA Rules not processed for user `7be6bc3eadcc40248b7b958b11e3df83`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:09.475406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:09.484561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.485135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.485505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.485803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] PATH_INFO: `/v3/users/1704f764cb274f168e13a15f433affba` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.487257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1704f764cb274f168e13a15f433affba)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.491182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.559208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1895/3801] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:09.560140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.562453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:09.651750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb0100-f64e-4b8f-8ede-3a5141f236a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.658109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.658538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.658800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.659081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.671771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.673386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.686620 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1896/3802] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:09.687566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.698661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77751cfc-cca5-4cf8-ae3b-a4458487ac69 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.700931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1704f764cb274f168e13a15f433affba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:09.706087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be6bc3eadcc40248b7b958b11e3df83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a05d2088ea04234aade7f9496271e5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.709630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.709630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.709630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.709630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.709630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.710754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1704f764cb274f168e13a15f433affba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:09.711298 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1897/3803] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:39:09 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:09.711833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1704f764cb274f168e13a15f433affba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:09.716162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.718194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:09.726351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1704f764cb274f168e13a15f433affba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:09.733831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462b1f8-f076-450a-8fc3-c026a55be565 tempest-IdentityCatalogTest-1568615388 tempest-IdentityCatalogTest-1568615388-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.747087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:09.747087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:09.747087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:09.747087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] PATH_INFO: `/v3/projects/80484a078561483885d3ad26f2d82552` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:09.747562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80484a078561483885d3ad26f2d82552)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:09.747562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:09.877203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1704f764cb274f168e13a15f433affba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:09.887653 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1907/3804] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:09 2022] DELETE /identity/v3/users/1704f764cb274f168e13a15f433affba => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:09.887653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:09.887653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:09.979689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04484f-1184-4419-a3d8-b0900d156fa1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:09.991408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80484a078561483885d3ad26f2d82552', 'request_id': 'req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.012544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80484a078561483885d3ad26f2d82552', 'request_id': 'req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.122662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:10.136074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:10.137237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.137558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.138121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] PATH_INFO: `/v3/users/7be6bc3eadcc40248b7b958b11e3df83` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.140269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be6bc3eadcc40248b7b958b11e3df83)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:10.146743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:10.151026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80484a078561483885d3ad26f2d82552', 'request_id': 'req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.219457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] The token cache is being invalidate because project 80484a078561483885d3ad26f2d82552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:10.220108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.225333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5ac3934-7d59-4dbd-bd5a-e0e43aa06b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.231634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1898/3805] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:09 2022] DELETE /identity/v3/projects/80484a078561483885d3ad26f2d82552 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:10.240640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabdcb-39f8-4a82-9485-4f470d7a7d58 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.241080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabdcb-39f8-4a82-9485-4f470d7a7d58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.241414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aabdcb-39f8-4a82-9485-4f470d7a7d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.305299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-31aabdcb-39f8-4a82-9485-4f470d7a7d58 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:10.306189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31aabdcb-39f8-4a82-9485-4f470d7a7d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.339527 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1899/3806] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:10.350940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.351238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.351522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.397874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:10.399718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.422650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1900/3807] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:10.423945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:10.426276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.442844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbec1b3-a0db-4d55-82cf-1d332c233b20 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:10.456315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:10.457177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.457608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.457936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] PATH_INFO: `/v3/projects/2a9860ff5bca4afc9a272f5d3781f3e7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.459134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9860ff5bca4afc9a272f5d3781f3e7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:10.464194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:10.515591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be6bc3eadcc40248b7b958b11e3df83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.526668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be6bc3eadcc40248b7b958b11e3df83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.527538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be6bc3eadcc40248b7b958b11e3df83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.548896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be6bc3eadcc40248b7b958b11e3df83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.597918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9860ff5bca4afc9a272f5d3781f3e7', 'request_id': 'req-b767e15f-3694-47be-a57d-d9b73c32d1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.605304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9860ff5bca4afc9a272f5d3781f3e7', 'request_id': 'req-b767e15f-3694-47be-a57d-d9b73c32d1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.622624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be6bc3eadcc40248b7b958b11e3df83'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.633974 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1908/3808] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:09 2022] DELETE /identity/v3/users/7be6bc3eadcc40248b7b958b11e3df83 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:10.635153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:10.637342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.712992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503084d0-7894-477e-a1f0-5e5140445c4d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:10.720129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9860ff5bca4afc9a272f5d3781f3e7', 'request_id': 'req-b767e15f-3694-47be-a57d-d9b73c32d1a0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.727389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b989a-a267-4310-9705-8432da71d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:10.730301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b989a-a267-4310-9705-8432da71d6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.730769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b989a-a267-4310-9705-8432da71d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.731215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b989a-a267-4310-9705-8432da71d6f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.732578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b989a-a267-4310-9705-8432da71d6f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:10.733507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] The token cache is being invalidate because project 2a9860ff5bca4afc9a272f5d3781f3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:10.733908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.734960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:10.736623 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1901/3809] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:10 2022] DELETE /identity/v3/projects/2a9860ff5bca4afc9a272f5d3781f3e7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:10.741090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:10.744127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.744277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b989a-a267-4310-9705-8432da71d6f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:10.745363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b989a-a267-4310-9705-8432da71d6f3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:10.775101 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1909/3810] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:10.776405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749e60c-a743-40d7-82c1-e040f1db2d71 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.776648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749e60c-a743-40d7-82c1-e040f1db2d71 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.776923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749e60c-a743-40d7-82c1-e040f1db2d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.816536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8749e60c-a743-40d7-82c1-e040f1db2d71 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:10.817858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8749e60c-a743-40d7-82c1-e040f1db2d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.819708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e15f-3694-47be-a57d-d9b73c32d1a0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:10.828388 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1910/3811] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:10.832312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.832312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.832312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.867331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:10.871110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.891927 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1911/3812] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:10.898904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:10.898904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.902763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:10.903515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.904608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.904989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.908022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.925104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0aa0-dd40-461f-a4af-64a444b86678 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:10.929367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:10.930780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:10.938797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:10.939537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.941392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.941392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:10.941392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:10.944173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:10.952702 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1902/3813] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:10.953970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:10.957019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:10.961547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:10.979352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed15e8-43b8-4570-930a-d31537b2dcc7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:10.985925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c13c4-c77f-45fa-842a-f176ae5d0a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:10.987035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c13c4-c77f-45fa-842a-f176ae5d0a52 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:10.987403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c13c4-c77f-45fa-842a-f176ae5d0a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:10.987735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c13c4-c77f-45fa-842a-f176ae5d0a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.003498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c13c4-c77f-45fa-842a-f176ae5d0a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.005398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c13c4-c77f-45fa-842a-f176ae5d0a52 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.017316 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1903/3814] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:11.019128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbdcd-166a-4dc0-9b5e-63ba2d0d3655 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.019617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbdcd-166a-4dc0-9b5e-63ba2d0d3655 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.020053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbdcd-166a-4dc0-9b5e-63ba2d0d3655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.044169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1a3fbdcd-166a-4dc0-9b5e-63ba2d0d3655 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:11.045978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a3fbdcd-166a-4dc0-9b5e-63ba2d0d3655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:11.056341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1904/3815] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:11.063270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbdcd-166a-4dc0-9b5e-63ba2d0d3655 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.077539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbdcd-166a-4dc0-9b5e-63ba2d0d3655 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.079822 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1912/3816] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:10 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:11.089564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.190276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.191204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.191204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.191433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.192092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:11.195706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.199388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.212611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f441f-1e59-4bde-bb03-af6d0f5f180a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.231651 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1905/3817] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:11.233398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.246152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.251035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.252126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.253138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.255577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.260486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403d988-6c4f-48e7-993d-d79007d12c3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.261347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.270967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.271661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.272408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.272408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.273031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.274994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.310342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:11.421897 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1913/3818] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:11 2022] POST /identity/v3/users => generated 284 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:11.422815 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1906/3819] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:11 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:11.426912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.434461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.460212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef422-e5ef-45a8-82d5-27cfa5a3b8c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.575054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.575750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.576671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.577040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.577796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.579686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.596643 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1914/3820] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:11.613440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.620256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b99772-a782-4906-a61a-282064653273 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.632954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68aefa-20b2-4729-998f-85d5702f1916 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.637995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.638250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.639378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.639821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.639965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.640094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.640216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.640372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.640747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.641027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.642546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.643054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.659777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1915/3821] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:11.664149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.680664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0558d9-5ad1-4430-9f98-5ae838ef7a29 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.686317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.687024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.689405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.689405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] PATH_INFO: `/v3/projects/6f39381b69ce43b688f5b1ebe548a623/users/38eb539f2cc348548b4b3c5c5825aa8b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.707166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f39381b69ce43b688f5b1ebe548a623, user_id=38eb539f2cc348548b4b3c5c5825aa8b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.710614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.742361 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1907/3822] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:11 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:11.743367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.756257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9abf6d-c7ac-4d5b-bb3b-178b2f8b7da0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.764288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.764798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.765017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.765293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.766154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.769749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.785181 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1908/3823] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:11.790995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.801906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84a0ea-2eb5-4497-9444-2f0f0fb5fd0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.808601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fc7bc-f2a7-4dbf-9fbf-acf7e188a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.809487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc7bc-f2a7-4dbf-9fbf-acf7e188a52c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.811117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc7bc-f2a7-4dbf-9fbf-acf7e188a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.811653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fc7bc-f2a7-4dbf-9fbf-acf7e188a52c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.812350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc7bc-f2a7-4dbf-9fbf-acf7e188a52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.814611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fc7bc-f2a7-4dbf-9fbf-acf7e188a52c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:11.826970 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1916/3824] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:11 2022] PUT /identity/v3/projects/6f39381b69ce43b688f5b1ebe548a623/users/38eb539f2cc348548b4b3c5c5825aa8b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:11.836507 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1909/3825] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:11.837580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:11.837996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b9f2-e175-4e00-95b8-84dff2d165ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.838308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b9f2-e175-4e00-95b8-84dff2d165ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.838582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b9f2-e175-4e00-95b8-84dff2d165ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.894667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16b9b9f2-e175-4e00-95b8-84dff2d165ae None None] MFA Rules not processed for user `38eb539f2cc348548b4b3c5c5825aa8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:11.896007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16b9b9f2-e175-4e00-95b8-84dff2d165ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:11.953279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6866410-564f-4582-adc8-24a3e6fa36b3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:11.962065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5d027-869b-48ac-80cb-2ebd478ee2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:11.962846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d027-869b-48ac-80cb-2ebd478ee2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:11.963186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d027-869b-48ac-80cb-2ebd478ee2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:11.966082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d027-869b-48ac-80cb-2ebd478ee2e3 admin admin] PATH_INFO: `/v3/projects/80ef7de41a5a4e3599dbefeadb7cb1fa/users/2ff557eb6afe4b29bbccd87ffdbe21c0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:11.989507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5d027-869b-48ac-80cb-2ebd478ee2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ef7de41a5a4e3599dbefeadb7cb1fa, user_id=2ff557eb6afe4b29bbccd87ffdbe21c0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:11.992792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5d027-869b-48ac-80cb-2ebd478ee2e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:12.111341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1910/3826] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:12.111752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b9f2-e175-4e00-95b8-84dff2d165ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:12.118437 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1917/3827] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:11 2022] PUT /identity/v3/projects/80ef7de41a5a4e3599dbefeadb7cb1fa/users/2ff557eb6afe4b29bbccd87ffdbe21c0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:12.128091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ecad-47d9-4c0b-96ac-5b9ff7eb1bdd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:12.129928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ecad-47d9-4c0b-96ac-5b9ff7eb1bdd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:12.131862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ecad-47d9-4c0b-96ac-5b9ff7eb1bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:12.156300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b9f2-e175-4e00-95b8-84dff2d165ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:12.244935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a9b0ecad-47d9-4c0b-96ac-5b9ff7eb1bdd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:12.244935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a9b0ecad-47d9-4c0b-96ac-5b9ff7eb1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:12.293504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:12.294322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:12.295165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:12.295446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:12.296170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:12.298256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:12.326535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:12.395451 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1911/3828] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:12 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:12.396446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:12.400777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:12.407057 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1918/3829] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:12.407909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0ecad-47d9-4c0b-96ac-5b9ff7eb1bdd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:12.424014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0ecad-47d9-4c0b-96ac-5b9ff7eb1bdd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:12.621938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:12.623190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:12.625918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:12.626796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:12.628691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:12.632459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8a025-8456-4beb-ac5d-c836bc2d0fd0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:12.634328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:12.677831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:12.680086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:12.680461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:12.680746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] PATH_INFO: `/v3/projects/3a05d2088ea04234aade7f9496271e5e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:12.682607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a05d2088ea04234aade7f9496271e5e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:12.685596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:12.783281 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1919/3830] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:12 2022] POST /identity/v3/users => generated 290 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:12.784263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:12.830517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a05d2088ea04234aade7f9496271e5e', 'request_id': 'req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:12.839140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a05d2088ea04234aade7f9496271e5e', 'request_id': 'req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:12.900903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aa674-9f55-472e-b446-42b6ce55a8f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:12.928783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a05d2088ea04234aade7f9496271e5e', 'request_id': 'req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:12.948286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] The token cache is being invalidate because project 3a05d2088ea04234aade7f9496271e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:12.948730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:12.950687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:12.954601 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1912/3831] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:12 2022] DELETE /identity/v3/projects/3a05d2088ea04234aade7f9496271e5e => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:12.957616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:12.964264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:12.973508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:12.974218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:12.974650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:12.974941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:12.977132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:12.997121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6fdab-2371-45b4-9af6-2d05c7f2584f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.008997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.009785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.010274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.010649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.014752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:13.037459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.041688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.061565 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1913/3832] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:13.064386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.073604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:13.109165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.114048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c95b6-3841-42ae-adf2-344d04f9df47 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.116176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.134438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77117d2c-5aa2-4a88-807c-453a8d921bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.136643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77117d2c-5aa2-4a88-807c-453a8d921bba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.136643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77117d2c-5aa2-4a88-807c-453a8d921bba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.136643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77117d2c-5aa2-4a88-807c-453a8d921bba admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.136643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77117d2c-5aa2-4a88-807c-453a8d921bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.139217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77117d2c-5aa2-4a88-807c-453a8d921bba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.176812 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1914/3833] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:13.181801 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1920/3834] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:13.183378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f9ab-c4ab-4b07-b40c-3aae5369691e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.186327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f9ab-c4ab-4b07-b40c-3aae5369691e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.186843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f9ab-c4ab-4b07-b40c-3aae5369691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.187421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.208204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9cff9-0e82-4103-9d04-bceefdd4b57d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.214585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.215602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.222722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.222722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] PATH_INFO: `/v3/projects/04493f55ad8c48e08c5d8fc3e6ed8642/users/9fbba8435050471a8fb90ced44d54090/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.235752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8e5f9ab-c4ab-4b07-b40c-3aae5369691e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:13.237257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8e5f9ab-c4ab-4b07-b40c-3aae5369691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:13.251141 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1915/3835] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:13.259620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244d67-8b06-4cd8-9b4e-94cc00734d55 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.263905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244d67-8b06-4cd8-9b4e-94cc00734d55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.263905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244d67-8b06-4cd8-9b4e-94cc00734d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.264751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04493f55ad8c48e08c5d8fc3e6ed8642, user_id=9fbba8435050471a8fb90ced44d54090, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.271352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.304294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3f244d67-8b06-4cd8-9b4e-94cc00734d55 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:13.305639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f244d67-8b06-4cd8-9b4e-94cc00734d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:13.326734 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1916/3836] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:13.331804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f244d67-8b06-4cd8-9b4e-94cc00734d55 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.340657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f244d67-8b06-4cd8-9b4e-94cc00734d55 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.346644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.347207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.347546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.347751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.348411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:13.348715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.350502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.361544 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1921/3837] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:13 2022] PUT /identity/v3/projects/04493f55ad8c48e08c5d8fc3e6ed8642/users/9fbba8435050471a8fb90ced44d54090/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:13.366484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1917/3838] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:39:13.371965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.375717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.383602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992e1ea-3a09-4048-a2ca-e6dcda3d7122 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.485970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.486643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.487929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.488230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.489186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.491329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca938-b4cb-4918-bf06-dfdaaeaab67c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.492158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.499498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.500116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.502408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.502408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.502408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.504652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.514650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:13.521524 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1922/3839] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:13.523286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.534018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed58863-ff84-4f2f-9278-fa73c11197e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.539534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e23e5-36c5-4bec-ba5c-bc6e23447b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.540392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e23e5-36c5-4bec-ba5c-bc6e23447b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.540688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e23e5-36c5-4bec-ba5c-bc6e23447b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.540968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e23e5-36c5-4bec-ba5c-bc6e23447b3f admin admin] PATH_INFO: `/v3/projects/04493f55ad8c48e08c5d8fc3e6ed8642/users/9fbba8435050471a8fb90ced44d54090/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.542993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e23e5-36c5-4bec-ba5c-bc6e23447b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04493f55ad8c48e08c5d8fc3e6ed8642, user_id=9fbba8435050471a8fb90ced44d54090, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.545878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e23e5-36c5-4bec-ba5c-bc6e23447b3f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.556951 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1923/3840] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:13 2022] PUT /identity/v3/projects/04493f55ad8c48e08c5d8fc3e6ed8642/users/9fbba8435050471a8fb90ced44d54090/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:13.569969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb044-099c-4a0e-9a49-d45c0a659f73 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.570517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb044-099c-4a0e-9a49-d45c0a659f73 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.570902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb044-099c-4a0e-9a49-d45c0a659f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.605098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f24eb044-099c-4a0e-9a49-d45c0a659f73 None None] MFA Rules not processed for user `9fbba8435050471a8fb90ced44d54090`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:13.606820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f24eb044-099c-4a0e-9a49-d45c0a659f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:13.645451 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1918/3841] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:13 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:13.649669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.760119 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1924/3842] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:13.761273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eb044-099c-4a0e-9a49-d45c0a659f73 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.782393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eb044-099c-4a0e-9a49-d45c0a659f73 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.789293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17a4f3-c765-498d-bfe6-72b0cb090ceb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.797069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.797848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.798339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.798716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.799483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.802151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.877602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.878303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.878590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.878868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.879512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.880532 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:13.880532 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:13.880532 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:13.881425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.930409 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1919/3843] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:13 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:13.931416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.943344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d80202-8241-48b9-a70d-15956f69a657 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.948710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.949394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.949682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.949960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:13.951029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:13.952691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:13.971399 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1920/3844] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:13.978509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:13.992035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab2665-021b-468b-b378-148b517964d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:13.997656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:13.998467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:13.998848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:13.999315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.000062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.001979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.007295 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1925/3845] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:39:13 2022] POST /identity/v3/regions => generated 222 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:14.008859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.018071 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1921/3846] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:39:14.021678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.032596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431f504-5b8d-4bfd-a879-42133d8d86e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.033926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6205a74-a96a-4e80-9f48-6f91c200b29e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.039703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.039703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.040033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.040270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.040922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.042728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.049580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4d5e2-64cb-4431-8675-7a72567bf5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.050400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4d5e2-64cb-4431-8675-7a72567bf5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.050746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4d5e2-64cb-4431-8675-7a72567bf5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.051114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4d5e2-64cb-4431-8675-7a72567bf5d7 admin admin] PATH_INFO: `/v3/projects/ea9a2b7a83c34336b9d206eb5c9118cc/users/e7281b26a31e49318567c2327b27a3c8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.067417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4d5e2-64cb-4431-8675-7a72567bf5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9a2b7a83c34336b9d206eb5c9118cc, user_id=e7281b26a31e49318567c2327b27a3c8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.070333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4d5e2-64cb-4431-8675-7a72567bf5d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.133127 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1926/3847] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:39:14 2022] POST /identity/v3/regions => generated 224 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:14.137751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.169270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469ed7-dc84-4fe9-87a3-7e1f178f95e7 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.184887 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1922/3848] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:14 2022] PUT /identity/v3/projects/ea9a2b7a83c34336b9d206eb5c9118cc/users/e7281b26a31e49318567c2327b27a3c8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:14.198664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b449f-b43f-49f8-b8ad-3ea4be1817b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.198989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b449f-b43f-49f8-b8ad-3ea4be1817b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.199264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b449f-b43f-49f8-b8ad-3ea4be1817b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.310876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.312687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.313855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.314380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/5fc41916-a6b7-40e8-87bd-a43e004ce215` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.317421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f5b449f-b43f-49f8-b8ad-3ea4be1817b8 None None] MFA Rules not processed for user `e7281b26a31e49318567c2327b27a3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:14.318730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f5b449f-b43f-49f8-b8ad-3ea4be1817b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:14.325294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:create_region(region_id=5fc41916-a6b7-40e8-87bd-a43e004ce215)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.341231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.472775 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1927/3849] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Oct 18 13:39:14 2022] PUT /identity/v3/regions/5fc41916-a6b7-40e8-87bd-a43e004ce215 => generated 231 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:14.477627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.485267 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1923/3850] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:14.486507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b449f-b43f-49f8-b8ad-3ea4be1817b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.500711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b449f-b43f-49f8-b8ad-3ea4be1817b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.532503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7281b26a31e49318567c2327b27a3c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea9a2b7a83c34336b9d206eb5c9118cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.532503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.532503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.532824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] PATH_INFO: `/v3/domains/default` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.534765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.536489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.538155 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1924/3851] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 13:39:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:39:14.543996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.553011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b95b11-eec9-4313-a145-c7d402d9aae9 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.559823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.560148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.560600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.560943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/5fc41916-a6b7-40e8-87bd-a43e004ce215` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.561603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=5fc41916-a6b7-40e8-87bd-a43e004ce215)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.563421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.668514 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1928/3852] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:39:14 2022] DELETE /identity/v3/regions/5fc41916-a6b7-40e8-87bd-a43e004ce215 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:14.673591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.717152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e8ccd-1cce-4925-870c-c425850b8d60 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.723992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.724703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.725083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.725613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.726359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.728133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.735297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1cd5-42c9-480f-8b42-4d48facd92b3 tempest-DefaultDomainTestJSON-876992002 tempest-DefaultDomainTestJSON-876992002-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.753490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.754183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.754938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.755273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] PATH_INFO: `/v3/users/e7281b26a31e49318567c2327b27a3c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.756466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7281b26a31e49318567c2327b27a3c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.759275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:14.867579 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1929/3853] 10.222.0.27 () {60 vars in 1150 bytes} [Tue Oct 18 13:39:14 2022] POST /identity/v3/regions => generated 252 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:14.868642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:14.893249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:14.896747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9656-be00-4d57-8cd8-fdd35f693b5c tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:14.902363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:14.903452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:14.903848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:14.904199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/82327a29e8684352aa390897919d15d7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:14.905171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:update_region(region_id=82327a29e8684352aa390897919d15d7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:14.906494 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:14.906494 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:14.906494 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:14.908041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.040539 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1930/3854] 10.222.0.27 () {60 vars in 1250 bytes} [Tue Oct 18 13:39:14 2022] PATCH /identity/v3/regions/82327a29e8684352aa390897919d15d7 => generated 254 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:15.043851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.046789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7281b26a31e49318567c2327b27a3c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:15.047931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7281b26a31e49318567c2327b27a3c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:15.132414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05016bc-1df5-4797-b3c9-ab79214f2337 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.142890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.143559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.143979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.144310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/82327a29e8684352aa390897919d15d7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.147902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7281b26a31e49318567c2327b27a3c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:15.148510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7281b26a31e49318567c2327b27a3c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:15.151203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:get_region(region_id=82327a29e8684352aa390897919d15d7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.157819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c308aff1-6d70-420d-8666-7cf947f92857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7281b26a31e49318567c2327b27a3c8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:15.159684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.186350 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1931/3855] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:39:15 2022] GET /identity/v3/regions/82327a29e8684352aa390897919d15d7 => generated 254 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:15.188611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.191364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:15.208168 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1925/3856] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:14 2022] DELETE /identity/v3/users/e7281b26a31e49318567c2327b27a3c8 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:15.213680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.213997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.214355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.221688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ef673-de05-47a9-8aa3-6fc8827ae068 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.283131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:15.284576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:15.360152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.362423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.362423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.362423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/82327a29e8684352aa390897919d15d7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.362423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=82327a29e8684352aa390897919d15d7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.363819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.439901 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1926/3857] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:15.481581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.484615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:15.486033 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1932/3858] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:39:15 2022] DELETE /identity/v3/regions/82327a29e8684352aa390897919d15d7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:15.490090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.515003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d847-29b0-4c67-897a-f48dd958fdfc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.520672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.522311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.522905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.524046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.524668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.525768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.536513 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1933/3859] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:39:15 2022] GET /identity/v3/regions => generated 668 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:15.537654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.565896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fb7e2-feef-48de-b258-aecdb1370797 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.573791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.575003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.575499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.576041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/82327a29e8684352aa390897919d15d7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.577596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=82327a29e8684352aa390897919d15d7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.579523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Could not find region: 82327a29e8684352aa390897919d15d7.: keystone.exception.RegionNotFound: Could not find region: 82327a29e8684352aa390897919d15d7. Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 82327a29e8684352aa390897919d15d7. Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:39:15.589750 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 82327a29e8684352aa390897919d15d7. Oct 18 13:39:15.591093 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:39:15.599923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1934/3860] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:39:15 2022] DELETE /identity/v3/regions/82327a29e8684352aa390897919d15d7 => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:39:15.601590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.603792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c63d4-839c-4d22-866a-812c3da6ea6a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.616743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44b4b-c282-4fd4-a9ad-186f2cdd2fdb tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.625982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.629865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.629865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.629865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.629865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.629865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.640955 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1935/3861] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 13:39:15 2022] GET /identity/v3/regions => generated 668 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:15.641589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.642264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.642551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.642669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.642866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.655088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf05514-10d2-45de-94ef-ccdd531c2cb6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.661161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.662685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.662843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.663923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.664311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.664781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.665516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.667774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.701879 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1927/3862] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:15.800662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.815850 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1936/3863] 10.222.0.27 () {60 vars in 1150 bytes} [Tue Oct 18 13:39:15 2022] POST /identity/v3/regions => generated 253 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:15.821650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54a70-0a21-457d-a307-678f8552d1ca service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.848503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.850069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.850984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.850984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.851518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Adding query filter params (parent_region_id=c5861161288f4af686b7640c2b80498e) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:15.851829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.853984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:15.875051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:15.891355 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1928/3864] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:39:15 2022] GET /identity/v3/regions?parent_region_id=c5861161288f4af686b7640c2b80498e => generated 399 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:15.894896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169eeac-148a-4af0-bcf2-e56eb6da7c6e tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:15.900908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:15.901564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:15.901843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:15.902153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/f82f025e8c7e45149fdd28001a12dbe3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:15.903079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f82f025e8c7e45149fdd28001a12dbe3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:15.906247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:16.048816 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1937/3865] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:39:15 2022] DELETE /identity/v3/regions/f82f025e8c7e45149fdd28001a12dbe3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:16.053845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:16.075365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772e64-564b-44b5-9c1e-78d6042d1adc tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:16.103010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:16.104185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:16.104687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:16.105225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/ff486813a28d4dc28dab962994662a9a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:16.106196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ff486813a28d4dc28dab962994662a9a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:16.108441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:16.130971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:16.197259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1929/3866] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:39:16 2022] DELETE /identity/v3/regions/ff486813a28d4dc28dab962994662a9a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:16.202728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:16.222750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb08d8c-5628-4c2d-a4c8-5be32d147676 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:16.246246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48c57b-1859-43f0-b838-8795481869f6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbba8435050471a8fb90ced44d54090', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04493f55ad8c48e08c5d8fc3e6ed8642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:16.255842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c57b-1859-43f0-b838-8795481869f6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:16.255842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c57b-1859-43f0-b838-8795481869f6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:16.255842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48c57b-1859-43f0-b838-8795481869f6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] PATH_INFO: `/v3/regions/c5861161288f4af686b7640c2b80498e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:16.255842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48c57b-1859-43f0-b838-8795481869f6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c5861161288f4af686b7640c2b80498e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:16.255842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48c57b-1859-43f0-b838-8795481869f6 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:16.356438 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1938/3867] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:39:16 2022] DELETE /identity/v3/regions/c5861161288f4af686b7640c2b80498e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:16.360503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:16.377059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:16.408905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949afb-e8b1-4e34-baae-9d1cdafdfd93 tempest-RegionsTestJSON-2076260636 tempest-RegionsTestJSON-2076260636-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:16.431642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:16.432310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:16.434971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:16.434971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] PATH_INFO: `/v3/users/38eb539f2cc348548b4b3c5c5825aa8b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:16.436660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38eb539f2cc348548b4b3c5c5825aa8b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:16.438796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:16.572793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:16.711094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a238-5c07-4633-936b-7e010a303fd7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:16.711647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a238-5c07-4633-936b-7e010a303fd7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:16.721512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a238-5c07-4633-936b-7e010a303fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:16.735562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38eb539f2cc348548b4b3c5c5825aa8b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:16.738013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38eb539f2cc348548b4b3c5c5825aa8b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:16.770733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-86b0a238-5c07-4633-936b-7e010a303fd7 None None] MFA Rules not processed for user `2ff557eb6afe4b29bbccd87ffdbe21c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:16.772036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86b0a238-5c07-4633-936b-7e010a303fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:16.833259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38eb539f2cc348548b4b3c5c5825aa8b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:16.834031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38eb539f2cc348548b4b3c5c5825aa8b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:16.845004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38eb539f2cc348548b4b3c5c5825aa8b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:16.886706 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1930/3868] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:16 2022] DELETE /identity/v3/users/38eb539f2cc348548b4b3c5c5825aa8b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:16.892875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:16.895323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.019267 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1939/3869] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:17.034069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde95f1-c4da-43be-b4ac-8fed62193935 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.034563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde95f1-c4da-43be-b4ac-8fed62193935 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.034920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde95f1-c4da-43be-b4ac-8fed62193935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.066620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cbde95f1-c4da-43be-b4ac-8fed62193935 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:17.068147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cbde95f1-c4da-43be-b4ac-8fed62193935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.084130 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1940/3870] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:17.084130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.084130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.084130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.088358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dbc20-e5b1-44ba-b943-d1a1b2e153b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:17.099348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:17.100245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.100443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.100788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] PATH_INFO: `/v3/projects/ea9a2b7a83c34336b9d206eb5c9118cc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.106666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9a2b7a83c34336b9d206eb5c9118cc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:17.106666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:17.113155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] MFA Rules not processed for user `2ff557eb6afe4b29bbccd87ffdbe21c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:17.114616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.223190 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1941/3871] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:17.224552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:17.235175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.291683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9a2b7a83c34336b9d206eb5c9118cc', 'request_id': 'req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:17.301000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9a2b7a83c34336b9d206eb5c9118cc', 'request_id': 'req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:17.322872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc6ee-c754-42e1-8a49-5d9f14d678e4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:17.383656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb968736-55fe-48d7-8147-f59829ea3290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:17.384627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968736-55fe-48d7-8147-f59829ea3290 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.385151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968736-55fe-48d7-8147-f59829ea3290 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.385678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb968736-55fe-48d7-8147-f59829ea3290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.387737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9a2b7a83c34336b9d206eb5c9118cc', 'request_id': 'req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:17.401654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] The token cache is being invalidate because project ea9a2b7a83c34336b9d206eb5c9118cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:17.401944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:17.402811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d40b792-7a81-4ed2-b7f4-d0f4fd66a253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:17.404950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1931/3872] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:16 2022] DELETE /identity/v3/projects/ea9a2b7a83c34336b9d206eb5c9118cc => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:17.409175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.409484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.409756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.452937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] MFA Rules not processed for user `2ff557eb6afe4b29bbccd87ffdbe21c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:17.456564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.484877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968736-55fe-48d7-8147-f59829ea3290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:17.493560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb968736-55fe-48d7-8147-f59829ea3290 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:17.519213 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1942/3873] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:17.520883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf2a50-61a6-4ec0-9fa6-1c3ad66ead66 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.526334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf2a50-61a6-4ec0-9fa6-1c3ad66ead66 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.526770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf2a50-61a6-4ec0-9fa6-1c3ad66ead66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.546007 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1932/3874] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:17.553159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:17.554738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.574971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3ccf2a50-61a6-4ec0-9fa6-1c3ad66ead66 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:17.577406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ccf2a50-61a6-4ec0-9fa6-1c3ad66ead66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.605226 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1943/3875] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:17.616021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:17.618952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba00a1-3aa2-4e2c-98c4-16404db35853 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.619346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba00a1-3aa2-4e2c-98c4-16404db35853 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.620022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba00a1-3aa2-4e2c-98c4-16404db35853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.646976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-73ba00a1-3aa2-4e2c-98c4-16404db35853 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:17.648342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73ba00a1-3aa2-4e2c-98c4-16404db35853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.660682 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1944/3876] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:17.665153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba00a1-3aa2-4e2c-98c4-16404db35853 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:17.685324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba00a1-3aa2-4e2c-98c4-16404db35853 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:17.699204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:17.699881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.700167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.700443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.702037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:17.703320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:17.705338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:17.732171 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1945/3877] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:39:17.736047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:17.750218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22fac1-f5d0-4f82-9ec3-dfce869d0e72 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:17.753411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1fce-a4b4-4d0e-8a93-5edbd21228ba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:17.759067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:17.759508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.759787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.760061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.760696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:17.765769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:17.766951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:17.767511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:17.768023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:17.777047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:17.777263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:17.798951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:17.803508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:17.828666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1933/3878] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:17.904919 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1946/3879] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:17 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:17.909805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:17.944954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a80d6-ebaa-4f07-9364-d44ae61e5cd7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:18.109505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:18.109505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.110208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.110208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.110569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:18.120466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:18.205346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:18.250827 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1934/3880] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:17 2022] POST /identity/v3/users => generated 300 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:18.252443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:18.276703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8ea49-709c-4139-8822-6b106a8d428f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:18.290927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:18.291896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.292891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.293377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.295059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:18.296899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:18.314981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:18.315991 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1947/3881] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:18.335673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9923-5f1d-48e2-96f9-2060e2ae6ae1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:18.340690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:18.341775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.341775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.341978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] PATH_INFO: `/v3/projects/b705800add164387b0e14fdd177320bb/users/4ffd67d699a74ccd91333d2faa8f19f1/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.388902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b705800add164387b0e14fdd177320bb, user_id=4ffd67d699a74ccd91333d2faa8f19f1, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:18.393612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:18.500558 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1935/3882] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:18 2022] PUT /identity/v3/projects/b705800add164387b0e14fdd177320bb/users/4ffd67d699a74ccd91333d2faa8f19f1/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:18.504526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:18.524420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01395-4275-43f5-9c15-c3b036e61aba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:18.629498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:18.630353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.630820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.631120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.631789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:18.633792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:18.646485 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1948/3883] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:39:18.651145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:18.665199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb98b0f-82b4-4564-8cc7-c44b1948b121 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:18.678630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c61b8c-d38b-4b65-a315-6c90d3beb501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:18.679339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c61b8c-d38b-4b65-a315-6c90d3beb501 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.684115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c61b8c-d38b-4b65-a315-6c90d3beb501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.684115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c61b8c-d38b-4b65-a315-6c90d3beb501 admin admin] PATH_INFO: `/v3/projects/b705800add164387b0e14fdd177320bb/users/4ffd67d699a74ccd91333d2faa8f19f1/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.684115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c61b8c-d38b-4b65-a315-6c90d3beb501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b705800add164387b0e14fdd177320bb, user_id=4ffd67d699a74ccd91333d2faa8f19f1, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:18.685253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:18.689374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:18.698921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c61b8c-d38b-4b65-a315-6c90d3beb501 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:18.728892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e3e4-45a6-4fbd-8bbe-a0a9fe48b22f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:18.739759 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1936/3884] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:18 2022] PUT /identity/v3/projects/b705800add164387b0e14fdd177320bb/users/4ffd67d699a74ccd91333d2faa8f19f1/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:18.750793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58385ece-2672-457f-984b-d49ff2595fc9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.751080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58385ece-2672-457f-984b-d49ff2595fc9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.751376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58385ece-2672-457f-984b-d49ff2595fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.813298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-58385ece-2672-457f-984b-d49ff2595fc9 None None] MFA Rules not processed for user `4ffd67d699a74ccd91333d2faa8f19f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:18.814838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58385ece-2672-457f-984b-d49ff2595fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:18.853980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:18.854925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.855279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.855698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] PATH_INFO: `/v3/projects/6f39381b69ce43b688f5b1ebe548a623` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.857537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f39381b69ce43b688f5b1ebe548a623)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:18.860046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:18.923448 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1937/3885] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:18.928087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58385ece-2672-457f-984b-d49ff2595fc9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:18.959440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58385ece-2672-457f-984b-d49ff2595fc9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:18.966295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:18.967697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:18.968293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:18.971008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:18.971008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:18.972574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:19.018216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f39381b69ce43b688f5b1ebe548a623', 'request_id': 'req-bd5c8bc7-a545-48d2-a26a-b1a14297b015'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.027576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f39381b69ce43b688f5b1ebe548a623', 'request_id': 'req-bd5c8bc7-a545-48d2-a26a-b1a14297b015'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.086151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1938/3886] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:18 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:19.088882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:19.091333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:19.103275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f39381b69ce43b688f5b1ebe548a623', 'request_id': 'req-bd5c8bc7-a545-48d2-a26a-b1a14297b015'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.121189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] The token cache is being invalidate because project 6f39381b69ce43b688f5b1ebe548a623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:19.121485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.122319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.124403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1949/3887] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:18 2022] DELETE /identity/v3/projects/6f39381b69ce43b688f5b1ebe548a623 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:19.126002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:19.127862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:19.188427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15dfe8-e3da-4826-ad33-7d7daff087b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:19.193640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:19.199327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:19.199327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:19.199327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] PATH_INFO: `/v3/users/1fbc5130642349b4a985d88f4515040f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:19.199327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbc5130642349b4a985d88f4515040f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:19.199327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:19.251655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c8bc7-a545-48d2-a26a-b1a14297b015 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:19.256472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:19.258267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:19.258267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:19.258267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:19.258575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:19.260342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:19.385990 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1950/3888] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:19 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:19.387367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:19.390642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:19.405046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d756f-b651-4185-83f5-5fbcdccfe5d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:19.410657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:19.411282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:19.412002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:19.412284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] PATH_INFO: `/v3/users/9fbba8435050471a8fb90ced44d54090` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:19.413958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbba8435050471a8fb90ced44d54090)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:19.415445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:19.464748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbc5130642349b4a985d88f4515040f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.465852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbc5130642349b4a985d88f4515040f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.562501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbc5130642349b4a985d88f4515040f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.563661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbc5130642349b4a985d88f4515040f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.579109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbc5130642349b4a985d88f4515040f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.613669 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1939/3889] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:19 2022] DELETE /identity/v3/users/1fbc5130642349b4a985d88f4515040f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:19.616518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:19.617091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:19.676915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbba8435050471a8fb90ced44d54090'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.692564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbba8435050471a8fb90ced44d54090'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.693710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbba8435050471a8fb90ced44d54090'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.731110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbba8435050471a8fb90ced44d54090'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.748062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621394-fc4d-46d5-b6d4-642752d03f5e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:19.766556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:19.767203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:19.767485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:19.767758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:19.768423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:19.770043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:19.806282 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1940/3890] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:19.807448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:19.816294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:19.856902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4948bde8-0861-4d3d-9d8a-de2923c920f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbba8435050471a8fb90ced44d54090'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:19.858986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588339a-8715-4a14-bacc-9907d5324d25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:19.865460 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1951/3891] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:19 2022] DELETE /identity/v3/users/9fbba8435050471a8fb90ced44d54090 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:19.872966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:19.873601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:19.873880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:19.874179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:19.874890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:19.876503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:19.902629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:19.902966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:19.903199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:19.928520 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1941/3892] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:19.938900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:19.962692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa608942-557d-422b-990f-1ffd3c9b6230 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:20.005941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] MFA Rules not processed for user `2ff557eb6afe4b29bbccd87ffdbe21c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:20.008590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:20.149744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1db420-0df6-4a54-b7a2-14a76597e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:20.150511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1db420-0df6-4a54-b7a2-14a76597e6da admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:20.150795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1db420-0df6-4a54-b7a2-14a76597e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:20.151071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1db420-0df6-4a54-b7a2-14a76597e6da admin admin] PATH_INFO: `/v3/projects/a60028c38c0e4d18835d9bf7c05fc6fc/users/34aaaf6746e14a148b8002646845d25c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:20.194619 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1952/3893] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:20.196245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:20.197835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:20.224320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1db420-0df6-4a54-b7a2-14a76597e6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a60028c38c0e4d18835d9bf7c05fc6fc, user_id=34aaaf6746e14a148b8002646845d25c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:20.226048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34cff8-c0ff-4712-8613-ad9b142e55d6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:20.227051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1db420-0df6-4a54-b7a2-14a76597e6da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:20.232237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:20.232864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:20.233152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:20.233454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] PATH_INFO: `/v3/projects/2ca4cc1ec1fa44159bd24c7e1d67b907` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:20.234665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca4cc1ec1fa44159bd24c7e1d67b907)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:20.238510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:20.283135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:20.355061 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1942/3894] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:19 2022] PUT /identity/v3/projects/a60028c38c0e4d18835d9bf7c05fc6fc/users/34aaaf6746e14a148b8002646845d25c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:20.371957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:20.373038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:20.373547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:20.447482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'request_id': 'req-f2e1710d-8b8f-417d-9192-39d13d69fab7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:20.471094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] MFA Rules not processed for user `34aaaf6746e14a148b8002646845d25c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:20.473667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:20.493642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'request_id': 'req-f2e1710d-8b8f-417d-9192-39d13d69fab7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:20.584527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca4cc1ec1fa44159bd24c7e1d67b907', 'request_id': 'req-f2e1710d-8b8f-417d-9192-39d13d69fab7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:20.621411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] The token cache is being invalidate because project 2ca4cc1ec1fa44159bd24c7e1d67b907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:20.622719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:20.628419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e1710d-8b8f-417d-9192-39d13d69fab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:20.636459 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1953/3895] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:20 2022] DELETE /identity/v3/projects/2ca4cc1ec1fa44159bd24c7e1d67b907 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:20.660616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4074-3259-4095-9b2f-784fa83b90b9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:20.665521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4074-3259-4095-9b2f-784fa83b90b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:20.665521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4074-3259-4095-9b2f-784fa83b90b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:20.671176 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1943/3896] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:20.679495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:20.681157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:20.732579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e4ef4074-3259-4095-9b2f-784fa83b90b9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:20.734504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4ef4074-3259-4095-9b2f-784fa83b90b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:20.838921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207e80c-005f-4d53-a274-70e1f0447b63 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:20.850714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:20.851764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:20.852262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:20.852745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:20.865148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:20.895976 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1954/3897] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:20.904811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73dd2-1e69-4377-a14e-f7a3ac6d35ab None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:20.905833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73dd2-1e69-4377-a14e-f7a3ac6d35ab None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:20.906236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df73dd2-1e69-4377-a14e-f7a3ac6d35ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:20.936836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:20.954320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1df73dd2-1e69-4377-a14e-f7a3ac6d35ab None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:20.957800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1df73dd2-1e69-4377-a14e-f7a3ac6d35ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:20.979137 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1955/3898] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:20.982884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73dd2-1e69-4377-a14e-f7a3ac6d35ab None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:21.005863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df73dd2-1e69-4377-a14e-f7a3ac6d35ab None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:21.020215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:21.020928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:21.021299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:21.021623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:21.022313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:21.022440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:21.024189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:21.027048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:21.028214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:21.064561 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1956/3899] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:21.071446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:21.081401 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1944/3900] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:21.095342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a57b4-f5d7-4352-8f38-17b3a6596c59 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:21.108632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:21.109328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:21.109619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:21.109896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:21.110605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:21.113684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:21.215319 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1957/3901] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:21 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:21.219560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:21.235267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33bed9-b8a6-487a-acc2-ecc6a0245707 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:21.389204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:21.390790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:21.391358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:21.391731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:21.392773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:21.395282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:21.553702 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1945/3902] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:21 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:21.557760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:21.574980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2928f-f849-43d5-8934-b360fc35f09d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:21.588297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:21.595172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:21.595172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:21.595172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:21.595172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:21.596139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:21.619914 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1958/3903] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:21.626841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:21.641557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23913c0-9b0e-4bce-8858-b2e3b1044a6b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:21.658092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338f19b-a2e6-4975-ac6c-f6ff950f3d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:21.658729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338f19b-a2e6-4975-ac6c-f6ff950f3d96 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:21.659011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338f19b-a2e6-4975-ac6c-f6ff950f3d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:21.659341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338f19b-a2e6-4975-ac6c-f6ff950f3d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:21.660065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338f19b-a2e6-4975-ac6c-f6ff950f3d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:21.664325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338f19b-a2e6-4975-ac6c-f6ff950f3d96 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:21.688259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1946/3904] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:21.692786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:21.707865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becb6c8-d412-4be4-b24e-c67d6e5926e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:21.719642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:21.720340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:21.723382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:21.723980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] PATH_INFO: `/v3/projects/d7da04837f274837b4ae78eeb84e7ad5/users/edaf36cec0a3424fb5906ddac7c29358/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:21.766455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7da04837f274837b4ae78eeb84e7ad5, user_id=edaf36cec0a3424fb5906ddac7c29358, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:21.773048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:21.883148 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1959/3905] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:21 2022] PUT /identity/v3/projects/d7da04837f274837b4ae78eeb84e7ad5/users/edaf36cec0a3424fb5906ddac7c29358/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:21.889813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:21.890168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:21.890401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:21.941077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:21.945248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:22.127585 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1947/3906] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:22.142106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:22.144011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:22.188814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:22.190879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:22.229083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4704-6a66-4ab7-a70d-059d432e7e77 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:22.256495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:22.256495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:22.256495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:22.256495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] PATH_INFO: `/v3/users/4ffd67d699a74ccd91333d2faa8f19f1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:22.266387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffd67d699a74ccd91333d2faa8f19f1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:22.269724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:22.330851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46737472-eb2f-4043-9d6e-20abac1addc0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:22.390318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:22.390318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:22.390318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:22.390318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:22.390902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:22.390902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:22.396470 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1960/3907] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:22.398120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:22.400373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:22.459663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfdcfe-1da2-46ef-a085-fd42f830f9ba service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:22.471299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:22.471299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:22.471299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:22.471299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] PATH_INFO: `/v3/projects/04493f55ad8c48e08c5d8fc3e6ed8642` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:22.472221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=04493f55ad8c48e08c5d8fc3e6ed8642)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:22.475153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:22.508755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:22.665993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffd67d699a74ccd91333d2faa8f19f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.669059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffd67d699a74ccd91333d2faa8f19f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.683246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04493f55ad8c48e08c5d8fc3e6ed8642', 'request_id': 'req-e718c1a5-2919-437d-a67f-b92f21b8adfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.690810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04493f55ad8c48e08c5d8fc3e6ed8642', 'request_id': 'req-e718c1a5-2919-437d-a67f-b92f21b8adfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.763518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffd67d699a74ccd91333d2faa8f19f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.764142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffd67d699a74ccd91333d2faa8f19f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.778395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f234aea-b319-4731-a7cf-c7a2eb819346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffd67d699a74ccd91333d2faa8f19f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.823655 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1948/3908] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:22 2022] DELETE /identity/v3/users/4ffd67d699a74ccd91333d2faa8f19f1 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:22.826658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8908a-060b-47ad-888a-50332ea399c4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:22.826951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8908a-060b-47ad-888a-50332ea399c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:22.827229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8908a-060b-47ad-888a-50332ea399c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:22.870757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0a8908a-060b-47ad-888a-50332ea399c4 None None] MFA Rules not processed for user `2ff557eb6afe4b29bbccd87ffdbe21c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:22.873783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0a8908a-060b-47ad-888a-50332ea399c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:22.931183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04493f55ad8c48e08c5d8fc3e6ed8642', 'request_id': 'req-e718c1a5-2919-437d-a67f-b92f21b8adfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.964073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] The token cache is being invalidate because project 04493f55ad8c48e08c5d8fc3e6ed8642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:22.971152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.971152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e718c1a5-2919-437d-a67f-b92f21b8adfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:22.977498 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1961/3909] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:22 2022] DELETE /identity/v3/projects/04493f55ad8c48e08c5d8fc3e6ed8642 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:22.979255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:22.985617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:22.986216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:23.063223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:23.065827 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1949/3910] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:23.068023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da1f9-e1ff-48ee-8fa9-c8f7a5667461 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:23.068367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da1f9-e1ff-48ee-8fa9-c8f7a5667461 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:23.068700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8da1f9-e1ff-48ee-8fa9-c8f7a5667461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:23.078526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:23.117561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:23.143429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d8da1f9-e1ff-48ee-8fa9-c8f7a5667461 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:23.149228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d8da1f9-e1ff-48ee-8fa9-c8f7a5667461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:23.259482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1962/3911] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:23.283415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:23.285918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:23.336702 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1950/3912] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:23.340911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ac2-2ca5-48c1-b424-ae0858cec7be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:23.347719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ac2-2ca5-48c1-b424-ae0858cec7be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:23.353264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ac2-2ca5-48c1-b424-ae0858cec7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:23.441378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61b8c2-cb5d-4e1d-a123-525f899cf826 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:23.455607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:23.456427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:23.456687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:23.456968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:23.469826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c4f02ac2-2ca5-48c1-b424-ae0858cec7be None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:23.476255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4f02ac2-2ca5-48c1-b424-ae0858cec7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:23.489700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:23.491373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:23.495280 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1951/3913] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:23.500006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f02ac2-2ca5-48c1-b424-ae0858cec7be None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:23.520029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f02ac2-2ca5-48c1-b424-ae0858cec7be None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:23.533026 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1963/3914] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:39:23.536331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:23.540347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:23.540347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:23.540347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:23.540347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:23.540347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:23.542539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:23.586963 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1952/3915] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:23.591043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:23.609922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759f0dd-d1a4-48a0-9344-9e5744f82c93 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:23.617059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:23.618585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:23.619134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:23.619885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:23.621036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:23.623591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:23.758747 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1964/3916] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:23 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:23.760027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:23.776075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd10d3c-81bd-49d5-ab4d-1354f6ae4400 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:23.881317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:23.882002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:23.882310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:23.882638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:23.883295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:23.886204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:24.083236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:24.092752 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1953/3917] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:23 2022] POST /identity/v3/users => generated 281 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:24.097768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d931a2-7317-4be1-ab90-95b6e6934c78 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:24.103906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:24.107385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:24.107385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:24.107385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:24.107385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:24.108366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:24.120732 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1965/3918] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:24.125496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:24.145297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53c68f-1927-42e5-91ff-02336ef2f29b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:24.152500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0d7a-f39d-47d8-898a-7378049f0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:24.153406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0d7a-f39d-47d8-898a-7378049f0086 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:24.153917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0d7a-f39d-47d8-898a-7378049f0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:24.154991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0d7a-f39d-47d8-898a-7378049f0086 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:24.160100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb0d7a-f39d-47d8-898a-7378049f0086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:24.163200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb0d7a-f39d-47d8-898a-7378049f0086 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:24.203898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:24.207235 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1954/3919] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:24.218346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6478-9b6c-4c0d-8b59-d0a81eec6d40 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:24.228322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:24.233177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:24.233387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:24.233663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] PATH_INFO: `/v3/projects/596f5ca7eaab402a813c1edcaba7e4ec/users/37ac9c48c0d3436a9c10ad8700b34097/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:24.280806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=596f5ca7eaab402a813c1edcaba7e4ec, user_id=37ac9c48c0d3436a9c10ad8700b34097, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:24.288654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:24.400273 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1966/3920] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:24 2022] PUT /identity/v3/projects/596f5ca7eaab402a813c1edcaba7e4ec/users/37ac9c48c0d3436a9c10ad8700b34097/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:24.414086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:24.415011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:24.415390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:24.468806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] MFA Rules not processed for user `37ac9c48c0d3436a9c10ad8700b34097`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:24.468806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:24.642435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:24.645240 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1955/3921] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:24.681484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:24.683717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:24.761264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e87d50-446a-425b-8a74-03b03bcdfe4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:24.765397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:24.766274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:24.766796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:24.767227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:24.768034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:24.770170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:24.886981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7cdd-d4c4-4e87-950b-11d59120dbaf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:24.896157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:24.897098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:24.897545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:24.898150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] PATH_INFO: `/v3/projects/b705800add164387b0e14fdd177320bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:24.900106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b705800add164387b0e14fdd177320bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:24.918657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:24.966943 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1967/3922] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:24 2022] POST /identity/v3/projects => generated 367 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:24.972368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:25.089728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b705800add164387b0e14fdd177320bb', 'request_id': 'req-447aac28-623e-4ae1-af1f-8051ef6ab947'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.097716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b705800add164387b0e14fdd177320bb', 'request_id': 'req-447aac28-623e-4ae1-af1f-8051ef6ab947'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.097941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2e2fb-8ac8-45ec-b7a1-0bb0bf421eea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:25.187127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:25.190945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:25.190945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:25.190945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:25.190945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:25.191360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:25.210529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b705800add164387b0e14fdd177320bb', 'request_id': 'req-447aac28-623e-4ae1-af1f-8051ef6ab947'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.235124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] The token cache is being invalidate because project b705800add164387b0e14fdd177320bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:25.235551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.236401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.241432 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1956/3923] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:24 2022] DELETE /identity/v3/projects/b705800add164387b0e14fdd177320bb => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:25.242578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:25.245735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:25.264873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aac28-623e-4ae1-af1f-8051ef6ab947 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:25.283508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:25.284236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:25.284721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:25.285195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] PATH_INFO: `/v3/users/34aaaf6746e14a148b8002646845d25c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:25.286899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34aaaf6746e14a148b8002646845d25c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:25.297378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:25.309440 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1968/3924] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:24 2022] POST /identity/v3/users => generated 290 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:25.323128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:25.331572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:25.366723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e9769-4423-4242-a944-9e91df6c346c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:25.378635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:25.384261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:25.384261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:25.384261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:25.384261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:25.384261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:25.401959 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1969/3925] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:25.432079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:25.471294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e968-62e0-46de-a347-cfeca2e2f0e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:25.507288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:25.510807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:25.511098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:25.511380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] PATH_INFO: `/v3/projects/7c1d1f80e24b4737ba3d4b631afb47f9/users/252611ea03c841c48619a6ead90822fc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:25.557686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1d1f80e24b4737ba3d4b631afb47f9, user_id=252611ea03c841c48619a6ead90822fc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:25.569544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:25.615854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34aaaf6746e14a148b8002646845d25c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.616503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34aaaf6746e14a148b8002646845d25c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.687016 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1970/3926] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:25 2022] PUT /identity/v3/projects/7c1d1f80e24b4737ba3d4b631afb47f9/users/252611ea03c841c48619a6ead90822fc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:25.691221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:25.696691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:25.708772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:25.709631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34aaaf6746e14a148b8002646845d25c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.710308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34aaaf6746e14a148b8002646845d25c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.722900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34aaaf6746e14a148b8002646845d25c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:25.831813 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1957/3927] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:25 2022] DELETE /identity/v3/users/34aaaf6746e14a148b8002646845d25c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:25.943432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e39ec-75fa-4fb0-9f29-1bfdaccf0d06 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:26.088577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099d20c-7841-466b-a3ba-de91ea6c4bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:26.089398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d20c-7841-466b-a3ba-de91ea6c4bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:26.089754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d20c-7841-466b-a3ba-de91ea6c4bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:26.090172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d20c-7841-466b-a3ba-de91ea6c4bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:26.091163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099d20c-7841-466b-a3ba-de91ea6c4bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:26.093262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099d20c-7841-466b-a3ba-de91ea6c4bc7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:26.123470 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1971/3928] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:26.127746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:26.145002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd3a0a-b566-4ff1-ad07-56e6bdf4c691 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:26.156777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:26.157576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:26.158502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:26.159862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] PATH_INFO: `/v3/projects/7c1d1f80e24b4737ba3d4b631afb47f9/users/252611ea03c841c48619a6ead90822fc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:26.163028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1d1f80e24b4737ba3d4b631afb47f9, user_id=252611ea03c841c48619a6ead90822fc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:26.165929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:26.190210 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1958/3929] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:26 2022] PUT /identity/v3/projects/7c1d1f80e24b4737ba3d4b631afb47f9/users/252611ea03c841c48619a6ead90822fc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:26.193441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aad19-0636-4e03-8425-37c7987850f4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:26.193781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aad19-0636-4e03-8425-37c7987850f4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:26.194084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aad19-0636-4e03-8425-37c7987850f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:26.270702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d65aad19-0636-4e03-8425-37c7987850f4 None None] MFA Rules not processed for user `252611ea03c841c48619a6ead90822fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:26.273103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d65aad19-0636-4e03-8425-37c7987850f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:26.401126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:26.403195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:26.522516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:26.605105 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1972/3930] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:26.621036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074f30-77ff-4903-9952-3fb78dde028f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:26.621945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074f30-77ff-4903-9952-3fb78dde028f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:26.623085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074f30-77ff-4903-9952-3fb78dde028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:26.665853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f879c-1e22-40bf-ba19-56badfc14e89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:26.687753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:26.689409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:26.691202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:26.691702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] PATH_INFO: `/v3/users/548f86671c744430829ba6cc2d6463b6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:26.694332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548f86671c744430829ba6cc2d6463b6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:26.696864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e8074f30-77ff-4903-9952-3fb78dde028f None None] MFA Rules not processed for user `f278334f3cd646a89ec99502f0bfe636`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:26.698748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:26.700656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8074f30-77ff-4903-9952-3fb78dde028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:26.936130 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1973/3931] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:26.938323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074f30-77ff-4903-9952-3fb78dde028f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:26.977514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8074f30-77ff-4903-9952-3fb78dde028f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:26.982889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416880d-ae32-486a-b239-f0bb93fd1227 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:26.983729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416880d-ae32-486a-b239-f0bb93fd1227 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:26.984168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416880d-ae32-486a-b239-f0bb93fd1227 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:26.984663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416880d-ae32-486a-b239-f0bb93fd1227 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:26.985540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416880d-ae32-486a-b239-f0bb93fd1227 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:26.987633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416880d-ae32-486a-b239-f0bb93fd1227 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:27.053734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548f86671c744430829ba6cc2d6463b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:27.055581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548f86671c744430829ba6cc2d6463b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:27.142010 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1974/3932] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:26 2022] POST /identity/v3/projects => generated 359 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:27.143740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a214725-00b2-47d4-97fb-3a499c5f45ba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:27.144202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a214725-00b2-47d4-97fb-3a499c5f45ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:27.145054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a214725-00b2-47d4-97fb-3a499c5f45ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:27.172446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0a214725-00b2-47d4-97fb-3a499c5f45ba None None] MFA Rules not processed for user `f278334f3cd646a89ec99502f0bfe636`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:27.176932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a214725-00b2-47d4-97fb-3a499c5f45ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:27.179415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548f86671c744430829ba6cc2d6463b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:27.180365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548f86671c744430829ba6cc2d6463b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:27.195566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548f86671c744430829ba6cc2d6463b6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:27.242017 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1959/3933] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:26 2022] DELETE /identity/v3/users/548f86671c744430829ba6cc2d6463b6 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:27.243074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:27.249629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:27.302585 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1975/3934] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:27.306128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:27.306416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:27.306690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:27.347164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:27.349977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:27.405289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b77411-77b9-4a0c-a84c-c1e6a3b17fb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:27.427392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:27.428195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:27.433250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:27.433250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:27.433250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:27.444315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:27.594727 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1976/3935] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:27.594727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:27.598525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:27.644370 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1960/3936] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:27 2022] POST /identity/v3/users => generated 371 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:27.646405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:27.665998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:27.746439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ab2c2-ed45-4cf3-90c8-ff3c199cbee7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:27.754644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:27.755295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:27.755752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:27.756701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:27.759288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:27.809024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5406f-99b6-4c4b-aa95-c14804b21415 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:27.812930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:27.814092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:27.814286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:27.814715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:27.826892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:27.829126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:27.848045 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1961/3937] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:27.849334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:27.856363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:27.859682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:27.861603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:27.872833 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1977/3938] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:27.885652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce526c-e861-4b43-b3ff-b2a4842d9676 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:27.886774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:27.899609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:27.900783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:27.901241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:27.901687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] PATH_INFO: `/v3/projects/a60028c38c0e4d18835d9bf7c05fc6fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:27.905046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a60028c38c0e4d18835d9bf7c05fc6fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:27.907099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:27.914010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e387a4-8a54-4c7a-9a6c-318fe4d63dd0 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:27.935772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:27.937979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:27.938294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:27.938570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/919f0a4d7250466cb99e28cdd96ceb29` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:28.013584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:get_user(user_id=919f0a4d7250466cb99e28cdd96ceb29)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:28.021901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:28.021901 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1978/3939] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:39:27 2022] GET /identity/v3/users/919f0a4d7250466cb99e28cdd96ceb29 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:28.026098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:28.049323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bf285-4bfa-4ff1-9da3-28d19adf4c27 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:28.060575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:28.063381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:28.065165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:28.065556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/919f0a4d7250466cb99e28cdd96ceb29` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:28.069680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_user(user_id=919f0a4d7250466cb99e28cdd96ceb29)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:28.072943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:28.141302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a60028c38c0e4d18835d9bf7c05fc6fc', 'request_id': 'req-935c33ea-3f78-432e-9381-24fd29c1b7c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.155897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a60028c38c0e4d18835d9bf7c05fc6fc', 'request_id': 'req-935c33ea-3f78-432e-9381-24fd29c1b7c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.240017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a60028c38c0e4d18835d9bf7c05fc6fc', 'request_id': 'req-935c33ea-3f78-432e-9381-24fd29c1b7c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.257456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] The token cache is being invalidate because project a60028c38c0e4d18835d9bf7c05fc6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:28.257755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.262202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-935c33ea-3f78-432e-9381-24fd29c1b7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.264718 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1962/3940] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:27 2022] DELETE /identity/v3/projects/a60028c38c0e4d18835d9bf7c05fc6fc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:28.269990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ff45-f9b5-47c6-bc00-359bc4c74971 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:28.270391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ff45-f9b5-47c6-bc00-359bc4c74971 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:28.270677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83ff45-f9b5-47c6-bc00-359bc4c74971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:28.292956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919f0a4d7250466cb99e28cdd96ceb29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.327913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919f0a4d7250466cb99e28cdd96ceb29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.328770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919f0a4d7250466cb99e28cdd96ceb29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.333668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e83ff45-f9b5-47c6-bc00-359bc4c74971 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:28.335114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e83ff45-f9b5-47c6-bc00-359bc4c74971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:28.357074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919f0a4d7250466cb99e28cdd96ceb29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.450209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919f0a4d7250466cb99e28cdd96ceb29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.462847 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1979/3941] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:28 2022] DELETE /identity/v3/users/919f0a4d7250466cb99e28cdd96ceb29 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:28.464965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:28.465706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:28.668073 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1963/3942] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:28.678386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f8d5-b9b1-40e8-92df-ea2b39306854 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:28.679528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f8d5-b9b1-40e8-92df-ea2b39306854 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:28.679996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f8d5-b9b1-40e8-92df-ea2b39306854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:28.726254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e230d2-f10e-433d-bbd7-c63cda81bf12 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:28.735329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3a07f8d5-b9b1-40e8-92df-ea2b39306854 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:28.741880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:28.742220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a07f8d5-b9b1-40e8-92df-ea2b39306854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:28.744326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:28.744617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:28.745158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/b89d43673ac3440b88603a1a25880df9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:28.761045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b89d43673ac3440b88603a1a25880df9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:28.768707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:28.917811 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1964/3943] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:28.922988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f8d5-b9b1-40e8-92df-ea2b39306854 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:28.937661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f8d5-b9b1-40e8-92df-ea2b39306854 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:28.962771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89d43673ac3440b88603a1a25880df9', 'request_id': 'req-953cbc75-9c98-4a20-a51d-e56aff35ec4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:28.990779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89d43673ac3440b88603a1a25880df9', 'request_id': 'req-953cbc75-9c98-4a20-a51d-e56aff35ec4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.027580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:29.048455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:29.049222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:29.049734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:29.050702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:29.051983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:29.052560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:29.054501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:29.057069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89d43673ac3440b88603a1a25880df9', 'request_id': 'req-953cbc75-9c98-4a20-a51d-e56aff35ec4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.076343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] The token cache is being invalidate because project b89d43673ac3440b88603a1a25880df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:29.076798 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1965/3944] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:29.080973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:29.081157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.083399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.088622 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1980/3945] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:28 2022] DELETE /identity/v3/projects/b89d43673ac3440b88603a1a25880df9 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:29.096664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:29.100741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:29.103000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7f971-5672-45b7-937e-9ea709aff6b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:29.115360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:29.116958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:29.117667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:29.118182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:29.119483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:29.127068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:29.249294 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1966/3946] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:29 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:29.250405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:29.258616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:29.260816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cbc75-9c98-4a20-a51d-e56aff35ec4c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:29.391242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:29.391909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:29.392204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:29.392603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:29.393117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:29.397476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:29.432599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a8e1-877a-4c7f-a281-c13778019b8b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:29.444046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:29.444718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:29.445005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:29.445283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] PATH_INFO: `/v3/projects/34c7d8a7682f4d75b980c0d60de4d6fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:29.446620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c7d8a7682f4d75b980c0d60de4d6fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:29.459010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:29.547014 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1981/3947] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:29 2022] POST /identity/v3/projects => generated 359 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:29.551192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:29.568807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:29.654304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:29.669618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c7d8a7682f4d75b980c0d60de4d6fe', 'request_id': 'req-6366dcd5-4ca9-4d64-9c03-d933c43d8360'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.686526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c7d8a7682f4d75b980c0d60de4d6fe', 'request_id': 'req-6366dcd5-4ca9-4d64-9c03-d933c43d8360'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.798744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c7d8a7682f4d75b980c0d60de4d6fe', 'request_id': 'req-6366dcd5-4ca9-4d64-9c03-d933c43d8360'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.817494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] The token cache is being invalidate because project 34c7d8a7682f4d75b980c0d60de4d6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:29.821003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.822454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:29.825204 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1967/3948] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:29 2022] DELETE /identity/v3/projects/34c7d8a7682f4d75b980c0d60de4d6fe => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:29.828372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:29.830594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caaf96-b2a6-47f1-bc83-ed4a8c9d88ce tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:29.831187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:29.977007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1f08-fed7-4159-bb68-b56db547a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:29.977758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1f08-fed7-4159-bb68-b56db547a598 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:29.978178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1f08-fed7-4159-bb68-b56db547a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:29.980069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1f08-fed7-4159-bb68-b56db547a598 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:29.980871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1f08-fed7-4159-bb68-b56db547a598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:29.983398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1f08-fed7-4159-bb68-b56db547a598 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:29.995048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366dcd5-4ca9-4d64-9c03-d933c43d8360 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.009681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1b0a-374b-4066-af25-9feb1b68055d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.010688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1b0a-374b-4066-af25-9feb1b68055d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.011049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1b0a-374b-4066-af25-9feb1b68055d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.011398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1b0a-374b-4066-af25-9feb1b68055d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.012575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d1b0a-374b-4066-af25-9feb1b68055d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.015567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d1b0a-374b-4066-af25-9feb1b68055d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.100588 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1982/3949] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:29 2022] POST /identity/v3/users => generated 294 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:30.100588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.100588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.100588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.152341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:30.156849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:30.180685 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1983/3950] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:30.189719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.192137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:30.225099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6c8f-6e46-40eb-bbff-48f79e949e85 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.227322 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1968/3951] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:29 2022] POST /identity/v3/users => generated 417 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:30.229024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378ccc-89a2-405f-8493-fd42a26a5721 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.230237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378ccc-89a2-405f-8493-fd42a26a5721 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.230528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378ccc-89a2-405f-8493-fd42a26a5721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.240319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.241086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.241543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.242745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.245637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.250414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.276821 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1984/3952] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:30.277798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.304607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786816-1eea-4b67-87cb-d9a68b228417 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.313259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a8378ccc-89a2-405f-8493-fd42a26a5721 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:30.315091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8378ccc-89a2-405f-8493-fd42a26a5721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:30.316105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.317801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.318468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.320702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.320702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.320702 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:30.320702 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:30.320702 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:30.327063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.336479 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1969/3953] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:30.337416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378ccc-89a2-405f-8493-fd42a26a5721 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.368474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378ccc-89a2-405f-8493-fd42a26a5721 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.382593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.383635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.384242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.385076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.386272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.388554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.401900 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1970/3954] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:30.403162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.420171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8f089-67d1-4337-9431-54fa12c07f10 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.447124 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1985/3955] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:39:30 2022] POST /identity/v3/roles => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:30.447614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.463083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.465510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.466469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.466883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.467679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:30.468937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.474492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.494108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a5d0c-7964-4922-9bd5-f9f218719676 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.510868 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1971/3956] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:30.512866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.522747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.523430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.523717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.524000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] PATH_INFO: `/v3/projects/00268a549cc14a63ace1d947c9319dc3/users/5e7af6fbddc84b0fbe84bf5cd3947340/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.556128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51a39-e407-44ff-8f33-70c5e37d76d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.578608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.582657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.583940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.585686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/89509746e08d44fab348c11565cef268` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.592094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00268a549cc14a63ace1d947c9319dc3, user_id=5e7af6fbddc84b0fbe84bf5cd3947340, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.595954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.622106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:30.647847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:get_user(user_id=89509746e08d44fab348c11565cef268)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.650307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.663056 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1972/3957] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:39:30 2022] GET /identity/v3/users/89509746e08d44fab348c11565cef268 => generated 417 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:30.668442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.711531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c38a-af0c-4ca4-825b-3413b995b8bd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.720311 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1986/3958] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:30 2022] PUT /identity/v3/projects/00268a549cc14a63ace1d947c9319dc3/users/5e7af6fbddc84b0fbe84bf5cd3947340/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:30.721717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:30.862641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.863511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.865387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.865839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.866189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee87d24-e94c-4671-ad99-dd4319a1a884 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:30.868294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.873351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.878659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4fbc3-23db-4402-b25f-7a4264c8471e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:30.879315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fbc3-23db-4402-b25f-7a4264c8471e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.879599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fbc3-23db-4402-b25f-7a4264c8471e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.879877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fbc3-23db-4402-b25f-7a4264c8471e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/roles/dafd3b9e0ce040faa40dff00329a6c2a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.882100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4fbc3-23db-4402-b25f-7a4264c8471e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:get_role(role_id=dafd3b9e0ce040faa40dff00329a6c2a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:30.883031 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-b1c4fbc3-23db-4402-b25f-7a4264c8471e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:30.883031 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:30.883031 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:30.883937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4fbc3-23db-4402-b25f-7a4264c8471e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:30.894324 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1987/3959] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:39:30 2022] GET /identity/v3/roles/dafd3b9e0ce040faa40dff00329a6c2a => generated 240 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:30.898611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:30.898611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:30.898611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:30.964706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:30.974035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] MFA Rules not processed for user `5e7af6fbddc84b0fbe84bf5cd3947340`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:30.975391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:31.061148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1973/3960] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:30 2022] POST /identity/v3/projects => generated 365 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:31.062441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:31.125564 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1988/3961] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:31.126989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:31.132962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:31.255274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ad9ca-7b77-4f5d-827e-679331e647c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:31.260742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:31.261391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:31.261669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:31.261946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:31.262619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:31.267579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:31.409463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613008-cbb6-4f0d-b515-4ce22633adee None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:31.519460 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1974/3962] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:31 2022] POST /identity/v3/projects => generated 357 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:31.520248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:31.615590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:31.617289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:31.617950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:31.618933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:31.622315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:31.628512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f400bbb-c367-4863-bb64-cdb18dffd5a6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:31.643394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:31.646674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:31.654341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:31.654987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:31.655343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:31.655888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:31.656610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:31.663649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:31.683413 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1989/3963] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:31.685044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:31.690020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:31.859748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92972bb8-abd0-43d0-8698-b469925b3507 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:31.863210 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1975/3964] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:31 2022] POST /identity/v3/users => generated 283 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:31.864078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:32.013747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:32.015822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.018202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.020164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.148000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f810-1712-4917-a08f-981197fc2cd4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:32.171843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:32.172786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.173287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.173741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/0b4dfca424ea40609c87230203f2d1a6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.176700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b4dfca424ea40609c87230203f2d1a6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:32.185842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:32.192879 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1976/3965] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:39:31 2022] GET /identity/v3/projects/0b4dfca424ea40609c87230203f2d1a6 => generated 357 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:32.199820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:32.225049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45208-b290-44e1-b167-83a30c6d7086 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:32.229469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:32.230634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.231183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.231746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.232668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:32.236883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:32.253874 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1977/3966] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:32 2022] GET /identity/v3/roles => generated 1651 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:32.254898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:32.270425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63399-952a-4698-9e41-7fe59e5e26d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:32.275027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:32.276612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:32.277435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:32.278542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.278923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.279359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/0b4dfca424ea40609c87230203f2d1a6/users/89509746e08d44fab348c11565cef268/roles/dafd3b9e0ce040faa40dff00329a6c2a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.281891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0b4dfca424ea40609c87230203f2d1a6, user_id=89509746e08d44fab348c11565cef268, role_id=dafd3b9e0ce040faa40dff00329a6c2a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:32.284945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:32.295526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:32.331329 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1990/3967] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:32.331329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:32.346116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4f2d7-e50a-4e50-874d-bda2f550477d service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:32.355150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:32.355902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.359546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.359546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.359546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:32.359546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:32.389851 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1978/3968] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:32 2022] PUT /identity/v3/projects/0b4dfca424ea40609c87230203f2d1a6/users/89509746e08d44fab348c11565cef268/roles/dafd3b9e0ce040faa40dff00329a6c2a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:32.393767 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1991/3969] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:32 2022] GET /identity/v3/roles => generated 1651 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:32.394275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:32.397690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:32.445016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2f78-f69a-42cf-a699-a9a9e01112af admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:32.624727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff182a8e-431a-4bf9-a0cd-df8b0d827cc3 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:32.636152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:32.636926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.637203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.639775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.640503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:32.645324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:32.647886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e36156-31b5-4398-99cd-b7ac86b79be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:32.652089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36156-31b5-4398-99cd-b7ac86b79be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.652089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36156-31b5-4398-99cd-b7ac86b79be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.652089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36156-31b5-4398-99cd-b7ac86b79be7 admin admin] PATH_INFO: `/v3/projects/3c6a1e83216c4a3882adbeab292b822f/users/62ff0a5713b44b7aac67e73e037e8a6b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.707141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e36156-31b5-4398-99cd-b7ac86b79be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6a1e83216c4a3882adbeab292b822f, user_id=62ff0a5713b44b7aac67e73e037e8a6b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:32.710471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e36156-31b5-4398-99cd-b7ac86b79be7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:32.836030 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1992/3970] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:32 2022] PUT /identity/v3/projects/3c6a1e83216c4a3882adbeab292b822f/users/62ff0a5713b44b7aac67e73e037e8a6b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:32.843303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c606-12fc-4548-b503-317d2160396b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:32.857373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c606-12fc-4548-b503-317d2160396b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:32.857373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c606-12fc-4548-b503-317d2160396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:32.857624 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1979/3971] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:32 2022] POST /identity/v3/projects => generated 359 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:32.860750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:32.907409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5f60c606-12fc-4548-b503-317d2160396b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:32.911535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f60c606-12fc-4548-b503-317d2160396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:33.025294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c68bc-eec3-4380-a5c6-348542f0c1d0 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:33.043817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1ba17-3b4d-418c-a1de-021493513ea4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:33.047506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ba17-3b4d-418c-a1de-021493513ea4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:33.047800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ba17-3b4d-418c-a1de-021493513ea4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:33.051777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ba17-3b4d-418c-a1de-021493513ea4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/fa29e93bfcf841dea8688c17677f602d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:33.053422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1ba17-3b4d-418c-a1de-021493513ea4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:get_project(project_id=fa29e93bfcf841dea8688c17677f602d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:33.063113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1ba17-3b4d-418c-a1de-021493513ea4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:33.074683 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1980/3972] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:39:32 2022] GET /identity/v3/projects/fa29e93bfcf841dea8688c17677f602d => generated 359 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:33.081385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436627-3603-4a13-9d77-b4883e5e318b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:33.081780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436627-3603-4a13-9d77-b4883e5e318b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:33.082143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10436627-3603-4a13-9d77-b4883e5e318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:33.102076 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1993/3973] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:33.109689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c606-12fc-4548-b503-317d2160396b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:33.145962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60c606-12fc-4548-b503-317d2160396b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:33.155889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10436627-3603-4a13-9d77-b4883e5e318b None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:33.163090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10436627-3603-4a13-9d77-b4883e5e318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:33.164710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:33.167503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:33.168016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:33.168466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/fa29e93bfcf841dea8688c17677f602d/users/89509746e08d44fab348c11565cef268/roles/dafd3b9e0ce040faa40dff00329a6c2a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:33.175080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fa29e93bfcf841dea8688c17677f602d, user_id=89509746e08d44fab348c11565cef268, role_id=dafd3b9e0ce040faa40dff00329a6c2a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:33.185434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:33.275333 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1994/3974] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:33 2022] PUT /identity/v3/projects/fa29e93bfcf841dea8688c17677f602d/users/89509746e08d44fab348c11565cef268/roles/dafd3b9e0ce040faa40dff00329a6c2a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:33.279859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:33.286999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:33.309505 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1981/3975] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:39:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:33.310714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436627-3603-4a13-9d77-b4883e5e318b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:33.346348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10436627-3603-4a13-9d77-b4883e5e318b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:33.443034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b2763-b21e-47d1-9681-151f1dcec778 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:33.454658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:33.456575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:33.456974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:33.457356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:33.510996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:33.511918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:33.512316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:33.513332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/89509746e08d44fab348c11565cef268/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:33.516858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=89509746e08d44fab348c11565cef268)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:33.521786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:33.554841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:33.721958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:33.727073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:33.735943 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1982/3976] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:39:33 2022] GET /identity/v3/users/89509746e08d44fab348c11565cef268/projects => generated 840 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:33.743081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:33.749846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:33.757211 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1995/3977] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:33.761732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:33.806426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559870c-b82b-4f9b-90ab-53aa0f2210e0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:33.818592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:33.819387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:33.819782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:33.820166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/fa29e93bfcf841dea8688c17677f602d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:33.822817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa29e93bfcf841dea8688c17677f602d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:33.824919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:33.995963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e65c2-20eb-4a15-8760-eec8faf4d393 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:34.018229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:34.020972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:34.023062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:34.027239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:34.122796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa29e93bfcf841dea8688c17677f602d', 'request_id': 'req-57bc55cc-e731-4f22-bb04-97defa5c3d1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.135182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa29e93bfcf841dea8688c17677f602d', 'request_id': 'req-57bc55cc-e731-4f22-bb04-97defa5c3d1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.203399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:34.205560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:34.228383 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1983/3978] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:34.267134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa29e93bfcf841dea8688c17677f602d', 'request_id': 'req-57bc55cc-e731-4f22-bb04-97defa5c3d1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.285162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] The token cache is being invalidate because project fa29e93bfcf841dea8688c17677f602d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:34.285495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.286305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.289641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1996/3979] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:33 2022] DELETE /identity/v3/projects/fa29e93bfcf841dea8688c17677f602d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:34.300585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:34.324883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671b9cc-7375-4ee4-9760-2332ea798353 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:34.405175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:34.405758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:34.406305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:34.409348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/0b4dfca424ea40609c87230203f2d1a6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:34.409348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b4dfca424ea40609c87230203f2d1a6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:34.410319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:34.708125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4dfca424ea40609c87230203f2d1a6', 'request_id': 'req-a3c24a9f-83e2-43f0-854e-701946192784'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.724545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4dfca424ea40609c87230203f2d1a6', 'request_id': 'req-a3c24a9f-83e2-43f0-854e-701946192784'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.878820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4dfca424ea40609c87230203f2d1a6', 'request_id': 'req-a3c24a9f-83e2-43f0-854e-701946192784'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.899143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] The token cache is being invalidate because project 0b4dfca424ea40609c87230203f2d1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:34.899704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.903810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:34.911709 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1984/3980] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:34 2022] DELETE /identity/v3/projects/0b4dfca424ea40609c87230203f2d1a6 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:34.915800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:34.918234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:34.939516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc55cc-e731-4f22-bb04-97defa5c3d1f tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:35.073745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:35.074610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:35.075010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:35.075833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/roles/dafd3b9e0ce040faa40dff00329a6c2a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:35.079743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dafd3b9e0ce040faa40dff00329a6c2a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:35.084317 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:35.084317 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:35.084317 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:35.084317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:35.145462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:35.321810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invalidating the token cache because role dafd3b9e0ce040faa40dff00329a6c2a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:35.321810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:35.321810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-74fd5f2d-793c-4955-b0f4-434352fe60b8 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:35.323577 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1997/3981] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:34 2022] DELETE /identity/v3/roles/dafd3b9e0ce040faa40dff00329a6c2a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:35.327533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:35.329087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:35.354142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c24a9f-83e2-43f0-854e-701946192784 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:35.494119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:35.494119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:35.494119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:35.558554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:35.559263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:35.559681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:35.559959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/89509746e08d44fab348c11565cef268` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:35.563646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_user(user_id=89509746e08d44fab348c11565cef268)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:35.566530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:35.572603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:35.578627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:35.691973 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1998/3982] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:39:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:35.705165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:35.706959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:35.721808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89509746e08d44fab348c11565cef268'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:35.730244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89509746e08d44fab348c11565cef268'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:35.865185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c094f-956f-4ac4-9bf5-c61109d89da6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:35.874195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89509746e08d44fab348c11565cef268'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:35.875604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89509746e08d44fab348c11565cef268'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:35.883663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:35.884419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:35.884925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:35.885537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:35.888864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89509746e08d44fab348c11565cef268'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:35.889421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:35.909494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:35.911706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:35.939698 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1985/3983] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:35 2022] DELETE /identity/v3/users/89509746e08d44fab348c11565cef268 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:35.944570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:35.946388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:35.962214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 1999/3984] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:36.079603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:36.176654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8f1df-c642-47e0-879f-1c9ba23eaba1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:36.198700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:36.199955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:36.200581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:36.201113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/13247503db08400ea64a0e8a50ca2fee` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:36.202827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13247503db08400ea64a0e8a50ca2fee)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:36.205224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:36.401140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13247503db08400ea64a0e8a50ca2fee', 'request_id': 'req-32f63906-e43e-41f2-97dc-ff1bc880184c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:36.417897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13247503db08400ea64a0e8a50ca2fee', 'request_id': 'req-32f63906-e43e-41f2-97dc-ff1bc880184c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:36.500475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13247503db08400ea64a0e8a50ca2fee', 'request_id': 'req-32f63906-e43e-41f2-97dc-ff1bc880184c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:36.547452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] The token cache is being invalidate because project 13247503db08400ea64a0e8a50ca2fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:36.547808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:36.550892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32f63906-e43e-41f2-97dc-ff1bc880184c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:36.555436 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1986/3985] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:35 2022] DELETE /identity/v3/projects/13247503db08400ea64a0e8a50ca2fee => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:36.561485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:36.579804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481876-b260-4ef2-b7b4-1e58a886cc97 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:36.678635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:36.801817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:36.802529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:36.809263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:36.809263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/37ac9c48c0d3436a9c10ad8700b34097` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:36.809263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:update_user(user_id=37ac9c48c0d3436a9c10ad8700b34097)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:36.813166 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:39:36.813166 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:39:36.813166 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:39:36.814555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:37.006285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:37.124021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invalidating the token cache because user 37ac9c48c0d3436a9c10ad8700b34097 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:37.124856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:37.125721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:37.128093 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2000/3986] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Oct 18 13:39:36 2022] PATCH /identity/v3/users/37ac9c48c0d3436a9c10ad8700b34097 => generated 294 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:37.133722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f700610-9bd4-44ad-88f6-ae8de7bb30d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:37.134078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f700610-9bd4-44ad-88f6-ae8de7bb30d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:37.134568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f700610-9bd4-44ad-88f6-ae8de7bb30d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:37.284090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f700610-9bd4-44ad-88f6-ae8de7bb30d7 None None] MFA Rules not processed for user `37ac9c48c0d3436a9c10ad8700b34097`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:37.285334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f700610-9bd4-44ad-88f6-ae8de7bb30d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:37.310864 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1987/3987] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:37 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:37.312142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:37.314011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:37.343110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8ac40-8341-4403-b73d-093599068ae4 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:37.355643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:37.355968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:37.356201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:37.358545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:37.361256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:37.362246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:37.362365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/37ac9c48c0d3436a9c10ad8700b34097` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:37.365880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:update_user(user_id=37ac9c48c0d3436a9c10ad8700b34097)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:37.376519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:37.413179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:37.419626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:37.423661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:37.573797 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1988/3988] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 18 13:39:37.580512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:37.597292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:37.599082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:37.673173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invalidating the token cache because user 37ac9c48c0d3436a9c10ad8700b34097 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:37.673610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:37.674361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:37.677056 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2001/3989] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Oct 18 13:39:37 2022] PATCH /identity/v3/users/37ac9c48c0d3436a9c10ad8700b34097 => generated 294 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:37.689882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:37.691564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:37.741843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a9016-f5da-4745-bf84-7f04117f81dd tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:37.768622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:37.769289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:37.769577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:37.769858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/37ac9c48c0d3436a9c10ad8700b34097` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:37.808104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:update_user(user_id=37ac9c48c0d3436a9c10ad8700b34097)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:37.813738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:37.830985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01be6-b301-411e-80eb-dd2945c02855 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:37.838235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a439aaf-da79-4a84-94d8-2a11c589f7c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:37.838873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439aaf-da79-4a84-94d8-2a11c589f7c7 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:37.839505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439aaf-da79-4a84-94d8-2a11c589f7c7 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:37.839798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439aaf-da79-4a84-94d8-2a11c589f7c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:37.842436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2a439aaf-da79-4a84-94d8-2a11c589f7c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:37.883592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a439aaf-da79-4a84-94d8-2a11c589f7c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:37.902239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a439aaf-da79-4a84-94d8-2a11c589f7c7 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:37.928136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:37.931863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1989/3990] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:38.002317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invalidating the token cache because user 37ac9c48c0d3436a9c10ad8700b34097 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:38.002622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:38.003254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:38.005458 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2002/3991] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Oct 18 13:39:37 2022] PATCH /identity/v3/users/37ac9c48c0d3436a9c10ad8700b34097 => generated 294 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:38.009926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eedb3f-05e2-4aad-a483-f200e8e6992d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:38.011007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eedb3f-05e2-4aad-a483-f200e8e6992d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:38.011260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eedb3f-05e2-4aad-a483-f200e8e6992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:38.091927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-60eedb3f-05e2-4aad-a483-f200e8e6992d None None] MFA Rules not processed for user `37ac9c48c0d3436a9c10ad8700b34097`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:38.093563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60eedb3f-05e2-4aad-a483-f200e8e6992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:38.098240 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1990/3992] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:38 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:38.102632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:38.107134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:38.157659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeac97-6f55-45b4-aee9-f33458ee0e7d tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:38.177850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:38.177850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:38.178988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:38.179662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/37ac9c48c0d3436a9c10ad8700b34097` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:38.185549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:update_user(user_id=37ac9c48c0d3436a9c10ad8700b34097)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:38.188369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:38.353547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:38.399521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:38.436733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invalidating the token cache because user 37ac9c48c0d3436a9c10ad8700b34097 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:38.437549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:38.441786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36280517-39a4-4fab-92af-2056c103202e tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:38.453316 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2003/3993] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Oct 18 13:39:38 2022] PATCH /identity/v3/users/37ac9c48c0d3436a9c10ad8700b34097 => generated 294 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:38.457248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eedb3f-05e2-4aad-a483-f200e8e6992d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:38.489978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eedb3f-05e2-4aad-a483-f200e8e6992d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:38.497027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:38.498258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:38.499090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:38.499090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:38.500616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:38.502617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:38.514635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:38.515217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:38.515662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:38.545517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:38.547088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:38.557862 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2004/3994] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:39:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 18 13:39:38.573566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:38.575203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:38.599395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d900d3-b55c-44b7-9606-3482fca592d8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:38.606939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a381d-47c9-4bc2-af55-a54947130b9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:38.607577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a381d-47c9-4bc2-af55-a54947130b9c service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:38.607862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a381d-47c9-4bc2-af55-a54947130b9c service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:38.608224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a381d-47c9-4bc2-af55-a54947130b9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:38.625500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a381d-47c9-4bc2-af55-a54947130b9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:38.627225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a381d-47c9-4bc2-af55-a54947130b9c service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:38.662267 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1991/3995] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:39:38 2022] POST /identity/v3/users => generated 264 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:38.666848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:38.671097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:38.686038 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2005/3996] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:39:38.715413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37c3b4-b872-411f-ab07-0bb58588acb1 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:38.732240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee95ffa-35d9-40b2-a675-f9c173b60a3a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:38.732935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee95ffa-35d9-40b2-a675-f9c173b60a3a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:38.733226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee95ffa-35d9-40b2-a675-f9c173b60a3a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:38.733638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee95ffa-35d9-40b2-a675-f9c173b60a3a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/4b5ca63d57454ca7ad4faf7c0e2ebf8e/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:39.030320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bee95ffa-35d9-40b2-a675-f9c173b60a3a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4b5ca63d57454ca7ad4faf7c0e2ebf8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:39.109881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1992/3997] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:39:38 2022] POST /identity/v3/users/4b5ca63d57454ca7ad4faf7c0e2ebf8e/password => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:39.576391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4fb32-ae14-4686-b53a-018dbfe54773 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:39.577502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4fb32-ae14-4686-b53a-018dbfe54773 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:39.578133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4fb32-ae14-4686-b53a-018dbfe54773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:39.663140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a2f4fb32-ae14-4686-b53a-018dbfe54773 None None] MFA Rules not processed for user `edaf36cec0a3424fb5906ddac7c29358`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:39.672219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a2f4fb32-ae14-4686-b53a-018dbfe54773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:39.691309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:39.738116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:39.738675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:39.738675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:39.834400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:39.844314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:39.866750 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2006/3998] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:39.867524 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1993/3999] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:39:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:39.884736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4fb32-ae14-4686-b53a-018dbfe54773 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:39.907391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4fb32-ae14-4686-b53a-018dbfe54773 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:39.919793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb242ee-73de-4bdc-b6c7-7ec56cca1ade service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:39.920760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb242ee-73de-4bdc-b6c7-7ec56cca1ade service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:39.921230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb242ee-73de-4bdc-b6c7-7ec56cca1ade service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:39.921686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb242ee-73de-4bdc-b6c7-7ec56cca1ade service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:39.933612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb242ee-73de-4bdc-b6c7-7ec56cca1ade service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:39.936264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:39.938029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:39.949132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb242ee-73de-4bdc-b6c7-7ec56cca1ade service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:39.975127 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2007/4000] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:40.116356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69106b-046d-4ac0-97a8-b4b649675be6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:40.116647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69106b-046d-4ac0-97a8-b4b649675be6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:40.116929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69106b-046d-4ac0-97a8-b4b649675be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:40.118905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87d6d-621e-41e9-bdba-7736321afac7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:40.126613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:40.127702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:40.128297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:40.128840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:40.140848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:40.143131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:40.151413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9a69106b-046d-4ac0-97a8-b4b649675be6 None None] MFA Rules not processed for user `4b5ca63d57454ca7ad4faf7c0e2ebf8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:40.152639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a69106b-046d-4ac0-97a8-b4b649675be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:40.163122 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2008/4001] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:40 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:40.165663 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1994/4002] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:40.166764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69106b-046d-4ac0-97a8-b4b649675be6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:40.199255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69106b-046d-4ac0-97a8-b4b649675be6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:40.207720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:40.208431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:40.213402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:40.213402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:40.223029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:40.225260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:40.241096 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2009/4003] 10.222.0.27 () {56 vars in 1263 bytes} [Tue Oct 18 13:39:40 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:40.245293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:40.264839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8000d-69b2-4a2c-a67d-47a1c312dc6b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:40.302164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:40.302164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:40.302164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:40.302589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/4b5ca63d57454ca7ad4faf7c0e2ebf8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:40.302712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4b5ca63d57454ca7ad4faf7c0e2ebf8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:40.310094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:40.539663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5ca63d57454ca7ad4faf7c0e2ebf8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:40.540832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5ca63d57454ca7ad4faf7c0e2ebf8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:40.672087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5ca63d57454ca7ad4faf7c0e2ebf8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:40.673005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5ca63d57454ca7ad4faf7c0e2ebf8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:40.694759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-29cc8e8a-de5b-459d-a156-dd321853de5c tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5ca63d57454ca7ad4faf7c0e2ebf8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:40.748066 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1995/4004] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:40 2022] DELETE /identity/v3/users/4b5ca63d57454ca7ad4faf7c0e2ebf8e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:40.765455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:40.782082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04341-f304-4dbc-8856-8d3b697a52aa tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:40.902042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:40.902794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:40.903343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:40.903742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:40.904799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:40.909050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:40.932531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:40.932941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:40.933336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:40.979068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:40.981232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:41.057126 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2010/4005] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:40 2022] POST /identity/v3/users => generated 367 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:41.060388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:41.068514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:41.084720 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1996/4006] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:39:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:41.096384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ebee-9002-4c11-ad03-c9de486f8a4a tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:41.107826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:41.109720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:41.111037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:41.111391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:41.111633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:41.112005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:41.112883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:41.115133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:41.265669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c7ef1-b182-4a5c-97a7-fd5db49959fe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:41.282657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:41.283286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:41.283572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:41.283850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:41.294727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:41.296336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:41.313570 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2011/4007] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:41 2022] POST /identity/v3/projects => generated 360 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:41.315450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:41.318427 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1997/4008] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:41.542228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69cae-c6a2-4b62-aa6a-1c8e58029fb6 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:41.550455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:41.553295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:41.553787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:41.554137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/584be09339404e3990115a981467321b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:41.581471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:update_user(user_id=584be09339404e3990115a981467321b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:41.584853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:41.737197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2012/4009] 10.222.0.27 () {60 vars in 1244 bytes} [Tue Oct 18 13:39:41 2022] PATCH /identity/v3/users/584be09339404e3990115a981467321b => generated 522 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:41.745119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:41.757182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2482dff-cdb0-40cc-b0d7-4be4ca7e9f01 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:41.766182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:41.767216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:41.767530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:41.768013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/584be09339404e3990115a981467321b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:41.822799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:get_user(user_id=584be09339404e3990115a981467321b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:41.826442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:41.832650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1998/4010] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 13:39:41 2022] GET /identity/v3/users/584be09339404e3990115a981467321b => generated 389 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:39:41.832873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:41.843653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59663030-411d-4d9f-8002-8ee765ea9478 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:41.850630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:41.851562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:41.852222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:41.852666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/projects/84b77ab9e5de4004858ca40ac6b12b91` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:41.854256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_project(project_id=84b77ab9e5de4004858ca40ac6b12b91)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:41.856688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:41.922756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:41.928283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:41.930907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:42.027394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b77ab9e5de4004858ca40ac6b12b91', 'request_id': 'req-1e99fb8a-5f90-41a1-8271-648c61b40f62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.050524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b77ab9e5de4004858ca40ac6b12b91', 'request_id': 'req-1e99fb8a-5f90-41a1-8271-648c61b40f62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.158662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df828-2168-4199-a77b-46d7a062c404 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:42.169489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:42.169489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b77ab9e5de4004858ca40ac6b12b91', 'request_id': 'req-1e99fb8a-5f90-41a1-8271-648c61b40f62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.201147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] The token cache is being invalidate because project 84b77ab9e5de4004858ca40ac6b12b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:42.201147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.201147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.202093 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2013/4011] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:41 2022] DELETE /identity/v3/projects/84b77ab9e5de4004858ca40ac6b12b91 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:42.206415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:42.208677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:42.348610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99fb8a-5f90-41a1-8271-648c61b40f62 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:42.353590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:42.354269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:42.354928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:42.355867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] PATH_INFO: `/v3/users/5e7af6fbddc84b0fbe84bf5cd3947340` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:42.358904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7af6fbddc84b0fbe84bf5cd3947340)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:42.361673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252611ea03c841c48619a6ead90822fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c1d1f80e24b4737ba3d4b631afb47f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:42.363366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:42.363660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:42.370403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] PATH_INFO: `/v3/users/584be09339404e3990115a981467321b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:42.370556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:42.370684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorizing `identity:delete_user(user_id=584be09339404e3990115a981467321b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:42.375181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:42.594631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584be09339404e3990115a981467321b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.610916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584be09339404e3990115a981467321b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.612942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584be09339404e3990115a981467321b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.630206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584be09339404e3990115a981467321b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.699350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7af6fbddc84b0fbe84bf5cd3947340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.700667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7af6fbddc84b0fbe84bf5cd3947340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.713722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584be09339404e3990115a981467321b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.726715 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2014/4012] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:42 2022] DELETE /identity/v3/users/584be09339404e3990115a981467321b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:42.732422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:42.734686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:42.857304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7af6fbddc84b0fbe84bf5cd3947340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.865103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc441b-3468-4fea-8fe2-3042747fa151 tempest-UsersV3TestJSON-1659226050 tempest-UsersV3TestJSON-1659226050-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:42.865587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7af6fbddc84b0fbe84bf5cd3947340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.871741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:42.872512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:42.874153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:42.874479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] PATH_INFO: `/v3/users/37ac9c48c0d3436a9c10ad8700b34097` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:42.879303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2ecf39d2-6905-4e6d-a048-a08390783e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7af6fbddc84b0fbe84bf5cd3947340'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:42.899878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ac9c48c0d3436a9c10ad8700b34097)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:42.902011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:42.919127 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 1999/4013] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:41 2022] DELETE /identity/v3/users/5e7af6fbddc84b0fbe84bf5cd3947340 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:42.921601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:42.922148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:42.922275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:42.954495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:42.956606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:43.042386 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2000/4014] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:43.053834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:43.056666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:43.201459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37017-a87f-437f-8fdc-f6670237be67 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:43.206363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83253f0a-8fcd-4599-bc0f-736c46b3fbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:43.206967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:43.207200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253f0a-8fcd-4599-bc0f-736c46b3fbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:43.207538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253f0a-8fcd-4599-bc0f-736c46b3fbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:43.208668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253f0a-8fcd-4599-bc0f-736c46b3fbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:43.221413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:43.222626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:43.224500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83253f0a-8fcd-4599-bc0f-736c46b3fbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:43.228091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83253f0a-8fcd-4599-bc0f-736c46b3fbe1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:43.240145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:43.245873 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2001/4015] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:43.313331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ac9c48c0d3436a9c10ad8700b34097'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:43.322092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2015/4016] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:42 2022] DELETE /identity/v3/users/37ac9c48c0d3436a9c10ad8700b34097 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:43.331247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:43.331908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:43.332441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:43.405043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:43.409860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:43.543359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2002/4017] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:43.572502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:43.578268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:43.743285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315ce9e-ce3c-4dc2-9ba4-430bbba5079c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:43.749649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:43.750352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:43.750683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:43.751019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:43.773569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:43.775287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:43.798536 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2016/4018] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:44.587969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:44.781790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:45.224952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:45.226748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:45.250643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b91116-6a77-4bb9-9d3d-c9ac6e85d765 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:45.263672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:45.265726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:45.266383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:45.266735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] PATH_INFO: `/v3/projects/00268a549cc14a63ace1d947c9319dc3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:45.277985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=00268a549cc14a63ace1d947c9319dc3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:45.279934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:45.423857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:45.425427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:45.478006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00268a549cc14a63ace1d947c9319dc3', 'request_id': 'req-9dc02ecc-d943-4016-b879-706a0f99e4fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:45.517890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00268a549cc14a63ace1d947c9319dc3', 'request_id': 'req-9dc02ecc-d943-4016-b879-706a0f99e4fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:45.631229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00268a549cc14a63ace1d947c9319dc3', 'request_id': 'req-9dc02ecc-d943-4016-b879-706a0f99e4fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:45.660712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] The token cache is being invalidate because project 00268a549cc14a63ace1d947c9319dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:45.661025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:45.664283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9dc02ecc-d943-4016-b879-706a0f99e4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:45.671412 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2003/4019] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:45 2022] DELETE /identity/v3/projects/00268a549cc14a63ace1d947c9319dc3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:45.676646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0da3-d8cd-47ad-80c7-3b3f0270bf5d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:45.677070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0da3-d8cd-47ad-80c7-3b3f0270bf5d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:45.677366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0da3-d8cd-47ad-80c7-3b3f0270bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:45.692404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da9e6-03e3-4dc6-9a09-ada47e7dc2f0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:45.740470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17fa0da3-d8cd-47ad-80c7-3b3f0270bf5d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:45.746400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17fa0da3-d8cd-47ad-80c7-3b3f0270bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:45.901282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:45.901979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:45.905592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:45.905822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:45.910777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:45.949516 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2004/4020] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:45.951295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:45.951688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:45.951885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:45.952003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:45.953513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:45.976679 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2017/4021] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:46.030656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:46.035174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:46.060885 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2005/4022] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:46.065351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.085954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d66fa-e0bc-4395-81ad-e34af0bfbffb service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.092547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.093283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.093507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.093787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.094484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:46.094793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.096433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.116165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.117682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:46.143299 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2018/4023] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:46.147087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.160596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b811d3-13ca-4bfe-b6b8-541094b6b950 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.167726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef63c-7810-4182-9f50-4c9f083a8435 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.173215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.173874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.175824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.177515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] PATH_INFO: `/v3/projects/596f5ca7eaab402a813c1edcaba7e4ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.179716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=596f5ca7eaab402a813c1edcaba7e4ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.184344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.185482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.185769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.186049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.186439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.186724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.191931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.379702 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2019/4024] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:46 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:46.383538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.415266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596f5ca7eaab402a813c1edcaba7e4ec', 'request_id': 'req-5f832377-0cf7-4c82-8403-1982beb51a3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:46.457240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596f5ca7eaab402a813c1edcaba7e4ec', 'request_id': 'req-5f832377-0cf7-4c82-8403-1982beb51a3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:46.535759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628db1c-53eb-42b5-97ec-eafad0e8a512 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.542720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.543588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.544601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.546469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596f5ca7eaab402a813c1edcaba7e4ec', 'request_id': 'req-5f832377-0cf7-4c82-8403-1982beb51a3c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:46.546783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.549555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.549695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.564174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] The token cache is being invalidate because project 596f5ca7eaab402a813c1edcaba7e4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:46.564618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:46.565594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:46.571878 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2006/4025] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:46 2022] DELETE /identity/v3/projects/596f5ca7eaab402a813c1edcaba7e4ec => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:46.572991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.574431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:46.676807 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2020/4026] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:46 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:46.678022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.681151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:46.712914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbafce2-b1b1-49cb-8432-c3414213ceae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.725794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.727570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f832377-0cf7-4c82-8403-1982beb51a3c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.728297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.728794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.729229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.730265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.732095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.740232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.740895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.741172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.741442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] PATH_INFO: `/v3/users/252611ea03c841c48619a6ead90822fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.747482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252611ea03c841c48619a6ead90822fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.749472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.760065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2021/4027] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:46.765491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.781119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ff5b3-a919-481e-be6a-e3c33a41bf26 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.787157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.787319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.787545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.788139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.789509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.791334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.813681 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2022/4028] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:46.815261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:46.828169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a533c-db88-498a-b295-e5de211cd39d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:46.837605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af882-0f4f-4605-bc24-19bfd77ae090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:46.838795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af882-0f4f-4605-bc24-19bfd77ae090 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:46.838795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af882-0f4f-4605-bc24-19bfd77ae090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:46.839495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af882-0f4f-4605-bc24-19bfd77ae090 admin admin] PATH_INFO: `/v3/projects/c91e951241484042bee82e86072758cb/users/5f2d1c7b234f4a9a86ca5f2700fb77fe/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:46.858375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af882-0f4f-4605-bc24-19bfd77ae090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91e951241484042bee82e86072758cb, user_id=5f2d1c7b234f4a9a86ca5f2700fb77fe, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:46.863421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af882-0f4f-4605-bc24-19bfd77ae090 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:46.883675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:47.047109 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2023/4029] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:46 2022] PUT /identity/v3/projects/c91e951241484042bee82e86072758cb/users/5f2d1c7b234f4a9a86ca5f2700fb77fe/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:47.059047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9be4-7573-4666-8aca-b0d264999a31 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:47.059900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9be4-7573-4666-8aca-b0d264999a31 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:47.061337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9be4-7573-4666-8aca-b0d264999a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:47.131553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252611ea03c841c48619a6ead90822fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:47.132529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252611ea03c841c48619a6ead90822fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:47.142337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4efd9be4-7573-4666-8aca-b0d264999a31 None None] MFA Rules not processed for user `5f2d1c7b234f4a9a86ca5f2700fb77fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:47.143281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4efd9be4-7573-4666-8aca-b0d264999a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:47.205186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252611ea03c841c48619a6ead90822fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:47.205813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252611ea03c841c48619a6ead90822fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:47.218798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252611ea03c841c48619a6ead90822fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:47.295430 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2007/4030] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:46 2022] DELETE /identity/v3/users/252611ea03c841c48619a6ead90822fc => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:47.349765 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2024/4031] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:47.354121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:47.355953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:47.504233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153c92a-8d88-4e87-997c-fece4c218fe7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:47.509579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:47.511163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:47.511450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:47.511767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:47.512527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:47.514877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:47.679766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2008/4032] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:47 2022] POST /identity/v3/projects => generated 377 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:47.680575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9be4-7573-4666-8aca-b0d264999a31 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:47.835092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9be4-7573-4666-8aca-b0d264999a31 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:47.951589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:48.024256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:48.025417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:48.025707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:48.026037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:48.026733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:48.031737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:48.178875 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2025/4033] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:47 2022] POST /identity/v3/users => generated 289 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:48.180561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:48.210738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7885e-f07f-42bc-98e8-fe2cd31305f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:48.229280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:48.230142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:48.230525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:48.230908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:48.232513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:48.233703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:48.264710 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2009/4034] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:48.266360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:48.279411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3ab0c-5d31-4f5f-a8b6-967dc8136789 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:48.298988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb6e87-9905-40e2-b350-867bd9f893bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:48.299801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6e87-9905-40e2-b350-867bd9f893bb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:48.300190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6e87-9905-40e2-b350-867bd9f893bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:48.300603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6e87-9905-40e2-b350-867bd9f893bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:48.301565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb6e87-9905-40e2-b350-867bd9f893bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:48.309215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb6e87-9905-40e2-b350-867bd9f893bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:48.332347 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2026/4035] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:48.335445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:48.350503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9bf6e-c9ee-41fc-b993-aa08300bf88c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:48.366031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:48.366864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:48.367421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:48.367844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] PATH_INFO: `/v3/projects/fb27afea82ea40039c6187bd7936e258/users/76e4f71559f6440bba79ca0cb77362dd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:48.404487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb27afea82ea40039c6187bd7936e258, user_id=76e4f71559f6440bba79ca0cb77362dd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:48.410251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:48.507792 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2010/4036] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:48 2022] PUT /identity/v3/projects/fb27afea82ea40039c6187bd7936e258/users/76e4f71559f6440bba79ca0cb77362dd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:48.519776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:48.522806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:48.522806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:48.585132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] MFA Rules not processed for user `76e4f71559f6440bba79ca0cb77362dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:48.586862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:48.819583 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2027/4037] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:48.842784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:48.845240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:48.985307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:48.987679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:49.009299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef970f8f-2980-4afd-bd22-14bf6318d238 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:49.019826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf2c73-2f4d-40bd-bb55-fed5606aa24e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:49.021595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf2c73-2f4d-40bd-bb55-fed5606aa24e service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:49.021900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf2c73-2f4d-40bd-bb55-fed5606aa24e service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:49.022211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf2c73-2f4d-40bd-bb55-fed5606aa24e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:49.107010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c096bb-ec05-4148-b178-c91344233e4c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:49.121368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:49.123774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:49.124102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:49.124438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] PATH_INFO: `/v3/projects/7c1d1f80e24b4737ba3d4b631afb47f9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:49.129504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1d1f80e24b4737ba3d4b631afb47f9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:49.133996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:49.173240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf2c73-2f4d-40bd-bb55-fed5606aa24e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:49.174828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf2c73-2f4d-40bd-bb55-fed5606aa24e service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:49.201889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2011/4038] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:49.378184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1d1f80e24b4737ba3d4b631afb47f9', 'request_id': 'req-cab81e78-6d60-4a5e-b238-3782d919ec9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:49.389069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1d1f80e24b4737ba3d4b631afb47f9', 'request_id': 'req-cab81e78-6d60-4a5e-b238-3782d919ec9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:49.478170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1d1f80e24b4737ba3d4b631afb47f9', 'request_id': 'req-cab81e78-6d60-4a5e-b238-3782d919ec9d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:49.537722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] The token cache is being invalidate because project 7c1d1f80e24b4737ba3d4b631afb47f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:49.545175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:49.545175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cab81e78-6d60-4a5e-b238-3782d919ec9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:49.557657 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2028/4039] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:48 2022] DELETE /identity/v3/projects/7c1d1f80e24b4737ba3d4b631afb47f9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:49.570000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb769ac3-8ffc-4ef1-a6c5-61de85db0d52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:49.570367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb769ac3-8ffc-4ef1-a6c5-61de85db0d52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:49.570596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb769ac3-8ffc-4ef1-a6c5-61de85db0d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:49.620944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eb769ac3-8ffc-4ef1-a6c5-61de85db0d52 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:49.622800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb769ac3-8ffc-4ef1-a6c5-61de85db0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:49.638534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:49.732537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:49.733695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:49.735280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:49.779822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:49.782972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:49.876343 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2012/4040] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:49.888283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e820-671a-4792-ad69-ee6fc3432085 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:49.888572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e820-671a-4792-ad69-ee6fc3432085 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:49.888847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e820-671a-4792-ad69-ee6fc3432085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:49.984759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5c91e820-671a-4792-ad69-ee6fc3432085 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:49.986026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c91e820-671a-4792-ad69-ee6fc3432085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:50.015125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2013/4041] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:50.019218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91e820-671a-4792-ad69-ee6fc3432085 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:50.033286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91e820-671a-4792-ad69-ee6fc3432085 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:50.041228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:50.042152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:50.042731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:50.043195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:50.044067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:50.044531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:50.046525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:50.064528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2014/4042] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:39:50.070576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:50.104186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594fe8c-57d2-4d16-8266-0f7fc00ef919 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:50.104572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2029/4043] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:39:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:50.110154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:50.111052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:50.111666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:50.112102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:50.112910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:50.116029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:50.120951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:50.127383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:50.276557 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2015/4044] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:50 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:50.280618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:50.283289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b770c7-c4fb-481e-83bb-4cdf420ca946 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:50.405468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:50.413755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529a43b-1e19-45e3-a87f-c3e6c3d0b29e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:50.416089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:50.416731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:50.417007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:50.417276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:50.427193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:50.427817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:50.428069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:50.428345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:50.429034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:50.432187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:50.504140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:50.505897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:50.516387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2030/4045] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:50.567329 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2016/4046] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:50 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:50.571993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:50.589379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d14d6-1305-4968-9af4-d74fc3555788 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:50.614291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:50.615029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:50.615478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:50.615843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:50.616702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:50.624203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:50.652325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2031/4047] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:50.656807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:50.677212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d6372-75ba-4a31-a973-764b735ea89d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:50.697740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25853d4f-1845-4102-8cf8-58baedeb697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:50.698608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853d4f-1845-4102-8cf8-58baedeb697f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:50.698946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853d4f-1845-4102-8cf8-58baedeb697f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:50.703410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853d4f-1845-4102-8cf8-58baedeb697f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:50.703410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25853d4f-1845-4102-8cf8-58baedeb697f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:50.703410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25853d4f-1845-4102-8cf8-58baedeb697f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:50.734418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2017/4048] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:50.735672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:50.748070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6bf1-2f72-415d-8ec5-2b427b0321bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:50.780224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:50.780914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:50.781193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:50.781468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] PATH_INFO: `/v3/projects/349b7dccc74b4f70bb6365870acf5948/users/7c1e8b84a306486f8fb8489eb0d4e2df/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:50.824299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=349b7dccc74b4f70bb6365870acf5948, user_id=7c1e8b84a306486f8fb8489eb0d4e2df, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:50.828552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:51.011157 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2032/4049] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:50 2022] PUT /identity/v3/projects/349b7dccc74b4f70bb6365870acf5948/users/7c1e8b84a306486f8fb8489eb0d4e2df/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:51.017133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:51.017649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:51.018179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:51.077194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] MFA Rules not processed for user `7c1e8b84a306486f8fb8489eb0d4e2df`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:51.078618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:51.087281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:51.268420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2018/4050] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:51.273026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:51.427280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbfb68-2182-445d-b9b2-23cb836cabc6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:51.440217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:51.440849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:51.441126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:51.441554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:51.442228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:51.444155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:51.498165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:51.502566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:51.595245 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2033/4051] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:51 2022] POST /identity/v3/projects => generated 385 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:51.596206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:51.601596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:51.676176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2a715-53c0-4a89-8f72-3dc62e8616e8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:51.765385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202feed8-cf65-4692-86fc-5a958c38a626 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:51.785775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:51.787077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:51.787579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:51.788272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:51.789169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:51.792898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:51.800339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:51.801212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:51.802362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:51.804247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:51.815946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:51.941795 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2034/4052] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:51 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:51.942077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:51.974641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76583c75-69ed-4c62-a67d-c8d22cf95a28 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:51.976606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:51.980276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:51.996497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:51.999674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:52.001435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:52.001583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:52.002613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:52.006988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:52.008258 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2019/4053] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:52.032300 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2035/4054] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:52.040658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:52.064059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7cb83-2e6a-4978-8479-930077696be8 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:52.090294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8156a4f-9afc-43c1-aa2d-5dd406b2763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:52.096877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8156a4f-9afc-43c1-aa2d-5dd406b2763c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:52.098082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8156a4f-9afc-43c1-aa2d-5dd406b2763c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:52.098641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8156a4f-9afc-43c1-aa2d-5dd406b2763c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:52.100776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8156a4f-9afc-43c1-aa2d-5dd406b2763c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:52.102836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8156a4f-9afc-43c1-aa2d-5dd406b2763c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:52.126606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2020/4055] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:52.133403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:52.151696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d843a-73a7-4650-a9cc-dbb345b55465 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:52.152518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:52.165871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84323ec7-0881-49a2-ba32-de7fc8bb25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:52.166652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323ec7-0881-49a2-ba32-de7fc8bb25e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:52.166914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323ec7-0881-49a2-ba32-de7fc8bb25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:52.167393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323ec7-0881-49a2-ba32-de7fc8bb25e1 admin admin] PATH_INFO: `/v3/projects/b75ccf50f8bf4d3d80aedc730b1b53d2/users/9e593572acf241198995b3ccfbcf9b37/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:52.201879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84323ec7-0881-49a2-ba32-de7fc8bb25e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75ccf50f8bf4d3d80aedc730b1b53d2, user_id=9e593572acf241198995b3ccfbcf9b37, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:52.204778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84323ec7-0881-49a2-ba32-de7fc8bb25e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:52.240582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f36c7-f9ca-4e88-9360-1545db78cd1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:52.241088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f36c7-f9ca-4e88-9360-1545db78cd1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:52.241465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f36c7-f9ca-4e88-9360-1545db78cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:52.278630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af6f36c7-f9ca-4e88-9360-1545db78cd1c None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:52.281205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af6f36c7-f9ca-4e88-9360-1545db78cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:52.284062 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2036/4056] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:52 2022] PUT /identity/v3/projects/b75ccf50f8bf4d3d80aedc730b1b53d2/users/9e593572acf241198995b3ccfbcf9b37/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:52.296907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e727-4371-45ed-8014-a56ffe3e0bc8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:52.297444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e727-4371-45ed-8014-a56ffe3e0bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:52.297877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e727-4371-45ed-8014-a56ffe3e0bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:52.376008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4163e727-4371-45ed-8014-a56ffe3e0bc8 None None] MFA Rules not processed for user `9e593572acf241198995b3ccfbcf9b37`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:52.379892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4163e727-4371-45ed-8014-a56ffe3e0bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:52.535999 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2021/4057] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:52.553908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f36c7-f9ca-4e88-9360-1545db78cd1c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:52.598943 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2037/4058] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:52.623385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e727-4371-45ed-8014-a56ffe3e0bc8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:52.725796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f36c7-f9ca-4e88-9360-1545db78cd1c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:52.736185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:52.736752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:52.737082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:52.737435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:52.751106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:52.757399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e727-4371-45ed-8014-a56ffe3e0bc8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:52.768601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:52.770241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:52.770635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:52.772854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:52.773826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:52.777310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:52.820596 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2022/4059] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:39:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:39:52.821529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:52.824336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:52.885325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:52.888273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:52.935560 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2038/4060] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:53.004082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61873e-886d-4e27-931e-c52d4709d603 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:53.036525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:53.037456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:53.037821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:53.040001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:53.046957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:53.087840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:53.089653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:53.134391 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2023/4061] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:53.639137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:53.650086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e45dce-0aa5-492c-988b-5e719129d71a service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:53.654573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96959c-fe02-4e1f-a2bd-20c9b55d9462 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:53.655300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96959c-fe02-4e1f-a2bd-20c9b55d9462 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:53.655628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96959c-fe02-4e1f-a2bd-20c9b55d9462 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:53.655968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96959c-fe02-4e1f-a2bd-20c9b55d9462 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:53.694959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96959c-fe02-4e1f-a2bd-20c9b55d9462 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:53.701787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:53.703366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:53.711282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96959c-fe02-4e1f-a2bd-20c9b55d9462 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:53.753010 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2039/4062] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:53.871944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef6739-5c30-4b5b-971d-94b197760bef None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:53.872467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef6739-5c30-4b5b-971d-94b197760bef None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:53.872952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef6739-5c30-4b5b-971d-94b197760bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:53.891445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ee314-d36d-42ea-9c00-694281456dd9 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:53.903516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:53.903516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:53.903516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:53.903977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] PATH_INFO: `/v3/users/5f2d1c7b234f4a9a86ca5f2700fb77fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:53.910887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2d1c7b234f4a9a86ca5f2700fb77fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:53.914494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:53.928593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-feef6739-5c30-4b5b-971d-94b197760bef None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:53.932583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-feef6739-5c30-4b5b-971d-94b197760bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:54.094736 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2040/4063] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:39:54.103131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:54.103415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:54.103880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:54.161820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:54.161820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:54.181811 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2041/4064] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:54.183039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:54.187914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:54.242321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866bfd9-2f0d-414d-a479-4e7fe2ad35d6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:54.248742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2d1c7b234f4a9a86ca5f2700fb77fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.249690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2d1c7b234f4a9a86ca5f2700fb77fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.265638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:54.266357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:54.266642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:54.266992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] PATH_INFO: `/v3/users/658e3ac336ac4342bd204a74515fcd96` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:54.269032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658e3ac336ac4342bd204a74515fcd96)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:54.271137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:54.360584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2d1c7b234f4a9a86ca5f2700fb77fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.361753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2d1c7b234f4a9a86ca5f2700fb77fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.386393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f50114c5-ae4c-4a11-b3b9-aae92f2c98aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2d1c7b234f4a9a86ca5f2700fb77fe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.428939 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2024/4065] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:53 2022] DELETE /identity/v3/users/5f2d1c7b234f4a9a86ca5f2700fb77fe => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:54.431794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:54.432080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:54.432351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:54.473098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658e3ac336ac4342bd204a74515fcd96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.489122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:54.490509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:54.495743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658e3ac336ac4342bd204a74515fcd96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.497779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658e3ac336ac4342bd204a74515fcd96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.526956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658e3ac336ac4342bd204a74515fcd96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.603987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:54.631947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658e3ac336ac4342bd204a74515fcd96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:54.639062 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2042/4066] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:54 2022] DELETE /identity/v3/users/658e3ac336ac4342bd204a74515fcd96 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:54.687695 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2025/4067] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:54.723214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:54.724715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:54.843146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709630c-aabc-4a52-93e0-f88b37c93b48 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:54.848896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:54.850580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:54.851033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:54.851459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:54.958270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:54.962693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:54.972079 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2043/4068] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:54.990000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:54.991381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.018970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:55.021876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce92cf-d2c4-4cc1-9039-a96aacce25d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:55.022782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.035163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:55.038585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.039074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.039515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] PATH_INFO: `/v3/users/7c1e8b84a306486f8fb8489eb0d4e2df` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.041171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1e8b84a306486f8fb8489eb0d4e2df)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:55.049039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:55.086493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c166fe-33bc-43a2-adb2-3541416ac644 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:55.095201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:55.096752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.097204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.097859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] PATH_INFO: `/v3/projects/17da40534ba847b18b2f0cde9b822b24` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.099865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=17da40534ba847b18b2f0cde9b822b24)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:55.102619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:55.153707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:55.317750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1e8b84a306486f8fb8489eb0d4e2df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.320173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17da40534ba847b18b2f0cde9b822b24', 'request_id': 'req-5641c2bb-6cea-48a0-b321-a555d52915cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.331206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1e8b84a306486f8fb8489eb0d4e2df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.333703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17da40534ba847b18b2f0cde9b822b24', 'request_id': 'req-5641c2bb-6cea-48a0-b321-a555d52915cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.410620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1e8b84a306486f8fb8489eb0d4e2df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.412326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1e8b84a306486f8fb8489eb0d4e2df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.422805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1e8b84a306486f8fb8489eb0d4e2df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.443844 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2026/4069] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:54 2022] DELETE /identity/v3/users/7c1e8b84a306486f8fb8489eb0d4e2df => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:55.446273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:55.446273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.506394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17da40534ba847b18b2f0cde9b822b24', 'request_id': 'req-5641c2bb-6cea-48a0-b321-a555d52915cb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.521919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] The token cache is being invalidate because project 17da40534ba847b18b2f0cde9b822b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:55.522409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.523704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5641c2bb-6cea-48a0-b321-a555d52915cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:55.530830 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2044/4070] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:55 2022] DELETE /identity/v3/projects/17da40534ba847b18b2f0cde9b822b24 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:55.530830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f32c-64f6-40b8-9a30-0ba7f030caad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.530830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f32c-64f6-40b8-9a30-0ba7f030caad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.530830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9f32c-64f6-40b8-9a30-0ba7f030caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.558266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-51b9f32c-64f6-40b8-9a30-0ba7f030caad None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:55.560350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51b9f32c-64f6-40b8-9a30-0ba7f030caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.574102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e3e66-595a-4889-9c8a-c92543740054 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:55.585122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:55.586125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.586503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.586884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.589433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.659749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2045/4071] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:55.660949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.661304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.661654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.689133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:55.691754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:55.703063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:55.705223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.724794 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2046/4072] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:55.727081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:55.729345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.734944 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2027/4073] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:55.736064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:55.739747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.763085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca8d10-83a3-47c8-85e7-c1f32e230813 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:55.769966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:55.772047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.772531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.772909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] PATH_INFO: `/v3/projects/c91e951241484042bee82e86072758cb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.782987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91e951241484042bee82e86072758cb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:55.786236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:55.855406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce684-c89f-41f4-b73f-7228a337fe23 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:55.860427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0fff1-9b48-4c24-809f-9034f413c6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:55.861052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0fff1-9b48-4c24-809f-9034f413c6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.861428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0fff1-9b48-4c24-809f-9034f413c6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.861799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0fff1-9b48-4c24-809f-9034f413c6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.875979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0fff1-9b48-4c24-809f-9034f413c6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:55.877766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0fff1-9b48-4c24-809f-9034f413c6f0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:55.891374 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2028/4074] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:55.894264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5669c6-a5d4-43da-943a-28fe8d5a4b98 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:55.894661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5669c6-a5d4-43da-943a-28fe8d5a4b98 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:55.895191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5669c6-a5d4-43da-943a-28fe8d5a4b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:55.951935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ee5669c6-a5d4-43da-943a-28fe8d5a4b98 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:55.956002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee5669c6-a5d4-43da-943a-28fe8d5a4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:55.985313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91e951241484042bee82e86072758cb', 'request_id': 'req-6a2bf05b-8527-481e-b8de-167a539d7434'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.001620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91e951241484042bee82e86072758cb', 'request_id': 'req-6a2bf05b-8527-481e-b8de-167a539d7434'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.078321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91e951241484042bee82e86072758cb', 'request_id': 'req-6a2bf05b-8527-481e-b8de-167a539d7434'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.101308 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2029/4075] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:56.102960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] The token cache is being invalidate because project c91e951241484042bee82e86072758cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:56.103526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.105677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5669c6-a5d4-43da-943a-28fe8d5a4b98 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.111871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.118183 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2047/4076] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:55 2022] DELETE /identity/v3/projects/c91e951241484042bee82e86072758cb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:56.122626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.125674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:56.132692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5669c6-a5d4-43da-943a-28fe8d5a4b98 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:56.151944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:56.153021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:56.153540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:56.154032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:56.154956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:56.155488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:56.158588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:56.160840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf05b-8527-481e-b8de-167a539d7434 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:56.179613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:56.181081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:56.181590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:56.182635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] PATH_INFO: `/v3/users/76e4f71559f6440bba79ca0cb77362dd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:56.185253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e4f71559f6440bba79ca0cb77362dd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:56.188690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:56.195409 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2030/4077] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:56.201604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.203824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:56.225374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6139b-0eb0-416a-ba5b-da5f3430dc56 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:56.235147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:56.236112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:56.236560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:56.237442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:56.240126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:56.243225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:56.343541 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2031/4078] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:56 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:56.343541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.343541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:56.409624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f9370-69f5-40ff-9cb4-fb9172f168dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:56.414019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:56.417831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:56.417831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:56.417831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:56.419047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:56.422748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e4f71559f6440bba79ca0cb77362dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.430640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:56.431508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e4f71559f6440bba79ca0cb77362dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.432149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:56.432453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e4f71559f6440bba79ca0cb77362dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.444749 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2032/4079] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:56.454488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.462090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e4f71559f6440bba79ca0cb77362dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.537317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e4f71559f6440bba79ca0cb77362dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:56.549218 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2048/4080] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:56 2022] DELETE /identity/v3/users/76e4f71559f6440bba79ca0cb77362dd => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:56.623535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b7c5-3e04-476f-9317-907d517b47d3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:56.658579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:56.706961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:56.767832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:56.767832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:56.767832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:56.768307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:56.769020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:56.773071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:56.881841 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2033/4081] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:56 2022] POST /identity/v3/users => generated 297 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:39:56.886189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.889199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:56.907672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054fb13-e5e5-4f26-b72c-badc92be7dd0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:56.912744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:56.913686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:56.913686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:56.914277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:56.914936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:56.916564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:56.931857 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2049/4082] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:56.933395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.947330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29095862-8a20-4ba6-9301-e527fc29a3cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:56.962211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:56.962984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:56.963332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:56.963682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:56.964410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:56.966714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:56.978134 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2034/4083] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:56.982471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:56.997259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5791-0c3d-4958-91cb-ec9ab1d9c167 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:57.002225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3659ac-31d9-4a5e-8cfb-627829606592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:57.002894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3659ac-31d9-4a5e-8cfb-627829606592 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:57.003180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3659ac-31d9-4a5e-8cfb-627829606592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:57.003458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3659ac-31d9-4a5e-8cfb-627829606592 admin admin] PATH_INFO: `/v3/projects/90c056fcd52f4a97b89c731d06027fc5/users/11af7a4f65914752be86a83fa3408870/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:57.020432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3659ac-31d9-4a5e-8cfb-627829606592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c056fcd52f4a97b89c731d06027fc5, user_id=11af7a4f65914752be86a83fa3408870, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:57.023298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3659ac-31d9-4a5e-8cfb-627829606592 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:57.084949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:57.087114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:57.133460 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2050/4084] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:56 2022] PUT /identity/v3/projects/90c056fcd52f4a97b89c731d06027fc5/users/11af7a4f65914752be86a83fa3408870/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:57.140735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:57.141049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:57.141292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:57.183307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:57.185963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:57.281339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d52229-25fd-44b9-9d57-79294f18db5f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:57.315737 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2051/4085] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:57.326999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:57.329167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:57.479401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:57.480376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:57.483119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:57.486695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:57.496172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:57.517989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0b9ce-1d73-4435-a9e3-75594137da73 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:57.524161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:57.524920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:57.525357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:57.525730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:57.541419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:57.542901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:57.543088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:57.544800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:57.567399 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2035/4086] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:39:57.571621 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2052/4087] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:39:57.575244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:57.584534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:57.608716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8d802-9b41-4bf1-aa94-9980dd5e4bbe service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:57.613651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:57.614492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:57.614905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:57.615182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] PATH_INFO: `/v3/projects/349b7dccc74b4f70bb6365870acf5948` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:57.617923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=349b7dccc74b4f70bb6365870acf5948)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:57.620226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:57.778420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349b7dccc74b4f70bb6365870acf5948', 'request_id': 'req-f566c1d6-f589-4d34-beb0-05a30ac46a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:57.788205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349b7dccc74b4f70bb6365870acf5948', 'request_id': 'req-f566c1d6-f589-4d34-beb0-05a30ac46a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:57.873051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349b7dccc74b4f70bb6365870acf5948', 'request_id': 'req-f566c1d6-f589-4d34-beb0-05a30ac46a21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:57.896387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] The token cache is being invalidate because project 349b7dccc74b4f70bb6365870acf5948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:57.896688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:57.897421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:57.899223 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2036/4088] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:57 2022] DELETE /identity/v3/projects/349b7dccc74b4f70bb6365870acf5948 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:57.905876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:57.917898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fb4b8-a93c-4a64-9d50-55660dbfad23 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:57.992855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:58.020670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:58.021640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:58.022385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:58.022920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] PATH_INFO: `/v3/users/9e593572acf241198995b3ccfbcf9b37` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:58.024383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e593572acf241198995b3ccfbcf9b37)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:58.026734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:58.252714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:58.254604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:58.279910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566c1d6-f589-4d34-beb0-05a30ac46a21 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:58.293197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:58.294682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:58.295127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:58.295589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] PATH_INFO: `/v3/projects/fb27afea82ea40039c6187bd7936e258` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:58.298439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb27afea82ea40039c6187bd7936e258)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:58.300914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:58.403468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e593572acf241198995b3ccfbcf9b37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.429441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e593572acf241198995b3ccfbcf9b37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.433701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e593572acf241198995b3ccfbcf9b37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.473865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e593572acf241198995b3ccfbcf9b37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.554550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb27afea82ea40039c6187bd7936e258', 'request_id': 'req-36beef8f-bf33-469b-bc51-8f57369efd1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.577587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb27afea82ea40039c6187bd7936e258', 'request_id': 'req-36beef8f-bf33-469b-bc51-8f57369efd1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.650069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f79617ca-0629-4d14-89ef-61d12920f4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e593572acf241198995b3ccfbcf9b37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.692466 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2053/4089] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:39:57 2022] DELETE /identity/v3/users/9e593572acf241198995b3ccfbcf9b37 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:39:58.848239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb27afea82ea40039c6187bd7936e258', 'request_id': 'req-36beef8f-bf33-469b-bc51-8f57369efd1d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.867392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] The token cache is being invalidate because project fb27afea82ea40039c6187bd7936e258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:39:58.867708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.869154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36beef8f-bf33-469b-bc51-8f57369efd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:39:58.875610 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2037/4090] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:58 2022] DELETE /identity/v3/projects/fb27afea82ea40039c6187bd7936e258 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:39:58.878150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8de044-2194-4fd1-98e6-40a3c72d517f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:58.878444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8de044-2194-4fd1-98e6-40a3c72d517f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:58.878731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8de044-2194-4fd1-98e6-40a3c72d517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:58.923374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b8de044-2194-4fd1-98e6-40a3c72d517f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:58.924631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b8de044-2194-4fd1-98e6-40a3c72d517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:59.092977 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2054/4091] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:59.102549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7944-b479-4938-bb1c-13958de644bb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.103899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7944-b479-4938-bb1c-13958de644bb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.105491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd7944-b479-4938-bb1c-13958de644bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.132866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89bd7944-b479-4938-bb1c-13958de644bb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:39:59.136272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89bd7944-b479-4938-bb1c-13958de644bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:59.152452 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2038/4092] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:39:59.156674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8de044-2194-4fd1-98e6-40a3c72d517f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:59.173701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8de044-2194-4fd1-98e6-40a3c72d517f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:59.182659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:59.183299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.185393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.185393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.185393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:39:59.185393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:59.187049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:59.222159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:59.224814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd7944-b479-4938-bb1c-13958de644bb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:59.225114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2055/4093] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:39:59.239161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd7944-b479-4938-bb1c-13958de644bb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:59.249939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:59.253602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.253602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.253602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.253602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:59.254262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:59.414334 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2039/4094] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:39:59 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:59.417688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:59.443960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf534c-a23d-469e-adfa-d7db5cea9472 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:59.576493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:59.577213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.577510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.578091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.578515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:59.580514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:59.719905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2056/4095] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:39:59 2022] POST /identity/v3/users => generated 283 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:39:59.721297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:59.740996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca8440-5294-475c-b297-11ab2434f2bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:59.755186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:59.755882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.756790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.756790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.757208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:59.763814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:59.785680 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2040/4096] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:59.788647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:59.803782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516061f6-2f27-43e0-9739-1b58d5d44229 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:59.808685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:59.810270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.810633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.811377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.812116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:59.815167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:59.847683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:59.848754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:39:59.877642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026bb7-d880-4cd4-bc17-d1db8a54658b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:59.880769 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2057/4097] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:39:59.886806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:39:59.894274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:59.896217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.897450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.901624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] PATH_INFO: `/v3/projects/b75ccf50f8bf4d3d80aedc730b1b53d2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.908278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75ccf50f8bf4d3d80aedc730b1b53d2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:59.912657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:39:59.922549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2ead-06b1-4f8a-a01f-b88166c63576 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:39:59.940101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07524a23-c628-48f0-ad74-003a45068d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:39:59.941735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07524a23-c628-48f0-ad74-003a45068d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:39:59.942242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07524a23-c628-48f0-ad74-003a45068d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:39:59.942772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07524a23-c628-48f0-ad74-003a45068d41 admin admin] PATH_INFO: `/v3/projects/176d5bcda729496fb4b7273d8292f920/users/373f3de3f4aa42ffa4e8c9c44ba2e9c0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:39:59.983877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07524a23-c628-48f0-ad74-003a45068d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176d5bcda729496fb4b7273d8292f920, user_id=373f3de3f4aa42ffa4e8c9c44ba2e9c0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:39:59.995694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07524a23-c628-48f0-ad74-003a45068d41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:00.112164 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2058/4098] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:39:59 2022] PUT /identity/v3/projects/176d5bcda729496fb4b7273d8292f920/users/373f3de3f4aa42ffa4e8c9c44ba2e9c0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:00.124642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:00.125336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:00.125584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:00.146835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75ccf50f8bf4d3d80aedc730b1b53d2', 'request_id': 'req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:00.161323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75ccf50f8bf4d3d80aedc730b1b53d2', 'request_id': 'req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:00.181388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] MFA Rules not processed for user `373f3de3f4aa42ffa4e8c9c44ba2e9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:00.212695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:00.285334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75ccf50f8bf4d3d80aedc730b1b53d2', 'request_id': 'req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:00.324886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] The token cache is being invalidate because project b75ccf50f8bf4d3d80aedc730b1b53d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:00.325357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:00.330083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e5a2cf0a-2e13-45dd-b01d-eb1a00de45a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:00.330083 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2041/4099] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:39:59 2022] DELETE /identity/v3/projects/b75ccf50f8bf4d3d80aedc730b1b53d2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:00.335246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3aab-095d-44ef-a11a-031fd27642da None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:00.335870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3aab-095d-44ef-a11a-031fd27642da None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:00.336390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec3aab-095d-44ef-a11a-031fd27642da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:00.376980 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2059/4100] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:00.381530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67ec3aab-095d-44ef-a11a-031fd27642da None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:00.385492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67ec3aab-095d-44ef-a11a-031fd27642da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:00.406888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:00.414212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:00.530973 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2042/4101] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:00.539587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac685ca-6c1f-4de6-9718-07307ab6720a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:00.549707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac685ca-6c1f-4de6-9718-07307ab6720a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:00.550495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac685ca-6c1f-4de6-9718-07307ab6720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:00.596518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ac685ca-6c1f-4de6-9718-07307ab6720a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:00.600079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ac685ca-6c1f-4de6-9718-07307ab6720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:00.623027 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2043/4102] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:00.626890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac685ca-6c1f-4de6-9718-07307ab6720a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:00.642818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71696e6-7927-4257-a1c4-2e0626ac0fe9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:00.647845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:00.648655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:00.649712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:00.650147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:00.650639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac685ca-6c1f-4de6-9718-07307ab6720a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:00.661457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:00.663152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:00.672063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:00.673019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:00.674627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:00.676104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:00.677914 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2060/4103] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:00.690284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:00.691055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:00.696676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:00.736464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:00.736686 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2044/4104] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:00.752109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849254d-5731-489c-aa8b-6a6edec986ae service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:00.775097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:00.775097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:00.775097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:00.775657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:00.776263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:00.778618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:01.009961 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2061/4105] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:00 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:01.012344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:01.026033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68269-47d7-4eb8-a007-d6333c935a53 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:01.072672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:01.101322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:01.254590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:01.255128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:01.255601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:01.256072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:01.257052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:01.260710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:01.379376 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2045/4106] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:01 2022] POST /identity/v3/users => generated 287 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:01.383619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:01.397885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a48005-cb9a-407c-89dd-e583c28e74f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:01.417390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:01.418278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:01.419447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:01.419835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:01.422885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:01.424652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:01.451093 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2062/4107] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:01.455347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:01.467581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de5c9b-e994-46dd-ba50-2d8862c6efec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:01.474213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c4764-1eed-46c5-876f-b973e981df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:01.475432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4764-1eed-46c5-876f-b973e981df09 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:01.476147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4764-1eed-46c5-876f-b973e981df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:01.476837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4764-1eed-46c5-876f-b973e981df09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:01.477742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c4764-1eed-46c5-876f-b973e981df09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:01.481623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c4764-1eed-46c5-876f-b973e981df09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:01.497356 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2046/4108] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:01.501766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:01.514646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee2624-c8cc-4ce2-b62c-c45c37ec8e1b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:01.520118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:01.522297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:01.522297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:01.522297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] PATH_INFO: `/v3/projects/7bca5c89b76e4ff6932ec494d9f2af0f/users/82859690b7744f8a9364a7cee2f7e698/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:01.550693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bca5c89b76e4ff6932ec494d9f2af0f, user_id=82859690b7744f8a9364a7cee2f7e698, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:01.555846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:01.708708 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2063/4109] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:01 2022] PUT /identity/v3/projects/7bca5c89b76e4ff6932ec494d9f2af0f/users/82859690b7744f8a9364a7cee2f7e698/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:01.723980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:01.724952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:01.725383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:01.794607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] MFA Rules not processed for user `82859690b7744f8a9364a7cee2f7e698`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:01.796304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:01.819855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:01.823185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:01.933418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2047/4110] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:01.950968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:01.952709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:01.983055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6dbfd-ba50-4ceb-a547-57c16c2122a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:01.994465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:01.997334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:01.997810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:01.998289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] PATH_INFO: `/v3/users/373f3de3f4aa42ffa4e8c9c44ba2e9c0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:01.999670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373f3de3f4aa42ffa4e8c9c44ba2e9c0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:02.002157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:02.042811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0de2c6-87bf-4387-804b-5004f1976791 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:02.047359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20298-393b-4f12-a31d-4895ae322319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:02.047987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20298-393b-4f12-a31d-4895ae322319 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:02.048427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20298-393b-4f12-a31d-4895ae322319 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:02.048713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20298-393b-4f12-a31d-4895ae322319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:02.058304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20298-393b-4f12-a31d-4895ae322319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:02.060923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20298-393b-4f12-a31d-4895ae322319 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:02.072913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2048/4111] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:40:02.240759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373f3de3f4aa42ffa4e8c9c44ba2e9c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:02.253173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373f3de3f4aa42ffa4e8c9c44ba2e9c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:02.262959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373f3de3f4aa42ffa4e8c9c44ba2e9c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:02.276306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373f3de3f4aa42ffa4e8c9c44ba2e9c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:02.401562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373f3de3f4aa42ffa4e8c9c44ba2e9c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:02.414882 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2064/4112] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:01 2022] DELETE /identity/v3/users/373f3de3f4aa42ffa4e8c9c44ba2e9c0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:02.420647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:02.421037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:02.421321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:02.452690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:02.454286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:02.566290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2049/4113] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:02.594907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:02.597382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:02.682139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43417964-8e00-4e90-b5cd-6995bf741535 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:02.687353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:02.691105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:02.691105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:02.691105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:02.705636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:02.705636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:02.734777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2065/4114] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:03.090806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:03.122915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:03.405965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:03.409695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:03.424166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75924fb0-f738-4f0a-bbf0-2ed2acdbb22e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:03.430183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:03.431154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:03.431441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:03.431712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] PATH_INFO: `/v3/users/82859690b7744f8a9364a7cee2f7e698` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:03.432878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=82859690b7744f8a9364a7cee2f7e698)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:03.435075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:03.686493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82859690b7744f8a9364a7cee2f7e698'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:03.687566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82859690b7744f8a9364a7cee2f7e698'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:03.743995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:03.745951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:03.765020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f5da4-81ee-4c68-8a7f-5c5d37d05c7b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:03.772536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:03.774254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:03.783085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:03.783384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] PATH_INFO: `/v3/projects/176d5bcda729496fb4b7273d8292f920` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:03.784954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=176d5bcda729496fb4b7273d8292f920)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:03.787288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:03.829083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82859690b7744f8a9364a7cee2f7e698'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:03.829083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82859690b7744f8a9364a7cee2f7e698'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:03.838032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2cd88bde-c4f0-49ae-808d-74718a98f0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82859690b7744f8a9364a7cee2f7e698'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:03.863105 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2050/4115] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:03 2022] DELETE /identity/v3/users/82859690b7744f8a9364a7cee2f7e698 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:03.867938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:03.868699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:03.868984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:03.893103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:03.894393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:03.928075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176d5bcda729496fb4b7273d8292f920', 'request_id': 'req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:03.935955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176d5bcda729496fb4b7273d8292f920', 'request_id': 'req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:03.973284 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2051/4116] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:04.011192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:04.013144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:04.063859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176d5bcda729496fb4b7273d8292f920', 'request_id': 'req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:04.082168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] The token cache is being invalidate because project 176d5bcda729496fb4b7273d8292f920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:04.082863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:04.083852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3af7a030-7a1c-4c2a-8241-e33fd32f0a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:04.087580 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2066/4117] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:03 2022] DELETE /identity/v3/projects/176d5bcda729496fb4b7273d8292f920 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:04.092735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0ddb-4c22-4c20-a901-7db1e5dac796 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.093421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0ddb-4c22-4c20-a901-7db1e5dac796 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.093935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c0ddb-4c22-4c20-a901-7db1e5dac796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.096023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a194-1fcd-4c2f-be1f-93380397c37f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:04.140339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a53c0ddb-4c22-4c20-a901-7db1e5dac796 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:04.142014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a53c0ddb-4c22-4c20-a901-7db1e5dac796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:04.166777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:04.167724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.168995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.169284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.172902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:04.230407 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2067/4118] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:04.239900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c88ca2-42e3-485d-8328-9ba5b42f53bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.241437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c88ca2-42e3-485d-8328-9ba5b42f53bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.242046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c88ca2-42e3-485d-8328-9ba5b42f53bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.272649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-43c88ca2-42e3-485d-8328-9ba5b42f53bc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:04.272903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:04.274655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-43c88ca2-42e3-485d-8328-9ba5b42f53bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:04.275635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:04.297240 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2052/4119] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:04.297812 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2068/4120] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:04.302435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:04.315598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbf7aa-7c0e-4c10-859d-49ed01300ff9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:04.322106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:04.323356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.323645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.323918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.324621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:04.324928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:04.328193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:04.349823 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2053/4121] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:04.354090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c88ca2-42e3-485d-8328-9ba5b42f53bc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:04.366413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c88ca2-42e3-485d-8328-9ba5b42f53bc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:04.373761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:04.374746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.375187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.375652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.376465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:04.381295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:04.550098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2069/4122] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:04 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:04.550339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:04.560495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84ea5f-0244-490c-94c0-40d2f60a5b9e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:04.630772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:04.632492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.633086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.633614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.634718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:04.638101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:04.736069 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2054/4123] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:04 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:04.740403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:04.753677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd707-f80a-4d3e-80ec-d8c31917de21 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:04.762430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:04.768694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.768694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.768694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.768694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:04.768694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:04.784933 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2070/4124] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:04.789638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:04.805541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134b064-b070-48fa-b9bc-7ff7f5ec586b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:04.815143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83acac2-3b5f-41e8-94c6-a7b0d2e9ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:04.819506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83acac2-3b5f-41e8-94c6-a7b0d2e9ceba admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.819506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83acac2-3b5f-41e8-94c6-a7b0d2e9ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.819506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83acac2-3b5f-41e8-94c6-a7b0d2e9ceba admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.819506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83acac2-3b5f-41e8-94c6-a7b0d2e9ceba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:04.819506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83acac2-3b5f-41e8-94c6-a7b0d2e9ceba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:04.832000 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2055/4125] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:04.835982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:04.847223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4c412-cf19-42ea-929a-016f70065767 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:04.854020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:04.854823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.855411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.855730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] PATH_INFO: `/v3/projects/ad13985f72b54af7bea9210361f484a8/users/e373e006057645d989e15c0efe4c06fc/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:04.877641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad13985f72b54af7bea9210361f484a8, user_id=e373e006057645d989e15c0efe4c06fc, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:04.880351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:04.923718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:04.960123 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2071/4126] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:04 2022] PUT /identity/v3/projects/ad13985f72b54af7bea9210361f484a8/users/e373e006057645d989e15c0efe4c06fc/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:04.972362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a1fd-8290-4e85-9cf9-617e0ce9e351 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:04.972756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a1fd-8290-4e85-9cf9-617e0ce9e351 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:04.973184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a1fd-8290-4e85-9cf9-617e0ce9e351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.017988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f620a1fd-8290-4e85-9cf9-617e0ce9e351 None None] MFA Rules not processed for user `e373e006057645d989e15c0efe4c06fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:05.020033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f620a1fd-8290-4e85-9cf9-617e0ce9e351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:05.111820 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2056/4127] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:05.115984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:05.194558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8f035-5562-4d20-bce9-da196d90630f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:05.201145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:05.202003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.202254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.202564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.203404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:05.205308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:05.323976 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2072/4128] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:05 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:05.326468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620a1fd-8290-4e85-9cf9-617e0ce9e351 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:05.342031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620a1fd-8290-4e85-9cf9-617e0ce9e351 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:05.410083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:05.410771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.411115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.411478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.412186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:05.414364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:05.450025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:05.489463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:05.493419 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2057/4129] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:05 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:05.498488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:05.509835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bea52-ae6b-4e79-a8db-a32fa325643b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:05.515525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:05.516180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.516460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.516734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.517539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:05.519199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:05.534549 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2073/4130] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:05.538420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:05.564220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fd838-eaa1-4ca5-9aa2-f6394b0925d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:05.570537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:05.571149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.571662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.572020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] PATH_INFO: `/v3/projects/654fb78dadc64120bd93a764bc1a1aa0/users/67d092450f0c4e728cc018a8b84c0620/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.592575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=654fb78dadc64120bd93a764bc1a1aa0, user_id=67d092450f0c4e728cc018a8b84c0620, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:05.596359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:05.687869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2058/4131] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:05 2022] PUT /identity/v3/projects/654fb78dadc64120bd93a764bc1a1aa0/users/67d092450f0c4e728cc018a8b84c0620/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:05.692164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:05.705443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f105ea6-d76a-41c9-a319-5ab76da185ca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:05.790315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:05.790887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.791066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.791794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.795896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:05.796046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:05.798108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:05.799771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:05.818276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8c67f-870a-4c0a-a82a-8dd4d0b21ccb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:05.830759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2074/4132] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:05.832576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:05.835781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:05.836515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.838289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.838289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] PATH_INFO: `/v3/projects/7bca5c89b76e4ff6932ec494d9f2af0f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.843385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bca5c89b76e4ff6932ec494d9f2af0f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:05.848075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:05.849871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4769d-ee6a-4df0-a29e-8e911fe88a10 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:05.856783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4375d-b184-4cba-9dde-24bb205de997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:05.857635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4375d-b184-4cba-9dde-24bb205de997 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.862518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4375d-b184-4cba-9dde-24bb205de997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.863032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4375d-b184-4cba-9dde-24bb205de997 admin admin] PATH_INFO: `/v3/projects/654fb78dadc64120bd93a764bc1a1aa0/users/67d092450f0c4e728cc018a8b84c0620/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.867724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4375d-b184-4cba-9dde-24bb205de997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654fb78dadc64120bd93a764bc1a1aa0, user_id=67d092450f0c4e728cc018a8b84c0620, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:05.871648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4375d-b184-4cba-9dde-24bb205de997 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:05.888305 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2075/4133] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:05 2022] PUT /identity/v3/projects/654fb78dadc64120bd93a764bc1a1aa0/users/67d092450f0c4e728cc018a8b84c0620/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:05.902139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:05.902139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:05.902139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:05.936230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] MFA Rules not processed for user `67d092450f0c4e728cc018a8b84c0620`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:05.938198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:05.998814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bca5c89b76e4ff6932ec494d9f2af0f', 'request_id': 'req-c48079ad-cf39-41c1-b0fa-c683b051b62f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:06.007961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bca5c89b76e4ff6932ec494d9f2af0f', 'request_id': 'req-c48079ad-cf39-41c1-b0fa-c683b051b62f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:06.021322 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2076/4134] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:06.045794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:06.047649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:06.094459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bca5c89b76e4ff6932ec494d9f2af0f', 'request_id': 'req-c48079ad-cf39-41c1-b0fa-c683b051b62f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:06.112085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] The token cache is being invalidate because project 7bca5c89b76e4ff6932ec494d9f2af0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:06.112829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:06.114472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c48079ad-cf39-41c1-b0fa-c683b051b62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:06.118911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2059/4135] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:05 2022] DELETE /identity/v3/projects/7bca5c89b76e4ff6932ec494d9f2af0f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:06.128426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b34ec-72f8-4367-9883-89b86e457710 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.130084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b34ec-72f8-4367-9883-89b86e457710 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.131235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b34ec-72f8-4367-9883-89b86e457710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:06.148846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b97f9-3e77-4770-86ff-0c9cb9446174 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:06.176955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dd4b34ec-72f8-4367-9883-89b86e457710 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:06.198584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd4b34ec-72f8-4367-9883-89b86e457710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:06.246806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:06.247498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.247781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.248056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:06.250254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:06.350895 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2060/4136] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:06.352962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83564535-8ca1-4561-aa7d-8b1440f3ff55 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.353419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83564535-8ca1-4561-aa7d-8b1440f3ff55 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.353831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83564535-8ca1-4561-aa7d-8b1440f3ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:06.362636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:06.364436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:06.380246 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2077/4137] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:40:06.393000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-83564535-8ca1-4561-aa7d-8b1440f3ff55 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:06.394285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83564535-8ca1-4561-aa7d-8b1440f3ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:06.410795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2061/4138] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:06.413384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:06.428566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11b7c4-01ea-494a-a7b9-bf5dd53fc876 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:06.436157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:06.437469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.438447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.447513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:06.447513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:06.447513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:06.447513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:06.468783 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2078/4139] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:40:06.473066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83564535-8ca1-4561-aa7d-8b1440f3ff55 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:06.485123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83564535-8ca1-4561-aa7d-8b1440f3ff55 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:06.500329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:06.500979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.501261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.501533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:06.502232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:06.504217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:06.658310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2062/4140] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:06 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:06.666914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:06.679886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f8b64-96d5-42b2-a7aa-f51aa3283947 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:06.727809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:06.778794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:06.779596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.779998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.780373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:06.781113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:06.784017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:06.850078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:06.896255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2079/4141] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:06 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:06.903094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:06.914739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774866d-3b79-4a0f-b3a5-1825950fcffb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:06.923547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:06.924273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.924650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.925062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:06.925817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:06.927714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:06.953632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:06.966441 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2063/4142] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:06.974918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792ce86-2ef1-40e9-bc28-0af7ee871888 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:06.989863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77820-8a36-48ad-89cd-1caee5cb16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:06.990857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77820-8a36-48ad-89cd-1caee5cb16a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:06.992617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77820-8a36-48ad-89cd-1caee5cb16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:06.992895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77820-8a36-48ad-89cd-1caee5cb16a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:07.000525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d77820-8a36-48ad-89cd-1caee5cb16a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:07.002458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d77820-8a36-48ad-89cd-1caee5cb16a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:07.033345 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2080/4143] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:07.036526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:07.052918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331500b1-4b2a-4e82-bdea-cc81b388c842 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:07.067999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:07.068764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:07.070130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:07.071200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] PATH_INFO: `/v3/projects/be1ed88e12504e3685eaaa0ac453202e/users/05517b4af11741bda3e7eebb6232e83e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:07.104410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1ed88e12504e3685eaaa0ac453202e, user_id=05517b4af11741bda3e7eebb6232e83e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:07.107606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:07.196177 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2064/4144] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:07 2022] PUT /identity/v3/projects/be1ed88e12504e3685eaaa0ac453202e/users/05517b4af11741bda3e7eebb6232e83e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:07.203873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:07.207942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:07.208500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:07.243057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] MFA Rules not processed for user `05517b4af11741bda3e7eebb6232e83e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:07.244592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:07.370917 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2081/4145] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:07.435590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:07.438964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:07.593486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307d35c-539a-4be1-82df-61c73aadd6ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:07.599455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a7f4-c60d-4b1d-ac83-8e4b05aed6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:07.600160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7f4-c60d-4b1d-ac83-8e4b05aed6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:07.602878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7f4-c60d-4b1d-ac83-8e4b05aed6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:07.603309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a7f4-c60d-4b1d-ac83-8e4b05aed6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:07.619007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a7f4-c60d-4b1d-ac83-8e4b05aed6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:07.621974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2a7f4-c60d-4b1d-ac83-8e4b05aed6c0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:07.635090 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2065/4146] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:07.985058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:08.237845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:08.353923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:08.359265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:08.387304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b8a84-9af6-4306-aa4c-24b2068d9538 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:08.401962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea914a7-9c77-4743-930f-4a93728043ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:08.402895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea914a7-9c77-4743-930f-4a93728043ee service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:08.411823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea914a7-9c77-4743-930f-4a93728043ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:08.411823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea914a7-9c77-4743-930f-4a93728043ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:08.415101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ea914a7-9c77-4743-930f-4a93728043ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:08.557131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea914a7-9c77-4743-930f-4a93728043ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:08.562524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea914a7-9c77-4743-930f-4a93728043ee service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:08.581940 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2082/4147] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:09.625492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:09.982374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:10.608361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:11.734962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:12.186255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:13.045841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:13.046868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:13.047311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:13.234900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:13.242324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] MFA Rules not processed for user `11af7a4f65914752be86a83fa3408870`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:13.244615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:13.334261 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2066/4148] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:13.422826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7b1e-b1d1-482c-9f76-16dfd902dc6c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:13.423652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7b1e-b1d1-482c-9f76-16dfd902dc6c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:13.424165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d7b1e-b1d1-482c-9f76-16dfd902dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:13.457202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d54d7b1e-b1d1-482c-9f76-16dfd902dc6c None None] MFA Rules not processed for user `11af7a4f65914752be86a83fa3408870`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:13.461538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d54d7b1e-b1d1-482c-9f76-16dfd902dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:13.479924 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2083/4149] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:13.487434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:13.491980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:13.537249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:13.537249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:13.537249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:13.584955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:13.586650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:13.697346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faca35-a50a-4ce0-a3c7-0c743ee25640 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:13.714640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a982a4-6ffd-499d-86cd-755722f15d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:13.718381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a982a4-6ffd-499d-86cd-755722f15d3b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:13.718381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a982a4-6ffd-499d-86cd-755722f15d3b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:13.718381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a982a4-6ffd-499d-86cd-755722f15d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:13.720018 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2084/4150] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:13.749679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a982a4-6ffd-499d-86cd-755722f15d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:13.750339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a982a4-6ffd-499d-86cd-755722f15d3b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:13.763266 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2067/4151] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:13.965233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:14.076005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:14.586813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:14.821171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82,keystone:UPDATE=4,keystone:INSERT=8,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:16.161466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:16.890145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:16.925176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:16.927430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:17.124056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96c54c-7b86-466d-bc33-fed664cdc4a0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:17.136698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:17.137472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:17.137854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:17.138271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:17.145302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:17.172334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:17.174086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:17.194626 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2085/4152] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:17.791148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:17.792275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:17.792965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:17.836776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:17.836958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:17.875034 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2068/4153] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:18.499545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:18.746092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:UPDATE=2,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:20.796177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:20.831920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:22.271471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:22.272044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:22.285420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d3a0f-c07e-40e3-93fa-05a6dc767f3a service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:22.290810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:22.300151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:22.305881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:22.305881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:22.305881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:22.331888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:22.333735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:22.346538 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2086/4154] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:22.501967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:22.507279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:22.513619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:22.660639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293bf2-b917-4d4e-84ad-641b141bca0f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:22.666471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:22.671897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:22.672591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:22.672871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:22.673143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] PATH_INFO: `/v3/users/edaf36cec0a3424fb5906ddac7c29358` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:22.680123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edaf36cec0a3424fb5906ddac7c29358)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:22.682087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:22.926865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edaf36cec0a3424fb5906ddac7c29358'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:22.930099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edaf36cec0a3424fb5906ddac7c29358'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:23.054631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edaf36cec0a3424fb5906ddac7c29358'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:23.056471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edaf36cec0a3424fb5906ddac7c29358'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:23.065789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-77fb96d4-6c11-42aa-93e0-0b75f8e62235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edaf36cec0a3424fb5906ddac7c29358'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:23.113995 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2069/4155] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:22 2022] DELETE /identity/v3/users/edaf36cec0a3424fb5906ddac7c29358 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:23.547071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:23.891498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:23.900746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:23.907152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1b6b2-45b3-4844-a40b-c595ff4225c7 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:24.044102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:24.044102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:24.044102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:24.044102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] PATH_INFO: `/v3/projects/d7da04837f274837b4ae78eeb84e7ad5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:24.044564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7da04837f274837b4ae78eeb84e7ad5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:24.046673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:24.279203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7da04837f274837b4ae78eeb84e7ad5', 'request_id': 'req-2230208e-cfa5-4d28-8895-4e6f51fe17e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:24.298320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7da04837f274837b4ae78eeb84e7ad5', 'request_id': 'req-2230208e-cfa5-4d28-8895-4e6f51fe17e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:24.472729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7da04837f274837b4ae78eeb84e7ad5', 'request_id': 'req-2230208e-cfa5-4d28-8895-4e6f51fe17e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:24.496680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] The token cache is being invalidate because project d7da04837f274837b4ae78eeb84e7ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:24.497058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:24.502903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2230208e-cfa5-4d28-8895-4e6f51fe17e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:24.507688 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2087/4156] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:23 2022] DELETE /identity/v3/projects/d7da04837f274837b4ae78eeb84e7ad5 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:24.516584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba723-bb0a-46b1-8a7f-0193ec316572 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:24.519759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba723-bb0a-46b1-8a7f-0193ec316572 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:24.519759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba723-bb0a-46b1-8a7f-0193ec316572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:24.560910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d7aba723-bb0a-46b1-8a7f-0193ec316572 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:24.563064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d7aba723-bb0a-46b1-8a7f-0193ec316572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:24.730021 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2070/4157] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:24.737712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c01cf6-2c7f-48b6-8081-d3f0dc53c7a5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:24.738323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c01cf6-2c7f-48b6-8081-d3f0dc53c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:24.738323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c01cf6-2c7f-48b6-8081-d3f0dc53c7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:24.763962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e5c01cf6-2c7f-48b6-8081-d3f0dc53c7a5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:24.765174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5c01cf6-2c7f-48b6-8081-d3f0dc53c7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:24.799582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2088/4158] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:24.804963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba723-bb0a-46b1-8a7f-0193ec316572 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:24.821633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba723-bb0a-46b1-8a7f-0193ec316572 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:24.839606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:24.841092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:24.841401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:24.841655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:24.842366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:24.842675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:24.845792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:24.878810 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2071/4159] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:24.880274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c01cf6-2c7f-48b6-8081-d3f0dc53c7a5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:24.893822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c01cf6-2c7f-48b6-8081-d3f0dc53c7a5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:24.910334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:24.921123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:24.926740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:24.926740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:24.926740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:24.926740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:24.926740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:25.101681 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2089/4160] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:24 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:25.102962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:25.118848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4475d-6cc1-436a-9326-8c7829a0cdb3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:25.197266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:25.198642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:25.199265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:25.199756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:25.200783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:25.203265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:25.306681 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2072/4161] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:25 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:25.313192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:25.348473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eeda4-183d-4079-8cb2-febaf691c820 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:25.373665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:25.375490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:25.376038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:25.376568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:25.377497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:25.379615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:25.404393 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2090/4162] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:25.405364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:25.422693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3216ef-dba1-47ed-b430-900ee3db618b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:25.433405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285309-dcfb-43cf-8386-1873c7eb09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:25.434023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285309-dcfb-43cf-8386-1873c7eb09e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:25.434338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285309-dcfb-43cf-8386-1873c7eb09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:25.434613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285309-dcfb-43cf-8386-1873c7eb09e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:25.435394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84285309-dcfb-43cf-8386-1873c7eb09e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:25.436928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84285309-dcfb-43cf-8386-1873c7eb09e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:25.452835 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2073/4163] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:25.456928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:25.494982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff890fb-deef-45d6-a49c-4a417b3ff313 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:25.501263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:25.504992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:25.505924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:25.509382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] PATH_INFO: `/v3/projects/538f09867ca94acc96254d7ad045061e/users/10e09e671cd64d5e83fdfd289762ae16/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:25.533931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538f09867ca94acc96254d7ad045061e, user_id=10e09e671cd64d5e83fdfd289762ae16, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:25.537717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:25.621994 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2091/4164] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:25 2022] PUT /identity/v3/projects/538f09867ca94acc96254d7ad045061e/users/10e09e671cd64d5e83fdfd289762ae16/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:25.632655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:25.632936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:25.633209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:25.668039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] MFA Rules not processed for user `10e09e671cd64d5e83fdfd289762ae16`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:25.669186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:25.797771 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2074/4165] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:25.990735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:25.994548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:26.099453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:26.101140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:26.176619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5a552-21de-4577-9993-2d525f1cfba0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:26.191795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:26.192986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:26.193741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:26.194350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] PATH_INFO: `/v3/users/97fcf7685853432ab0173f0cfac41863` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:26.201133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fcf7685853432ab0173f0cfac41863)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:26.203994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:26.252978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:26.305734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:26.347164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bc8b5-9244-456d-adfc-753c5f7b1a0c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:26.354668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:26.356597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:26.357354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:26.357939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:26.368697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:26.371847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:26.387845 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2075/4166] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:26.463524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:26.481118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fcf7685853432ab0173f0cfac41863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.483165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5689eb-52e8-42ed-be6c-fb4e0784f2f3 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:26.495316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:26.496948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:26.498392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:26.499068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] PATH_INFO: `/v3/users/10e09e671cd64d5e83fdfd289762ae16` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:26.505282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e09e671cd64d5e83fdfd289762ae16)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:26.508323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:26.511219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fcf7685853432ab0173f0cfac41863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.513722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fcf7685853432ab0173f0cfac41863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.546228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fcf7685853432ab0173f0cfac41863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.637771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2db4819b-ff9a-44c6-bf31-55a906df919b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fcf7685853432ab0173f0cfac41863'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.645365 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2092/4167] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:25 2022] DELETE /identity/v3/users/97fcf7685853432ab0173f0cfac41863 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:26.755052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e09e671cd64d5e83fdfd289762ae16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.755847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e09e671cd64d5e83fdfd289762ae16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.869674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e09e671cd64d5e83fdfd289762ae16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.870760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e09e671cd64d5e83fdfd289762ae16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.879973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e09e671cd64d5e83fdfd289762ae16'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:26.921464 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2076/4168] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:26 2022] DELETE /identity/v3/users/10e09e671cd64d5e83fdfd289762ae16 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:40:26.926513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:26.933047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:26.933047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:26.958326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:26.961759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:27.107351 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2093/4169] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:27.113600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:27.115373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:27.195369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd05e-031f-43ee-8eb2-564e36b530cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:27.200073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:27.200919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:27.201388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:27.201828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:27.213842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:27.216438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:27.225163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:27.227919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:27.234368 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2077/4170] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:40:27.255583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc965d4d-6e78-496b-a00e-e05005bf8f39 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:27.264665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:27.265932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:27.266426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:27.266885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] PATH_INFO: `/v3/projects/500c1691c5bb4729ba86089d20dedf27` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:27.268599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500c1691c5bb4729ba86089d20dedf27)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:27.272408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:27.447160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500c1691c5bb4729ba86089d20dedf27', 'request_id': 'req-4287dc2c-3514-4c7f-a82c-bc09d08ea743'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:27.455380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500c1691c5bb4729ba86089d20dedf27', 'request_id': 'req-4287dc2c-3514-4c7f-a82c-bc09d08ea743'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:27.538910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500c1691c5bb4729ba86089d20dedf27', 'request_id': 'req-4287dc2c-3514-4c7f-a82c-bc09d08ea743'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:27.561034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] The token cache is being invalidate because project 500c1691c5bb4729ba86089d20dedf27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:27.562818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:27.563561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:27.565111 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2094/4171] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:27 2022] DELETE /identity/v3/projects/500c1691c5bb4729ba86089d20dedf27 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:27.569326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:27.596843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e11988-54d5-4456-ba17-9a8d291d37c1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:27.682305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:27.682973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:27.683779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:27.684420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] PATH_INFO: `/v3/users/c98e22c79e144f43b84c006ecc2ad91f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:27.685950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98e22c79e144f43b84c006ecc2ad91f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:27.688357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:28.012671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:28.012671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:28.021032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98e22c79e144f43b84c006ecc2ad91f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.030216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98e22c79e144f43b84c006ecc2ad91f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.031341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287dc2c-3514-4c7f-a82c-bc09d08ea743 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:28.040963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:28.043211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:28.049416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:28.049416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] PATH_INFO: `/v3/projects/538f09867ca94acc96254d7ad045061e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:28.049416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=538f09867ca94acc96254d7ad045061e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:28.049416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:28.185793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98e22c79e144f43b84c006ecc2ad91f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.186601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98e22c79e144f43b84c006ecc2ad91f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.198378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a47a6139-ca6d-48ee-9373-1f2e02ee7a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98e22c79e144f43b84c006ecc2ad91f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.232546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2078/4172] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:27 2022] DELETE /identity/v3/users/c98e22c79e144f43b84c006ecc2ad91f => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:28.283226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538f09867ca94acc96254d7ad045061e', 'request_id': 'req-6fa4dbea-03ae-465b-8332-9bf2129be17b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.297406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538f09867ca94acc96254d7ad045061e', 'request_id': 'req-6fa4dbea-03ae-465b-8332-9bf2129be17b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.415256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:28.423466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538f09867ca94acc96254d7ad045061e', 'request_id': 'req-6fa4dbea-03ae-465b-8332-9bf2129be17b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.467645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] The token cache is being invalidate because project 538f09867ca94acc96254d7ad045061e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:28.467945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.468626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6fa4dbea-03ae-465b-8332-9bf2129be17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.470463 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2095/4173] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:28 2022] DELETE /identity/v3/projects/538f09867ca94acc96254d7ad045061e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:28.476143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:28.476758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:28.477267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:28.508628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:28.511370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:28.586878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:28.604616 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2079/4174] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:28.614452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ece0-6593-4fa6-a476-e0720ccdda88 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:28.615150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ece0-6593-4fa6-a476-e0720ccdda88 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:28.615610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45ece0-6593-4fa6-a476-e0720ccdda88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:28.623934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:28.625955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:28.643629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7fbf1-aaf4-4991-913b-2210b6a55c26 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:28.649955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:28.650864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:28.651316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:28.651739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] PATH_INFO: `/v3/users/05517b4af11741bda3e7eebb6232e83e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:28.653620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05517b4af11741bda3e7eebb6232e83e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:28.656217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:28.656904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8e45ece0-6593-4fa6-a476-e0720ccdda88 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:28.658333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8e45ece0-6593-4fa6-a476-e0720ccdda88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:28.683831 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2096/4175] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:28.684762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45ece0-6593-4fa6-a476-e0720ccdda88 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:28.701581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45ece0-6593-4fa6-a476-e0720ccdda88 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:28.708280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:28.709896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:28.710377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:28.710807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:28.711677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:28.712550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:28.715164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:28.734118 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2097/4176] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:28.735282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:28.747928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2713a1c-b1dc-422a-8d5a-86c418f76f87 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:28.753336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:28.754176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:28.754588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:28.754900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:28.755705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:28.759220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:28.856224 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2098/4177] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:28 2022] POST /identity/v3/projects => generated 397 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:28.857605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:28.896111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05517b4af11741bda3e7eebb6232e83e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.906201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05517b4af11741bda3e7eebb6232e83e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:28.992359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81226a2f-3e84-46a0-b58b-e838658aa2b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:28.999874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9bd58-a4cf-41f5-b4aa-f9f5bb293038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.000501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9bd58-a4cf-41f5-b4aa-f9f5bb293038 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.000785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9bd58-a4cf-41f5-b4aa-f9f5bb293038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.001077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9bd58-a4cf-41f5-b4aa-f9f5bb293038 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.001697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9bd58-a4cf-41f5-b4aa-f9f5bb293038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.003751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9bd58-a4cf-41f5-b4aa-f9f5bb293038 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:29.038315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05517b4af11741bda3e7eebb6232e83e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.041520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05517b4af11741bda3e7eebb6232e83e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.056556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05517b4af11741bda3e7eebb6232e83e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.119642 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2080/4178] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:28 2022] DELETE /identity/v3/users/05517b4af11741bda3e7eebb6232e83e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:29.123536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:29.126891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:29.142394 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2099/4179] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:28 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:29.143810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.144099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.144377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.187672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:29.189551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:29.292941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a01418-2489-4b49-830c-fc0bb36c85f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:29.304908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.305572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.306011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.306227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] PATH_INFO: `/v3/projects/839ea251cbf14e1ea20d69d823d0dd12` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.309538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839ea251cbf14e1ea20d69d823d0dd12)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.313526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:29.353441 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2100/4180] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:29.356124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:29.358081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:29.376001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5304c-1cc7-44ce-99eb-af37923094b2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:29.382740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.383661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.384686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.385028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.385695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.387379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:29.406226 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2101/4181] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:29.406226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:29.406226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:29.443400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839ea251cbf14e1ea20d69d823d0dd12', 'request_id': 'req-4202090e-49db-4d39-bdd3-474247f592b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.470090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839ea251cbf14e1ea20d69d823d0dd12', 'request_id': 'req-4202090e-49db-4d39-bdd3-474247f592b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.501519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b4f7e-3813-4db9-92a1-0504b31380bf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:29.515913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:29.574934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839ea251cbf14e1ea20d69d823d0dd12', 'request_id': 'req-4202090e-49db-4d39-bdd3-474247f592b9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.584071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71040da-b75f-4acc-8a2e-2c94b453cade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.584071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71040da-b75f-4acc-8a2e-2c94b453cade service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.584071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71040da-b75f-4acc-8a2e-2c94b453cade service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.584071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71040da-b75f-4acc-8a2e-2c94b453cade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.598348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] The token cache is being invalidate because project 839ea251cbf14e1ea20d69d823d0dd12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:29.600093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.600980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:29.606826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2081/4182] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:29 2022] DELETE /identity/v3/projects/839ea251cbf14e1ea20d69d823d0dd12 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:29.612847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:29.612847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:29.666073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71040da-b75f-4acc-8a2e-2c94b453cade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.668645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71040da-b75f-4acc-8a2e-2c94b453cade service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:29.684025 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2102/4183] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:29.686178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91d9d5-e86f-4a30-b868-fb8fa47713fd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.686609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91d9d5-e86f-4a30-b868-fb8fa47713fd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.687377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91d9d5-e86f-4a30-b868-fb8fa47713fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.712593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc91d9d5-e86f-4a30-b868-fb8fa47713fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:29.715588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc91d9d5-e86f-4a30-b868-fb8fa47713fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:29.733208 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2103/4184] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:29.741258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f27ab-9df8-4217-8a36-0aaddb025a0a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.741672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f27ab-9df8-4217-8a36-0aaddb025a0a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.742046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f27ab-9df8-4217-8a36-0aaddb025a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.773615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202090e-49db-4d39-bdd3-474247f592b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:29.786482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:29.796302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.796879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.797165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.797441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.798776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.799552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d16f27ab-9df8-4217-8a36-0aaddb025a0a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:29.803234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:29.803681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d16f27ab-9df8-4217-8a36-0aaddb025a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:29.826825 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2104/4185] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:29.830311 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2082/4186] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:29.836142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f27ab-9df8-4217-8a36-0aaddb025a0a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:29.836509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:29.844084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f27ab-9df8-4217-8a36-0aaddb025a0a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:29.850959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.851588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.851870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.852144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.852806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:29.853181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.854853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:29.855647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b468f-537e-49bc-b1ad-7220a3d5d985 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:29.867000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5275fc-9e48-47d2-a2a2-da01b88af6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.867690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5275fc-9e48-47d2-a2a2-da01b88af6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.867971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5275fc-9e48-47d2-a2a2-da01b88af6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.868229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5275fc-9e48-47d2-a2a2-da01b88af6fe admin admin] PATH_INFO: `/v3/projects/f306cab2d79640c4be438bbf95cf421f/users/ed69f78553214ef388d5489123297357/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.874820 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2105/4187] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:29.875733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:29.888266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cd172-afc7-4f21-9c51-029f3d015ebf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:29.893916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:29.894621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:29.895158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:29.895956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:29.896898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.899052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:29.934014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5275fc-9e48-47d2-a2a2-da01b88af6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f306cab2d79640c4be438bbf95cf421f, user_id=ed69f78553214ef388d5489123297357, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:29.940359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5275fc-9e48-47d2-a2a2-da01b88af6fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:30.004341 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2106/4188] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:29 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:30.006874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:30.101822 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2083/4189] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:29 2022] PUT /identity/v3/projects/f306cab2d79640c4be438bbf95cf421f/users/ed69f78553214ef388d5489123297357/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:30.103815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e110d7-0b8a-4de8-9741-4e33fae414f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:30.107765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.108154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.108432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.171282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:30.172531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:30.200393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:30.201197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.201584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.201978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.204489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:30.214246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:30.284418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2084/4190] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:30.295017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:30.297359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:30.338111 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2107/4191] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:30 2022] POST /identity/v3/users => generated 285 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:30.340285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:30.361733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900aef-4e81-4f0a-9555-d55fcd82d34e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:30.376211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:30.376849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.378309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.378309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.381000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:30.388259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:30.424473 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2108/4192] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:30.424473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:30.435042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7ea67-a924-42ff-b39f-64b7f26e2d41 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:30.443530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:30.444057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574307d5-50a7-4968-910c-9df001d0a7cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:30.444827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.445909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.446495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.447386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:30.451533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:30.474772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb455a2c-a177-4625-9175-ce180cf73290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:30.476361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455a2c-a177-4625-9175-ce180cf73290 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.476837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455a2c-a177-4625-9175-ce180cf73290 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.477348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455a2c-a177-4625-9175-ce180cf73290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.504766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:30.514735 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2109/4193] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:30.523154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:30.534260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb455a2c-a177-4625-9175-ce180cf73290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:30.535914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb455a2c-a177-4625-9175-ce180cf73290 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:30.542090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8260899-9f38-4dd7-bb8e-c4f91a3860ee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:30.560585 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2085/4194] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:30.561573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:30.562407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.562799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.564826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] PATH_INFO: `/v3/projects/da1f1762fee648d28c5476cbaa27d82a/users/3cbf754d45be4505aaf1e72106ddd56d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.601696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1f1762fee648d28c5476cbaa27d82a, user_id=3cbf754d45be4505aaf1e72106ddd56d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:30.604952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:30.708026 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2110/4195] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:30 2022] PUT /identity/v3/projects/da1f1762fee648d28c5476cbaa27d82a/users/3cbf754d45be4505aaf1e72106ddd56d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:30.722948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.723830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.724284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.746124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:30.748623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:30.774123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:30.791840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] MFA Rules not processed for user `3cbf754d45be4505aaf1e72106ddd56d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:30.793841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:30.917280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d7e39-fc53-48fb-bd98-3c841a084ace admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:30.923311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:30.924087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:30.924361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:30.924728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] PATH_INFO: `/v3/projects/be1ed88e12504e3685eaaa0ac453202e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:30.925813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1ed88e12504e3685eaaa0ac453202e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:30.928611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:30.994686 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2086/4196] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:31.014939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:31.016699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:31.095703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1ed88e12504e3685eaaa0ac453202e', 'request_id': 'req-8d1f2e14-ca0f-4904-9624-f5c69ea42594'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.104926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1ed88e12504e3685eaaa0ac453202e', 'request_id': 'req-8d1f2e14-ca0f-4904-9624-f5c69ea42594'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.176766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bdb7-a381-4174-ac5e-196a5cd1b4dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:31.197380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1ed88e12504e3685eaaa0ac453202e', 'request_id': 'req-8d1f2e14-ca0f-4904-9624-f5c69ea42594'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.214024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] The token cache is being invalidate because project be1ed88e12504e3685eaaa0ac453202e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:31.214904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.215740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d1f2e14-ca0f-4904-9624-f5c69ea42594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.221887 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2111/4197] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:30 2022] DELETE /identity/v3/projects/be1ed88e12504e3685eaaa0ac453202e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:31.226289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f6df8-1329-408c-90a7-fc7188cc04f2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.226289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f6df8-1329-408c-90a7-fc7188cc04f2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.226289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f6df8-1329-408c-90a7-fc7188cc04f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.262439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-412f6df8-1329-408c-90a7-fc7188cc04f2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:31.264475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-412f6df8-1329-408c-90a7-fc7188cc04f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:31.270297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:31.270297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.270297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.270297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.271061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:31.343603 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2112/4198] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:31.350076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:31.351957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:31.354516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfa75-458e-49f2-b0e6-63d58eaea719 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.354825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfa75-458e-49f2-b0e6-63d58eaea719 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.362812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfa75-458e-49f2-b0e6-63d58eaea719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.367478 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2087/4199] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:31.383689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:31.385383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:31.419607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9e0bfa75-458e-49f2-b0e6-63d58eaea719 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:31.421308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e0bfa75-458e-49f2-b0e6-63d58eaea719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:31.422894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb8962-0d44-4639-ba7e-83b2ba6c8773 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:31.438695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:31.439680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.440156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.440595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] PATH_INFO: `/v3/users/e373e006057645d989e15c0efe4c06fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.442125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e373e006057645d989e15c0efe4c06fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:31.445330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:31.449352 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2113/4200] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:31.453111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfa75-458e-49f2-b0e6-63d58eaea719 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:31.484143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfa75-458e-49f2-b0e6-63d58eaea719 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:31.499991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:31.500626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.500908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.501361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.502021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:31.502372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:31.504034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:31.519799 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2114/4201] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:40:31.524011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:31.539266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151274f-e0d3-456c-828b-f088ac76a267 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:31.547224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:31.547224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.547224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.547492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.548117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:31.550266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:31.660089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2115/4202] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:31 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:31.660089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:31.700983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e373e006057645d989e15c0efe4c06fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.704413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e373e006057645d989e15c0efe4c06fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.733381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:31.793342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d9116-09d0-4a80-9480-83e26e530769 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:31.798091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e373e006057645d989e15c0efe4c06fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.799283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:31.800006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.800372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.800700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.801389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:31.803641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:31.810346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e373e006057645d989e15c0efe4c06fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.823217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e74ad52-63d5-45e0-a079-a41ebd8c6556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e373e006057645d989e15c0efe4c06fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:31.826148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:31.858033 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2088/4203] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:31 2022] DELETE /identity/v3/users/e373e006057645d989e15c0efe4c06fc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:40:31.867608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:31.867903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:31.868185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:31.898601 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2116/4204] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:31 2022] POST /identity/v3/users => generated 281 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:31.902899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:31.905042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:31.905997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:31.907575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:31.920156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23fcc6-e853-40c9-acc8-c098a2c9a2e5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:31.982809 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2089/4205] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:31.993004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:31.996049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:32.009303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:32.009939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.010260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.010649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.011889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:32.018546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:32.062757 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2117/4206] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:40:32.062757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:32.083776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234d2e7-b49a-41da-80a1-5d10f68d5837 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:32.090979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:32.092672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.092672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.092672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.093012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:32.094421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:32.118179 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2118/4207] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:32.121147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:32.124105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b979d4-2d9f-42e3-82fb-6141857b5974 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:32.128328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bc418-2a06-4d66-bc8e-345236ee6080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:32.129069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc418-2a06-4d66-bc8e-345236ee6080 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.129341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc418-2a06-4d66-bc8e-345236ee6080 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.129677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc418-2a06-4d66-bc8e-345236ee6080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.134217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ac473-7ffd-42a9-af77-dca3b7a32d4e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:32.139540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:32.140607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.140753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bc418-2a06-4d66-bc8e-345236ee6080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:32.140851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.140851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] PATH_INFO: `/v3/projects/defa7ac22af046d4873c8cc9f16ecd36/users/c37eb5c60b1b46819d1fa9023fab2ef6/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.141834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bc418-2a06-4d66-bc8e-345236ee6080 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:32.152067 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2090/4208] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:32.156446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] RBAC: Authorizing `identity:create_grant(project_id=defa7ac22af046d4873c8cc9f16ecd36, user_id=c37eb5c60b1b46819d1fa9023fab2ef6, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:32.159409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:32.251096 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2119/4209] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:32 2022] PUT /identity/v3/projects/defa7ac22af046d4873c8cc9f16ecd36/users/c37eb5c60b1b46819d1fa9023fab2ef6/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:40:32.269498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474338-1394-4c2f-8e76-1480f0e8fd68 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.269842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474338-1394-4c2f-8e76-1480f0e8fd68 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.270151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474338-1394-4c2f-8e76-1480f0e8fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.339054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-53474338-1394-4c2f-8e76-1480f0e8fd68 None None] MFA Rules not processed for user `c37eb5c60b1b46819d1fa9023fab2ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:32.341511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:32.347121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53474338-1394-4c2f-8e76-1480f0e8fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:32.359165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:32.362629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:32.446791 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2091/4210] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:32.468561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474338-1394-4c2f-8e76-1480f0e8fd68 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:32.508499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679f737-1376-427e-ba8f-870222ef391f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:32.515096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:32.516242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.516364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.516700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] PATH_INFO: `/v3/users/3cbf754d45be4505aaf1e72106ddd56d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.517906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbf754d45be4505aaf1e72106ddd56d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:32.520012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:32.589339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474338-1394-4c2f-8e76-1480f0e8fd68 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:32.596084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:32.597341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.597628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.597904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.633580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:32.634305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:32.656014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2092/4211] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:40:32.800269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:32.801956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:32.820834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271ac3a-16cf-47f1-ab36-0272d334d7a9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:32.822800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbf754d45be4505aaf1e72106ddd56d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:32.843732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:32.844276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:32.844560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbf754d45be4505aaf1e72106ddd56d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:32.844692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:32.845369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbf754d45be4505aaf1e72106ddd56d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:32.845629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] PATH_INFO: `/v3/projects/ad13985f72b54af7bea9210361f484a8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:32.849158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad13985f72b54af7bea9210361f484a8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:32.856971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:32.883997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbf754d45be4505aaf1e72106ddd56d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:32.997309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72cadf52-63bb-4f22-8f9b-6b56d10d760b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbf754d45be4505aaf1e72106ddd56d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.004196 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2120/4212] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:32 2022] DELETE /identity/v3/users/3cbf754d45be4505aaf1e72106ddd56d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:40:33.008698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:33.008983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:33.009256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:33.048637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:33.050037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:33.067833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad13985f72b54af7bea9210361f484a8', 'request_id': 'req-da314e83-1059-4ddf-9630-8d173543bf80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.077772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad13985f72b54af7bea9210361f484a8', 'request_id': 'req-da314e83-1059-4ddf-9630-8d173543bf80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.142506 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2121/4213] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:33.160022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:33.164960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:33.169280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad13985f72b54af7bea9210361f484a8', 'request_id': 'req-da314e83-1059-4ddf-9630-8d173543bf80'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.195036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] The token cache is being invalidate because project ad13985f72b54af7bea9210361f484a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:33.197122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.198904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.201523 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2093/4214] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:32 2022] DELETE /identity/v3/projects/ad13985f72b54af7bea9210361f484a8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:33.210945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:33.213029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:33.238875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314e83-1059-4ddf-9630-8d173543bf80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:33.250995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:33.251647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:33.251927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:33.252521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] PATH_INFO: `/v3/users/67d092450f0c4e728cc018a8b84c0620` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:33.253844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d092450f0c4e728cc018a8b84c0620)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:33.255800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:33.314891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247be08-72d3-4c2c-a4fa-227faa655fe9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:33.319778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:33.320685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:33.321190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:33.321719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:33.324123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:33.341532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:33.341532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:33.352733 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2122/4215] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:40:33.532307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d092450f0c4e728cc018a8b84c0620'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.533101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d092450f0c4e728cc018a8b84c0620'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.625202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d092450f0c4e728cc018a8b84c0620'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.625882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d092450f0c4e728cc018a8b84c0620'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.635521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d092450f0c4e728cc018a8b84c0620'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:33.660726 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2094/4216] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:33 2022] DELETE /identity/v3/users/67d092450f0c4e728cc018a8b84c0620 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:34.484564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:34.487471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:34.504939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509e69-fe24-4742-ab36-74b79e001912 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:34.628733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:34.629374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:34.629863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:34.630441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] PATH_INFO: `/v3/projects/654fb78dadc64120bd93a764bc1a1aa0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:34.632026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654fb78dadc64120bd93a764bc1a1aa0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:34.634212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:34.647528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:34.649950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:34.686861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79baf98-c98e-4793-bcf3-dd2b629ca41e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:34.702190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:34.703144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:34.710971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:34.711825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] PATH_INFO: `/v3/projects/da1f1762fee648d28c5476cbaa27d82a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:34.714295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1f1762fee648d28c5476cbaa27d82a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:34.717647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:34.830853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654fb78dadc64120bd93a764bc1a1aa0', 'request_id': 'req-df5302d7-bac7-4d04-8271-10a7aaacf6f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:34.850911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654fb78dadc64120bd93a764bc1a1aa0', 'request_id': 'req-df5302d7-bac7-4d04-8271-10a7aaacf6f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:34.853985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1f1762fee648d28c5476cbaa27d82a', 'request_id': 'req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:34.865450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1f1762fee648d28c5476cbaa27d82a', 'request_id': 'req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:34.951812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654fb78dadc64120bd93a764bc1a1aa0', 'request_id': 'req-df5302d7-bac7-4d04-8271-10a7aaacf6f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:34.969539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] The token cache is being invalidate because project 654fb78dadc64120bd93a764bc1a1aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:34.969842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:34.971471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-df5302d7-bac7-4d04-8271-10a7aaacf6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:34.973889 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2123/4217] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:34 2022] DELETE /identity/v3/projects/654fb78dadc64120bd93a764bc1a1aa0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:34.981082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfdf0-954a-4e7f-a8a9-d4c6c0cd2940 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:34.981437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfdf0-954a-4e7f-a8a9-d4c6c0cd2940 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:34.981778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfdf0-954a-4e7f-a8a9-d4c6c0cd2940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.014689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1f1762fee648d28c5476cbaa27d82a', 'request_id': 'req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:35.015042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-989cfdf0-954a-4e7f-a8a9-d4c6c0cd2940 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:35.016610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-989cfdf0-954a-4e7f-a8a9-d4c6c0cd2940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:35.032154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] The token cache is being invalidate because project da1f1762fee648d28c5476cbaa27d82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:35.032456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:35.033538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3aa8f71c-f1a2-4a08-be08-8aeea27271a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:35.043679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2095/4218] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:34 2022] DELETE /identity/v3/projects/da1f1762fee648d28c5476cbaa27d82a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:35.046035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60004e-7c54-4b85-ac39-318e992cdc0f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.046358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60004e-7c54-4b85-ac39-318e992cdc0f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.052899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60004e-7c54-4b85-ac39-318e992cdc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.109466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8b60004e-7c54-4b85-ac39-318e992cdc0f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:35.110890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b60004e-7c54-4b85-ac39-318e992cdc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:35.129659 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2096/4219] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:35.134147 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2124/4220] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:35.136367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7bf3-e5cd-4b63-b8c7-6e3ba7bdf8a3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.136367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7bf3-e5cd-4b63-b8c7-6e3ba7bdf8a3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.136367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7bf3-e5cd-4b63-b8c7-6e3ba7bdf8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.142930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e500-ca12-4f81-97d0-6c7b69269e1d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.143221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e500-ca12-4f81-97d0-6c7b69269e1d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.143501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e500-ca12-4f81-97d0-6c7b69269e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.191233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0f0f7bf3-e5cd-4b63-b8c7-6e3ba7bdf8a3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:35.192610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f0f7bf3-e5cd-4b63-b8c7-6e3ba7bdf8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:35.203413 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2097/4221] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:35.207878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7bf3-e5cd-4b63-b8c7-6e3ba7bdf8a3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.218777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-abb2e500-ca12-4f81-97d0-6c7b69269e1d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:35.220193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-abb2e500-ca12-4f81-97d0-6c7b69269e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:35.222653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7bf3-e5cd-4b63-b8c7-6e3ba7bdf8a3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.227965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.228711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.234280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.234280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.234997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:35.235519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.237739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.239987 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2125/4222] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:35.240956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e500-ca12-4f81-97d0-6c7b69269e1d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.255632 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2098/4223] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:40:35.262678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e500-ca12-4f81-97d0-6c7b69269e1d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.267560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.269278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.269916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.270271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.270557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.271512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:35.271820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.273464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.289641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2126/4224] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:35.289868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba60b-d964-4c7f-9283-b4fdb4205645 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.295722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.314809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e3793-3af4-46a2-bb2f-3c5aa4999d29 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.330237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.330877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.331523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.331904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.332287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.332416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.333073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.333202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.333357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.335268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.337221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.348145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.485352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:35.489679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2099/4225] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:35 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:35.494132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.519264 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2127/4226] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:35 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:35.522767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.640388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9865b2-0704-48a9-a6d9-676a770011e2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.672328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2c477-fc46-4592-b169-9c4fb5217fc1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.694330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.694330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.694330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.694330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.694832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.694832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.784989 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2128/4227] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:35 2022] POST /identity/v3/users => generated 282 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:35.789483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.818342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac15ab-527f-4642-8e75-806d819a8fa4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.833457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.834106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.835267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.835267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.839038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.839762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.840055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.840192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.840312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.840965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.841822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.844840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.862752 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2129/4228] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:35.866945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.888737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d13a69-1200-488d-8f3a-19a179b1f519 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.906476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.906476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.906476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.907091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:35.908004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:35.909626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:35.935902 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2130/4229] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:35.943986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.957776 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2100/4230] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:35 2022] POST /identity/v3/users => generated 284 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:35.962222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:35.979783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d49-cbfe-4183-8fcd-bc9c44c315e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.983265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495649e8-8c68-45ba-981f-185dca517541 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:35.997408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9752173-b223-4732-ac4f-6550884925f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:35.998130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9752173-b223-4732-ac4f-6550884925f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:35.998417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9752173-b223-4732-ac4f-6550884925f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:35.998694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9752173-b223-4732-ac4f-6550884925f2 admin admin] PATH_INFO: `/v3/projects/097da05d29b34d77bec9ca998cdcedf6/users/469b8f38063343f58b60a329a601e44e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.002908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:36.003542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.003823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.004095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.004752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:36.006427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:36.040571 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2101/4231] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:36.044730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:36.045562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9752173-b223-4732-ac4f-6550884925f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097da05d29b34d77bec9ca998cdcedf6, user_id=469b8f38063343f58b60a329a601e44e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:36.049066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9752173-b223-4732-ac4f-6550884925f2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:36.068743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9bd7a-c1e0-467d-a33f-302988fee10a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:36.075998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:36.076802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.077196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.077568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.078371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:36.080108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:36.095233 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2102/4232] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:36.099461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:36.111636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d603ca-6e7b-4d0b-8134-f5650c2bf789 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:36.118883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892482d-a648-4776-a772-9445a15392e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:36.118883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892482d-a648-4776-a772-9445a15392e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.118883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892482d-a648-4776-a772-9445a15392e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.119332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892482d-a648-4776-a772-9445a15392e7 admin admin] PATH_INFO: `/v3/projects/8c8666b164a743dea89a8f81a277d186/users/b7c0f8d3344b45e0a73747d85a9f9e0b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.142374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892482d-a648-4776-a772-9445a15392e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8666b164a743dea89a8f81a277d186, user_id=b7c0f8d3344b45e0a73747d85a9f9e0b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:36.145556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892482d-a648-4776-a772-9445a15392e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:36.146011 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2131/4233] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:35 2022] PUT /identity/v3/projects/097da05d29b34d77bec9ca998cdcedf6/users/469b8f38063343f58b60a329a601e44e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:36.162670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3f96d-a9b1-4b43-b055-05b70b449331 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.162954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3f96d-a9b1-4b43-b055-05b70b449331 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.163225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3f96d-a9b1-4b43-b055-05b70b449331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.208141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-29f3f96d-a9b1-4b43-b055-05b70b449331 None None] MFA Rules not processed for user `469b8f38063343f58b60a329a601e44e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:36.209429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-29f3f96d-a9b1-4b43-b055-05b70b449331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:36.234821 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2103/4234] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:36 2022] PUT /identity/v3/projects/8c8666b164a743dea89a8f81a277d186/users/b7c0f8d3344b45e0a73747d85a9f9e0b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:40:36.242221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.242510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.242786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.290635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:36.292785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:36.385584 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2132/4235] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:36.386611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3f96d-a9b1-4b43-b055-05b70b449331 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:36.400621 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2104/4236] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:36.510216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:36.512335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:36.532218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3f96d-a9b1-4b43-b055-05b70b449331 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:36.546123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:36.547070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.547528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.547985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.548633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:36.550618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:36.571706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:36.629780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e134-61b3-4abf-979d-6346cc5f07bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:36.634311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:36.634659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.635044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.635770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.647013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:36.648074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:36.660341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2105/4237] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:40:36.744659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:36.750132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2133/4238] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:36 2022] POST /identity/v3/projects => generated 363 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:36.764776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566b9a-90c6-4aba-bcbc-fd1f7baeb32c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:36.868753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:36.869493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:36.869895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:36.870732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:36.871665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:36.875191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:36.990225 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2106/4239] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:36 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:36.993694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:37.011995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b8fd7-cc5b-4db7-a5da-b7b72f08d94e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:37.020832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:37.020832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:37.020832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:37.020832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:37.021237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:37.021899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:37.035103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2134/4240] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:37.038945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:37.054374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466e74d-c82a-4160-96f4-a92e544e9286 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:37.061289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:37.062511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:37.063256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:37.064102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] PATH_INFO: `/v3/projects/188ad837b8884d57aefbcbee6f2f18e7/users/54613fc6625b4769abc3b930045b246a/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:37.085913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188ad837b8884d57aefbcbee6f2f18e7, user_id=54613fc6625b4769abc3b930045b246a, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:37.090822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:37.203155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:37.203577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2107/4241] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:37 2022] PUT /identity/v3/projects/188ad837b8884d57aefbcbee6f2f18e7/users/54613fc6625b4769abc3b930045b246a/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:37.216552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0b5e-b4bd-474f-a311-485ba0398972 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:37.304069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fbf94-230d-4e4f-bcff-f91f7599703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:37.304970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fbf94-230d-4e4f-bcff-f91f7599703f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:37.305124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fbf94-230d-4e4f-bcff-f91f7599703f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:37.305449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fbf94-230d-4e4f-bcff-f91f7599703f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:37.306209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fbf94-230d-4e4f-bcff-f91f7599703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:37.308994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fbf94-230d-4e4f-bcff-f91f7599703f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:37.325656 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2135/4242] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:37.329492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:37.342324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373691b-2eab-476f-8537-3392a992e672 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:37.344384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:37.349629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:37.350478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:37.350850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:37.351248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] PATH_INFO: `/v3/projects/188ad837b8884d57aefbcbee6f2f18e7/users/54613fc6625b4769abc3b930045b246a/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:37.353303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] RBAC: Authorizing `identity:create_grant(project_id=188ad837b8884d57aefbcbee6f2f18e7, user_id=54613fc6625b4769abc3b930045b246a, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:37.356465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:37.372284 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2108/4243] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:37 2022] PUT /identity/v3/projects/188ad837b8884d57aefbcbee6f2f18e7/users/54613fc6625b4769abc3b930045b246a/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:37.384372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad826d2-313a-45a5-aa86-6869a26ee51e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:37.388219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad826d2-313a-45a5-aa86-6869a26ee51e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:37.388219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad826d2-313a-45a5-aa86-6869a26ee51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:37.437074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-aad826d2-313a-45a5-aa86-6869a26ee51e None None] MFA Rules not processed for user `54613fc6625b4769abc3b930045b246a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:37.439736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aad826d2-313a-45a5-aa86-6869a26ee51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:37.548308 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2136/4244] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:37.565387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:37.663465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d1295-a77f-434e-b8c5-4ad8be10247e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:37.669350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1757e-92a0-4fb9-a739-fd90f85092e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:37.671929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1757e-92a0-4fb9-a739-fd90f85092e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:37.671929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1757e-92a0-4fb9-a739-fd90f85092e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:37.671929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1757e-92a0-4fb9-a739-fd90f85092e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:37.689205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1757e-92a0-4fb9-a739-fd90f85092e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:37.689471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1757e-92a0-4fb9-a739-fd90f85092e1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:37.704456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2109/4245] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:37.968702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:38.505446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:39.946222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:40.078265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:41.552418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:41.980138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:43.001442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad826d2-313a-45a5-aa86-6869a26ee51e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:43.016592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad826d2-313a-45a5-aa86-6869a26ee51e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:43.021070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:43.022731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:43.023354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:43.023865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:43.077152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:43.094045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:43.095791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:43.106876 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2137/4246] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:43.401534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5843e-855d-42d4-b369-6de3ad1627d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:43.402030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5843e-855d-42d4-b369-6de3ad1627d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:43.404897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5843e-855d-42d4-b369-6de3ad1627d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:43.464710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6fe5843e-855d-42d4-b369-6de3ad1627d6 None None] MFA Rules not processed for user `ed69f78553214ef388d5489123297357`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:43.466516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fe5843e-855d-42d4-b369-6de3ad1627d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:43.617180 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2110/4247] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:43.762878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:43.991054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:43.992796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:44.093347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4d3d4-f6c7-4fcc-8a6e-d93d88055eef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:44.093347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4d3d4-f6c7-4fcc-8a6e-d93d88055eef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:44.093347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4d3d4-f6c7-4fcc-8a6e-d93d88055eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:44.124918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-48c4d3d4-f6c7-4fcc-8a6e-d93d88055eef None None] MFA Rules not processed for user `f278334f3cd646a89ec99502f0bfe636`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:44.126660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48c4d3d4-f6c7-4fcc-8a6e-d93d88055eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:44.145885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f343-f0d6-4643-af13-9c4e63bd34ec service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:44.157834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:44.160254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:44.160617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:44.162816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:44.187381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:44.189452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:44.222239 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2138/4248] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:44.274179 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2111/4249] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:44.991098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:45.014864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:45.134947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:45.274448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7a36-09f2-4469-bf7c-023780d588be service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:45.283007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:45.284818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:45.285287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:45.285754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] PATH_INFO: `/v3/users/469b8f38063343f58b60a329a601e44e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:45.288655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469b8f38063343f58b60a329a601e44e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:45.291381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:45.563445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469b8f38063343f58b60a329a601e44e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:45.576799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469b8f38063343f58b60a329a601e44e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:45.580212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469b8f38063343f58b60a329a601e44e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:45.596655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469b8f38063343f58b60a329a601e44e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:45.693426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469b8f38063343f58b60a329a601e44e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:45.700115 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2139/4250] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:45 2022] DELETE /identity/v3/users/469b8f38063343f58b60a329a601e44e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:45.704640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:45.705094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:45.705606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:45.743324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:45.744703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:45.942877 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2112/4251] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:45.974270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:45.975553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:46.078602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:46.089587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ff735-51df-4037-8986-f439b171c8e5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:46.101153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:46.101791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:46.102085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:46.102367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:46.126463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:46.127940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:46.147065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2140/4252] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:46.488996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:47.585526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:47.640815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:47.642405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:47.661970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5ab6e-7fb2-4f07-86ff-bb7b783647b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:47.680733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:47.682348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:47.682859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:47.683930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] PATH_INFO: `/v3/projects/097da05d29b34d77bec9ca998cdcedf6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:47.685686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097da05d29b34d77bec9ca998cdcedf6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:47.688665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:47.756095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:47.924901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097da05d29b34d77bec9ca998cdcedf6', 'request_id': 'req-dd7c6b89-3edd-488e-8d3d-4917fde52a47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:47.955821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097da05d29b34d77bec9ca998cdcedf6', 'request_id': 'req-dd7c6b89-3edd-488e-8d3d-4917fde52a47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.060371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097da05d29b34d77bec9ca998cdcedf6', 'request_id': 'req-dd7c6b89-3edd-488e-8d3d-4917fde52a47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.081555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] The token cache is being invalidate because project 097da05d29b34d77bec9ca998cdcedf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:48.082260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.087686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd7c6b89-3edd-488e-8d3d-4917fde52a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.092529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2113/4253] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:47 2022] DELETE /identity/v3/projects/097da05d29b34d77bec9ca998cdcedf6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:48.096627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:48.109602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fe1ff-0d44-4456-9fee-817ef3bd862b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:48.117630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:48.280544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:48.283708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:48.284000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:48.284283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] PATH_INFO: `/v3/users/54613fc6625b4769abc3b930045b246a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:48.292524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54613fc6625b4769abc3b930045b246a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:48.301258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:48.666692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54613fc6625b4769abc3b930045b246a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.693692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54613fc6625b4769abc3b930045b246a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.694489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54613fc6625b4769abc3b930045b246a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.733594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54613fc6625b4769abc3b930045b246a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.905166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54613fc6625b4769abc3b930045b246a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:48.918778 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2141/4254] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:48 2022] DELETE /identity/v3/users/54613fc6625b4769abc3b930045b246a => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:40:49.158142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02fd5a-3a1f-40b7-b8fd-afbef431122e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:49.159123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02fd5a-3a1f-40b7-b8fd-afbef431122e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:49.159665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02fd5a-3a1f-40b7-b8fd-afbef431122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:49.203666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3a02fd5a-3a1f-40b7-b8fd-afbef431122e None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:49.205269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a02fd5a-3a1f-40b7-b8fd-afbef431122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:49.209532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:49.328913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2114/4255] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:49.660519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:50.294657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:50.845537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:50.847148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:51.017727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff20e6-3bb9-445e-9db9-4cf4d1fb5f43 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:51.027095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:51.031211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:51.031211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:51.031211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] PATH_INFO: `/v3/projects/188ad837b8884d57aefbcbee6f2f18e7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:51.032803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188ad837b8884d57aefbcbee6f2f18e7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:51.037318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:51.296565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188ad837b8884d57aefbcbee6f2f18e7', 'request_id': 'req-71c29101-19bb-4586-a230-6d25cda692d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:51.319719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188ad837b8884d57aefbcbee6f2f18e7', 'request_id': 'req-71c29101-19bb-4586-a230-6d25cda692d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:51.427986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188ad837b8884d57aefbcbee6f2f18e7', 'request_id': 'req-71c29101-19bb-4586-a230-6d25cda692d5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:51.463013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] The token cache is being invalidate because project 188ad837b8884d57aefbcbee6f2f18e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:51.463013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:51.463013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71c29101-19bb-4586-a230-6d25cda692d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:51.463013 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2142/4256] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:50 2022] DELETE /identity/v3/projects/188ad837b8884d57aefbcbee6f2f18e7 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:51.466442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6465ca9-133f-4250-b489-243e41538b58 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:51.466907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6465ca9-133f-4250-b489-243e41538b58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:51.467140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6465ca9-133f-4250-b489-243e41538b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:51.497685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b6465ca9-133f-4250-b489-243e41538b58 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:51.499163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6465ca9-133f-4250-b489-243e41538b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:51.643863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:51.644412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:51.644853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:51.692473 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2115/4257] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:51.702169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40155-3cc9-4e70-8ffc-5aa0f53b7038 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:51.702471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40155-3cc9-4e70-8ffc-5aa0f53b7038 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:51.702746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40155-3cc9-4e70-8ffc-5aa0f53b7038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:51.716967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] MFA Rules not processed for user `b7c0f8d3344b45e0a73747d85a9f9e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:51.721231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:51.722205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:51.763116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-93d40155-3cc9-4e70-8ffc-5aa0f53b7038 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:51.764838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93d40155-3cc9-4e70-8ffc-5aa0f53b7038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:51.800286 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2116/4258] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:51.804564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40155-3cc9-4e70-8ffc-5aa0f53b7038 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:51.823720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40155-3cc9-4e70-8ffc-5aa0f53b7038 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:51.884926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:51.884926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:51.885205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:51.885447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:51.887563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:51.887906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:51.889678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:51.908716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2117/4259] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:51.916256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:51.940990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc6247-dd68-4bcc-8179-2c4549f5970f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:51.967352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:51.968149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:51.968528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:51.969143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:51.970006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:51.977416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:51.983443 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2143/4260] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:40:52.048177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:52.049899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:52.133347 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2118/4261] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:51 2022] POST /identity/v3/projects => generated 391 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:52.137229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:52.252295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf04cd2-32aa-4cbc-888e-04d76d38de2e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:52.315359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0bc52-7c37-4226-b2fc-3b924e9a93e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:52.327720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:52.328609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:52.329056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:52.329513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:52.330357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:52.332373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:52.410298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:52.410922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:52.412302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:52.412757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:52.425629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2119/4262] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:52 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:52.430331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:52.447001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364d3b-702d-44f2-bc9b-45b6caa8499e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:52.457632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:52.458848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:52.460198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:52.461186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:52.462029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:52.467266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:52.501704 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2120/4263] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:40:52.506367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:52.521352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:52.534393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b503753-7445-45d8-b7a4-f559856e4c1a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:52.537935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:52.539629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:52.552034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71433be2-f3b2-49d0-8d50-c22729469a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:52.552702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71433be2-f3b2-49d0-8d50-c22729469a95 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:52.552983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71433be2-f3b2-49d0-8d50-c22729469a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:52.553325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71433be2-f3b2-49d0-8d50-c22729469a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:52.554213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71433be2-f3b2-49d0-8d50-c22729469a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:52.558289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71433be2-f3b2-49d0-8d50-c22729469a95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:52.571782 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2144/4264] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:40:52.584497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:52.594137 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2121/4265] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:52.599519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918541d-973a-471d-b0c1-ba7668cc5ff0 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:52.607072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:52.607809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:52.608087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:52.608565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] PATH_INFO: `/v3/projects/4f2e508e6cb84062ad3425dd17ea1e02/users/678d8f578daf42e3ae2f616dba767fa7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:52.627866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2e508e6cb84062ad3425dd17ea1e02, user_id=678d8f578daf42e3ae2f616dba767fa7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:52.631751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:52.736860 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2145/4266] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:52 2022] PUT /identity/v3/projects/4f2e508e6cb84062ad3425dd17ea1e02/users/678d8f578daf42e3ae2f616dba767fa7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:52.748298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca9c8-6e18-4e5e-a473-110148147ba4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:52.748820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca9c8-6e18-4e5e-a473-110148147ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:52.749252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca9c8-6e18-4e5e-a473-110148147ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:52.851545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-663ca9c8-6e18-4e5e-a473-110148147ba4 None None] MFA Rules not processed for user `678d8f578daf42e3ae2f616dba767fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:52.851545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-663ca9c8-6e18-4e5e-a473-110148147ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:52.974414 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2122/4267] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:52.974975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:53.150264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a055f-7cc6-46b5-9c00-3d9a6fe20fa8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:53.175946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:53.178305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:53.178305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:53.178305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:53.178305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:53.188116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:53.376237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ca9c8-6e18-4e5e-a473-110148147ba4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:53.379053 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2146/4268] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:52 2022] POST /identity/v3/projects => generated 393 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:40:53.388454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ca9c8-6e18-4e5e-a473-110148147ba4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:53.512030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:53.513467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:53.513919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:53.514394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:53.515204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:53.517307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:53.665701 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2123/4269] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:40:53 2022] POST /identity/v3/users => generated 303 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:40:53.669703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:53.696893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6e96c-19d2-42ad-9cf7-4962e42d42b4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:53.712058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:53.713017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:53.713467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:53.714528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:53.715365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:53.717173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:53.759942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:53.777627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3759c-7032-4861-a970-59e5a821806a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:53.778265 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2147/4270] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:53.811063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:53.812704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:53.816910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:53.829052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] PATH_INFO: `/v3/projects/8061c66ed81143e08ed127fdf7ea11b0/users/c45319fdf5d04170897c2554eec322ab/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:53.896463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8061c66ed81143e08ed127fdf7ea11b0, user_id=c45319fdf5d04170897c2554eec322ab, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:53.901975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:54.036973 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2124/4271] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:53 2022] PUT /identity/v3/projects/8061c66ed81143e08ed127fdf7ea11b0/users/c45319fdf5d04170897c2554eec322ab/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:40:54.040965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:54.058494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa9ee-ca34-4632-b93b-0caa348c6dd3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:54.211055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105fd41-7eae-4c71-ab62-50ac82cfdc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:54.212525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105fd41-7eae-4c71-ab62-50ac82cfdc12 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:54.215008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105fd41-7eae-4c71-ab62-50ac82cfdc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:54.215559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105fd41-7eae-4c71-ab62-50ac82cfdc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:54.217024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105fd41-7eae-4c71-ab62-50ac82cfdc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:54.219093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105fd41-7eae-4c71-ab62-50ac82cfdc12 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:54.240505 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2148/4272] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:40:54.242372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:54.280308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299b8af-3179-4739-aac6-c3ae04274619 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:54.299030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:54.300334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:54.301024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:54.301477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] PATH_INFO: `/v3/projects/8061c66ed81143e08ed127fdf7ea11b0/users/c45319fdf5d04170897c2554eec322ab/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:54.310678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8061c66ed81143e08ed127fdf7ea11b0, user_id=c45319fdf5d04170897c2554eec322ab, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:54.316050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:54.352096 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2125/4273] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:40:54 2022] PUT /identity/v3/projects/8061c66ed81143e08ed127fdf7ea11b0/users/c45319fdf5d04170897c2554eec322ab/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:54.355478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:54.355779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:54.356381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:54.416427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] MFA Rules not processed for user `c45319fdf5d04170897c2554eec322ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:54.431103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:54.530828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:54.743331 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2149/4274] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:54.840472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:54.844886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:54.986188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b986-237c-4848-a11e-6a3ff67d05a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:55.005237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:55.005880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:55.006857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:55.007328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:55.027649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:55.029297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:55.043004 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2126/4275] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:40:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:40:55.478011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:56.044273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:57.005189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:57.054135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:57.212357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:57.214951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:57.353813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f1be6-e606-4dc2-a925-9cfa1e88a720 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:57.359740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:57.362958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:57.362958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:57.362958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] PATH_INFO: `/v3/users/2ff557eb6afe4b29bbccd87ffdbe21c0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:57.366740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff557eb6afe4b29bbccd87ffdbe21c0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:57.370529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:57.708287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff557eb6afe4b29bbccd87ffdbe21c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:57.720293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff557eb6afe4b29bbccd87ffdbe21c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:57.726620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff557eb6afe4b29bbccd87ffdbe21c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:57.745754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff557eb6afe4b29bbccd87ffdbe21c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:57.865344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7da09662-6a95-4305-b78a-c1efdb0a97b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff557eb6afe4b29bbccd87ffdbe21c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:57.879881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2150/4276] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:40:57 2022] DELETE /identity/v3/users/2ff557eb6afe4b29bbccd87ffdbe21c0 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:59.021069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:59.039859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30f79-565a-4e0c-a33a-4c6473e8bc20 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:59.180774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:59.184304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:59.188435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:59.188435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] PATH_INFO: `/v3/projects/80ef7de41a5a4e3599dbefeadb7cb1fa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:59.188435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ef7de41a5a4e3599dbefeadb7cb1fa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:59.189572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:59.208413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:59.293487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:59.355285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'request_id': 'req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:59.367227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'request_id': 'req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:59.476350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ef7de41a5a4e3599dbefeadb7cb1fa', 'request_id': 'req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:59.492977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] The token cache is being invalidate because project 80ef7de41a5a4e3599dbefeadb7cb1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:40:59.493729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:59.495712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1a87b15-0254-452e-8fe6-7ba5cd6de3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:40:59.502457 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2127/4277] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:40:59 2022] DELETE /identity/v3/projects/80ef7de41a5a4e3599dbefeadb7cb1fa => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:40:59.503054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb741-3748-48dd-aa84-5e1bee223016 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:59.503370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb741-3748-48dd-aa84-5e1bee223016 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:59.503644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cb741-3748-48dd-aa84-5e1bee223016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:59.544305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ce5cb741-3748-48dd-aa84-5e1bee223016 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:59.545536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce5cb741-3748-48dd-aa84-5e1bee223016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:59.670854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8553a5-979c-49b0-a3e8-96a60e666afd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:59.671124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8553a5-979c-49b0-a3e8-96a60e666afd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:59.671398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8553a5-979c-49b0-a3e8-96a60e666afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:59.672053 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2151/4278] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:59.704638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce8553a5-979c-49b0-a3e8-96a60e666afd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:40:59.706310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce8553a5-979c-49b0-a3e8-96a60e666afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:40:59.716299 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2128/4279] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:40:59.720667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb741-3748-48dd-aa84-5e1bee223016 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:59.739820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cb741-3748-48dd-aa84-5e1bee223016 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:59.739820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:59.739820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:59.739820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:59.740395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:59.740395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:40:59.741058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:59.743081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:40:59.762462 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2152/4280] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:40:59.763708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8553a5-979c-49b0-a3e8-96a60e666afd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:40:59.789146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8553a5-979c-49b0-a3e8-96a60e666afd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:40:59.805601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:40:59.812975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:40:59.812975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:40:59.812975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:40:59.814248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:40:59.819120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:00.002549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:00.003910 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2129/4281] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:40:59 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:00.008290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:00.020910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53296b71-9263-4f85-a170-87fc0ed3f2aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:00.182012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:00.184013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:00.184412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:00.186116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:00.186116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:00.192170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:00.285802 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2153/4282] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:41:00 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:00.292302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:00.312285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13095-a197-4187-9862-8918f439f098 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:00.319302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:00.320434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:00.320965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:00.321516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:00.322464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:00.324640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:00.345168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:00.374703 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2130/4283] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:00.376514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abce61a-3352-44f3-ad70-6e7072928b1c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:00.397610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d523-7497-478f-8404-b9f6a14058b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:00.397808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d523-7497-478f-8404-b9f6a14058b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:00.398263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d523-7497-478f-8404-b9f6a14058b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:00.398647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d523-7497-478f-8404-b9f6a14058b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:00.399422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d523-7497-478f-8404-b9f6a14058b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:00.402004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d523-7497-478f-8404-b9f6a14058b5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:00.419043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2154/4284] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:00.423205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:00.441616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602885a-5956-46b9-b277-a9263efa5981 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:00.471286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:00.471975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:00.472260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:00.472536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] PATH_INFO: `/v3/projects/634f588c94434a2d95b1da508cb56f85/users/6c07f47c7ef045aab1daa8cb6df9566b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:00.518955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634f588c94434a2d95b1da508cb56f85, user_id=6c07f47c7ef045aab1daa8cb6df9566b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:00.522714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:00.586994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:00.603414 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2131/4285] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:41:00 2022] PUT /identity/v3/projects/634f588c94434a2d95b1da508cb56f85/users/6c07f47c7ef045aab1daa8cb6df9566b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:00.608469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:00.608782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:00.609007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:00.646774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:00.648782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:00.751641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2155/4286] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:00.762338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:00.764960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:00.850935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dbb65-3431-4ae0-8597-4855a7b2ed67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:00.857697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4ae1a-788f-4d90-a141-52fe68fe61d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:00.859855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ae1a-788f-4d90-a141-52fe68fe61d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:00.859855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ae1a-788f-4d90-a141-52fe68fe61d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:00.860261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4ae1a-788f-4d90-a141-52fe68fe61d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:00.873781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4ae1a-788f-4d90-a141-52fe68fe61d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:00.875790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4ae1a-788f-4d90-a141-52fe68fe61d7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:00.889899 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2132/4287] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:01.019542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:01.021100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:01.037152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a344537-6133-481c-888b-df8e24e0a6dd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:01.042201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:01.042869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:01.043337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:01.043796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] PATH_INFO: `/v3/users/ed69f78553214ef388d5489123297357` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:01.045516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed69f78553214ef388d5489123297357)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:01.048470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:01.116755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c9aa-0a59-4a52-83ad-2d47f1e57be7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:01.117531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c9aa-0a59-4a52-83ad-2d47f1e57be7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:01.117936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c9aa-0a59-4a52-83ad-2d47f1e57be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:01.141016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8d2c9aa-0a59-4a52-83ad-2d47f1e57be7 None None] MFA Rules not processed for user `b7c0f8d3344b45e0a73747d85a9f9e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:01.143160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8d2c9aa-0a59-4a52-83ad-2d47f1e57be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:01.203269 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2133/4288] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:41:01.283497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed69f78553214ef388d5489123297357'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:01.292586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed69f78553214ef388d5489123297357'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:01.294736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed69f78553214ef388d5489123297357'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:01.334737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed69f78553214ef388d5489123297357'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:01.476116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d4c6439e-5644-40f5-8749-c7fee1c06683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed69f78553214ef388d5489123297357'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:01.477587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2156/4289] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:41:01 2022] DELETE /identity/v3/users/ed69f78553214ef388d5489123297357 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:01.597519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:01.876758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:02.060080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2c9aa-0a59-4a52-83ad-2d47f1e57be7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:02.072652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2c9aa-0a59-4a52-83ad-2d47f1e57be7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:02.192013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:02.192722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:02.193007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:02.193275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] PATH_INFO: `/v3/projects/f306cab2d79640c4be438bbf95cf421f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:02.198807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f306cab2d79640c4be438bbf95cf421f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:02.202303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:02.382432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f306cab2d79640c4be438bbf95cf421f', 'request_id': 'req-a39f65e8-f8e5-4337-8402-61fa79771aba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:02.390759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f306cab2d79640c4be438bbf95cf421f', 'request_id': 'req-a39f65e8-f8e5-4337-8402-61fa79771aba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:02.483457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f306cab2d79640c4be438bbf95cf421f', 'request_id': 'req-a39f65e8-f8e5-4337-8402-61fa79771aba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:02.505629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] The token cache is being invalidate because project f306cab2d79640c4be438bbf95cf421f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:41:02.506152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:02.506871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a39f65e8-f8e5-4337-8402-61fa79771aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:02.510253 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2134/4290] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:41:02 2022] DELETE /identity/v3/projects/f306cab2d79640c4be438bbf95cf421f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:02.514017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f79e8c-cb60-4fae-a9eb-d93384a8ae54 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:02.514540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f79e8c-cb60-4fae-a9eb-d93384a8ae54 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:02.514635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f79e8c-cb60-4fae-a9eb-d93384a8ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:02.535663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95f79e8c-cb60-4fae-a9eb-d93384a8ae54 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:02.536988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95f79e8c-cb60-4fae-a9eb-d93384a8ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:02.574751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:02.621724 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2157/4291] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:41:02.630281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a04d4-c646-4fa3-b80b-6f1364404e76 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:02.630878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a04d4-c646-4fa3-b80b-6f1364404e76 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:02.631395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a04d4-c646-4fa3-b80b-6f1364404e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:02.670233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-493a04d4-c646-4fa3-b80b-6f1364404e76 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:02.671578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-493a04d4-c646-4fa3-b80b-6f1364404e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:02.684545 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2135/4292] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:02.685712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f79e8c-cb60-4fae-a9eb-d93384a8ae54 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:02.697595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f79e8c-cb60-4fae-a9eb-d93384a8ae54 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:02.703771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:02.704384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:02.704669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:02.705042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:02.705708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:41:02.707041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:02.708758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:02.735656 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2158/4293] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:41:02.736849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a04d4-c646-4fa3-b80b-6f1364404e76 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:02.736988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:02.748493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a04d4-c646-4fa3-b80b-6f1364404e76 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:02.755069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:02.770025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:02.771785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:02.772688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:02.773206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:02.775752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:02.785256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:02.797969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e5f41-1bd5-4438-8a80-b638c63be938 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:02.819940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:02.820793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:02.820893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:02.826903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] PATH_INFO: `/v3/users/678d8f578daf42e3ae2f616dba767fa7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:02.827911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] RBAC: Authorizing `identity:delete_user(user_id=678d8f578daf42e3ae2f616dba767fa7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:02.837400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:02.920560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2136/4294] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:41:02 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:02.925834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:03.094914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678d8f578daf42e3ae2f616dba767fa7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:03.114755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678d8f578daf42e3ae2f616dba767fa7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:03.114755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678d8f578daf42e3ae2f616dba767fa7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:03.126308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70d376-a022-4bb7-bd28-c043deb7f5ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:03.139077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678d8f578daf42e3ae2f616dba767fa7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:03.139841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:03.140362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.140638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.140911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.141576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:03.143590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:03.207771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-55e5f6a7-63ed-441a-8fbd-e1f6233f695f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678d8f578daf42e3ae2f616dba767fa7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:03.227555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2159/4295] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:41:02 2022] DELETE /identity/v3/users/678d8f578daf42e3ae2f616dba767fa7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:03.233585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.233918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.234930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.261603 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2137/4296] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:41:02 2022] POST /identity/v3/users => generated 290 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:03.266152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:03.270412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:03.294872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0b685-b5af-4513-93a7-2f99e6846d89 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:03.296605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:03.297754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:03.392341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:03.393056 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2160/4297] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:41:03.396825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.397216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.397735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.399965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:03.403785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:03.416858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:03.420354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:03.423887 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2138/4298] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:03.427504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:03.444699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307eb6c-b7b3-4608-8173-2465f66d4123 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:03.456713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:03.457716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.457993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.458292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.461536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:03.465046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:03.501936 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2139/4299] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:41:03.504644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:03.518778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9c56-7ad5-4c68-b947-6469843c4eec None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:03.525564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c096a-863a-46e6-8603-b057b9b1196c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:03.526608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c096a-863a-46e6-8603-b057b9b1196c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.527130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c096a-863a-46e6-8603-b057b9b1196c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.527636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c096a-863a-46e6-8603-b057b9b1196c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.528112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013160f2-0455-4fd1-a543-8e03115ea0b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:03.535998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:03.537558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.537858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.538191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] PATH_INFO: `/v3/projects/e41731743d534457a92c6244b7671d7b/users/41b888dbd64a4fc48ee745a7b38014c7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.562093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:03.568382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41731743d534457a92c6244b7671d7b, user_id=41b888dbd64a4fc48ee745a7b38014c7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:03.572270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:03.579090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c096a-863a-46e6-8603-b057b9b1196c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:03.581251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c096a-863a-46e6-8603-b057b9b1196c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:03.606675 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2161/4300] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:03.695007 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2140/4301] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:41:03 2022] PUT /identity/v3/projects/e41731743d534457a92c6244b7671d7b/users/41b888dbd64a4fc48ee745a7b38014c7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:03.696340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.696631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.696914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.720034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:03.721432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:03.830685 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2162/4302] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:41:03.844918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:03.846903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:03.933763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24982b93-f799-478c-a065-115eee832ba3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:03.939214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:03.939880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:03.940159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:03.940701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:03.956520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:03.959510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:03.976022 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2141/4303] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:05.161735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:05.164181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:05.185323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:05.200891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96c8a5-ae02-45fa-8bc5-63f53ff96f6d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:05.244087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:05.247053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:05.247598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:05.248068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] PATH_INFO: `/v3/projects/4f2e508e6cb84062ad3425dd17ea1e02` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:05.252780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2e508e6cb84062ad3425dd17ea1e02)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:05.261450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:05.347886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:05.525498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2e508e6cb84062ad3425dd17ea1e02', 'request_id': 'req-3778d4cd-1017-4e18-a36e-3f806876a472'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:05.543087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2e508e6cb84062ad3425dd17ea1e02', 'request_id': 'req-3778d4cd-1017-4e18-a36e-3f806876a472'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:05.649176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2e508e6cb84062ad3425dd17ea1e02', 'request_id': 'req-3778d4cd-1017-4e18-a36e-3f806876a472'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:05.662355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] The token cache is being invalidate because project 4f2e508e6cb84062ad3425dd17ea1e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:41:05.663047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:05.664093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:05.669588 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2163/4304] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:41:05 2022] DELETE /identity/v3/projects/4f2e508e6cb84062ad3425dd17ea1e02 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:05.670695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:05.684654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ef65e-a601-4478-920e-55db954e5c25 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:05.778698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:05.779526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:05.780200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:05.780521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] PATH_INFO: `/v3/users/c45319fdf5d04170897c2554eec322ab` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:05.781777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45319fdf5d04170897c2554eec322ab)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:05.783781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:06.030473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45319fdf5d04170897c2554eec322ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:06.031186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45319fdf5d04170897c2554eec322ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:06.107492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45319fdf5d04170897c2554eec322ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:06.114684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45319fdf5d04170897c2554eec322ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:06.119540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e6fb49c-438c-4163-bccb-e5ae34a1fdad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45319fdf5d04170897c2554eec322ab'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:06.172183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2142/4305] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:41:05 2022] DELETE /identity/v3/users/c45319fdf5d04170897c2554eec322ab => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:06.848543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:07.257116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:07.258840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:07.283429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778d4cd-1017-4e18-a36e-3f806876a472 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:07.401593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:07.402407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:07.402741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:07.403080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] PATH_INFO: `/v3/projects/8061c66ed81143e08ed127fdf7ea11b0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:07.405558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8061c66ed81143e08ed127fdf7ea11b0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:07.407614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:07.578510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8061c66ed81143e08ed127fdf7ea11b0', 'request_id': 'req-4201db35-6fc7-4202-8467-5286dfeadd08'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:07.583492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8061c66ed81143e08ed127fdf7ea11b0', 'request_id': 'req-4201db35-6fc7-4202-8467-5286dfeadd08'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:07.636814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:07.670539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8061c66ed81143e08ed127fdf7ea11b0', 'request_id': 'req-4201db35-6fc7-4202-8467-5286dfeadd08'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:07.688928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] The token cache is being invalidate because project 8061c66ed81143e08ed127fdf7ea11b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:41:07.689659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:07.691649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4201db35-6fc7-4202-8467-5286dfeadd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:07.698945 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2164/4306] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:41:07 2022] DELETE /identity/v3/projects/8061c66ed81143e08ed127fdf7ea11b0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:07.700468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64660f1-0dbc-42ff-8250-7c387f487050 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:07.700761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64660f1-0dbc-42ff-8250-7c387f487050 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:07.701039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64660f1-0dbc-42ff-8250-7c387f487050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:07.742071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f64660f1-0dbc-42ff-8250-7c387f487050 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:07.746167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f64660f1-0dbc-42ff-8250-7c387f487050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:07.912750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d03c0-3fa7-435c-970a-cb25f61751bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:07.913298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d03c0-3fa7-435c-970a-cb25f61751bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:07.913298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d03c0-3fa7-435c-970a-cb25f61751bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:07.919541 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2143/4307] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:07.950217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9b6d03c0-3fa7-435c-970a-cb25f61751bc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:07.953701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b6d03c0-3fa7-435c-970a-cb25f61751bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:07.973324 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2165/4308] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:07.978006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64660f1-0dbc-42ff-8250-7c387f487050 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:07.995884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64660f1-0dbc-42ff-8250-7c387f487050 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:08.007694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:08.008334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.008613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.009147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.009871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:41:08.010245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:08.013730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:08.034915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d03c0-3fa7-435c-970a-cb25f61751bc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:08.046602 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2144/4309] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:41:08.049387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d03c0-3fa7-435c-970a-cb25f61751bc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:08.056883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:08.056883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.056883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.056883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.057704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:08.059848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:08.191148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:08.196998 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2166/4310] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:41:08 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:08.207170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a1b9-6c23-4288-98ee-f3f97c298653 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:08.326624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:08.327482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.327831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.328170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.329463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:08.333849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:08.384778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:08.417711 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2145/4311] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:41:08 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:08.421709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:08.433690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e2d37-0bc9-40ee-81dd-3a9073438f62 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:08.439925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:08.441129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.441615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.442047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.444165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:08.447258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:08.474105 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2167/4312] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:08.478229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:08.489302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56935f80-539b-4853-90fe-8619c6e64cf3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:08.498391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850986-f7f7-494f-9018-5a8ad237a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:08.498625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850986-f7f7-494f-9018-5a8ad237a303 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.501171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850986-f7f7-494f-9018-5a8ad237a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.501171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850986-f7f7-494f-9018-5a8ad237a303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.501171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850986-f7f7-494f-9018-5a8ad237a303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:08.502949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850986-f7f7-494f-9018-5a8ad237a303 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:08.518915 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2146/4313] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:08.522768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:08.535568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac2a30-d690-4fd0-afd5-4dce98407765 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:08.540910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:08.542080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.542559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.543070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] PATH_INFO: `/v3/projects/9c96c8b0fa8749f8aded94bcec51c4e1/users/8d1486fc35a843a1bf84cc14b98e0c89/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.565389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c96c8b0fa8749f8aded94bcec51c4e1, user_id=8d1486fc35a843a1bf84cc14b98e0c89, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:08.565389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:08.648728 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2168/4314] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:41:08 2022] PUT /identity/v3/projects/9c96c8b0fa8749f8aded94bcec51c4e1/users/8d1486fc35a843a1bf84cc14b98e0c89/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:41:08.660201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011f9e-b5e5-47a9-877f-2418c81c6f56 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.661058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011f9e-b5e5-47a9-877f-2418c81c6f56 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.661635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90011f9e-b5e5-47a9-877f-2418c81c6f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.694371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90011f9e-b5e5-47a9-877f-2418c81c6f56 None None] MFA Rules not processed for user `8d1486fc35a843a1bf84cc14b98e0c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:08.696131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90011f9e-b5e5-47a9-877f-2418c81c6f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:08.782372 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2147/4315] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:08.803710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:08.807529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:08.841863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:08.907716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dbecd-82fc-4575-9d78-b94b75efc2d7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:08.920329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:08.920329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:08.920329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:08.920329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:08.934354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:08.935888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:08.958923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2169/4316] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:09.364104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:09.592949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:10.699297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:11.036379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:11.641327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:11.806617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:13.482391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:13.986025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:15.623574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:15.967599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:16.280694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f807-6d9a-4754-8969-36fadb7bba72 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:16.281343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f807-6d9a-4754-8969-36fadb7bba72 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:16.281762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f807-6d9a-4754-8969-36fadb7bba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:16.375707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52c8f807-6d9a-4754-8969-36fadb7bba72 None None] MFA Rules not processed for user `6c07f47c7ef045aab1daa8cb6df9566b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:16.380144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52c8f807-6d9a-4754-8969-36fadb7bba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:16.544628 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2148/4317] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:17.190126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:17.191774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:17.263921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:17.416638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cfd8e-0420-427f-b4a2-445da38f9035 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:17.436059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:17.436702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:17.437152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:17.437384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:17.462320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:17.462320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:17.484777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2170/4318] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:17.601579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:18.493040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:19.315656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:19.979162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:20.423848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6480594-a1a3-4133-9add-fa855ff144ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:20.424069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6480594-a1a3-4133-9add-fa855ff144ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:20.424342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6480594-a1a3-4133-9add-fa855ff144ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:20.463512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6480594-a1a3-4133-9add-fa855ff144ee None None] MFA Rules not processed for user `41b888dbd64a4fc48ee745a7b38014c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:20.465316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6480594-a1a3-4133-9add-fa855ff144ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:20.607012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:20.609119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2149/4319] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:20.956799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:21.012003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:21.013549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:21.042338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef01b-25a1-4416-979d-75a13483a1ad service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:21.063023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcea40-6b02-4154-b0b8-1444911d2dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:21.063940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcea40-6b02-4154-b0b8-1444911d2dac service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:21.064226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcea40-6b02-4154-b0b8-1444911d2dac service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:21.064499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcea40-6b02-4154-b0b8-1444911d2dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:21.085551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcea40-6b02-4154-b0b8-1444911d2dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:21.094813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcea40-6b02-4154-b0b8-1444911d2dac service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:21.117748 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2171/4320] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:23.621379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6480594-a1a3-4133-9add-fa855ff144ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:23.635876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6480594-a1a3-4133-9add-fa855ff144ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:23.643595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55655b-6f0a-45fa-8050-4facc3a5a011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:23.644684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55655b-6f0a-45fa-8050-4facc3a5a011 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:23.645867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55655b-6f0a-45fa-8050-4facc3a5a011 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:23.646357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55655b-6f0a-45fa-8050-4facc3a5a011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:23.651702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a55655b-6f0a-45fa-8050-4facc3a5a011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:23.677623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55655b-6f0a-45fa-8050-4facc3a5a011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:23.679744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55655b-6f0a-45fa-8050-4facc3a5a011 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:23.690940 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2150/4321] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:24.418318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:24.419562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:24.420012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:24.444491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce3ab-8ad9-4e01-bc72-8e3cceabbec2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:24.444931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce3ab-8ad9-4e01-bc72-8e3cceabbec2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:24.445213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce3ab-8ad9-4e01-bc72-8e3cceabbec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:24.480319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:24.483361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:24.503986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-707ce3ab-8ad9-4e01-bc72-8e3cceabbec2 None None] MFA Rules not processed for user `6c07f47c7ef045aab1daa8cb6df9566b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:24.505234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-707ce3ab-8ad9-4e01-bc72-8e3cceabbec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:24.533788 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2151/4322] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:24.630674 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2172/4323] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:27.361760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dcdef-47fc-42df-aad0-982220c1c8a4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:27.362227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dcdef-47fc-42df-aad0-982220c1c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:27.362340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dcdef-47fc-42df-aad0-982220c1c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:27.398463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c54dcdef-47fc-42df-aad0-982220c1c8a4 None None] MFA Rules not processed for user `41b888dbd64a4fc48ee745a7b38014c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:27.399946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c54dcdef-47fc-42df-aad0-982220c1c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:27.416861 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2152/4324] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:34.604948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=72 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:37.387120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:40.426038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:40.427733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:40.570629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7ca2a-c8a5-435b-bdfc-c3e321e52d8a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:40.576419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7831e-8e11-4283-9d37-ef302076b055 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:40.577101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7831e-8e11-4283-9d37-ef302076b055 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:40.577480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7831e-8e11-4283-9d37-ef302076b055 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:40.577910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7831e-8e11-4283-9d37-ef302076b055 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:40.580182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ac7831e-8e11-4283-9d37-ef302076b055 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:40.611739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7831e-8e11-4283-9d37-ef302076b055 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:40.613528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7831e-8e11-4283-9d37-ef302076b055 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:40.643580 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2173/4325] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:42.149207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dcdef-47fc-42df-aad0-982220c1c8a4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:42.233195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dcdef-47fc-42df-aad0-982220c1c8a4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:42.241956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:42.242783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:42.243853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:42.244193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] PATH_INFO: `/v3/users/8d1486fc35a843a1bf84cc14b98e0c89` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:42.245862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1486fc35a843a1bf84cc14b98e0c89)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:42.247962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:42.483414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1486fc35a843a1bf84cc14b98e0c89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:42.484415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1486fc35a843a1bf84cc14b98e0c89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:42.572781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1486fc35a843a1bf84cc14b98e0c89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:42.573467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1486fc35a843a1bf84cc14b98e0c89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:42.601541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1486fc35a843a1bf84cc14b98e0c89'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:42.646746 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2153/4326] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:41:42 2022] DELETE /identity/v3/users/8d1486fc35a843a1bf84cc14b98e0c89 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:42.648400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:42.648818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:42.648954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:42.670110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:42.671330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:42.766671 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2174/4327] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:42.779972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:42.781471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:42.933916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d2e94-e62f-419b-ac86-0546424513dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:42.938150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42c3a3-2c77-483c-9856-64a6f853f2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:42.938773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42c3a3-2c77-483c-9856-64a6f853f2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:42.939222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42c3a3-2c77-483c-9856-64a6f853f2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:42.939970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42c3a3-2c77-483c-9856-64a6f853f2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:42.977824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42c3a3-2c77-483c-9856-64a6f853f2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:42.979446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42c3a3-2c77-483c-9856-64a6f853f2d0 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:42.992304 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2154/4328] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:43.515402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:43.517273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:43.543482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4b9c-7cbd-44ca-beed-88b5fa2f1eb0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:43.549851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:43.551596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:43.552040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:43.552636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] PATH_INFO: `/v3/projects/9c96c8b0fa8749f8aded94bcec51c4e1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:43.554005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c96c8b0fa8749f8aded94bcec51c4e1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:43.557206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:43.767214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c96c8b0fa8749f8aded94bcec51c4e1', 'request_id': 'req-1234ceff-aed0-4aff-8552-107a831792f8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:43.780506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c96c8b0fa8749f8aded94bcec51c4e1', 'request_id': 'req-1234ceff-aed0-4aff-8552-107a831792f8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:43.922829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c96c8b0fa8749f8aded94bcec51c4e1', 'request_id': 'req-1234ceff-aed0-4aff-8552-107a831792f8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:43.943950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] The token cache is being invalidate because project 9c96c8b0fa8749f8aded94bcec51c4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:41:43.944469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:43.945372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1234ceff-aed0-4aff-8552-107a831792f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:43.947910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2175/4329] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:41:43 2022] DELETE /identity/v3/projects/9c96c8b0fa8749f8aded94bcec51c4e1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:43.953386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab5e8-7f33-4688-8972-87fdb8552a4a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:43.953869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab5e8-7f33-4688-8972-87fdb8552a4a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:43.955753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab5e8-7f33-4688-8972-87fdb8552a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:43.970416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:43.988403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-574ab5e8-7f33-4688-8972-87fdb8552a4a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:43.990100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-574ab5e8-7f33-4688-8972-87fdb8552a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:44.067364 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2155/4330] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:44.069051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada721b-79b7-4356-91b0-0b35080b2085 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.069342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada721b-79b7-4356-91b0-0b35080b2085 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.069620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada721b-79b7-4356-91b0-0b35080b2085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.081070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:44.096030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9ada721b-79b7-4356-91b0-0b35080b2085 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:44.097664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ada721b-79b7-4356-91b0-0b35080b2085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:44.109615 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2176/4331] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:44.110902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab5e8-7f33-4688-8972-87fdb8552a4a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:44.123718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab5e8-7f33-4688-8972-87fdb8552a4a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:44.129882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:44.130544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.130825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.131099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.131756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:41:44.132056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:44.133739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:44.148458 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2156/4332] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:41:44.153054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada721b-79b7-4356-91b0-0b35080b2085 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:44.162725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada721b-79b7-4356-91b0-0b35080b2085 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:44.168112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:44.169196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.169196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.169381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.169924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:44.171891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:44.282777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2177/4333] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:41:44 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:44.290000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:44.297752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b668-859f-4628-880a-183a54d4bfc7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:44.411328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:44.411959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.412240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.412570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.413214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:44.416176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:44.513875 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2157/4334] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:41:44 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:44.517743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:44.531492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5927189-a63e-430f-8ffb-cd63e902d644 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:44.538373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:44.539557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.541229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.542335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.544359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:44.547566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:44.559814 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2178/4335] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:44.563796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:44.576570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefcd0-28ad-4a6b-a399-e58ab2e8ddda admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:44.581631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a831db-0066-4662-bb72-123122a43cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:44.583036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a831db-0066-4662-bb72-123122a43cee admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.583809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a831db-0066-4662-bb72-123122a43cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.584785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a831db-0066-4662-bb72-123122a43cee admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.586646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a831db-0066-4662-bb72-123122a43cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:44.588974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a831db-0066-4662-bb72-123122a43cee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:44.608343 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2158/4336] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:44.612470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:44.627413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84451-1d73-421f-8570-c9cbebe08ec5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:44.634207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:44.635364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.635887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.636367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] PATH_INFO: `/v3/projects/85a7cbc1d4c745cbbb429841e245e4be/users/7e8ff395542a474db5d442e2273e097c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.680105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a7cbc1d4c745cbbb429841e245e4be, user_id=7e8ff395542a474db5d442e2273e097c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:44.689449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:44.816726 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2179/4337] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:41:44 2022] PUT /identity/v3/projects/85a7cbc1d4c745cbbb429841e245e4be/users/7e8ff395542a474db5d442e2273e097c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:44.821564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb9a6e-3450-4697-bca1-e89c3abd584b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:44.821564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb9a6e-3450-4697-bca1-e89c3abd584b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:44.821842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb9a6e-3450-4697-bca1-e89c3abd584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:44.883295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e1eb9a6e-3450-4697-bca1-e89c3abd584b None None] MFA Rules not processed for user `7e8ff395542a474db5d442e2273e097c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:44.885880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e1eb9a6e-3450-4697-bca1-e89c3abd584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:45.084149 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2159/4338] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:45.130298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:45.132403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:45.266255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f9454-7a98-4c44-b561-7135659463cb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:45.272416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:45.273281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:45.273738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:45.274149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:45.291270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:45.292749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:45.310898 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2180/4339] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:41:45.540148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:45.790758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066e287-4d90-4da1-867e-99c81082d1cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:45.791272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066e287-4d90-4da1-867e-99c81082d1cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:45.791689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066e287-4d90-4da1-867e-99c81082d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:45.819356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4066e287-4d90-4da1-867e-99c81082d1cc None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:45.821427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4066e287-4d90-4da1-867e-99c81082d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:45.910158 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2160/4340] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:51.038724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:51.041864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:51.127567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05fad-a09e-44b7-a659-79dd907c2079 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:51.132328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:51.132993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:51.133276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:51.133553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] PATH_INFO: `/v3/users/11af7a4f65914752be86a83fa3408870` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:51.134844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11af7a4f65914752be86a83fa3408870)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:51.136961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:51.337282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:51.338999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11af7a4f65914752be86a83fa3408870'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:51.360271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11af7a4f65914752be86a83fa3408870'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:51.361302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11af7a4f65914752be86a83fa3408870'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:51.384381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11af7a4f65914752be86a83fa3408870'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:51.509341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cacc300f-94b7-4c5f-b3ea-09da7fc92b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11af7a4f65914752be86a83fa3408870'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:51.519015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2181/4341] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:41:51 2022] DELETE /identity/v3/users/11af7a4f65914752be86a83fa3408870 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:52.568946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066e287-4d90-4da1-867e-99c81082d1cc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:52.583900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066e287-4d90-4da1-867e-99c81082d1cc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:52.696002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:52.697660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:52.698287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:52.698807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] PATH_INFO: `/v3/projects/90c056fcd52f4a97b89c731d06027fc5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:52.700243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c056fcd52f4a97b89c731d06027fc5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:52.703900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:53.001711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c056fcd52f4a97b89c731d06027fc5', 'request_id': 'req-e3222a10-d6b0-4911-9419-ffaca8042bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:53.010409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c056fcd52f4a97b89c731d06027fc5', 'request_id': 'req-e3222a10-d6b0-4911-9419-ffaca8042bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:53.108993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c056fcd52f4a97b89c731d06027fc5', 'request_id': 'req-e3222a10-d6b0-4911-9419-ffaca8042bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:53.123752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] The token cache is being invalidate because project 90c056fcd52f4a97b89c731d06027fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:41:53.124380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:53.125333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3222a10-d6b0-4911-9419-ffaca8042bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:53.127589 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2161/4342] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:41:52 2022] DELETE /identity/v3/projects/90c056fcd52f4a97b89c731d06027fc5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:53.135262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20acf5-7a72-4d23-b87a-f1e58b81f8ea None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:53.136302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20acf5-7a72-4d23-b87a-f1e58b81f8ea None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:53.136792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20acf5-7a72-4d23-b87a-f1e58b81f8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:53.161507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c20acf5-7a72-4d23-b87a-f1e58b81f8ea None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:53.162799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c20acf5-7a72-4d23-b87a-f1e58b81f8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:53.308547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb63eb-4972-4fb5-9a94-5b773c347945 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:53.309051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb63eb-4972-4fb5-9a94-5b773c347945 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:53.309475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb63eb-4972-4fb5-9a94-5b773c347945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:53.309846 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2182/4343] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:53.337624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ecb63eb-4972-4fb5-9a94-5b773c347945 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:53.338180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ecb63eb-4972-4fb5-9a94-5b773c347945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:53.348801 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2162/4344] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:53.355709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20acf5-7a72-4d23-b87a-f1e58b81f8ea None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:53.391398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20acf5-7a72-4d23-b87a-f1e58b81f8ea None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:53.399916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:53.400557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:53.400841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:53.404418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:53.405147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:41:53.405463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:53.409873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:53.481226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb63eb-4972-4fb5-9a94-5b773c347945 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:53.481378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2183/4345] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:41:53.496691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb63eb-4972-4fb5-9a94-5b773c347945 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:53.510420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:53.511191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:53.511938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:53.512221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:53.517552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:53.520535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:53.652265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:53.683026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2163/4346] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:41:53 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:41:53.685710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:53.722758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819ef8-4dec-48db-bc89-634745836892 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:53.850552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:53.851947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:53.856687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:53.856687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:53.856687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:53.856687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:53.978739 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2184/4347] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:41:53 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:53.979343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:53.992542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266940f5-d02c-4162-838e-286e87eabcc8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:54.004176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:54.004884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:54.005171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:54.005452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:54.008562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:54.008562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:54.028089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2164/4348] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:41:54.030895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:54.050125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee24f4e-dc91-4d03-80c3-d2070bf92961 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:54.057352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91577a9-003a-4402-87b6-5c448db08a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:54.058348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91577a9-003a-4402-87b6-5c448db08a1d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:54.058807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91577a9-003a-4402-87b6-5c448db08a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:54.059267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91577a9-003a-4402-87b6-5c448db08a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:54.060558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91577a9-003a-4402-87b6-5c448db08a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:54.077994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91577a9-003a-4402-87b6-5c448db08a1d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:54.131425 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2185/4349] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:54.142271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:54.157287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba082a92-e839-42f4-a615-5ac2aa903f8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:54.173174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:54.173967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:54.174497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:54.174944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] PATH_INFO: `/v3/projects/d48ccdeda168408cafdfeb80be6e45fe/users/e278470f898b4da39ca176d5c505f051/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:54.222987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ed062-8e01-42fd-aaec-723f885aa961 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:54.223481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ed062-8e01-42fd-aaec-723f885aa961 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:54.223560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ed062-8e01-42fd-aaec-723f885aa961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:54.232744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48ccdeda168408cafdfeb80be6e45fe, user_id=e278470f898b4da39ca176d5c505f051, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:54.242976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:54.263898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-327ed062-8e01-42fd-aaec-723f885aa961 None None] MFA Rules not processed for user `f278334f3cd646a89ec99502f0bfe636`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:54.265146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-327ed062-8e01-42fd-aaec-723f885aa961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:54.300127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:54.342185 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2186/4350] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:54.364035 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2165/4351] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:41:54 2022] PUT /identity/v3/projects/d48ccdeda168408cafdfeb80be6e45fe/users/e278470f898b4da39ca176d5c505f051/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:54.383175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08527-2ef1-4856-a2bc-3d02b397f80d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:54.383691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08527-2ef1-4856-a2bc-3d02b397f80d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:54.386321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08527-2ef1-4856-a2bc-3d02b397f80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:54.455959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-85b08527-2ef1-4856-a2bc-3d02b397f80d None None] MFA Rules not processed for user `e278470f898b4da39ca176d5c505f051`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:54.461361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85b08527-2ef1-4856-a2bc-3d02b397f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:54.624729 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2187/4352] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:54.626301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:54.814318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632f460-f8bd-4a3b-b60b-528e0da8f24f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:54.848304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:54.848304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:54.848304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:54.848304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:54.849316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:54.850696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:55.019274 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2166/4353] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:41:54 2022] POST /identity/v3/projects => generated 381 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:55.020221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08527-2ef1-4856-a2bc-3d02b397f80d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:55.038452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08527-2ef1-4856-a2bc-3d02b397f80d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:55.213074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:55.213717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:55.213994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:55.214295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:55.214943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:55.216997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:55.328709 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2188/4354] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:41:55 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:55.335041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:55.350648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b1bc0-a88f-4aad-9a5f-70922c4ce815 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:55.363834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:55.364731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:55.365215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:55.365667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:55.366563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:55.373769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:55.403435 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2167/4355] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:55.412840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:55.429618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dec4f-07a6-44f0-bec6-8fec6b5ab0aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:55.445302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:55.474830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:55.478011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:55.478382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] PATH_INFO: `/v3/projects/683384046c8244c5be43c37bd3eab182/users/b4db698b4ef948c58b5f5d19c573783b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:55.533819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683384046c8244c5be43c37bd3eab182, user_id=b4db698b4ef948c58b5f5d19c573783b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:55.541940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:55.640063 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2189/4356] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:41:55 2022] PUT /identity/v3/projects/683384046c8244c5be43c37bd3eab182/users/b4db698b4ef948c58b5f5d19c573783b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:55.643635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:55.661748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88b81-ebd7-45f3-9d86-677bf2111a99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:55.801305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af423c48-16db-448f-a367-76da6430ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:55.802077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af423c48-16db-448f-a367-76da6430ea8d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:55.802424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af423c48-16db-448f-a367-76da6430ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:55.803024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af423c48-16db-448f-a367-76da6430ea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:55.803615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af423c48-16db-448f-a367-76da6430ea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:55.805302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af423c48-16db-448f-a367-76da6430ea8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:55.818757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2168/4357] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:41:55.823027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:55.848798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b41b3a-2ac6-461f-a5f9-952b25289285 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:55.855087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:55.856015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:55.857063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:55.857540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] PATH_INFO: `/v3/projects/683384046c8244c5be43c37bd3eab182/users/b4db698b4ef948c58b5f5d19c573783b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:55.860826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683384046c8244c5be43c37bd3eab182, user_id=b4db698b4ef948c58b5f5d19c573783b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:55.880341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:55.903634 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2190/4358] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:41:55 2022] PUT /identity/v3/projects/683384046c8244c5be43c37bd3eab182/users/b4db698b4ef948c58b5f5d19c573783b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:41:55.913776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331a359-a378-4539-9da3-172f7631cb26 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:55.914074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331a359-a378-4539-9da3-172f7631cb26 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:55.914514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331a359-a378-4539-9da3-172f7631cb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:56.000228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d331a359-a378-4539-9da3-172f7631cb26 None None] MFA Rules not processed for user `b4db698b4ef948c58b5f5d19c573783b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:56.001482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d331a359-a378-4539-9da3-172f7631cb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:56.097505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:56.180283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2169/4359] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:56.185760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:56.197890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e9cf9-1cd9-48d9-b463-e779d8d16a49 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:56.203263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:56.205189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:56.205508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:56.206384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:56.207146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:56.208969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invalid input for field 'name': '' is too short Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: On instance['name']: Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: On instance['name']: Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: '' Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise error Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application '' Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:56.229873 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:41:56.231179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application '' Oct 18 13:41:56.232000 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:56.240770 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2191/4360] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:41:56 2022] POST /identity/v3/domains => generated 283 bytes in 56 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 18 13:41:56.246329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331a359-a378-4539-9da3-172f7631cb26 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:56.262522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331a359-a378-4539-9da3-172f7631cb26 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:56.280263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:56.280916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:56.281202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:56.281482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:56.282186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:56.283825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: On instance['name']: Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: On instance['name']: Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.303530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 18 13:41:56.304530 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.305615 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2170/4361] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:41:56 2022] POST /identity/v3/domains => generated 412 bytes in 59 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:41:56.309668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:56.327576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e14b1-599e-4412-8d28-136bd02d74ef tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:56.343197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:56.344483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:56.344922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:56.345341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:56.346191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:56.348602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:56.425849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:56.429841 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2192/4362] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:41:56 2022] POST /identity/v3/domains => generated 276 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:56.432709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:56.448630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d02c-1393-4ba5-9507-2d7a2dd1caf5 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:56.577179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:56.578809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:56.579212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:56.579627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains/37dcad59371e405f84d8e591d08c3c5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:56.607562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=37dcad59371e405f84d8e591d08c3c5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:56.610378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 18 13:41:56.635399 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 18 13:41:56.636464 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:56.638431 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2171/4363] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:41:56 2022] DELETE /identity/v3/domains/37dcad59371e405f84d8e591d08c3c5d => generated 120 bytes in 206 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:41:56.642558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:56.656570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138f03f-3898-4691-ba12-703ee7f8b6b6 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:56.679937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:56.680531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:56.680867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:56.681149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains/37dcad59371e405f84d8e591d08c3c5d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:56.682469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=37dcad59371e405f84d8e591d08c3c5d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:56.684190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:56.738921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:56.739856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:56.901001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:56.901991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:56.904789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2193/4364] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:41:56 2022] PATCH /identity/v3/domains/37dcad59371e405f84d8e591d08c3c5d => generated 277 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:41:56.909026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:56.910863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:56.932179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ce9a6-daa2-4068-bac4-42ea238ce25d tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:57.015211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:57.015211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:57.015755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:57.015936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains/37dcad59371e405f84d8e591d08c3c5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:57.031078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=37dcad59371e405f84d8e591d08c3c5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:57.032698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:57.085315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.101984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.109778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:57.295469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d', 'request_id': 'req-951e2cc4-14ee-42be-a57a-1b7c54eee632'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.307428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d', 'request_id': 'req-951e2cc4-14ee-42be-a57a-1b7c54eee632'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.394510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d', 'request_id': 'req-951e2cc4-14ee-42be-a57a-1b7c54eee632'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.406404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] The token cache is being invalidate because project 37dcad59371e405f84d8e591d08c3c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:41:57.406702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.407384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.418355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d', 'request_id': 'req-951e2cc4-14ee-42be-a57a-1b7c54eee632'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.419057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d', 'request_id': 'req-951e2cc4-14ee-42be-a57a-1b7c54eee632'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.419684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '37dcad59371e405f84d8e591d08c3c5d', 'request_id': 'req-951e2cc4-14ee-42be-a57a-1b7c54eee632'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.434492 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2172/4365] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:41:56 2022] DELETE /identity/v3/domains/37dcad59371e405f84d8e591d08c3c5d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:57.436203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:57.449494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80be4-af2b-465f-88a9-083641a84b3f tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:57.547210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:57.548113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:57.548403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:57.548683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains/7bea4aa83967478398ae2a8227117e05` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:57.559045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Could not find domain: 7bea4aa83967478398ae2a8227117e05.: keystone.exception.DomainNotFound: Could not find domain: 7bea4aa83967478398ae2a8227117e05. Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7bea4aa83967478398ae2a8227117e05. Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:41:57.564381 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:41:57.565428 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:41:57.566879 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7bea4aa83967478398ae2a8227117e05. Oct 18 13:41:57.567834 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.567834 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2194/4366] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:41:57 2022] DELETE /identity/v3/domains/7bea4aa83967478398ae2a8227117e05 => generated 112 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:41:57.572727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:57.574297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:57.587282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e2cc4-14ee-42be-a57a-1b7c54eee632 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:57.592531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:57.593180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:57.593466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:57.593746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:57.594426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:57.596065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:57.676913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2173/4367] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:41:57 2022] POST /identity/v3/domains => generated 252 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:41:57.682323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:57.694106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221df4a-eea2-4dcd-aade-82fe1e387bd0 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:57.753557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:57.756156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:57.756156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:57.756156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:57.756156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:57.757754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:57.823211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.sql.core [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-788251369' for key 'project.ixu_project_name_domain_id'") Oct 18 13:41:57.823211 n-d-858383-13 devstack@keystone.service[82160]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:41:57.823211 n-d-858383-13 devstack@keystone.service[82160]: [parameters: {'id': '3805b131915543eb9b53fe1f8847fd6e', 'name': 'tempest-domain-dup-788251369', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 13:41:57.823211 n-d-858383-13 devstack@keystone.service[82160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-788251369.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-788251369. Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:41:57.832077 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-788251369' for key 'project.ixu_project_name_domain_id'") Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 13:41:57.836531 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application yield resource Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise self.value Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application session.commit() Oct 18 13:41:57.837770 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:41:57.838924 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 13:41:57.840079 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result.read() Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:41:57.841036 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-788251369' for key 'project.ixu_project_name_domain_id'") Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [parameters: {'id': '3805b131915543eb9b53fe1f8847fd6e', 'name': 'tempest-domain-dup-788251369', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.842091 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-788251369. Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:41:57.842975 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-788251369. Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:41:57.844287 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2195/4368] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:41:57 2022] POST /identity/v3/domains => generated 211 bytes in 152 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:41:57.846557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:57.857957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d2741-9873-4e45-9a20-528f9aae3683 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:57.863220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:57.864003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:57.864301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:57.864593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains/557daa3051e04c8b93c644d0359e489c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:57.877614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=557daa3051e04c8b93c644d0359e489c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:57.879683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:57.903188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '557daa3051e04c8b93c644d0359e489c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:57.905523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '557daa3051e04c8b93c644d0359e489c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.041110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '557daa3051e04c8b93c644d0359e489c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.041872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '557daa3051e04c8b93c644d0359e489c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.047747 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2174/4369] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:41:57 2022] PATCH /identity/v3/domains/557daa3051e04c8b93c644d0359e489c => generated 253 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:41:58.049616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:58.051513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:58.071613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152e0c-acd6-422f-b900-b4335f1f5ba8 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:58.157529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:58.168893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:58.169625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:58.170239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:58.170599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains/557daa3051e04c8b93c644d0359e489c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:58.184843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=557daa3051e04c8b93c644d0359e489c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:58.187511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:58.220246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '557daa3051e04c8b93c644d0359e489c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.235450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '557daa3051e04c8b93c644d0359e489c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.391575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557daa3051e04c8b93c644d0359e489c', 'request_id': 'req-ed4bd670-000f-4823-9eaa-f8de26fe76cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.402633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557daa3051e04c8b93c644d0359e489c', 'request_id': 'req-ed4bd670-000f-4823-9eaa-f8de26fe76cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.474895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557daa3051e04c8b93c644d0359e489c', 'request_id': 'req-ed4bd670-000f-4823-9eaa-f8de26fe76cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.489667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] The token cache is being invalidate because project 557daa3051e04c8b93c644d0359e489c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:41:58.489965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.490850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.510094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '557daa3051e04c8b93c644d0359e489c', 'request_id': 'req-ed4bd670-000f-4823-9eaa-f8de26fe76cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.511733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '557daa3051e04c8b93c644d0359e489c', 'request_id': 'req-ed4bd670-000f-4823-9eaa-f8de26fe76cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.516842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '557daa3051e04c8b93c644d0359e489c', 'request_id': 'req-ed4bd670-000f-4823-9eaa-f8de26fe76cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.524929 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2196/4370] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:41:58 2022] DELETE /identity/v3/domains/557daa3051e04c8b93c644d0359e489c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:41:58.535251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:58.548392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544065-c783-4e10-b1ef-aa3a2d9c56fe tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:58.635289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602fef9-d9f2-4ca5-a4bb-9b52fb636090 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4db698b4ef948c58b5f5d19c573783b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '683384046c8244c5be43c37bd3eab182', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:58.635942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602fef9-d9f2-4ca5-a4bb-9b52fb636090 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:58.636228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602fef9-d9f2-4ca5-a4bb-9b52fb636090 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:58.636507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602fef9-d9f2-4ca5-a4bb-9b52fb636090 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] PATH_INFO: `/v3/domains/37dcad59371e405f84d8e591d08c3c5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:58.646302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602fef9-d9f2-4ca5-a4bb-9b52fb636090 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2602fef9-d9f2-4ca5-a4bb-9b52fb636090 tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Could not find domain: 37dcad59371e405f84d8e591d08c3c5d.: keystone.exception.DomainNotFound: Could not find domain: 37dcad59371e405f84d8e591d08c3c5d. Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 37dcad59371e405f84d8e591d08c3c5d. Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:41:58.651745 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:41:58.652820 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:41:58.654012 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 37dcad59371e405f84d8e591d08c3c5d. Oct 18 13:41:58.655238 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:41:58.655238 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2175/4371] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:41:58 2022] PATCH /identity/v3/domains/37dcad59371e405f84d8e591d08c3c5d => generated 112 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:41:58.657250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:58.658731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:58.736251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bd670-000f-4823-9eaa-f8de26fe76cd tempest-DomainsNegativeTestJSON-927070556 tempest-DomainsNegativeTestJSON-927070556-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:58.744190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:58.744841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:58.745316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:58.754532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] PATH_INFO: `/v3/users/e278470f898b4da39ca176d5c505f051` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:58.754532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e278470f898b4da39ca176d5c505f051)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:58.754532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:58.928531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e278470f898b4da39ca176d5c505f051'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.936730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e278470f898b4da39ca176d5c505f051'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.937425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e278470f898b4da39ca176d5c505f051'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:58.970732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e278470f898b4da39ca176d5c505f051'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:59.077215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e278470f898b4da39ca176d5c505f051'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:41:59.087431 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2197/4372] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:41:58 2022] DELETE /identity/v3/users/e278470f898b4da39ca176d5c505f051 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:41:59.094041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:59.094583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:59.095450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:59.143168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:41:59.144521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:59.163502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:59.274666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2176/4373] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:41:59.294515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:41:59.296663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:41:59.382839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0bc3-63bd-4347-bb45-66b173a9b65c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:41:59.388052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:41:59.388763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:41:59.389073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:41:59.389349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:41:59.404721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:41:59.414966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:41:59.433558 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2198/4374] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:00.279843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:01.180914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:01.182537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:01.199322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d82033-c7d9-4433-93e0-f32ab2a2efbb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:01.207403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:01.208349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:01.208782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:01.209230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] PATH_INFO: `/v3/projects/d48ccdeda168408cafdfeb80be6e45fe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:01.210700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48ccdeda168408cafdfeb80be6e45fe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:01.214661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:01.350686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48ccdeda168408cafdfeb80be6e45fe', 'request_id': 'req-f99ccce6-73e9-464e-b4ab-97a570146211'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.365267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48ccdeda168408cafdfeb80be6e45fe', 'request_id': 'req-f99ccce6-73e9-464e-b4ab-97a570146211'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.531475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48ccdeda168408cafdfeb80be6e45fe', 'request_id': 'req-f99ccce6-73e9-464e-b4ab-97a570146211'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.544158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] The token cache is being invalidate because project d48ccdeda168408cafdfeb80be6e45fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:01.544679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.545524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.547178 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2177/4375] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:01 2022] DELETE /identity/v3/projects/d48ccdeda168408cafdfeb80be6e45fe => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:01.551377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:01.562353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1de0-5138-478e-9ed2-f0009e719e0e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:01.629597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:01.630310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:01.630600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:01.630875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] PATH_INFO: `/v3/users/b4db698b4ef948c58b5f5d19c573783b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:01.632033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4db698b4ef948c58b5f5d19c573783b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:01.634347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:01.888197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4db698b4ef948c58b5f5d19c573783b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.902911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4db698b4ef948c58b5f5d19c573783b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.903843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4db698b4ef948c58b5f5d19c573783b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.918645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4db698b4ef948c58b5f5d19c573783b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:01.978495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:01.995230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-63868758-7aab-4368-86bc-aeab31fa9fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4db698b4ef948c58b5f5d19c573783b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:02.015194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2199/4376] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:01 2022] DELETE /identity/v3/users/b4db698b4ef948c58b5f5d19c573783b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:03.218661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:03.221773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:03.247235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ccce6-73e9-464e-b4ab-97a570146211 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:03.376049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:03.377584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:03.378092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:03.378724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] PATH_INFO: `/v3/projects/683384046c8244c5be43c37bd3eab182` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:03.380916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=683384046c8244c5be43c37bd3eab182)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:03.384453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:03.563277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:03.573890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683384046c8244c5be43c37bd3eab182', 'request_id': 'req-caf53746-7c12-4a22-bcbc-e34bf3adb139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:03.588567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683384046c8244c5be43c37bd3eab182', 'request_id': 'req-caf53746-7c12-4a22-bcbc-e34bf3adb139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:03.686354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683384046c8244c5be43c37bd3eab182', 'request_id': 'req-caf53746-7c12-4a22-bcbc-e34bf3adb139'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:03.702155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] The token cache is being invalidate because project 683384046c8244c5be43c37bd3eab182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:03.703466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:03.704315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-caf53746-7c12-4a22-bcbc-e34bf3adb139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:03.706621 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2178/4377] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:03 2022] DELETE /identity/v3/projects/683384046c8244c5be43c37bd3eab182 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:03.717319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad568e-d290-48e8-88be-c00cd05906c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:03.719405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad568e-d290-48e8-88be-c00cd05906c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:03.719834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad568e-d290-48e8-88be-c00cd05906c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:03.838218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c7ad568e-d290-48e8-88be-c00cd05906c9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:03.840083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7ad568e-d290-48e8-88be-c00cd05906c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:04.004567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2200/4378] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:04.011175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.011513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.012069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.032667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:04.033825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:04.042782 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2179/4379] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:04.047045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad568e-d290-48e8-88be-c00cd05906c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.061938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad568e-d290-48e8-88be-c00cd05906c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:04.082264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:04.082264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.082264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.082539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.082983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:04.083293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:04.091940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:04.092024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.098386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:04.116269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136e76-4dfe-4cc9-b29c-39b49412636f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:04.137242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:04.137903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.139985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.140293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] PATH_INFO: `/v3/users/7e8ff395542a474db5d442e2273e097c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.140939 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2201/4380] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:04.141854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.145222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8ff395542a474db5d442e2273e097c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:04.157822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:04.177642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5eba2-f063-4482-ba3d-4643242cfe6c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:04.191012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:04.191952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.195950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.195950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.195950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:04.198532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:04.351231 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2202/4381] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:04 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:04.354962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.462765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537c98-3969-4c18-b908-6a860df03cb4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:04.472989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:04.474034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.474542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.475031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.475915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:04.480194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:04.497559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8ff395542a474db5d442e2273e097c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:04.500668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8ff395542a474db5d442e2273e097c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:04.579214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8ff395542a474db5d442e2273e097c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:04.581151 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2203/4382] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:04 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:04.581557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8ff395542a474db5d442e2273e097c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:04.585888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.588234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:04.593473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4190cbe6-9aea-4030-b6eb-b9080c6dd13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8ff395542a474db5d442e2273e097c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:04.601725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de241c-0822-466a-814e-41e73642de44 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:04.607201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:04.608571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.608571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.608571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.609030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:04.610758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:04.629952 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2204/4383] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:42:04.644771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.656763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076498-94b0-4b06-8779-6997dd670d7e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:04.672966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:04.673261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.673631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.673916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.674615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:04.676487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:04.681104 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2180/4384] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:04 2022] DELETE /identity/v3/users/7e8ff395542a474db5d442e2273e097c => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:04.686129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.686609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.687054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.706542 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2205/4385] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:04.707566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.715550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:04.723385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3066a-d584-4d01-aa99-51deee18e15a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:04.744401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:04.745565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:04.843025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0749d7-568d-4904-8ca2-900a67f7ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:04.843722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0749d7-568d-4904-8ca2-900a67f7ddbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.844008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0749d7-568d-4904-8ca2-900a67f7ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.844286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0749d7-568d-4904-8ca2-900a67f7ddbf admin admin] PATH_INFO: `/v3/projects/0d586690e62645e6b2d12b94b71bdccf/users/588acdee9f204d5aa1fe64b8a63a0636/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:04.851680 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2181/4386] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:04.868346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0749d7-568d-4904-8ca2-900a67f7ddbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d586690e62645e6b2d12b94b71bdccf, user_id=588acdee9f204d5aa1fe64b8a63a0636, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:04.868609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0749d7-568d-4904-8ca2-900a67f7ddbf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:04.879563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:04.882218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:04.952353 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2206/4387] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:04 2022] PUT /identity/v3/projects/0d586690e62645e6b2d12b94b71bdccf/users/588acdee9f204d5aa1fe64b8a63a0636/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:04.964019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a2535-875f-45a8-8836-e1374588ddcf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:04.965910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a2535-875f-45a8-8836-e1374588ddcf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:04.975308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a2535-875f-45a8-8836-e1374588ddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:05.037171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-165a2535-875f-45a8-8836-e1374588ddcf None None] MFA Rules not processed for user `588acdee9f204d5aa1fe64b8a63a0636`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:05.038920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-165a2535-875f-45a8-8836-e1374588ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:05.052097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67aa0-9495-491f-a6d9-238586dea35e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:05.154308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:05.158105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:05.158105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:05.158468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:05.175463 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2207/4388] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:05.179395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a2535-875f-45a8-8836-e1374588ddcf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:05.300006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:05.301363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a2535-875f-45a8-8836-e1374588ddcf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:05.303453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:05.312361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:05.313159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:05.314101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:05.314101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:05.314814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:05.318985 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2182/4389] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:05.321870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:05.434483 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2208/4390] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:05 2022] POST /identity/v3/projects => generated 387 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:05.439107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:05.454874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8bcf2-00b9-429c-9c16-c4b8a069be2c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:05.529953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:05.541340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:05.541859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:05.542941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:05.543835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:05.548848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:05.668631 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2183/4391] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:05 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:05.669625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:05.671351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:05.688013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63d35b-ca4b-4943-bd8c-3979575a6b9c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:05.702105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:05.702755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:05.703044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:05.703321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:05.703983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:05.705614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:05.716739 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2209/4392] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:05.721298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:05.732246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230a908-48a8-43f5-8d96-c493d47c412c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:05.739480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:05.739480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:05.739480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:05.739480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] PATH_INFO: `/v3/projects/2513b49b081049d59c4796f262e907df/users/aab38b97975c4acd8efc0e9ce3fc8e43/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:05.755598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2513b49b081049d59c4796f262e907df, user_id=aab38b97975c4acd8efc0e9ce3fc8e43, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:05.758545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:05.823183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:05.826226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:05.843520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0996199-dcd4-4817-abe8-c14a89bd5f62 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:05.856227 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2184/4393] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:05 2022] PUT /identity/v3/projects/2513b49b081049d59c4796f262e907df/users/aab38b97975c4acd8efc0e9ce3fc8e43/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:05.858024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:05.971189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:05.971971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:05.972402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:05.972860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] PATH_INFO: `/v3/projects/85a7cbc1d4c745cbbb429841e245e4be` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:05.985840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a7cbc1d4c745cbbb429841e245e4be)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:05.991765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:06.054873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7033b62-e3e0-43a8-8c1b-a1296c059961 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:06.063592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:06.065374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.065818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.066260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.067353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:06.070875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:06.090041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2185/4394] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:06.093676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:06.108733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be164e-0430-43f1-ae96-aee98e2624ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:06.115485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f23c7-4311-4ef6-9025-7e14d4ab881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:06.116175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f23c7-4311-4ef6-9025-7e14d4ab881a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.116452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f23c7-4311-4ef6-9025-7e14d4ab881a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.116775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f23c7-4311-4ef6-9025-7e14d4ab881a admin admin] PATH_INFO: `/v3/projects/2513b49b081049d59c4796f262e907df/users/aab38b97975c4acd8efc0e9ce3fc8e43/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.121152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f23c7-4311-4ef6-9025-7e14d4ab881a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2513b49b081049d59c4796f262e907df, user_id=aab38b97975c4acd8efc0e9ce3fc8e43, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:06.125323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f23c7-4311-4ef6-9025-7e14d4ab881a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:06.139940 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2186/4395] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:06 2022] PUT /identity/v3/projects/2513b49b081049d59c4796f262e907df/users/aab38b97975c4acd8efc0e9ce3fc8e43/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:06.151471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.151744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.152041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.184886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] MFA Rules not processed for user `aab38b97975c4acd8efc0e9ce3fc8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:06.186107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:06.201131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a7cbc1d4c745cbbb429841e245e4be', 'request_id': 'req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.210240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a7cbc1d4c745cbbb429841e245e4be', 'request_id': 'req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.286585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a7cbc1d4c745cbbb429841e245e4be', 'request_id': 'req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.301743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] The token cache is being invalidate because project 85a7cbc1d4c745cbbb429841e245e4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:06.302044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.302758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd10ee8e-0eda-4565-9d30-ce904a32ce8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.304739 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2210/4396] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:05 2022] DELETE /identity/v3/projects/85a7cbc1d4c745cbbb429841e245e4be => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:06.310424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200a09-e199-401e-8d21-b24586dd07e8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.316158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200a09-e199-401e-8d21-b24586dd07e8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.316676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200a09-e199-401e-8d21-b24586dd07e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.361944 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2187/4397] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:06.363263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:06.366343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:06.369793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a0200a09-e199-401e-8d21-b24586dd07e8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:06.374480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0200a09-e199-401e-8d21-b24586dd07e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:06.448241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:06.523214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2211/4398] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:06.523636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f288-8ede-4722-a8bb-703013aa27b4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:06.532476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200a09-e199-401e-8d21-b24586dd07e8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:06.537603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:06.538316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.538603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.538882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] PATH_INFO: `/v3/users/6c07f47c7ef045aab1daa8cb6df9566b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.545018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200a09-e199-401e-8d21-b24586dd07e8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:06.545338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c07f47c7ef045aab1daa8cb6df9566b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:06.547475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:06.550770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbde56-0757-4c4e-b335-a675d6467e4e tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:06.552123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbde56-0757-4c4e-b335-a675d6467e4e tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.552123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbde56-0757-4c4e-b335-a675d6467e4e tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.552123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbde56-0757-4c4e-b335-a675d6467e4e tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects/0d586690e62645e6b2d12b94b71bdccf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.554110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbde56-0757-4c4e-b335-a675d6467e4e tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d586690e62645e6b2d12b94b71bdccf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:06.557145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbde56-0757-4c4e-b335-a675d6467e4e tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:06.563068 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2212/4399] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:42:06 2022] GET /identity/v3/projects/0d586690e62645e6b2d12b94b71bdccf => generated 387 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:06.564734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a6b6-571b-4aa4-8ae0-e38b890c3ee5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.565152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a6b6-571b-4aa4-8ae0-e38b890c3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.565523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a6b6-571b-4aa4-8ae0-e38b890c3ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.599176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2355a6b6-571b-4aa4-8ae0-e38b890c3ee5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:06.600431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2355a6b6-571b-4aa4-8ae0-e38b890c3ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:06.611076 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2213/4400] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:06.611736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a6b6-571b-4aa4-8ae0-e38b890c3ee5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:06.630953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a6b6-571b-4aa4-8ae0-e38b890c3ee5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:06.636855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:06.637485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.637771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.638049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.638755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:06.640854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:06.749691 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2214/4401] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:42:06 2022] POST /identity/v3/projects => generated 338 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:06.749691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:06.780445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c07f47c7ef045aab1daa8cb6df9566b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.781330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c07f47c7ef045aab1daa8cb6df9566b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.829724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3eec9-2eed-40fe-a5ac-2bf880a53f7c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:06.835214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:06.835840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:06.836122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:06.836389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:06.837537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:06.837912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:06.839945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:06.854098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2215/4402] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:06.858909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:06.860932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:06.869043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c07f47c7ef045aab1daa8cb6df9566b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.872669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c07f47c7ef045aab1daa8cb6df9566b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.881944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c07f47c7ef045aab1daa8cb6df9566b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:06.920006 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2188/4403] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:06 2022] DELETE /identity/v3/users/6c07f47c7ef045aab1daa8cb6df9566b => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:06.920857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:06.922269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:07.018921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55a67-3eec-477e-90e4-b0395bd68c5f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.023666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e9da-bfde-47e7-821f-1ecbf5a109d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.035655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.037491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.037935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.038412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.039217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.042579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.109896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.111746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.112133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.113337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.114140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.117235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.146146 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2216/4404] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:42:06 2022] GET /identity/v3/projects => generated 5787 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:07.150812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.164633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d5950-7d77-4e61-b136-ce29bdf45479 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.170939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.171178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.171615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.172000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects/0d586690e62645e6b2d12b94b71bdccf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.173536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d586690e62645e6b2d12b94b71bdccf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.184627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.186840 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2217/4405] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/projects/0d586690e62645e6b2d12b94b71bdccf => generated 387 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:07.190896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.197498 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2189/4406] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:06 2022] POST /identity/v3/projects => generated 365 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:07.202498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.211301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e049-475b-48eb-9520-cce1fd137855 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.315287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.317252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.317749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.318243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects/b9d054b776124344bdffd9079755aa8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.319945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9d054b776124344bdffd9079755aa8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.325238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.327222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f6573-9eef-4483-a9ce-b5bdaef7e2f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.328982 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2218/4407] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/projects/b9d054b776124344bdffd9079755aa8e => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:42:07.333657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.338442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.339252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.339982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.340261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.340900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.342897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.346012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92551ec9-4ce9-4902-ae4c-3911ee8c7984 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.352917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.353233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.353521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.353799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.354533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.366085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.406732 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2219/4408] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/projects => generated 6140 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:07.407770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.421539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e0526-21ea-43a0-8c24-9d553cd08cca tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.427068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.427745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.428112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.428632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.429678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:07.430271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.435143 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2190/4409] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:07 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:07.438671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.442561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.475354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62576619-68f2-448d-bddf-d2f96f3b7c0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.487857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.488765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.489248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.489702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.492748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.493407 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2220/4410] 10.222.0.27 () {58 vars in 1166 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/projects?domain_id=default => generated 5809 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:07.499577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.501578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.503781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:07.517768 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2191/4411] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:42:07.519664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.532914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a239f1c-24c2-4921-9c9a-887ff5e7e9f9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.541052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.541706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.542046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.542452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.543182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.545120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.576472 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2192/4412] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/projects => generated 6140 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:07.592596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.630764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0419d-4b12-47a0-97e4-a947113aa2af tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.652369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84808ac2-ce2c-4d40-ad3d-d5d741b4c84c tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.653297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:07.671683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.672676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.674225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.674729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.675622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.681104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:07.682226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.682655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.682959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.683233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.683942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.688423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:07.707536 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2193/4413] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:07.708597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.711737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:07.713493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.716282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.744031 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2221/4414] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:07.745373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.757649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c06b0-d530-493f-96cc-68ef02e8641f service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.763490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.766314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.766314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.766314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.767351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:07.767761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.770005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.780034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6ad3d-4b58-4a84-8d3f-9c07f06217c0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.793348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.794547 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2222/4415] 10.222.0.27 () {58 vars in 1166 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/projects?domain_id=default => generated 5809 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:07.795649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.806290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.806836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.807449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] PATH_INFO: `/v3/projects/634f588c94434a2d95b1da508cb56f85` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.809279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] RBAC: Authorizing `identity:delete_project(project_id=634f588c94434a2d95b1da508cb56f85)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.819453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.826753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd520-b411-489a-8ad0-1c5581dfc583 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:07.834086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:07.835864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:07.836260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:07.837316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] PATH_INFO: `/v3/projects/c022fb260b9b4cdeaade9e450b14c7aa/users/4515d177f6984dd1883466691c1d403b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:07.865992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c022fb260b9b4cdeaade9e450b14c7aa, user_id=4515d177f6984dd1883466691c1d403b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:07.875438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:07.977957 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2223/4416] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:07 2022] PUT /identity/v3/projects/c022fb260b9b4cdeaade9e450b14c7aa/users/4515d177f6984dd1883466691c1d403b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:07.977957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:07.984458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634f588c94434a2d95b1da508cb56f85', 'request_id': 'req-34564a48-2084-4f11-a3f6-acd779d2916b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.001240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634f588c94434a2d95b1da508cb56f85', 'request_id': 'req-34564a48-2084-4f11-a3f6-acd779d2916b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.074368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634f588c94434a2d95b1da508cb56f85', 'request_id': 'req-34564a48-2084-4f11-a3f6-acd779d2916b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.089201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] The token cache is being invalidate because project 634f588c94434a2d95b1da508cb56f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:08.090043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.090946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-34564a48-2084-4f11-a3f6-acd779d2916b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.093088 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2194/4417] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:07 2022] DELETE /identity/v3/projects/634f588c94434a2d95b1da508cb56f85 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:08.094888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a92518-0e64-404b-839b-498be4a4710c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.095395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a92518-0e64-404b-839b-498be4a4710c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.095795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a92518-0e64-404b-839b-498be4a4710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.106095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3983-a375-4e09-a208-6a2d2655259f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.156164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-82a92518-0e64-404b-839b-498be4a4710c None None] MFA Rules not processed for user `4515d177f6984dd1883466691c1d403b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:08.161607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82a92518-0e64-404b-839b-498be4a4710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.182022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b258-1533-463d-b563-345e7179f100 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:08.182678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b258-1533-463d-b563-345e7179f100 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.183017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b258-1533-463d-b563-345e7179f100 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.183290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b258-1533-463d-b563-345e7179f100 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.184843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b258-1533-463d-b563-345e7179f100 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:08.187213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b258-1533-463d-b563-345e7179f100 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:08.215788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2224/4418] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:42:07 2022] GET /identity/v3/projects => generated 5779 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:08.219850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98eee39-f490-4bd4-a0c1-fc51b95beb13 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.220157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98eee39-f490-4bd4-a0c1-fc51b95beb13 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.220433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98eee39-f490-4bd4-a0c1-fc51b95beb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.271315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d98eee39-f490-4bd4-a0c1-fc51b95beb13 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:08.273136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d98eee39-f490-4bd4-a0c1-fc51b95beb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.274002 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2195/4419] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:08.275462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a92518-0e64-404b-839b-498be4a4710c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:08.277019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82a92518-0e64-404b-839b-498be4a4710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.306294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a92518-0e64-404b-839b-498be4a4710c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.313153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:08.313922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.314327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.314676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.315506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-730439499) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:08.315878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:08.318334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:08.360907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2196/4420] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:42:08 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-730439499 => generated 534 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:08.362216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:08.367654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.406536 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2225/4421] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:08.409295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98eee39-f490-4bd4-a0c1-fc51b95beb13 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:08.432275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98eee39-f490-4bd4-a0c1-fc51b95beb13 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.446612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab38b97975c4acd8efc0e9ce3fc8e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2513b49b081049d59c4796f262e907df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:08.447278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.447561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.449305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] PATH_INFO: `/v3/projects/b9d054b776124344bdffd9079755aa8e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.450739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9d054b776124344bdffd9079755aa8e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:08.462123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:08.504730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089769c0-7463-4d3e-8608-91d973af4982 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.513699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af1e12-4e2f-4240-b85e-291c0011462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:08.514285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af1e12-4e2f-4240-b85e-291c0011462a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.514562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af1e12-4e2f-4240-b85e-291c0011462a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.514832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af1e12-4e2f-4240-b85e-291c0011462a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.515478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af1e12-4e2f-4240-b85e-291c0011462a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:08.517437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af1e12-4e2f-4240-b85e-291c0011462a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:08.631566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d054b776124344bdffd9079755aa8e', 'request_id': 'req-cae6c793-abfd-4d7e-87bf-6fe6b9642926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.644116 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2197/4422] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:08 2022] POST /identity/v3/projects => generated 363 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:08.646254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e3173-0e64-47b4-be53-8a62f779a841 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.647019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e3173-0e64-47b4-be53-8a62f779a841 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.647440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e3173-0e64-47b4-be53-8a62f779a841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.655843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d054b776124344bdffd9079755aa8e', 'request_id': 'req-cae6c793-abfd-4d7e-87bf-6fe6b9642926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.682208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e6e3173-0e64-47b4-be53-8a62f779a841 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:08.683950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e6e3173-0e64-47b4-be53-8a62f779a841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.779778 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2198/4423] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:08.780708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e3173-0e64-47b4-be53-8a62f779a841 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:08.783548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d054b776124344bdffd9079755aa8e', 'request_id': 'req-cae6c793-abfd-4d7e-87bf-6fe6b9642926'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.799173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] The token cache is being invalidate because project b9d054b776124344bdffd9079755aa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:08.799475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.800309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:08.806361 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2226/4424] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:08 2022] DELETE /identity/v3/projects/b9d054b776124344bdffd9079755aa8e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:08.807712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:08.810727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.814305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e3173-0e64-47b4-be53-8a62f779a841 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.824388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:08.824388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.824388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.824388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.824704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:08.824704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:08.871673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:08.898813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6c793-abfd-4d7e-87bf-6fe6b9642926 tempest-ListProjectsStaticTestJSON-468511244 tempest-ListProjectsStaticTestJSON-468511244-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.909479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:08.910148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.910604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.910881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.911546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:08.911856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:08.913706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:08.941259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2199/4425] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:08 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:08.941259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:08.944875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.954320 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2227/4426] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:08.956693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:08.964329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:08.978540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a66ef-6f04-486a-8123-42288c9308bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.990341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:08.994332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:08.994567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:08.995625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2920d-f23b-4f32-9584-363ac2ae9cbe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:08.996205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] PATH_INFO: `/v3/users/588acdee9f204d5aa1fe64b8a63a0636` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:08.997786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588acdee9f204d5aa1fe64b8a63a0636)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.002556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.007073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:09.008054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.008339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.009663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.010436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.013272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.041051 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2228/4427] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:09.043672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:09.063753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5211-4e1d-4208-acfb-c5d300d9170e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:09.073175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:09.073856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.074249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.074702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.075685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.082885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.179693 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2229/4428] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:09 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:09.183769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:09.234861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588acdee9f204d5aa1fe64b8a63a0636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:09.251362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588acdee9f204d5aa1fe64b8a63a0636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:09.325959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588acdee9f204d5aa1fe64b8a63a0636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:09.326640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588acdee9f204d5aa1fe64b8a63a0636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:09.337223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f5bb-9531-4afa-b881-79d39feb5d43 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:09.340851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588acdee9f204d5aa1fe64b8a63a0636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:09.342925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfab93-8e03-427f-b966-5f5f99975207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:09.343638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfab93-8e03-427f-b966-5f5f99975207 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.343929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfab93-8e03-427f-b966-5f5f99975207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.344211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfab93-8e03-427f-b966-5f5f99975207 admin admin] PATH_INFO: `/v3/projects/833cfeefac044cf09ac47196e01371f4/users/cd677a2ede7a4d4b8f6d08b62db1f24e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.367235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfab93-8e03-427f-b966-5f5f99975207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833cfeefac044cf09ac47196e01371f4, user_id=cd677a2ede7a4d4b8f6d08b62db1f24e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.372432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfab93-8e03-427f-b966-5f5f99975207 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.378140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:09.399806 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2200/4429] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:08 2022] DELETE /identity/v3/users/588acdee9f204d5aa1fe64b8a63a0636 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:09.400683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:09.408649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:09.475037 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2230/4430] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:09 2022] PUT /identity/v3/projects/833cfeefac044cf09ac47196e01371f4/users/cd677a2ede7a4d4b8f6d08b62db1f24e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:09.476029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.476339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.476601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.515929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:09.518033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:09.576100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c2cf-127f-4e6a-ae27-95ed82045af5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:09.679810 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2231/4431] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:09.681080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:09.685275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:09.705453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:09.706236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.706668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.707190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.708411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.710169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c61f-e800-4ce5-9ee6-300cebbea56e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:09.712384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.728957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:09.728957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.728957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.728957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.729381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.729381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.760728 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2232/4432] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:09.763215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:09.771837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:09.866139 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2201/4433] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:09 2022] POST /identity/v3/users => generated 281 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:09.866139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:09.885541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff69f0-d712-4387-9f4d-cd7c52f4cd0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:09.907177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cfcde-e1f4-4e7c-9a14-9e1094c8c87d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:09.915792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:09.915792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.916219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.916531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] PATH_INFO: `/v3/projects/833cfeefac044cf09ac47196e01371f4/users/cd677a2ede7a4d4b8f6d08b62db1f24e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.921965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f8faa-9c1f-4192-b1f4-a9da4eb37642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:09.922169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833cfeefac044cf09ac47196e01371f4, user_id=cd677a2ede7a4d4b8f6d08b62db1f24e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.926330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8faa-9c1f-4192-b1f4-a9da4eb37642 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.926744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8faa-9c1f-4192-b1f4-a9da4eb37642 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.927520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8faa-9c1f-4192-b1f4-a9da4eb37642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:09.932262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.958502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f8faa-9c1f-4192-b1f4-a9da4eb37642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:09.961374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f8faa-9c1f-4192-b1f4-a9da4eb37642 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:09.963410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2202/4434] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:09 2022] PUT /identity/v3/projects/833cfeefac044cf09ac47196e01371f4/users/cd677a2ede7a4d4b8f6d08b62db1f24e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:09.964344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:09.977082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2233/4435] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:09.979985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95958f-db6c-40d2-b603-b5f0dff74323 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:09.979985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95958f-db6c-40d2-b603-b5f0dff74323 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:09.979985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95958f-db6c-40d2-b603-b5f0dff74323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:10.029769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ea95958f-db6c-40d2-b603-b5f0dff74323 None None] MFA Rules not processed for user `cd677a2ede7a4d4b8f6d08b62db1f24e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:10.031590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea95958f-db6c-40d2-b603-b5f0dff74323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:10.120010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaa90-7c89-4dc5-8fef-ee7bb4ea6658 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:10.135808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:10.140291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:10.140585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:10.140870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:10.141563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:10.143206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:10.174154 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2203/4436] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:10.176166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:10.208113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430435b-8cfa-4e7a-bf91-1bfe30d44c77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:10.217383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:10.221381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:10.222143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:10.222633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:10.222866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:10.234996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:10.241339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:10.278159 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2204/4437] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:10.281634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:10.295172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac760b3b-8e23-43ca-ba20-3f7af5abc9e6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:10.301149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:10.303169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:10.303741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:10.304565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] PATH_INFO: `/v3/projects/ed5e4ba6c4664400a5b8156c5d2eff6c/users/ccfedb88bc954071bf8947f7f77a0436/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:10.345284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5e4ba6c4664400a5b8156c5d2eff6c, user_id=ccfedb88bc954071bf8947f7f77a0436, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:10.353234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:10.369304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:10.435560 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2234/4438] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:10.442625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2205/4439] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:10 2022] PUT /identity/v3/projects/ed5e4ba6c4664400a5b8156c5d2eff6c/users/ccfedb88bc954071bf8947f7f77a0436/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:10.460806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:10.475756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:10.490944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:10.496415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:10.497340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:10.611439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] MFA Rules not processed for user `ccfedb88bc954071bf8947f7f77a0436`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:10.612854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:10.691430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb792814-2f5b-4080-ac3a-b95fcac3bf5e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:10.703978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:10.704649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:10.705066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:10.705349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:10.827261 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2235/4440] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:10.828300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:10.836451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:10.889239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:10.890995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:10.922293 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2206/4441] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:10.925388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:10.986911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9102e-58cc-49e8-8483-4caea13ae44b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:10.997376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:10.998406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:10.998706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:10.998987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] PATH_INFO: `/v3/projects/0d586690e62645e6b2d12b94b71bdccf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:11.000544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d586690e62645e6b2d12b94b71bdccf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:11.002781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:11.099926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac8083-a530-4641-ae30-345ecb507974 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:11.118363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:11.118363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:11.118363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:11.118363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] PATH_INFO: `/v3/users/ccfedb88bc954071bf8947f7f77a0436` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:11.118780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccfedb88bc954071bf8947f7f77a0436)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:11.118780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:11.235457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d586690e62645e6b2d12b94b71bdccf', 'request_id': 'req-1855bd55-debf-42b6-ac59-9713631513e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.243696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d586690e62645e6b2d12b94b71bdccf', 'request_id': 'req-1855bd55-debf-42b6-ac59-9713631513e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.359377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d586690e62645e6b2d12b94b71bdccf', 'request_id': 'req-1855bd55-debf-42b6-ac59-9713631513e1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.399663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] The token cache is being invalidate because project 0d586690e62645e6b2d12b94b71bdccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:11.399972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.404141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.423715 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2236/4442] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:10 2022] DELETE /identity/v3/projects/0d586690e62645e6b2d12b94b71bdccf => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:11.423816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccfedb88bc954071bf8947f7f77a0436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.423816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccfedb88bc954071bf8947f7f77a0436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.426749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:11.428525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:11.525542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855bd55-debf-42b6-ac59-9713631513e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:11.531038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:11.531842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:11.532173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:11.532448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] PATH_INFO: `/v3/users/aab38b97975c4acd8efc0e9ce3fc8e43` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:11.533869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab38b97975c4acd8efc0e9ce3fc8e43)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:11.536301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:11.561630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccfedb88bc954071bf8947f7f77a0436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.563052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccfedb88bc954071bf8947f7f77a0436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.576425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccfedb88bc954071bf8947f7f77a0436'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.599392 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2207/4443] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:10 2022] DELETE /identity/v3/users/ccfedb88bc954071bf8947f7f77a0436 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:11.603802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:11.606031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:11.637216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:11.709256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620db52-a0d5-47aa-9cb3-8c560f8030d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:11.716007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcbc99-d865-422e-a3a6-a65608552a5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:11.716683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbc99-d865-422e-a3a6-a65608552a5b service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:11.717005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbc99-d865-422e-a3a6-a65608552a5b service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:11.717330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbc99-d865-422e-a3a6-a65608552a5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:11.726465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8fbcbc99-d865-422e-a3a6-a65608552a5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:11.738239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab38b97975c4acd8efc0e9ce3fc8e43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.744006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcbc99-d865-422e-a3a6-a65608552a5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:11.749690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcbc99-d865-422e-a3a6-a65608552a5b service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:11.757987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab38b97975c4acd8efc0e9ce3fc8e43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.759646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab38b97975c4acd8efc0e9ce3fc8e43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.780719 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2208/4444] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:11.784947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:11.786669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:11.787158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:11.793207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab38b97975c4acd8efc0e9ce3fc8e43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.814689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:11.816506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:11.863919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab38b97975c4acd8efc0e9ce3fc8e43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:11.880988 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2237/4445] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:11 2022] DELETE /identity/v3/users/aab38b97975c4acd8efc0e9ce3fc8e43 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:11.952925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2209/4446] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:12.055950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:12.060303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:12.137357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:12.202850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a9e28-039a-43f9-9772-a1816bf77816 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:12.215673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:12.216532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:12.216900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:12.217687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:12.295056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:12.296698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:12.314424 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2238/4447] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:12.366420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:12.369793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:12.413673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e834d3a-aa3f-4fbb-ac4f-786acc7fd963 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:12.421491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:12.422816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:12.423429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:12.423994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] PATH_INFO: `/v3/users/4515d177f6984dd1883466691c1d403b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:12.425742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4515d177f6984dd1883466691c1d403b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:12.429761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:12.682827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4515d177f6984dd1883466691c1d403b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:12.684505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4515d177f6984dd1883466691c1d403b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:12.734738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:12.736215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:12.754683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7f703-2412-483d-9892-643c6bf83821 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:12.763076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:12.763730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:12.764067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:12.764486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] PATH_INFO: `/v3/projects/2513b49b081049d59c4796f262e907df` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:12.767802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2513b49b081049d59c4796f262e907df)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:12.767802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:12.776641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4515d177f6984dd1883466691c1d403b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:12.777289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4515d177f6984dd1883466691c1d403b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:12.791878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7847dfa4-dbdb-4926-8e47-7f4cc445af46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4515d177f6984dd1883466691c1d403b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:12.837559 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2210/4448] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:12 2022] DELETE /identity/v3/users/4515d177f6984dd1883466691c1d403b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:12.842813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:12.843104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:12.845052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:12.902327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:12.902327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.012014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2513b49b081049d59c4796f262e907df', 'request_id': 'req-6e6e3945-c4a9-4a97-a339-50407fa07894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.020099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2513b49b081049d59c4796f262e907df', 'request_id': 'req-6e6e3945-c4a9-4a97-a339-50407fa07894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.050365 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2211/4449] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:13.079480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2513b49b081049d59c4796f262e907df', 'request_id': 'req-6e6e3945-c4a9-4a97-a339-50407fa07894'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.081615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:13.083950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.115096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] The token cache is being invalidate because project 2513b49b081049d59c4796f262e907df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:13.116458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.119110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e6e3945-c4a9-4a97-a339-50407fa07894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.123067 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2239/4450] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:12 2022] DELETE /identity/v3/projects/2513b49b081049d59c4796f262e907df => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:13.131295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.132479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.132907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.164413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:13.165958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.196757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f8ec1-b1f1-4635-ad41-2e59bc2dfd5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:13.317091 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2240/4451] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:13.325580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:13.325773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.356343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7571eb-5b4b-48b4-adf9-2c924e5e1d93 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:13.362735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6763143-d113-4aa1-b6a0-a3caa7badfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:13.366265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763143-d113-4aa1-b6a0-a3caa7badfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.366265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763143-d113-4aa1-b6a0-a3caa7badfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.366265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763143-d113-4aa1-b6a0-a3caa7badfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.367746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6763143-d113-4aa1-b6a0-a3caa7badfa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.370244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:13.371270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.371571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.371807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] PATH_INFO: `/v3/projects/ed5e4ba6c4664400a5b8156c5d2eff6c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.373484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5e4ba6c4664400a5b8156c5d2eff6c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:13.377621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:13.397673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6763143-d113-4aa1-b6a0-a3caa7badfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:13.401114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6763143-d113-4aa1-b6a0-a3caa7badfa8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:13.426936 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2212/4452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:13.428214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b27b-11fa-4a28-bd22-eb3175993495 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.431054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b27b-11fa-4a28-bd22-eb3175993495 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.431452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b27b-11fa-4a28-bd22-eb3175993495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.439769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:13.462425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9a4b27b-11fa-4a28-bd22-eb3175993495 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:13.468972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9a4b27b-11fa-4a28-bd22-eb3175993495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.473133 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2213/4453] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:13.483254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4b27b-11fa-4a28-bd22-eb3175993495 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:13.504218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4b27b-11fa-4a28-bd22-eb3175993495 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:13.522399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5e4ba6c4664400a5b8156c5d2eff6c', 'request_id': 'req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.533865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5e4ba6c4664400a5b8156c5d2eff6c', 'request_id': 'req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.594827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:13.596152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.596607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.597104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.597920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:13.598494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:13.601407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:13.612461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5e4ba6c4664400a5b8156c5d2eff6c', 'request_id': 'req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.622209 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2214/4454] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:13.626849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:13.635568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] The token cache is being invalidate because project ed5e4ba6c4664400a5b8156c5d2eff6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:13.636201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.636983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d773c9c-0b87-43c4-9f83-80a21c3a5d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:13.645923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2241/4455] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:13 2022] DELETE /identity/v3/projects/ed5e4ba6c4664400a5b8156c5d2eff6c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:13.650859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21222-56d4-48ba-bdb6-d7da7bec15a2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.651326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21222-56d4-48ba-bdb6-d7da7bec15a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.651837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21222-56d4-48ba-bdb6-d7da7bec15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.666201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba419c-0cae-441e-aa78-b772db3198be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:13.677555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:13.678149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.678723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.679003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.679763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:13.682376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:13.688138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9fa21222-56d4-48ba-bdb6-d7da7bec15a2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:13.689534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9fa21222-56d4-48ba-bdb6-d7da7bec15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.697636 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2242/4456] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:13.707085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d4531-6772-4061-baa6-5690fb180e04 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.707492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d4531-6772-4061-baa6-5690fb180e04 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.707866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d4531-6772-4061-baa6-5690fb180e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.728470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-318d4531-6772-4061-baa6-5690fb180e04 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:13.729714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-318d4531-6772-4061-baa6-5690fb180e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.737719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2243/4457] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:13.741921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d4531-6772-4061-baa6-5690fb180e04 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:13.752165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d4531-6772-4061-baa6-5690fb180e04 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:13.754499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:13.759680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:13.763010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.763010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.763010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.763010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:13.763010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:13.763559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:13.775511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2244/4458] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:13.779927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:13.795266 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2215/4459] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:13 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:42:13.801466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:13.804232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:13.808668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c773aed-8fa5-4859-803f-178460fdb6f4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:13.904049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:13.905294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.905657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.906085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.907205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:13.910099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:13.936897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf89d56-3e47-4933-98b4-5d319a6aaa09 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:13.942968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:13.944406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:13.944834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:13.945376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:13.947204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:13.951195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.028415 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2245/4460] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:13 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:14.029646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.060030 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2216/4461] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:13 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:14.064799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.081605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead96a4a-d79c-44d1-a650-bc97ee8b72a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.123730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7876b5e-d1fe-482a-baf8-1dfd67fb0e2e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.141202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.142903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.143309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.146598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.147438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.153667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.201443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.202130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.202480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.202862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.203714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.205363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.222564 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2217/4462] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:14.223558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.239011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7722e-76f6-4444-8cb0-9332646c528b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.257623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.257623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.257623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.257623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] PATH_INFO: `/v3/projects/47e855da49ee4a019bf84dc571003dba/users/8de95c040d2c4601b702234947c0a1ca/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.270214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2246/4463] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:14 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:14.275272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.279625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e855da49ee4a019bf84dc571003dba, user_id=8de95c040d2c4601b702234947c0a1ca, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.282323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.285972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a09117-df9a-480e-9280-8aaaa78c4eff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.291221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.291903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.292314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.292572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.293275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.295164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.306846 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2247/4464] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:14.313098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.326690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f53bb-f19b-456a-9fe3-2b939685628a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.333482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.334744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.335232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.335738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.336602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.338304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.356746 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2248/4465] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:42:14.357880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.373376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:14.375089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2218/4466] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:14 2022] PUT /identity/v3/projects/47e855da49ee4a019bf84dc571003dba/users/8de95c040d2c4601b702234947c0a1ca/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:14.378602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.381563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8b31f-aa0f-42cb-9fc3-c087d9032cc3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.382959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:14.537624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.538647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.541911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.541911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] PATH_INFO: `/v3/projects/d04a029c3b6b4aaeb1070405cd1e7ee0/users/d11c68a0dd7e4f5b8010efd50a906a42/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.546185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d656dd-e1f4-4e71-a605-cc353e978b7e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.557128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.558161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.561337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.561845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] PATH_INFO: `/v3/projects/c022fb260b9b4cdeaade9e450b14c7aa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.565423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c022fb260b9b4cdeaade9e450b14c7aa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.567678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.582073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04a029c3b6b4aaeb1070405cd1e7ee0, user_id=d11c68a0dd7e4f5b8010efd50a906a42, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.590179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.674434 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2249/4467] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:14 2022] PUT /identity/v3/projects/d04a029c3b6b4aaeb1070405cd1e7ee0/users/d11c68a0dd7e4f5b8010efd50a906a42/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:14.675559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.723914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c022fb260b9b4cdeaade9e450b14c7aa', 'request_id': 'req-4c79d1ce-6a67-4791-b906-70759aecb3a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:14.732435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c022fb260b9b4cdeaade9e450b14c7aa', 'request_id': 'req-4c79d1ce-6a67-4791-b906-70759aecb3a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:14.785131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016b1a-748d-4895-8929-1f3b0631f686 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.800986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:14.801365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c022fb260b9b4cdeaade9e450b14c7aa', 'request_id': 'req-4c79d1ce-6a67-4791-b906-70759aecb3a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:14.816789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] The token cache is being invalidate because project c022fb260b9b4cdeaade9e450b14c7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:14.817148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:14.817944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c79d1ce-6a67-4791-b906-70759aecb3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:14.820616 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2219/4468] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:14 2022] DELETE /identity/v3/projects/c022fb260b9b4cdeaade9e450b14c7aa => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:14.825388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.827306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.827717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.875454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] MFA Rules not processed for user `d11c68a0dd7e4f5b8010efd50a906a42`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:14.876278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:14.891880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.896144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.896525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.897329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.901687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.905085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:14.932904 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2250/4469] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:14.939329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:14.941094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:14.957892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87ce6b-3436-4a38-ab9a-06ab49af3837 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:14.964570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:14.965189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:14.965467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:14.965740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] PATH_INFO: `/v3/users/cd677a2ede7a4d4b8f6d08b62db1f24e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:14.966949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd677a2ede7a4d4b8f6d08b62db1f24e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:14.970643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:15.006327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:15.028684 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2220/4470] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:15.030575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:15.032925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:15.052542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58092b-c2d5-47f3-b49a-59abcb1e5cfc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:15.057384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:15.058074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:15.058373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:15.058650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] PATH_INFO: `/v3/projects/47e855da49ee4a019bf84dc571003dba/users/8de95c040d2c4601b702234947c0a1ca/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:15.061411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e855da49ee4a019bf84dc571003dba, user_id=8de95c040d2c4601b702234947c0a1ca, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:15.064376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:15.077979 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2221/4471] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:15 2022] PUT /identity/v3/projects/47e855da49ee4a019bf84dc571003dba/users/8de95c040d2c4601b702234947c0a1ca/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:15.078888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:15.090174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:15.135317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd677a2ede7a4d4b8f6d08b62db1f24e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:15.144335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd677a2ede7a4d4b8f6d08b62db1f24e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:15.145360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd677a2ede7a4d4b8f6d08b62db1f24e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:15.162556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd677a2ede7a4d4b8f6d08b62db1f24e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:15.255194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f44ec-9c26-48e3-859d-81d065c4fe36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:15.264651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1660dbbb-df6d-4838-8c22-0b103d8b1c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd677a2ede7a4d4b8f6d08b62db1f24e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:15.275699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:15.276334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:15.276615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:15.277190 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2251/4472] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:14 2022] DELETE /identity/v3/users/cd677a2ede7a4d4b8f6d08b62db1f24e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:15.277671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:15.278713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74000ce0-0795-4fbc-a15d-04b7da320b14 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:15.279226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74000ce0-0795-4fbc-a15d-04b7da320b14 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:15.279576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74000ce0-0795-4fbc-a15d-04b7da320b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:15.285770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:15.324537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-74000ce0-0795-4fbc-a15d-04b7da320b14 None None] MFA Rules not processed for user `8de95c040d2c4601b702234947c0a1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:15.327536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-74000ce0-0795-4fbc-a15d-04b7da320b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:15.410815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:15.413013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:15.436546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2222/4473] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:15.520849 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2252/4474] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:15.526371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:15.528759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:15.551436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:15.612409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:15.690570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78501446-376d-40c3-b5c9-2fe8084f247b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:15.795021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:15.797191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:15.798495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:15.799108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:15.800024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:15.804071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:15.976922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2223/4475] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:15 2022] POST /identity/v3/projects => generated 381 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:15.982021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74000ce0-0795-4fbc-a15d-04b7da320b14 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:15.994281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74000ce0-0795-4fbc-a15d-04b7da320b14 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:16.163960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:16.165718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:16.166233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:16.166618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:16.167520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:16.169582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:16.292161 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2253/4476] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:15 2022] POST /identity/v3/users => generated 291 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:16.293939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:16.307275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349fd82-bb17-4eaf-a536-4972f7c52480 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:16.319084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:16.319764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:16.320045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:16.320320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:16.321550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:16.323221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:16.332942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:16.341758 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2224/4477] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:16.343832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:16.363697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35831-1d7c-4da1-89e8-ae1234f4c7d7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:16.372036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a7c5-4f80-40d6-bf25-a6db2925788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:16.372810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a7c5-4f80-40d6-bf25-a6db2925788c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:16.373180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a7c5-4f80-40d6-bf25-a6db2925788c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:16.373543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a7c5-4f80-40d6-bf25-a6db2925788c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:16.374357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a7c5-4f80-40d6-bf25-a6db2925788c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:16.376601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a7c5-4f80-40d6-bf25-a6db2925788c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:16.396674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:16.398180 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2254/4478] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:42:16.410194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762f12-72af-4621-a1da-18afb0a312e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:16.420610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:16.421307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:16.421624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:16.421856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] PATH_INFO: `/v3/projects/204c060ec8f54ed3be353f17886962eb/users/200480b709e545c88149be3bdcbe4886/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:16.453554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=204c060ec8f54ed3be353f17886962eb, user_id=200480b709e545c88149be3bdcbe4886, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:16.453554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:16.567877 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2225/4479] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:16 2022] PUT /identity/v3/projects/204c060ec8f54ed3be353f17886962eb/users/200480b709e545c88149be3bdcbe4886/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:16.579053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:16.579824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:16.580170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:16.648016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] MFA Rules not processed for user `200480b709e545c88149be3bdcbe4886`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:16.649422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:16.811896 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2255/4480] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:16.831100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:16.835903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:16.967328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd65f0-4cd8-4fa9-9cf3-78cc63308f0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:16.977832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:16.985048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f56e2-9f4e-407b-915f-1b603ef00dc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:16.991069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f56e2-9f4e-407b-915f-1b603ef00dc3 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:16.991069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f56e2-9f4e-407b-915f-1b603ef00dc3 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:16.991069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f56e2-9f4e-407b-915f-1b603ef00dc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:17.119900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f56e2-9f4e-407b-915f-1b603ef00dc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:17.123161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f56e2-9f4e-407b-915f-1b603ef00dc3 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:17.138396 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2226/4481] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:17.838508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:17.838508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:17.947191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1aad8-9def-427f-8160-f8fe572a5b1d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:17.949468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:17.950289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:17.951597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:17.951597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] PATH_INFO: `/v3/projects/833cfeefac044cf09ac47196e01371f4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:17.952320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833cfeefac044cf09ac47196e01371f4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:17.954884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:18.151416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833cfeefac044cf09ac47196e01371f4', 'request_id': 'req-26315557-4ba6-4b34-9029-ee295d104290'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:18.170637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833cfeefac044cf09ac47196e01371f4', 'request_id': 'req-26315557-4ba6-4b34-9029-ee295d104290'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:18.248076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833cfeefac044cf09ac47196e01371f4', 'request_id': 'req-26315557-4ba6-4b34-9029-ee295d104290'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:18.294415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] The token cache is being invalidate because project 833cfeefac044cf09ac47196e01371f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:18.295414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:18.298229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-26315557-4ba6-4b34-9029-ee295d104290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:18.305936 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2256/4482] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:17 2022] DELETE /identity/v3/projects/833cfeefac044cf09ac47196e01371f4 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:18.312639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687344-0239-477d-8cc8-6df28edf9e09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:18.313081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687344-0239-477d-8cc8-6df28edf9e09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:18.313081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687344-0239-477d-8cc8-6df28edf9e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:18.368879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c2687344-0239-477d-8cc8-6df28edf9e09 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:18.369759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2687344-0239-477d-8cc8-6df28edf9e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:18.541456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2227/4483] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:18.549684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66af1a-8070-4744-99ce-c3964377b49c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:18.549977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66af1a-8070-4744-99ce-c3964377b49c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:18.550733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66af1a-8070-4744-99ce-c3964377b49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:18.591029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d66af1a-8070-4744-99ce-c3964377b49c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:18.592781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d66af1a-8070-4744-99ce-c3964377b49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:18.624618 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2257/4484] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:18.629285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2687344-0239-477d-8cc8-6df28edf9e09 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:18.654585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2687344-0239-477d-8cc8-6df28edf9e09 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:18.660563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:18.662890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:18.662890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:18.662890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:18.663884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:18.664344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:18.666723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:18.700518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:18.713160 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2228/4485] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:18.717344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66af1a-8070-4744-99ce-c3964377b49c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:18.731058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66af1a-8070-4744-99ce-c3964377b49c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:18.754719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:18.755978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:18.756470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:18.756978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:18.759142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:18.763140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:18.939594 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2258/4486] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:18 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:18.940520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:18.960887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6446b-1d0e-41e1-b2e6-489321c64115 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:19.100837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:19.103436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.104255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.104719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.105556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:19.122485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:19.251305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:19.252979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:19.287296 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2229/4487] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:18 2022] POST /identity/v3/users => generated 294 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:19.291798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:19.297641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5e79e-b3e6-48ff-bcf2-22f40b0f1afc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:19.308790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:19.309453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.310282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.310282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] PATH_INFO: `/v3/users/8de95c040d2c4601b702234947c0a1ca` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.313389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76136f3-bfeb-409f-a692-b63e710d7795 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:19.315282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de95c040d2c4601b702234947c0a1ca)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:19.322271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:19.324219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:19.324849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.328997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.330337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.331209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:19.334302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:19.386512 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2230/4488] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:19.395286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:19.420164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f4e7-b5ff-4495-9b10-06b3bea9691e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:19.433891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:19.435018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.435305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.435762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.436423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:19.438034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:19.472013 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2231/4489] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:42:19.481627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:19.525638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:19.527446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6305545-004d-447d-bb5c-69d77327b23f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:19.540718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42b90-0af7-4c61-93d5-fb8ae7afa86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:19.541482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42b90-0af7-4c61-93d5-fb8ae7afa86e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.542243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42b90-0af7-4c61-93d5-fb8ae7afa86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.542529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42b90-0af7-4c61-93d5-fb8ae7afa86e admin admin] PATH_INFO: `/v3/projects/a157c5671ed448d590c22ee730b7c14b/users/15250a0f5f1d4d8ea2bd032b39f5f8cb/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.583167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42b90-0af7-4c61-93d5-fb8ae7afa86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a157c5671ed448d590c22ee730b7c14b, user_id=15250a0f5f1d4d8ea2bd032b39f5f8cb, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:19.586810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42b90-0af7-4c61-93d5-fb8ae7afa86e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:19.649330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de95c040d2c4601b702234947c0a1ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:19.677609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2232/4490] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:19 2022] PUT /identity/v3/projects/a157c5671ed448d590c22ee730b7c14b/users/15250a0f5f1d4d8ea2bd032b39f5f8cb/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:19.726529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de95c040d2c4601b702234947c0a1ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:19.729187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de95c040d2c4601b702234947c0a1ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:19.744446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e54f-cc7c-41eb-8096-e4937abcbacf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.748771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e54f-cc7c-41eb-8096-e4937abcbacf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.750164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e54f-cc7c-41eb-8096-e4937abcbacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.817313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de95c040d2c4601b702234947c0a1ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:19.820862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a6f7e54f-cc7c-41eb-8096-e4937abcbacf None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:19.824620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6f7e54f-cc7c-41eb-8096-e4937abcbacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:19.913897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db549037-b8c9-4fe2-bc71-eeb76bc70cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de95c040d2c4601b702234947c0a1ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:19.924849 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2259/4491] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:19 2022] DELETE /identity/v3/users/8de95c040d2c4601b702234947c0a1ca => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:19.926465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.927396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.931770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.985413 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2233/4492] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:19.986859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213889e-27de-4135-991e-e97338e8c20a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:19.987209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213889e-27de-4135-991e-e97338e8c20a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:19.987489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213889e-27de-4135-991e-e97338e8c20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:19.995044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] MFA Rules not processed for user `15250a0f5f1d4d8ea2bd032b39f5f8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:19.997084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:20.054820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a213889e-27de-4135-991e-e97338e8c20a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:20.056140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a213889e-27de-4135-991e-e97338e8c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:20.144681 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2260/4493] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:20.145625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:20.148182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:20.199919 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2234/4494] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:20.224730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213889e-27de-4135-991e-e97338e8c20a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:20.226713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a213889e-27de-4135-991e-e97338e8c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:20.275381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e31320-4f76-4dc0-8181-f5dafd5e4a4b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:20.285233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:20.291074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:20.291074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:20.291074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:20.291074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:20.292446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:20.399715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213889e-27de-4135-991e-e97338e8c20a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:20.409427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:20.410199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:20.410602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:20.410978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:20.421814 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2261/4495] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:20 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:20.425741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:20.429825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:20.431454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:20.454422 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2235/4496] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:42:20.623962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792969d-c73f-4912-ac7b-423ccd22fab4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:20.641038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:20.641613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:20.641899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:20.642221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:20.642907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:20.648478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:20.747242 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2262/4497] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:20 2022] POST /identity/v3/users => generated 299 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:20.751063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:20.770128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80d2e2-9c34-4d2d-a531-604d09cc2811 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:20.777864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:20.778534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:20.778818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:20.779096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:20.779751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:20.781530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:20.809627 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2236/4498] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:20.817779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:20.834551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:20.847986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c08502-7176-43ac-9dac-eab52d7a7dd9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:20.875771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:20.876542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:20.876818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:20.877087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] PATH_INFO: `/v3/projects/91e1f000f2834af089c6a92600264a75/users/df97e7d292a9416aabd9a9a5a195495f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:20.914191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e1f000f2834af089c6a92600264a75, user_id=df97e7d292a9416aabd9a9a5a195495f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:20.917865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:20.934769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:21.069328 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2263/4499] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:20 2022] PUT /identity/v3/projects/91e1f000f2834af089c6a92600264a75/users/df97e7d292a9416aabd9a9a5a195495f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:21.077572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:21.083998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:21.085827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:21.099437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47706-08e7-46b2-8fa8-42ced6b9012b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:21.215596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60a84f-38a1-4e33-a1c1-059b260c2bdb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:21.221067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:21.222661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:21.223180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:21.223719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:21.224541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:21.228148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:21.229232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:21.229884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:21.230185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:21.230617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] PATH_INFO: `/v3/users/b7c0f8d3344b45e0a73747d85a9f9e0b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:21.234209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c0f8d3344b45e0a73747d85a9f9e0b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:21.244595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:21.244724 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2237/4500] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:21.247651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:21.264977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b22e5-ca81-4de1-9418-adf3efa78b77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:21.274857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04305c88-392c-4ffb-b24c-de875f620e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:21.274857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305c88-392c-4ffb-b24c-de875f620e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:21.275491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305c88-392c-4ffb-b24c-de875f620e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:21.275965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305c88-392c-4ffb-b24c-de875f620e99 admin admin] PATH_INFO: `/v3/projects/91e1f000f2834af089c6a92600264a75/users/df97e7d292a9416aabd9a9a5a195495f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:21.293945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04305c88-392c-4ffb-b24c-de875f620e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e1f000f2834af089c6a92600264a75, user_id=df97e7d292a9416aabd9a9a5a195495f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:21.297307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04305c88-392c-4ffb-b24c-de875f620e99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:21.318105 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2238/4501] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:21 2022] PUT /identity/v3/projects/91e1f000f2834af089c6a92600264a75/users/df97e7d292a9416aabd9a9a5a195495f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:21.328424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:21.329429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:21.330887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:21.417444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] MFA Rules not processed for user `df97e7d292a9416aabd9a9a5a195495f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:21.423217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:21.498173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c0f8d3344b45e0a73747d85a9f9e0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:21.508729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c0f8d3344b45e0a73747d85a9f9e0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:21.509466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c0f8d3344b45e0a73747d85a9f9e0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:21.524688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c0f8d3344b45e0a73747d85a9f9e0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:21.531182 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2239/4502] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:21.542495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:21.543935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:21.608554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15565402-5d3f-4cf5-8e29-d1a745c4ea9d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:21.612575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:21.614513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:21.614513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:21.614513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:21.624355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:21.625836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:21.637707 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2240/4503] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:42:21.638745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:21.640157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:21.679846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c0f8d3344b45e0a73747d85a9f9e0b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:21.691570 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2264/4504] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:21 2022] DELETE /identity/v3/users/b7c0f8d3344b45e0a73747d85a9f9e0b => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:21.750784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f259c4a-412c-48a0-b9ca-266c95c975ac service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:21.981519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:21.988164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:21.988455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:21.988734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] PATH_INFO: `/v3/projects/47e855da49ee4a019bf84dc571003dba` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:22.011842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e855da49ee4a019bf84dc571003dba)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:22.030507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:22.059526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:22.222183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e855da49ee4a019bf84dc571003dba', 'request_id': 'req-0881d787-cb09-4883-8b05-f304032c77f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.233463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e855da49ee4a019bf84dc571003dba', 'request_id': 'req-0881d787-cb09-4883-8b05-f304032c77f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.309281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e855da49ee4a019bf84dc571003dba', 'request_id': 'req-0881d787-cb09-4883-8b05-f304032c77f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.328000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] The token cache is being invalidate because project 47e855da49ee4a019bf84dc571003dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:22.328000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.329024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.334626 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2241/4505] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:21 2022] DELETE /identity/v3/projects/47e855da49ee4a019bf84dc571003dba => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:22.339738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:22.355525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a1318-9023-4066-937b-401850f6b5c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:22.458216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:22.467865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:22.467865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:22.467865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] PATH_INFO: `/v3/users/200480b709e545c88149be3bdcbe4886` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:22.469496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=200480b709e545c88149be3bdcbe4886)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:22.471497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:22.516760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:22.518195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:22.535595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d787-cb09-4883-8b05-f304032c77f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:22.543713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:22.544312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:22.545113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:22.545393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] PATH_INFO: `/v3/projects/8c8666b164a743dea89a8f81a277d186` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:22.546652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8666b164a743dea89a8f81a277d186)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:22.548746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:22.746995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8666b164a743dea89a8f81a277d186', 'request_id': 'req-e6bac731-c22d-466d-8484-3c1f2604cce1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.784152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200480b709e545c88149be3bdcbe4886'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.789126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8666b164a743dea89a8f81a277d186', 'request_id': 'req-e6bac731-c22d-466d-8484-3c1f2604cce1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.800665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200480b709e545c88149be3bdcbe4886'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.802745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200480b709e545c88149be3bdcbe4886'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.821906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200480b709e545c88149be3bdcbe4886'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.908327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8666b164a743dea89a8f81a277d186', 'request_id': 'req-e6bac731-c22d-466d-8484-3c1f2604cce1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.920875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] The token cache is being invalidate because project 8c8666b164a743dea89a8f81a277d186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:22.921261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.921986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e6bac731-c22d-466d-8484-3c1f2604cce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:22.923744 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2242/4506] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:22 2022] DELETE /identity/v3/projects/8c8666b164a743dea89a8f81a277d186 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:22.928601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfba7ba-5a38-4f4a-9dcd-eaecaa6db018 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:22.928996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfba7ba-5a38-4f4a-9dcd-eaecaa6db018 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:22.929356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfba7ba-5a38-4f4a-9dcd-eaecaa6db018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:22.943106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:22.955834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5bfba7ba-5a38-4f4a-9dcd-eaecaa6db018 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:22.957264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bfba7ba-5a38-4f4a-9dcd-eaecaa6db018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:23.040699 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2243/4507] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:23.050791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bac9f-e78a-4165-a514-d30b72b08c52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.050791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bac9f-e78a-4165-a514-d30b72b08c52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.050791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bac9f-e78a-4165-a514-d30b72b08c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.068904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200480b709e545c88149be3bdcbe4886'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:23.079201 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2265/4508] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:22 2022] DELETE /identity/v3/users/200480b709e545c88149be3bdcbe4886 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:23.097058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f11bac9f-e78a-4165-a514-d30b72b08c52 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:23.098535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f11bac9f-e78a-4165-a514-d30b72b08c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:23.214458 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2244/4509] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:23.222201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:23.223813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:23.248531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6455b54-4af2-4106-9c5d-46a852dbdb33 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:23.268020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:23.268656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.268939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.269212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.269954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:23.270401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:23.272133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:23.294641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2266/4510] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:23.297445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bac9f-e78a-4165-a514-d30b72b08c52 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:23.309949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bac9f-e78a-4165-a514-d30b72b08c52 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:23.319205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:23.319902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.321372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.321372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.321717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:23.328439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:23.490514 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2245/4511] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:23 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:23.494353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:23.507857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865afb-e469-46bf-8d1b-6bcd327de0a7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:23.586880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:23.589937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:23.620611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:23.622088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.622591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.623175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.623973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:23.626670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:23.771071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2edee5-d6ed-438c-bd55-bf2d37014649 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:23.775361 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2267/4512] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:23 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:23.780073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:23.797367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099d6c9-fb6e-49d5-96ad-ebc328a46cbc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:23.799110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:23.799906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.800293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.801010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] PATH_INFO: `/v3/users/15250a0f5f1d4d8ea2bd032b39f5f8cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.804331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15250a0f5f1d4d8ea2bd032b39f5f8cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:23.806706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:23.810270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:23.812136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.815044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.815499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.817664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:23.820931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:23.834545 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2268/4513] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:42:23.838968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:23.853031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d55b4-2a68-4c28-992b-250874a608c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:23.859573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:23.860485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.860967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.863842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.863842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:23.864300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:23.881628 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2269/4514] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:23.886038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:23.912722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0499b-f73e-4fbc-810b-fff9d846c697 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:23.928866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:23.929565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:23.931178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:23.931476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] PATH_INFO: `/v3/projects/097aa0eadf644bcebb1726180c126259/users/725680d81f6f43679703425651a3e207/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:23.952418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=097aa0eadf644bcebb1726180c126259, user_id=725680d81f6f43679703425651a3e207, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:23.956085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:24.103544 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2270/4515] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:23 2022] PUT /identity/v3/projects/097aa0eadf644bcebb1726180c126259/users/725680d81f6f43679703425651a3e207/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:24.104667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:24.111474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:24.174268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15250a0f5f1d4d8ea2bd032b39f5f8cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.175282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15250a0f5f1d4d8ea2bd032b39f5f8cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.235973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19f7f5-079f-4e6c-8a1d-90c77bbfb16d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:24.242707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:24.243562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:24.244019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:24.244436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] PATH_INFO: `/v3/projects/204c060ec8f54ed3be353f17886962eb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:24.247709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=204c060ec8f54ed3be353f17886962eb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:24.249791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:24.314685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15250a0f5f1d4d8ea2bd032b39f5f8cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.315346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15250a0f5f1d4d8ea2bd032b39f5f8cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.329482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-934d1210-7e26-498f-8e10-fd403b883da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15250a0f5f1d4d8ea2bd032b39f5f8cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.349869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2246/4516] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:23 2022] DELETE /identity/v3/users/15250a0f5f1d4d8ea2bd032b39f5f8cb => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:24.351520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd969a0-d836-440e-aaa8-4a4e1a8eb09a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:24.352039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd969a0-d836-440e-aaa8-4a4e1a8eb09a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:24.352367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd969a0-d836-440e-aaa8-4a4e1a8eb09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:24.378950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0cd969a0-d836-440e-aaa8-4a4e1a8eb09a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:24.395197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cd969a0-d836-440e-aaa8-4a4e1a8eb09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:24.457055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204c060ec8f54ed3be353f17886962eb', 'request_id': 'req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.468517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204c060ec8f54ed3be353f17886962eb', 'request_id': 'req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.548081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204c060ec8f54ed3be353f17886962eb', 'request_id': 'req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.589913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2247/4517] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:24.590511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] The token cache is being invalidate because project 204c060ec8f54ed3be353f17886962eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:24.590511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.590678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:24.590678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:24.590678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:24.591613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06bcfd65-fddd-445d-a8bd-3e4038e1e56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:24.594327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2271/4518] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:24 2022] DELETE /identity/v3/projects/204c060ec8f54ed3be353f17886962eb => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:24.600482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:24.601063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:24.601525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:24.634095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:24.648731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:24.689163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:24.690665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:24.779113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2248/4519] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:24.780253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:24.783909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:24.838846 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2272/4520] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:24.839895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:24.841236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:24.883593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1239bd-acdd-4ef3-8009-c4f58ea4fa98 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:24.899391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadc0f3-f40a-4daf-ae97-337d9d907b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:24.900152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc0f3-f40a-4daf-ae97-337d9d907b39 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:24.907168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc0f3-f40a-4daf-ae97-337d9d907b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:24.907168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc0f3-f40a-4daf-ae97-337d9d907b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:24.907168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:24.918013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8eadc0f3-f40a-4daf-ae97-337d9d907b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:24.945935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc0f3-f40a-4daf-ae97-337d9d907b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:24.953434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc0f3-f40a-4daf-ae97-337d9d907b39 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:24.976672 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2249/4521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:24.981764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622cf4-8aa0-4c40-b0cf-4de778fb122d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:24.982044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622cf4-8aa0-4c40-b0cf-4de778fb122d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:24.982468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622cf4-8aa0-4c40-b0cf-4de778fb122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:24.985295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:24.995548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e82288-fd4b-426c-af65-16e9591fd63e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:25.009440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:25.010229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:25.010512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:25.010787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:25.028377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54622cf4-8aa0-4c40-b0cf-4de778fb122d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:25.031402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54622cf4-8aa0-4c40-b0cf-4de778fb122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:25.032987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:25.036437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:25.051243 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2250/4522] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:25.056976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54622cf4-8aa0-4c40-b0cf-4de778fb122d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:25.063481 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2273/4523] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:25.083035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54622cf4-8aa0-4c40-b0cf-4de778fb122d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:25.092746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:25.093491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:25.093780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:25.094185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:25.094988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:25.095300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:25.103843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:25.130443 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2251/4524] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:25.132869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:25.144297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca701352-3d8a-4eed-ac23-621c8307a27f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:25.162073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:25.162073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:25.162073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:25.162073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:25.162769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:25.162769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:25.334501 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2274/4525] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:25 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:25.338844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:25.353418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d6b10-1948-4e64-b10f-5f68bb9dc63c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:25.483059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:25.488001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:25.488001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:25.488001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:25.488001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:25.492018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:25.662102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2252/4526] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:25 2022] POST /identity/v3/users => generated 305 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:25.675582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:25.699838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e05f43-3a6d-4fff-8ddb-ca18f18a7cbc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:25.709528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:25.710345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:25.710711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:25.711061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:25.712379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:25.714920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:25.776952 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2275/4527] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:25.777036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:25.787947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aea90-902f-4098-abcd-022a306ba31d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:25.793929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7deb0-b50f-44fe-a5c0-89a606202963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:25.794630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7deb0-b50f-44fe-a5c0-89a606202963 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:25.796272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7deb0-b50f-44fe-a5c0-89a606202963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:25.796272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7deb0-b50f-44fe-a5c0-89a606202963 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:25.796272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7deb0-b50f-44fe-a5c0-89a606202963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:25.809256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7deb0-b50f-44fe-a5c0-89a606202963 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:25.824709 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2253/4528] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:25.828661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:25.840248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebceb6-e135-4a2a-9f17-197a87df0f31 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:25.848224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:25.849466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:25.849956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:25.850558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] PATH_INFO: `/v3/projects/9e2388073d3841e1b55bac35b6885324/users/9c2aa26bd77e43f88d99ca90ccfcdae0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:25.868258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2388073d3841e1b55bac35b6885324, user_id=9c2aa26bd77e43f88d99ca90ccfcdae0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:25.872391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:26.006248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2276/4529] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:25 2022] PUT /identity/v3/projects/9e2388073d3841e1b55bac35b6885324/users/9c2aa26bd77e43f88d99ca90ccfcdae0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:26.018187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50874281-68ad-4173-bac7-ed2bc36d0e7d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:26.018741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50874281-68ad-4173-bac7-ed2bc36d0e7d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:26.019085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50874281-68ad-4173-bac7-ed2bc36d0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:26.050501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-50874281-68ad-4173-bac7-ed2bc36d0e7d None None] MFA Rules not processed for user `9c2aa26bd77e43f88d99ca90ccfcdae0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:26.053126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50874281-68ad-4173-bac7-ed2bc36d0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:26.150428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2254/4530] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:26.153949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:26.248254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6849-e67c-4837-861a-4280b61697d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:26.253490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:26.254342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:26.254626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:26.256021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:26.256144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:26.258708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:26.364410 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2277/4531] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:26 2022] POST /identity/v3/projects => generated 411 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:26.369195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50874281-68ad-4173-bac7-ed2bc36d0e7d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:26.391724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50874281-68ad-4173-bac7-ed2bc36d0e7d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:26.457933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:26.521339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:26.522214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:26.522502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:26.522818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:26.525430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:26.528126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:26.653888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2255/4532] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:26 2022] POST /identity/v3/users => generated 312 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:26.657551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:26.674497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ea4b7-4e04-460a-b040-b6d4d53e71f2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:26.683757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:26.684653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:26.685037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:26.685405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:26.686800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:26.690203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:26.711004 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2278/4533] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:26.715781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:26.736496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:26.745686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fc9c9-b189-44af-8a30-8def0c38291e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:26.750916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:26.771042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:26.772300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:26.773610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:26.774844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] PATH_INFO: `/v3/projects/34402cc1305c4e8a853f84583a1daacf/users/ae3c7762c98a4ce3be8eb3e92432be0b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:26.794326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d2e1-d1d8-4568-b77e-9f8935175139 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:26.806825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:26.808775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:26.811382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:26.812496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] PATH_INFO: `/v3/projects/a157c5671ed448d590c22ee730b7c14b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:26.814948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34402cc1305c4e8a853f84583a1daacf, user_id=ae3c7762c98a4ce3be8eb3e92432be0b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:26.815691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a157c5671ed448d590c22ee730b7c14b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:26.819703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:26.824450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:26.956350 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2256/4534] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:26 2022] PUT /identity/v3/projects/34402cc1305c4e8a853f84583a1daacf/users/ae3c7762c98a4ce3be8eb3e92432be0b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:26.960488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:27.013998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a157c5671ed448d590c22ee730b7c14b', 'request_id': 'req-db51f340-508d-4c4c-ba31-a80488a33966'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.034273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a157c5671ed448d590c22ee730b7c14b', 'request_id': 'req-db51f340-508d-4c4c-ba31-a80488a33966'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.111302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ecce5-4e94-418a-9585-a57d4b49e1d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:27.139028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a157c5671ed448d590c22ee730b7c14b', 'request_id': 'req-db51f340-508d-4c4c-ba31-a80488a33966'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.165395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] The token cache is being invalidate because project a157c5671ed448d590c22ee730b7c14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:27.165700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.167203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.171510 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2279/4535] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:26 2022] DELETE /identity/v3/projects/a157c5671ed448d590c22ee730b7c14b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:27.176768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:27.200055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:27.324861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:27.327674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:27.327674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:27.327674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:27.327674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:27.328949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:27.353556 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2257/4536] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:27.356887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:27.362363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:27.384787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51f340-508d-4c4c-ba31-a80488a33966 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:27.394955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:27.400750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf63c54-5875-47fd-be9d-31271989dd28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:27.402288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:27.402715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:27.403022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:27.403299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] PATH_INFO: `/v3/users/df97e7d292a9416aabd9a9a5a195495f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:27.405832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df97e7d292a9416aabd9a9a5a195495f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:27.411341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:27.426171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b308bb0-f6c1-4f6c-88c2-414160eda0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:27.427329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b308bb0-f6c1-4f6c-88c2-414160eda0db admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:27.427840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b308bb0-f6c1-4f6c-88c2-414160eda0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:27.428313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b308bb0-f6c1-4f6c-88c2-414160eda0db admin admin] PATH_INFO: `/v3/projects/34402cc1305c4e8a853f84583a1daacf/users/ae3c7762c98a4ce3be8eb3e92432be0b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:27.436432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b308bb0-f6c1-4f6c-88c2-414160eda0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=34402cc1305c4e8a853f84583a1daacf, user_id=ae3c7762c98a4ce3be8eb3e92432be0b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:27.439567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b308bb0-f6c1-4f6c-88c2-414160eda0db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:27.478020 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2258/4537] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:27 2022] PUT /identity/v3/projects/34402cc1305c4e8a853f84583a1daacf/users/ae3c7762c98a4ce3be8eb3e92432be0b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:27.489319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:27.489778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:27.490182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:27.547714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] MFA Rules not processed for user `ae3c7762c98a4ce3be8eb3e92432be0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:27.549151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:27.682404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df97e7d292a9416aabd9a9a5a195495f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.691323 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2259/4538] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:27 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:42:27.699421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df97e7d292a9416aabd9a9a5a195495f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.700814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df97e7d292a9416aabd9a9a5a195495f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.714416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df97e7d292a9416aabd9a9a5a195495f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.759364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:27.761619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:27.834011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df97e7d292a9416aabd9a9a5a195495f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:27.844066 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2280/4539] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:27 2022] DELETE /identity/v3/users/df97e7d292a9416aabd9a9a5a195495f => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:27.874477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6514b5-f293-4a5b-ab64-8cb9fa0fb2f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:27.937620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:27.967410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c142a3-74eb-484e-8c2c-ded361891a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:27.968271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c142a3-74eb-484e-8c2c-ded361891a93 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:27.968382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c142a3-74eb-484e-8c2c-ded361891a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:27.968588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c142a3-74eb-484e-8c2c-ded361891a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:27.971105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26c142a3-74eb-484e-8c2c-ded361891a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:28.073116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c142a3-74eb-484e-8c2c-ded361891a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:28.073116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c142a3-74eb-484e-8c2c-ded361891a93 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:28.091880 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2260/4540] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:27 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:42:28.916494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:28.978880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:29.217484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:29.555490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:29.557420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:29.717517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1689b0-c487-4bf4-9782-ec6aff7eb769 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:29.732339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:29.733777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:29.734330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:29.737589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] PATH_INFO: `/v3/projects/91e1f000f2834af089c6a92600264a75` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:29.739319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e1f000f2834af089c6a92600264a75)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:29.745607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:29.956020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e1f000f2834af089c6a92600264a75', 'request_id': 'req-5256792a-9980-483a-9c76-1a7b4c5d1f43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:29.975495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e1f000f2834af089c6a92600264a75', 'request_id': 'req-5256792a-9980-483a-9c76-1a7b4c5d1f43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:30.017087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:30.050612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e1f000f2834af089c6a92600264a75', 'request_id': 'req-5256792a-9980-483a-9c76-1a7b4c5d1f43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:30.068752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] The token cache is being invalidate because project 91e1f000f2834af089c6a92600264a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:30.069329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:30.070875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5256792a-9980-483a-9c76-1a7b4c5d1f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:30.074035 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2281/4541] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:29 2022] DELETE /identity/v3/projects/91e1f000f2834af089c6a92600264a75 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:30.079398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4468e-764e-4e8f-91a8-792e4bdd12b7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.079691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4468e-764e-4e8f-91a8-792e4bdd12b7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.079970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4468e-764e-4e8f-91a8-792e4bdd12b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.122905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08b4468e-764e-4e8f-91a8-792e4bdd12b7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:30.124405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08b4468e-764e-4e8f-91a8-792e4bdd12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:30.224305 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2261/4542] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:30.233471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6627de4-690d-4f4e-982e-7e26a1344e2f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.233886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6627de4-690d-4f4e-982e-7e26a1344e2f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.234236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6627de4-690d-4f4e-982e-7e26a1344e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.258601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a6627de4-690d-4f4e-982e-7e26a1344e2f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:30.260125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6627de4-690d-4f4e-982e-7e26a1344e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:30.272467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:30.283700 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2282/4543] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:30.294545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4468e-764e-4e8f-91a8-792e4bdd12b7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:30.309450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4468e-764e-4e8f-91a8-792e4bdd12b7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:30.324384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:30.328281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.328281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.328281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.328281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:30.328281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:30.334764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:30.352927 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2262/4544] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:30.357574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6627de4-690d-4f4e-982e-7e26a1344e2f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:30.378460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6627de4-690d-4f4e-982e-7e26a1344e2f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:30.393762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:30.397617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.397617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.397617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.397617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:30.401353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:30.505288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2283/4545] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:30 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:30.506414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:30.551208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0f71-568e-43ea-87cc-577a547df261 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:30.657202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:30.658260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.658732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.659024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.659739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:30.662126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:30.797532 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2263/4546] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:30 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:42:30.802014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:30.818008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240bf81-519b-4d54-b444-d25b8ff16756 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:30.827796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:30.828436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.828717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.829000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.829946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:30.831685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:30.846277 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2284/4547] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:30.853196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:30.880203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf153-da32-4e74-a4c1-d5915c2bfa28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:30.887223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ae155-c9db-4cc5-8e9e-c2048fa52544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:30.887865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ae155-c9db-4cc5-8e9e-c2048fa52544 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.888152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ae155-c9db-4cc5-8e9e-c2048fa52544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.888434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ae155-c9db-4cc5-8e9e-c2048fa52544 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.889189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ae155-c9db-4cc5-8e9e-c2048fa52544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:30.897700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ae155-c9db-4cc5-8e9e-c2048fa52544 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:30.919051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:30.919955 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2264/4548] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:30.935913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d946-3225-4ef2-8a97-d0014a5d1329 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:30.949216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:30.951790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:30.952205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:30.959607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] PATH_INFO: `/v3/projects/4b1125779ec1410a9c732e26473be4d3/users/74035c297a274fbdbc0b51d2e33b6fba/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:30.981744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1125779ec1410a9c732e26473be4d3, user_id=74035c297a274fbdbc0b51d2e33b6fba, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:30.985283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:31.074646 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2285/4549] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:30 2022] PUT /identity/v3/projects/4b1125779ec1410a9c732e26473be4d3/users/74035c297a274fbdbc0b51d2e33b6fba/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:31.084606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:31.085447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:31.086115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:31.116344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:31.119784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:31.262479 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2265/4550] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:31.299849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:31.302631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:31.419592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449dc74-ed0f-4ca3-8921-5b907162d317 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:31.426083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71e22-5543-4849-95a7-2c3e28b9d122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:31.427084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71e22-5543-4849-95a7-2c3e28b9d122 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:31.427534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71e22-5543-4849-95a7-2c3e28b9d122 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:31.427948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71e22-5543-4849-95a7-2c3e28b9d122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:31.444169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71e22-5543-4849-95a7-2c3e28b9d122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:31.446917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71e22-5543-4849-95a7-2c3e28b9d122 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:31.461848 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2286/4551] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:31.680528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:31.965402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:32.091810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:32.091810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:32.122163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef29e2-0dc7-469f-a9d6-a50e92c71fba None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:32.142914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:32.144123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:32.144417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:32.144701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] PATH_INFO: `/v3/users/d11c68a0dd7e4f5b8010efd50a906a42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:32.150744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11c68a0dd7e4f5b8010efd50a906a42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:32.153618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:32.436679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11c68a0dd7e4f5b8010efd50a906a42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:32.445100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11c68a0dd7e4f5b8010efd50a906a42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:32.531461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11c68a0dd7e4f5b8010efd50a906a42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:32.533051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11c68a0dd7e4f5b8010efd50a906a42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:32.546305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11c68a0dd7e4f5b8010efd50a906a42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:32.619484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2266/4552] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:32 2022] DELETE /identity/v3/users/d11c68a0dd7e4f5b8010efd50a906a42 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:32.624333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:32.624834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:32.626962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:32.677892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:32.679163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:32.866390 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2287/4553] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:32.952502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:32.953986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:33.084879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d66d-0e96-4afa-8fbd-e6c043346bea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:33.089782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:33.090754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:33.091375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:33.091806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:33.107772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:33.109344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:33.124830 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2267/4554] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:33.428518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:33.514289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:34.485335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:35.296994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:35.385701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:35.788201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:35.792298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:35.816894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc07a-b4ea-4c56-97c8-e59737738ef2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:35.834915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:35.835586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:35.835872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:35.836176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] PATH_INFO: `/v3/projects/d04a029c3b6b4aaeb1070405cd1e7ee0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:35.838075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04a029c3b6b4aaeb1070405cd1e7ee0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:35.840502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:36.014190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04a029c3b6b4aaeb1070405cd1e7ee0', 'request_id': 'req-70c63d70-e09a-49d3-8291-c1f6d8298dc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.023082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04a029c3b6b4aaeb1070405cd1e7ee0', 'request_id': 'req-70c63d70-e09a-49d3-8291-c1f6d8298dc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.077428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:36.079919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:36.099776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41721f2-c542-4711-9f8c-11021d676380 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:36.103466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04a029c3b6b4aaeb1070405cd1e7ee0', 'request_id': 'req-70c63d70-e09a-49d3-8291-c1f6d8298dc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.118653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] The token cache is being invalidate because project d04a029c3b6b4aaeb1070405cd1e7ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:36.119274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.120132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-70c63d70-e09a-49d3-8291-c1f6d8298dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.123140 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2288/4555] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:35 2022] DELETE /identity/v3/projects/d04a029c3b6b4aaeb1070405cd1e7ee0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:36.141805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee6e7f-4d9a-4e14-b0f7-061f506def89 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:36.142599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee6e7f-4d9a-4e14-b0f7-061f506def89 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:36.143081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee6e7f-4d9a-4e14-b0f7-061f506def89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:36.177967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6fee6e7f-4d9a-4e14-b0f7-061f506def89 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:36.180796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6fee6e7f-4d9a-4e14-b0f7-061f506def89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:36.248074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:36.250844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:36.251725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:36.252231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] PATH_INFO: `/v3/users/f278334f3cd646a89ec99502f0bfe636` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:36.254456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f278334f3cd646a89ec99502f0bfe636)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:36.256831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:36.288868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2289/4556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:36.299287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39320b-03cb-463d-913a-22d80d905c23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:36.299969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39320b-03cb-463d-913a-22d80d905c23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:36.299969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39320b-03cb-463d-913a-22d80d905c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:36.338989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7e39320b-03cb-463d-913a-22d80d905c23 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:36.341178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e39320b-03cb-463d-913a-22d80d905c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:36.353644 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2290/4557] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:36.370549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39320b-03cb-463d-913a-22d80d905c23 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:36.396217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39320b-03cb-463d-913a-22d80d905c23 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:36.403144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cc41c-1d0f-4043-bc36-feb4a633e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:36.404105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc41c-1d0f-4043-bc36-feb4a633e6ae admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:36.404694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc41c-1d0f-4043-bc36-feb4a633e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:36.405351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc41c-1d0f-4043-bc36-feb4a633e6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:36.406588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cc41c-1d0f-4043-bc36-feb4a633e6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:36.407036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cc41c-1d0f-4043-bc36-feb4a633e6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:36.412934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cc41c-1d0f-4043-bc36-feb4a633e6ae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:36.436987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f278334f3cd646a89ec99502f0bfe636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.441325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:36.446802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f278334f3cd646a89ec99502f0bfe636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.456893 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2291/4558] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:36.458427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:36.458866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:36.461419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:36.509536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] MFA Rules not processed for user `74035c297a274fbdbc0b51d2e33b6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:36.513141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:36.549379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f278334f3cd646a89ec99502f0bfe636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.549929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f278334f3cd646a89ec99502f0bfe636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.563076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f278334f3cd646a89ec99502f0bfe636'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:36.607192 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2292/4559] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:36.607192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:36.610934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:36.611742 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2268/4560] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:36 2022] DELETE /identity/v3/users/f278334f3cd646a89ec99502f0bfe636 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:36.612576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:36.613941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:36.652255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:36.655779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e5a61-cd5c-4ae7-aa8c-bacccd43261c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:36.721422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bb8b4-4a32-4af5-b5ac-14e6e7d2b72d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:36.728640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:36.729439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:36.729726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:36.729999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:36.730699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:36.734180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:36.739472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:36.740685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:36.741155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:36.741609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:36.743092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:36.746380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:36.824769 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2269/4561] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:36 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:36.830174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:36.854163 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2293/4562] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:36 2022] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:36.856091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:36.882662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:36.968747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a47c5f-375a-452e-b694-67e9370f340c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.050088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827a7a9-6459-4e26-92af-efb3e3ca6bb4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.063567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.063567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.063567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.063567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.075043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.084961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.088101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.088751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.089036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.089465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.090150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.092121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.183641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2294/4563] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:36 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:37.183641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.186682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:37.205930 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2270/4564] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:36 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:37.206775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.220351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b075e4-4428-4061-9537-4ad2fc3723f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.226026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.227540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.227996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.228582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.229741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.231108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1162a-173d-4723-a3bf-f6b56fecd35f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.238377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.244255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.244927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.245226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.249842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] PATH_INFO: `/v3/users/9c2aa26bd77e43f88d99ca90ccfcdae0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.251504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2aa26bd77e43f88d99ca90ccfcdae0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.253989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.259035 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2271/4565] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:37.270333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.290338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aad885-1385-4d39-af7b-29af55037645 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.290338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.290338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.290338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.290865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.304484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.307317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.319938 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2272/4566] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:37.321158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.331717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1ce0e-07c3-478b-b526-14e30601dab4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.337631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.338630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.339320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.339738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.340528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.342446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.354845 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2273/4567] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:37.356683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.381004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d23b9b-b609-489d-aafd-7b1941d22542 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.387103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.387984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.388408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.388823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] PATH_INFO: `/v3/projects/d92350ca17dc4da5b7d539a17d6983b3/users/c9e18942207c44d49cbdaa94ddd763b5/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.410154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92350ca17dc4da5b7d539a17d6983b3, user_id=c9e18942207c44d49cbdaa94ddd763b5, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.414619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.489677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2aa26bd77e43f88d99ca90ccfcdae0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:37.495459 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2274/4568] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:37 2022] PUT /identity/v3/projects/d92350ca17dc4da5b7d539a17d6983b3/users/c9e18942207c44d49cbdaa94ddd763b5/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:37.497752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.499521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2aa26bd77e43f88d99ca90ccfcdae0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:37.500295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2aa26bd77e43f88d99ca90ccfcdae0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:37.537700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2aa26bd77e43f88d99ca90ccfcdae0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:37.586648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b909b-1bd1-4693-8ab1-6f77362e8db5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.592299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.598580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.598580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.598580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] PATH_INFO: `/v3/projects/ae249afdcf6d4cf18d42abb8c1baaa5a/users/2f9b535d9e7d4a32947d3201fd04ad22/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.610506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae249afdcf6d4cf18d42abb8c1baaa5a, user_id=2f9b535d9e7d4a32947d3201fd04ad22, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.613384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.627446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2aa26bd77e43f88d99ca90ccfcdae0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:37.634844 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2295/4569] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:37 2022] DELETE /identity/v3/users/9c2aa26bd77e43f88d99ca90ccfcdae0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:37.635686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.637681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:37.718288 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2275/4570] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:37 2022] PUT /identity/v3/projects/ae249afdcf6d4cf18d42abb8c1baaa5a/users/2f9b535d9e7d4a32947d3201fd04ad22/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:37.729434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:37.733286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:37.776352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62be737-b0cc-4797-a8fe-05d7c9d8698f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.782774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:37.904510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cca7c-b1cc-48d1-809c-15820153a358 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:37.911247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.912413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.912869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.913307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] PATH_INFO: `/v3/projects/fc7d921cf98c41e092f10fda507c0624` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.915812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7d921cf98c41e092f10fda507c0624)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.930946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.937455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c86b4-2946-4519-8ccf-c516e75ec148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:37.938574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c86b4-2946-4519-8ccf-c516e75ec148 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.938868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c86b4-2946-4519-8ccf-c516e75ec148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.939675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c86b4-2946-4519-8ccf-c516e75ec148 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.940342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c86b4-2946-4519-8ccf-c516e75ec148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:37.948082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c86b4-2946-4519-8ccf-c516e75ec148 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:37.977703 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2296/4571] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:37.983057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177db9-73f8-40f4-b046-f5d914ca44d8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:37.983673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177db9-73f8-40f4-b046-f5d914ca44d8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:37.984128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177db9-73f8-40f4-b046-f5d914ca44d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:37.988144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:38.021505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-40177db9-73f8-40f4-b046-f5d914ca44d8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:38.022911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40177db9-73f8-40f4-b046-f5d914ca44d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.037175 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2297/4572] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:38.037175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:38.037175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:38.037175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:38.071495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7d921cf98c41e092f10fda507c0624', 'request_id': 'req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:38.081712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7d921cf98c41e092f10fda507c0624', 'request_id': 'req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:38.112539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] MFA Rules not processed for user `2f9b535d9e7d4a32947d3201fd04ad22`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:38.113792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.186286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7d921cf98c41e092f10fda507c0624', 'request_id': 'req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:38.208670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] The token cache is being invalidate because project fc7d921cf98c41e092f10fda507c0624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:38.209826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:38.211489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:38.214519 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2276/4573] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:37 2022] DELETE /identity/v3/projects/fc7d921cf98c41e092f10fda507c0624 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:38.217192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:38.247565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.299237 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2298/4574] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:38.319928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:38.329857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.444058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ebf5-62e3-4220-87ef-486838ed1d1a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:38.464619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52255524-e8ad-4a86-8820-ae2d16c53571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:38.465751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52255524-e8ad-4a86-8820-ae2d16c53571 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:38.466444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52255524-e8ad-4a86-8820-ae2d16c53571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:38.466914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52255524-e8ad-4a86-8820-ae2d16c53571 admin admin] PATH_INFO: `/v3/projects/d92350ca17dc4da5b7d539a17d6983b3/users/c9e18942207c44d49cbdaa94ddd763b5/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:38.474493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52255524-e8ad-4a86-8820-ae2d16c53571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92350ca17dc4da5b7d539a17d6983b3, user_id=c9e18942207c44d49cbdaa94ddd763b5, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:38.479150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d9bfe-6f8c-4968-beea-e63bc64d1add None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:38.482888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52255524-e8ad-4a86-8820-ae2d16c53571 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:38.484732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:38.487134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:38.487526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:38.488524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:38.490910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.531085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:38.531691 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2277/4575] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:38 2022] PUT /identity/v3/projects/d92350ca17dc4da5b7d539a17d6983b3/users/c9e18942207c44d49cbdaa94ddd763b5/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:38.531960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:38.533328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81bbe-7146-4e30-95d6-4c98c9a504bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:38.533759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81bbe-7146-4e30-95d6-4c98c9a504bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:38.534361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d81bbe-7146-4e30-95d6-4c98c9a504bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:38.556231 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2299/4576] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:38.557315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:38.558949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.598609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-67d81bbe-7146-4e30-95d6-4c98c9a504bf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:38.599913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67d81bbe-7146-4e30-95d6-4c98c9a504bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.755935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b719c-d314-46a2-8083-5f0aba9293da service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:38.761418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2278/4577] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:38.773878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47bdd0-0d51-4f7b-8480-5accb6bbb99c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:38.773878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47bdd0-0d51-4f7b-8480-5accb6bbb99c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:38.774201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47bdd0-0d51-4f7b-8480-5accb6bbb99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:38.833929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6f47bdd0-0d51-4f7b-8480-5accb6bbb99c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:38.835231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f47bdd0-0d51-4f7b-8480-5accb6bbb99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:38.868208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2279/4578] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:38.869206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47bdd0-0d51-4f7b-8480-5accb6bbb99c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:38.894048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47bdd0-0d51-4f7b-8480-5accb6bbb99c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:38.907276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:38.907912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:38.908192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:38.908464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:38.909123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:38.912253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:38.919187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:38.924981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:38.951487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2280/4579] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:38.957156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:38.958317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:38.958317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:38.958617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:38.960051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:39.002594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a3ca2-59f7-4b8c-9b2b-11b37e4fd0e5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:39.017595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:39.019608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:39.019996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:39.020399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:39.021142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:39.023324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:39.152845 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2281/4580] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:38 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:39.157479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:39.165344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:39.167202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:39.197794 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2300/4581] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:39.339845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:39.372762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d9ae0-818d-414d-a837-ee658ffac9f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:39.377844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:39.378449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:39.378796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:39.379126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:39.380099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:39.384125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:39.538843 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2282/4582] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:39 2022] POST /identity/v3/users => generated 287 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:39.543966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:39.572959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cd1eb-c510-4de8-a243-45e7c65944b3 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:39.592135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:39.603134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:39.603134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:39.603134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:39.603134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:39.603134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:39.623934 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2301/4583] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:39.627344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:39.641277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e99791-13ab-4df9-96f1-01f368560b3a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:39.647380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:39.648165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:39.648725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:39.649303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:39.650191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:39.656588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:39.674175 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2283/4584] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:39.675217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:39.696322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357177fd-5fa0-4eee-bf87-8879606e557b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:39.708001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d263e0-3e89-4f65-93c7-0233d07d7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:39.709410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d263e0-3e89-4f65-93c7-0233d07d7cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:39.710664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d263e0-3e89-4f65-93c7-0233d07d7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:39.711199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d263e0-3e89-4f65-93c7-0233d07d7cf2 admin admin] PATH_INFO: `/v3/projects/ca6bb7ad775b425fa91bbb81597c2fb0/users/6524b3e0315b48f59a53d7ca47575675/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:39.735980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d263e0-3e89-4f65-93c7-0233d07d7cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6bb7ad775b425fa91bbb81597c2fb0, user_id=6524b3e0315b48f59a53d7ca47575675, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:39.740785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d263e0-3e89-4f65-93c7-0233d07d7cf2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:39.824169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:39.826477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:39.853133 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2302/4585] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:39 2022] PUT /identity/v3/projects/ca6bb7ad775b425fa91bbb81597c2fb0/users/6524b3e0315b48f59a53d7ca47575675/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:39.866473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0c1d-456e-408a-8e68-5bb79a91de59 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:39.867167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0c1d-456e-408a-8e68-5bb79a91de59 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:39.867678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0c1d-456e-408a-8e68-5bb79a91de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:39.873941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbc512-2123-42ce-be20-704cff033fc5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:39.950750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-945e0c1d-456e-408a-8e68-5bb79a91de59 None None] MFA Rules not processed for user `6524b3e0315b48f59a53d7ca47575675`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:39.953877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-945e0c1d-456e-408a-8e68-5bb79a91de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:39.994359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:39.995016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:39.995540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:39.995674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] PATH_INFO: `/v3/projects/9e2388073d3841e1b55bac35b6885324` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:39.997064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2388073d3841e1b55bac35b6885324)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:40.000445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:40.067234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:40.115658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2303/4586] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:40.127347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:40.127705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:40.128520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:40.192219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] MFA Rules not processed for user `6524b3e0315b48f59a53d7ca47575675`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:40.198788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:40.214680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2388073d3841e1b55bac35b6885324', 'request_id': 'req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.225537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2388073d3841e1b55bac35b6885324', 'request_id': 'req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.301908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2388073d3841e1b55bac35b6885324', 'request_id': 'req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.321054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] The token cache is being invalidate because project 9e2388073d3841e1b55bac35b6885324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:40.321054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.322779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.325698 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2284/4587] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:39 2022] DELETE /identity/v3/projects/9e2388073d3841e1b55bac35b6885324 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:40.330821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:40.332444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:40.406848 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2304/4588] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:40.496654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c018f9a-326c-4a7f-aa86-1a1b8aa71876 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:40.511178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:40.511178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:40.511799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:40.512254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] PATH_INFO: `/v3/users/ae3c7762c98a4ce3be8eb3e92432be0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:40.515310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3c7762c98a4ce3be8eb3e92432be0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:40.518490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:40.520606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:40.530232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:40.775660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78eacd5-8b2e-432a-ba21-0dfd343f4262 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:40.800447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f9512-04eb-4e3c-8fbc-9e601e254842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:40.801098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f9512-04eb-4e3c-8fbc-9e601e254842 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:40.801382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f9512-04eb-4e3c-8fbc-9e601e254842 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:40.801661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f9512-04eb-4e3c-8fbc-9e601e254842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:40.811140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-989f9512-04eb-4e3c-8fbc-9e601e254842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:40.844621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3c7762c98a4ce3be8eb3e92432be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.846640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3c7762c98a4ce3be8eb3e92432be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.849334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f9512-04eb-4e3c-8fbc-9e601e254842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:40.853027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f9512-04eb-4e3c-8fbc-9e601e254842 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:40.879684 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2305/4589] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:42:40.976645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3c7762c98a4ce3be8eb3e92432be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:40.977527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3c7762c98a4ce3be8eb3e92432be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:41.008795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3c7762c98a4ce3be8eb3e92432be0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:41.053066 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2285/4590] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:40 2022] DELETE /identity/v3/users/ae3c7762c98a4ce3be8eb3e92432be0b => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:41.154397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:41.362697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:41.363039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:41.363323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:41.467282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] MFA Rules not processed for user `725680d81f6f43679703425651a3e207`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:41.468730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:41.676363 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2306/4591] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:41.702228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:41.702228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:41.815452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:41.852301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aa80e-58d0-4ebb-af04-8408b3c90c36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:41.856982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1a43d-43fa-4611-a532-05505cd65d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:41.857981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a43d-43fa-4611-a532-05505cd65d6f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:41.858470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a43d-43fa-4611-a532-05505cd65d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:41.859002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a43d-43fa-4611-a532-05505cd65d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:41.872165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a43d-43fa-4611-a532-05505cd65d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:41.873898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a43d-43fa-4611-a532-05505cd65d6f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:41.885118 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2286/4592] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:42.467953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:42.590618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:42.592346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:42.656536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:42.732631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1effc83-93de-460a-a369-05f6a50554fd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:42.739106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:42.740137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:42.744431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:42.744431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] PATH_INFO: `/v3/projects/34402cc1305c4e8a853f84583a1daacf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:42.744431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34402cc1305c4e8a853f84583a1daacf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:42.754795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:42.944183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34402cc1305c4e8a853f84583a1daacf', 'request_id': 'req-ba762d3a-e759-46ab-b40d-21f291be21a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:42.953802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34402cc1305c4e8a853f84583a1daacf', 'request_id': 'req-ba762d3a-e759-46ab-b40d-21f291be21a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:43.055843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34402cc1305c4e8a853f84583a1daacf', 'request_id': 'req-ba762d3a-e759-46ab-b40d-21f291be21a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:43.074147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf5fa-84e7-4202-9eaf-8020c0a7fb7a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.075567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf5fa-84e7-4202-9eaf-8020c0a7fb7a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.076089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf5fa-84e7-4202-9eaf-8020c0a7fb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.096550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] The token cache is being invalidate because project 34402cc1305c4e8a853f84583a1daacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:43.096855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:43.098404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ba762d3a-e759-46ab-b40d-21f291be21a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:43.103387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2307/4593] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:42 2022] DELETE /identity/v3/projects/34402cc1305c4e8a853f84583a1daacf => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:43.105239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7b81-c443-40f3-9879-aef3c7673228 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.106660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7b81-c443-40f3-9879-aef3c7673228 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.106660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7b81-c443-40f3-9879-aef3c7673228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.129849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-daaf7b81-c443-40f3-9879-aef3c7673228 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:43.133324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-daaf7b81-c443-40f3-9879-aef3c7673228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:43.162311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2eadf5fa-84e7-4202-9eaf-8020c0a7fb7a None None] MFA Rules not processed for user `c9e18942207c44d49cbdaa94ddd763b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:43.180269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2eadf5fa-84e7-4202-9eaf-8020c0a7fb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:43.279911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2308/4594] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:43.287659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2c4d-1a43-4973-8c73-ed56c0bf59e6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.288170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2c4d-1a43-4973-8c73-ed56c0bf59e6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.288524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2c4d-1a43-4973-8c73-ed56c0bf59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.360331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-047d2c4d-1a43-4973-8c73-ed56c0bf59e6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:43.363989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-047d2c4d-1a43-4973-8c73-ed56c0bf59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:43.372829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2287/4595] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:43.385771 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2309/4596] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:42:43.389771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cba24-042a-4a34-a941-5dc022328809 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.389771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cba24-042a-4a34-a941-5dc022328809 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.389771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cba24-042a-4a34-a941-5dc022328809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.391614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2c4d-1a43-4973-8c73-ed56c0bf59e6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:43.410710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2c4d-1a43-4973-8c73-ed56c0bf59e6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:43.423192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:43.423970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.424352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.424729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.430896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:43.431254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:43.433003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:43.456088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-208cba24-042a-4a34-a941-5dc022328809 None None] MFA Rules not processed for user `74035c297a274fbdbc0b51d2e33b6fba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:43.457354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-208cba24-042a-4a34-a941-5dc022328809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:43.490751 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2310/4597] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:43.504283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:43.528565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82657-5540-47a2-875c-80899a068cd6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:43.546869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:43.547900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.548407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.548886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.549744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:43.551948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:43.587864 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2288/4598] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:43.614406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cba24-042a-4a34-a941-5dc022328809 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:43.615900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-208cba24-042a-4a34-a941-5dc022328809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:43.701036 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2311/4599] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:43 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:43.720987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:43.790610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cba24-042a-4a34-a941-5dc022328809 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:43.919597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd042-fd5c-4654-88cb-c4e7c89111b4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:43.926595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:43.927571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.930866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.931511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.932636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:43.934968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:43.938032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:43.938762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:43.939132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:43.939314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:43.944875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:44.089123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:44.090803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:44.113634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2289/4600] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:44.116402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:44.124082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2312/4601] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:43 2022] POST /identity/v3/users => generated 284 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:44.131078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:44.148853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c414-4041-40bd-93a9-1a468d733df7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:44.165466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:44.166618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:44.167049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:44.167605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:44.168413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:44.172017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:44.190420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2290/4602] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:44.194303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:44.212684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20ef5-fffd-45f6-9788-453586a8f44c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:44.252656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c55e5-e988-42fe-b36a-a328d39bf54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:44.253578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c55e5-e988-42fe-b36a-a328d39bf54d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:44.254453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c55e5-e988-42fe-b36a-a328d39bf54d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:44.254831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c55e5-e988-42fe-b36a-a328d39bf54d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:44.258154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c55e5-e988-42fe-b36a-a328d39bf54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:44.262199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c55e5-e988-42fe-b36a-a328d39bf54d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:44.277381 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2313/4603] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:44.281589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:44.295822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc1aa-471e-4399-847e-11917bc0367f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:44.301978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:44.302997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:44.303664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:44.304080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] PATH_INFO: `/v3/projects/e73278571a3542a89d824f5f18c3d7a7/users/f20d28e1e4264d75b08873c0a652be40/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:44.329902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73278571a3542a89d824f5f18c3d7a7, user_id=f20d28e1e4264d75b08873c0a652be40, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:44.334771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:44.419232 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2291/4604] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:44 2022] PUT /identity/v3/projects/e73278571a3542a89d824f5f18c3d7a7/users/f20d28e1e4264d75b08873c0a652be40/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:44.430224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae9f2f-0428-415a-9b40-ac6dad1da412 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:44.435706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae9f2f-0428-415a-9b40-ac6dad1da412 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:44.437227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae9f2f-0428-415a-9b40-ac6dad1da412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:44.537702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2aae9f2f-0428-415a-9b40-ac6dad1da412 None None] MFA Rules not processed for user `f20d28e1e4264d75b08873c0a652be40`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:44.539207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2aae9f2f-0428-415a-9b40-ac6dad1da412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:44.724752 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2314/4605] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:44.734973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:44.845772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:44.921625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f602e5-a4eb-4553-8b27-33466e09b335 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:44.940352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:44.942314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:44.946812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:44.946812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:44.946812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:44.948671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:44.967482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:45.068171 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2292/4606] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:44 2022] POST /identity/v3/projects => generated 369 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:45.072855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae9f2f-0428-415a-9b40-ac6dad1da412 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:45.088417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae9f2f-0428-415a-9b40-ac6dad1da412 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:45.236925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:45.239463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:45.239865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:45.240521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:45.242925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:45.249065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:45.332610 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2315/4607] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:45 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:45.340271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:45.358448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8772ab-356d-476f-acee-1d3a0cd59c3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:45.369399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:45.370827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:45.372533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:45.372999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:45.373881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:45.376761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:45.416221 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2293/4608] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:45.416426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:45.430989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556ee62-0b7a-4424-9697-92b4106327cd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:45.441842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:45.442574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:45.443385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:45.443385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] PATH_INFO: `/v3/projects/f02c7c700c1a477b8074ee8f6815fdd6/users/83c1091569d44978b719e85a78998aef/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:45.483313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02c7c700c1a477b8074ee8f6815fdd6, user_id=83c1091569d44978b719e85a78998aef, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:45.486729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:45.563700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:45.564643 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2316/4609] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:45 2022] PUT /identity/v3/projects/f02c7c700c1a477b8074ee8f6815fdd6/users/83c1091569d44978b719e85a78998aef/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:45.577846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef692-dcff-44f1-9a4c-be72278a769a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:45.691169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778441c-22a9-4e79-8ae6-6cc5075bdb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:45.692142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778441c-22a9-4e79-8ae6-6cc5075bdb0f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:45.692566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778441c-22a9-4e79-8ae6-6cc5075bdb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:45.692981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778441c-22a9-4e79-8ae6-6cc5075bdb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:45.693831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778441c-22a9-4e79-8ae6-6cc5075bdb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:45.696714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778441c-22a9-4e79-8ae6-6cc5075bdb0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:45.710045 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2294/4610] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:45.713460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:45.725786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e6ff-bfb1-4bfa-8b39-6735c563153d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:45.742909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:45.743608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:45.743896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:45.744182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] PATH_INFO: `/v3/projects/f02c7c700c1a477b8074ee8f6815fdd6/users/83c1091569d44978b719e85a78998aef/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:45.762288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02c7c700c1a477b8074ee8f6815fdd6, user_id=83c1091569d44978b719e85a78998aef, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:45.773578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:45.829096 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2317/4611] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:45 2022] PUT /identity/v3/projects/f02c7c700c1a477b8074ee8f6815fdd6/users/83c1091569d44978b719e85a78998aef/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:45.842367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:45.842707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:45.843003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:45.953244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] MFA Rules not processed for user `83c1091569d44978b719e85a78998aef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:45.962376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:46.183312 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2295/4612] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:46.215585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:46.217730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:46.325455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635792a-5b64-476f-925d-402a20356e5a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:46.334869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66948ab-3e5d-4ad4-8341-706f90c7a97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:46.335509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66948ab-3e5d-4ad4-8341-706f90c7a97e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:46.335918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66948ab-3e5d-4ad4-8341-706f90c7a97e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:46.336199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66948ab-3e5d-4ad4-8341-706f90c7a97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:46.365832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66948ab-3e5d-4ad4-8341-706f90c7a97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:46.365832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66948ab-3e5d-4ad4-8341-706f90c7a97e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:46.385740 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2318/4613] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:46.428003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:46.685495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:48.342358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:48.671356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:48.671356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:48.784004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:48.793917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8a6bf-defa-452d-b944-63fa35001a05 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:48.799384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:48.800400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:48.800762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:48.801112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] PATH_INFO: `/v3/users/2f9b535d9e7d4a32947d3201fd04ad22` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:48.802549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9b535d9e7d4a32947d3201fd04ad22)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:48.804837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:49.137043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9b535d9e7d4a32947d3201fd04ad22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:49.138135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9b535d9e7d4a32947d3201fd04ad22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:49.213434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9b535d9e7d4a32947d3201fd04ad22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:49.214799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9b535d9e7d4a32947d3201fd04ad22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:49.233496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9b535d9e7d4a32947d3201fd04ad22'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:49.295261 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2296/4614] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:48 2022] DELETE /identity/v3/users/2f9b535d9e7d4a32947d3201fd04ad22 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:49.297344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed9b6-3d21-438f-b4dd-0129355470d7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:49.298177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed9b6-3d21-438f-b4dd-0129355470d7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:49.298615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed9b6-3d21-438f-b4dd-0129355470d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:49.353090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-918ed9b6-3d21-438f-b4dd-0129355470d7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:49.354370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-918ed9b6-3d21-438f-b4dd-0129355470d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:49.520448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2319/4615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:49.528537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:49.530659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:49.685145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672690f-8da2-4c2b-8448-8b9e23050e7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:49.691792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:49.694623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:49.694924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:49.695714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:49.740084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:49.751697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:49.788257 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2297/4616] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:49.864623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:50.767561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98dc6d-6eb7-4d80-87f0-b54c64943334 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:50.768096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98dc6d-6eb7-4d80-87f0-b54c64943334 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:50.768192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98dc6d-6eb7-4d80-87f0-b54c64943334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:50.803878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1d98dc6d-6eb7-4d80-87f0-b54c64943334 None None] MFA Rules not processed for user `725680d81f6f43679703425651a3e207`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:50.805506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d98dc6d-6eb7-4d80-87f0-b54c64943334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:50.950624 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2320/4617] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:51.428297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:51.432922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:51.465331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c653722-c15b-4a58-9953-bd77f0c4cf1f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:51.475461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:51.477612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:51.478822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:51.479232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] PATH_INFO: `/v3/projects/ae249afdcf6d4cf18d42abb8c1baaa5a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:51.481049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae249afdcf6d4cf18d42abb8c1baaa5a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:51.484378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:51.620447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae249afdcf6d4cf18d42abb8c1baaa5a', 'request_id': 'req-6feef261-dae9-4df3-a124-76a54b133f45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:51.633126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae249afdcf6d4cf18d42abb8c1baaa5a', 'request_id': 'req-6feef261-dae9-4df3-a124-76a54b133f45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:51.719948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae249afdcf6d4cf18d42abb8c1baaa5a', 'request_id': 'req-6feef261-dae9-4df3-a124-76a54b133f45'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:51.741584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] The token cache is being invalidate because project ae249afdcf6d4cf18d42abb8c1baaa5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:51.742520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:51.743424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6feef261-dae9-4df3-a124-76a54b133f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:51.748832 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2298/4618] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:51 2022] DELETE /identity/v3/projects/ae249afdcf6d4cf18d42abb8c1baaa5a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:51.753204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:51.753500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:51.753779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:51.787470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:51.790427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:51.871864 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2321/4619] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:42:51.879608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520519d-7645-4924-906b-58bac32a0561 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:51.879966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520519d-7645-4924-906b-58bac32a0561 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:51.880320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520519d-7645-4924-906b-58bac32a0561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:51.921575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:51.923482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:51.932442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9520519d-7645-4924-906b-58bac32a0561 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:51.934358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9520519d-7645-4924-906b-58bac32a0561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:51.935019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:51.940527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7536-616d-46f1-a1f7-464fb9e42916 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:51.947760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:51.949131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2299/4620] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:51.949241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:51.949241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:51.949782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] PATH_INFO: `/v3/users/f20d28e1e4264d75b08873c0a652be40` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:51.951911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20d28e1e4264d75b08873c0a652be40)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:51.954190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:51.954831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520519d-7645-4924-906b-58bac32a0561 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:51.998328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520519d-7645-4924-906b-58bac32a0561 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:52.005859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:52.009767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.009767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.009767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.010401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:52.010747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:52.019629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:52.041300 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2300/4621] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:52.045326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:52.078034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa998275-3fa2-438e-a36d-f29cd4f08213 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:52.092744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:52.095974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.099066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.099066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.099066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:52.103836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:52.197005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20d28e1e4264d75b08873c0a652be40'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:52.216008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20d28e1e4264d75b08873c0a652be40'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:52.217024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20d28e1e4264d75b08873c0a652be40'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:52.246575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20d28e1e4264d75b08873c0a652be40'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:52.278563 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2301/4622] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:52 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:42:52.290288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:52.292460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:52.336423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9bd46ead-2759-49db-93ba-ce6f6ee153ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20d28e1e4264d75b08873c0a652be40'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:52.344504 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2322/4623] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:51 2022] DELETE /identity/v3/users/f20d28e1e4264d75b08873c0a652be40 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:52.350379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c375-2c65-4504-9d6e-70008dbf5fdd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.351086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c375-2c65-4504-9d6e-70008dbf5fdd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.351535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703c375-2c65-4504-9d6e-70008dbf5fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.383848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:52.392203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d703c375-2c65-4504-9d6e-70008dbf5fdd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:52.393443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d703c375-2c65-4504-9d6e-70008dbf5fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:52.474974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55067b-01d1-475d-8b18-cff22e1898fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:52.547815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:52.548655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.549084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.549459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.551062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:52.553625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:52.610029 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2323/4624] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:42:52.671976 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2302/4625] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:52 2022] POST /identity/v3/users => generated 284 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:52.676510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703c375-2c65-4504-9d6e-70008dbf5fdd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:52.687783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:52.691476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:52.700675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703c375-2c65-4504-9d6e-70008dbf5fdd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:52.750645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:52.752995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.754118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.754483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.755625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:52.765619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:52.806103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2324/4626] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:52.807116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:52.856448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4ee10-022c-4a5b-87d7-0cc7a98777df admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:52.880204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:52.880864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.881152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.881430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.885711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:52.888062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:52.910889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03ec1d-ced2-4d13-8401-77e9f718068a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:52.935636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199baf17-2993-4cdd-ac18-b968f5d897c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:52.936361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baf17-2993-4cdd-ac18-b968f5d897c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.936694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baf17-2993-4cdd-ac18-b968f5d897c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.941812 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2325/4627] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:52.946575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:52.957160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baf17-2993-4cdd-ac18-b968f5d897c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.973686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737593c4-7354-4b22-b003-7941504b50dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:52.983111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:52.983805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:52.984092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:52.984374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] PATH_INFO: `/v3/projects/577fc9c75f4f4041be8b80cd77c9aee3/users/fc5360b1bf944dedb99694f87d953e2e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:52.987192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199baf17-2993-4cdd-ac18-b968f5d897c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:52.991311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199baf17-2993-4cdd-ac18-b968f5d897c9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:53.029327 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2303/4628] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:53.029497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577fc9c75f4f4041be8b80cd77c9aee3, user_id=fc5360b1bf944dedb99694f87d953e2e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:53.034366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:53.104855 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2326/4629] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:52 2022] PUT /identity/v3/projects/577fc9c75f4f4041be8b80cd77c9aee3/users/fc5360b1bf944dedb99694f87d953e2e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:53.214492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:53.214492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:53.214802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:53.255290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] MFA Rules not processed for user `fc5360b1bf944dedb99694f87d953e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:53.256577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:53.345582 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2304/4630] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:53.359462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:53.361277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:53.404836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:53.432408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db7fc6-9317-436d-8194-f2dfe20ef974 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:53.437470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:53.438269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:53.438879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:53.438879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:53.453010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:53.453010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:53.468987 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2327/4631] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:54.472704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:54.474497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:54.481627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:54.490035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:54.494862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:54.679228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6fef2-dca1-4d0e-83ea-0efee61cb310 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:54.694112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:54.705453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:54.705732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:54.707865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e87ab-7027-4e42-ab5e-0f4341aab4bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:54.708403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] PATH_INFO: `/v3/projects/e73278571a3542a89d824f5f18c3d7a7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:54.721368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73278571a3542a89d824f5f18c3d7a7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:54.727072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:54.730089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:54.730089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:54.733861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:54.733986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] PATH_INFO: `/v3/users/41b888dbd64a4fc48ee745a7b38014c7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:54.740573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b888dbd64a4fc48ee745a7b38014c7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:54.750756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:55.159815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b888dbd64a4fc48ee745a7b38014c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.160872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b888dbd64a4fc48ee745a7b38014c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.164601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73278571a3542a89d824f5f18c3d7a7', 'request_id': 'req-07195edd-8b8a-4e19-a736-b540a548416d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.175822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73278571a3542a89d824f5f18c3d7a7', 'request_id': 'req-07195edd-8b8a-4e19-a736-b540a548416d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.292747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b888dbd64a4fc48ee745a7b38014c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.293531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b888dbd64a4fc48ee745a7b38014c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.301925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b888dbd64a4fc48ee745a7b38014c7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.390165 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2305/4632] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:54 2022] DELETE /identity/v3/users/41b888dbd64a4fc48ee745a7b38014c7 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:55.393072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73278571a3542a89d824f5f18c3d7a7', 'request_id': 'req-07195edd-8b8a-4e19-a736-b540a548416d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.412279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] The token cache is being invalidate because project e73278571a3542a89d824f5f18c3d7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:55.413071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.415075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:55.419303 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2328/4633] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:54 2022] DELETE /identity/v3/projects/e73278571a3542a89d824f5f18c3d7a7 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:55.424110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:55.425740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:55.791780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa5cf-fb5c-4ec8-a011-18123f7a144f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:55.816677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:55.818436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:55.821323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:55.821907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] PATH_INFO: `/v3/users/83c1091569d44978b719e85a78998aef` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:55.828259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c1091569d44978b719e85a78998aef)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:55.851083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:56.095870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:56.209813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:56.211641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:56.247811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c1091569d44978b719e85a78998aef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.249218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c1091569d44978b719e85a78998aef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.356405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c1091569d44978b719e85a78998aef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.357455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c1091569d44978b719e85a78998aef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.378693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28bf592e-6b43-4a53-a763-1c202679f223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c1091569d44978b719e85a78998aef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.485055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07195edd-8b8a-4e19-a736-b540a548416d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:56.494097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:56.494824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:56.495408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:56.495827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] PATH_INFO: `/v3/projects/e41731743d534457a92c6244b7671d7b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:56.501300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41731743d534457a92c6244b7671d7b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:56.505402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:56.523509 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2306/4634] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:42:55 2022] DELETE /identity/v3/users/83c1091569d44978b719e85a78998aef => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:56.529621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:56.777721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41731743d534457a92c6244b7671d7b', 'request_id': 'req-30c3ed09-ea41-43ce-adf5-f9e52882137b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.804656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41731743d534457a92c6244b7671d7b', 'request_id': 'req-30c3ed09-ea41-43ce-adf5-f9e52882137b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.837621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365270cb-d319-4398-85d9-f85e28b0a6d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:56.838557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365270cb-d319-4398-85d9-f85e28b0a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:56.839025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365270cb-d319-4398-85d9-f85e28b0a6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:56.919563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41731743d534457a92c6244b7671d7b', 'request_id': 'req-30c3ed09-ea41-43ce-adf5-f9e52882137b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.925571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-365270cb-d319-4398-85d9-f85e28b0a6d7 None None] MFA Rules not processed for user `62ff0a5713b44b7aac67e73e037e8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:56.927858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-365270cb-d319-4398-85d9-f85e28b0a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:56.935907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] The token cache is being invalidate because project e41731743d534457a92c6244b7671d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:56.936254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.937418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-30c3ed09-ea41-43ce-adf5-f9e52882137b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:56.943669 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2329/4635] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:56 2022] DELETE /identity/v3/projects/e41731743d534457a92c6244b7671d7b => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:42:56.945841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f757-054d-4b5b-a4c0-8f235e879420 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:56.946288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f757-054d-4b5b-a4c0-8f235e879420 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:56.947292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f757-054d-4b5b-a4c0-8f235e879420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:56.987427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4f06f757-054d-4b5b-a4c0-8f235e879420 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:56.988880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f06f757-054d-4b5b-a4c0-8f235e879420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:57.063994 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2307/4636] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:42:57.181787 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2330/4637] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:57.183361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147370b4-6ccc-4bff-a72b-8a897f0d56f1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:57.183651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147370b4-6ccc-4bff-a72b-8a897f0d56f1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:57.183939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147370b4-6ccc-4bff-a72b-8a897f0d56f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:57.225991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-147370b4-6ccc-4bff-a72b-8a897f0d56f1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:57.229300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-147370b4-6ccc-4bff-a72b-8a897f0d56f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:57.240852 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2308/4638] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:57.245258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f757-054d-4b5b-a4c0-8f235e879420 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:57.262419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f757-054d-4b5b-a4c0-8f235e879420 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:57.280615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:57.281495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:57.281978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:57.282481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:57.283396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:57.283928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:57.285795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:57.305563 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2331/4639] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:42:57.306563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147370b4-6ccc-4bff-a72b-8a897f0d56f1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:57.324530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147370b4-6ccc-4bff-a72b-8a897f0d56f1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:57.333569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:57.334258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:57.340122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:57.342701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:57.351836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:57.357660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:57.501258 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2309/4640] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:57 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:57.501853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:57.522379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581faf64-11c8-46dd-9bb2-b8acc5de2911 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:57.706727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:57.707912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:57.708354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:57.711342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:57.712030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:57.714014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:57.844099 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2332/4641] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:57 2022] POST /identity/v3/users => generated 295 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:57.845384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:57.865264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf78b7-4826-4640-b57d-e7c6aea9f191 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:57.883529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:57.884174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:57.884460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:57.884737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:57.885409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:57.887458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:57.918501 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2310/4642] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:57.925216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:57.939553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1416e8-1583-40a3-a47a-4da42e16012a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:57.957454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:57.958104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:57.958390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:57.958665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:57.959522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:57.961945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:57.985619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:57.987949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:58.011676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef9205-2681-4efd-adb7-f225e05f1fa4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:58.025005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:58.026208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.026723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.027640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] PATH_INFO: `/v3/projects/f02c7c700c1a477b8074ee8f6815fdd6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.029575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02c7c700c1a477b8074ee8f6815fdd6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:58.030374 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2333/4643] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:58.031404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:58.032389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:58.048951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614ed3b-0c1a-4f45-9cd4-3b5170aa4190 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:58.054228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3171cb-3e52-4892-8e85-a8efa9e7ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:58.055691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3171cb-3e52-4892-8e85-a8efa9e7ceb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.057282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3171cb-3e52-4892-8e85-a8efa9e7ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.057637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3171cb-3e52-4892-8e85-a8efa9e7ceb5 admin admin] PATH_INFO: `/v3/projects/f43e41bfbb72427198a878de059fe0f6/users/89acf827045f47d98b97a8a4c2a3e19d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.100317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3171cb-3e52-4892-8e85-a8efa9e7ceb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43e41bfbb72427198a878de059fe0f6, user_id=89acf827045f47d98b97a8a4c2a3e19d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:58.108457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3171cb-3e52-4892-8e85-a8efa9e7ceb5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:58.232599 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2334/4644] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:58 2022] PUT /identity/v3/projects/f43e41bfbb72427198a878de059fe0f6/users/89acf827045f47d98b97a8a4c2a3e19d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:58.238424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.238701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.240420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02c7c700c1a477b8074ee8f6815fdd6', 'request_id': 'req-5b6c080e-e668-4775-a739-0429d3f4fabc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:58.244309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.278386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02c7c700c1a477b8074ee8f6815fdd6', 'request_id': 'req-5b6c080e-e668-4775-a739-0429d3f4fabc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:58.305773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:58.307020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:58.341914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02c7c700c1a477b8074ee8f6815fdd6', 'request_id': 'req-5b6c080e-e668-4775-a739-0429d3f4fabc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:58.359054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] The token cache is being invalidate because project f02c7c700c1a477b8074ee8f6815fdd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:42:58.359354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:58.360493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b6c080e-e668-4775-a739-0429d3f4fabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:42:58.362907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2311/4645] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:42:57 2022] DELETE /identity/v3/projects/f02c7c700c1a477b8074ee8f6815fdd6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:58.371599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a235-d9a0-4604-815d-dac4b199a1f7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.372023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a235-d9a0-4604-815d-dac4b199a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.372294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385a235-d9a0-4604-815d-dac4b199a1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.408920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6385a235-d9a0-4604-815d-dac4b199a1f7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:58.410818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6385a235-d9a0-4604-815d-dac4b199a1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:58.418947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:58.425073 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2335/4646] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:58.445263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:58.449272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:58.521137 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2312/4647] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:58.543407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb202-01e6-4fea-bb5a-c168efbed9a1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.543968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb202-01e6-4fea-bb5a-c168efbed9a1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.544818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3eb202-01e6-4fea-bb5a-c168efbed9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.624505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ba98b-44e5-4d11-b760-c163eb5c6e23 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:58.631259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:58.632176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3f3eb202-01e6-4fea-bb5a-c168efbed9a1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:58.634911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.635034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f3eb202-01e6-4fea-bb5a-c168efbed9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:58.636494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.648980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.655638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:58.657955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:58.670179 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2313/4648] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:58.673930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb202-01e6-4fea-bb5a-c168efbed9a1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:58.674686 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2336/4649] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:42:58.690268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3eb202-01e6-4fea-bb5a-c168efbed9a1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:58.695942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:58.696764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.697200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.697649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.698778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:42:58.699645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:58.703420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:58.720131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2314/4650] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:42:58.724420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:58.739550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5e92-8144-43b5-becb-357036753058 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:58.745162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:58.746033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:58.747333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:58.747333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:58.748636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:58.750017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:58.847636 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2337/4651] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:58 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:58.849080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:58.873937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e5e3-a9ed-4ec0-9b4f-18fe1aae9d95 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:59.041581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:59.042444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:59.043077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:59.043525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:59.044496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:59.067239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:59.242359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2315/4652] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:42:58 2022] POST /identity/v3/users => generated 287 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:42:59.245908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:59.261269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd42d5-950c-4768-8dd4-7eaf2e9a33b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:59.287828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:59.287828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:59.287828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:59.287828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:59.289097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:59.291889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:59.372485 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2338/4653] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:59.394510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:59.410089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba69c-7d10-4b94-8beb-faaf66d1b8d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:59.417638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:59.422875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffa81c-fb67-4476-9ae3-50a42509fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:59.428517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffa81c-fb67-4476-9ae3-50a42509fc41 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:59.428517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffa81c-fb67-4476-9ae3-50a42509fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:59.428517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffa81c-fb67-4476-9ae3-50a42509fc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:59.428517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffa81c-fb67-4476-9ae3-50a42509fc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:59.432421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffa81c-fb67-4476-9ae3-50a42509fc41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:59.467183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2316/4654] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:42:59.468645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:42:59.488505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef3ff-fdc2-4404-9350-4bf1a4e77e95 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:42:59.496880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:42:59.497841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:59.498373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:59.498650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] PATH_INFO: `/v3/projects/68246033b1e949c48a3ae510174deced/users/57254b85da284d8c880520332b1d0fcb/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:59.520937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68246033b1e949c48a3ae510174deced, user_id=57254b85da284d8c880520332b1d0fcb, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:42:59.527837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:42:59.674488 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2339/4655] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:42:59 2022] PUT /identity/v3/projects/68246033b1e949c48a3ae510174deced/users/57254b85da284d8c880520332b1d0fcb/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:42:59.697110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82881a-aebc-42bd-860a-42b4135bbad0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:42:59.697612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82881a-aebc-42bd-860a-42b4135bbad0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:42:59.697987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82881a-aebc-42bd-860a-42b4135bbad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:42:59.778915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc82881a-aebc-42bd-860a-42b4135bbad0 None None] MFA Rules not processed for user `57254b85da284d8c880520332b1d0fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:42:59.780727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc82881a-aebc-42bd-860a-42b4135bbad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:42:59.953448 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2317/4656] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:42:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:42:59.954793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:00.071888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b0750-dbbf-4c89-8640-fc6708c1dc18 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:00.085035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:00.087153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:00.087512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:00.087854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:00.092571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:00.094843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:00.209188 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2340/4657] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:42:59 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:00.212454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82881a-aebc-42bd-860a-42b4135bbad0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:00.232119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82881a-aebc-42bd-860a-42b4135bbad0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:00.420887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:00.421880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:00.425913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:00.425913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:00.425913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:00.431047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:00.560925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2318/4658] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:00 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:00.565004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:00.604362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a5d9a-d4a8-4d2a-9f48-4a03067dfede admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:00.647762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:00.649395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:00.650092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:00.652416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:00.653257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:00.656733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:00.673500 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2341/4659] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:43:00.678615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:00.701603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e202dd-f520-499f-afae-034aa2b795f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:00.713745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:00.715705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:00.715705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:00.715954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] PATH_INFO: `/v3/projects/00d320872c4949c49c3adb10f51bac9f/users/398c970cee514f0db52c20124b474c01/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:00.738133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d320872c4949c49c3adb10f51bac9f, user_id=398c970cee514f0db52c20124b474c01, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:00.743029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:00.825390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:00.873594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:00.875365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:00.877945 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2319/4660] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:00 2022] PUT /identity/v3/projects/00d320872c4949c49c3adb10f51bac9f/users/398c970cee514f0db52c20124b474c01/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:00.882263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:00.920732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3dfbe-5dcd-45d4-a25f-e7befa6af5ca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:01.029508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc955-ea1f-417f-8e45-95e80ff8c548 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:01.035649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:01.036423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.036763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.037722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.037976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:01.041229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:01.060030 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2320/4661] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:01.061465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:01.076101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78eae-8e42-4bcc-a0ae-4f3117827601 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:01.083609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04e239-d51e-43fa-913b-03fee41f40cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:01.084463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e239-d51e-43fa-913b-03fee41f40cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.085590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e239-d51e-43fa-913b-03fee41f40cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.085961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04e239-d51e-43fa-913b-03fee41f40cb admin admin] PATH_INFO: `/v3/projects/00d320872c4949c49c3adb10f51bac9f/users/398c970cee514f0db52c20124b474c01/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.086097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:01.089198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04e239-d51e-43fa-913b-03fee41f40cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d320872c4949c49c3adb10f51bac9f, user_id=398c970cee514f0db52c20124b474c01, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:01.091983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04e239-d51e-43fa-913b-03fee41f40cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:01.104539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:01.105197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.105482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.106005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] PATH_INFO: `/v3/users/c37eb5c60b1b46819d1fa9023fab2ef6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.107660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37eb5c60b1b46819d1fa9023fab2ef6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:01.109816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:01.119198 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2321/4662] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:01 2022] PUT /identity/v3/projects/00d320872c4949c49c3adb10f51bac9f/users/398c970cee514f0db52c20124b474c01/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:01.135337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7611f7-2882-4ff7-aa4f-f2c7cc2120a3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.135607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7611f7-2882-4ff7-aa4f-f2c7cc2120a3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.135827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7611f7-2882-4ff7-aa4f-f2c7cc2120a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.181421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb7611f7-2882-4ff7-aa4f-f2c7cc2120a3 None None] MFA Rules not processed for user `398c970cee514f0db52c20124b474c01`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:01.182781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb7611f7-2882-4ff7-aa4f-f2c7cc2120a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:01.293215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37eb5c60b1b46819d1fa9023fab2ef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:01.305626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37eb5c60b1b46819d1fa9023fab2ef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:01.306808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37eb5c60b1b46819d1fa9023fab2ef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:01.330862 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2322/4663] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:01.336130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7611f7-2882-4ff7-aa4f-f2c7cc2120a3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:01.340212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37eb5c60b1b46819d1fa9023fab2ef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:01.349141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7611f7-2882-4ff7-aa4f-f2c7cc2120a3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:01.355931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398c970cee514f0db52c20124b474c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d320872c4949c49c3adb10f51bac9f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:01.356758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.360687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.361253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.362428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:01.362808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:01.365335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:01.393694 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2323/4664] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:43:01.403247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:01.409435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:01.428792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2e522e5-1315-40ae-8123-608bdcdad222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37eb5c60b1b46819d1fa9023fab2ef6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:01.438341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1e475-67cc-4c11-a44a-ccba93225e7a tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:01.441561 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2342/4665] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:00 2022] DELETE /identity/v3/users/c37eb5c60b1b46819d1fa9023fab2ef6 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:01.446337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.446865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.447149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.505404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:01.508189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:01.517378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398c970cee514f0db52c20124b474c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d320872c4949c49c3adb10f51bac9f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:01.519204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.519783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.520207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.521539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:01.527020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:01.644587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2324/4666] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:01 2022] POST /identity/v3/projects => generated 348 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:01.648120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:01.676322 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2343/4667] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:01.704279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:01.706188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:01.785403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:01.791342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c919ce-d4c3-48d4-aff2-14a9280f75ed tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:01.802458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:01.809867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398c970cee514f0db52c20124b474c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d320872c4949c49c3adb10f51bac9f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:01.810698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:01.810986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:01.811274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:01.814221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:01.814545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:01.818741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:01.845011 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2325/4668] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:01.858177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:01.866118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:01.897182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107d424-0905-4367-93c8-845ab6eceba9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:02.020949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2ef5-ce92-41e4-acf4-36b76d2150f0 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:02.023191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390c1af-2749-4c14-9058-a57acb6908d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:02.024063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c1af-2749-4c14-9058-a57acb6908d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:02.024500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c1af-2749-4c14-9058-a57acb6908d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:02.024916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390c1af-2749-4c14-9058-a57acb6908d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:02.030029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:02.030723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:02.030999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:02.031332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:02.050104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:02.051758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:02.068609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2326/4669] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:02.120423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c1af-2749-4c14-9058-a57acb6908d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:02.122177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390c1af-2749-4c14-9058-a57acb6908d5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:02.138687 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2344/4670] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:02.931609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:02.935427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:02.972608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a57b8-e8f8-4940-9f69-3f4615e8d391 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:02.987747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:02.989817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:02.991357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:02.992214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] PATH_INFO: `/v3/projects/defa7ac22af046d4873c8cc9f16ecd36` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:02.995303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:02.996610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=defa7ac22af046d4873c8cc9f16ecd36)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:03.014913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:03.267337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'defa7ac22af046d4873c8cc9f16ecd36', 'request_id': 'req-d201c303-79e2-45dc-90c5-2c65d2ca76a9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:03.293160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'defa7ac22af046d4873c8cc9f16ecd36', 'request_id': 'req-d201c303-79e2-45dc-90c5-2c65d2ca76a9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:03.388107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'defa7ac22af046d4873c8cc9f16ecd36', 'request_id': 'req-d201c303-79e2-45dc-90c5-2c65d2ca76a9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:03.409779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] The token cache is being invalidate because project defa7ac22af046d4873c8cc9f16ecd36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:03.410500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:03.412249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d201c303-79e2-45dc-90c5-2c65d2ca76a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:03.420514 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2327/4671] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:02 2022] DELETE /identity/v3/projects/defa7ac22af046d4873c8cc9f16ecd36 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:03.425132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fdd51-97b2-447a-9a38-436acd866935 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:03.426149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fdd51-97b2-447a-9a38-436acd866935 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:03.426657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fdd51-97b2-447a-9a38-436acd866935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:03.489417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-863fdd51-97b2-447a-9a38-436acd866935 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:03.500648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-863fdd51-97b2-447a-9a38-436acd866935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:03.575554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:03.751092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2345/4672] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:03.759988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0195f-ad22-42d6-836d-75c6af2b2a56 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:03.760706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0195f-ad22-42d6-836d-75c6af2b2a56 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:03.761206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0195f-ad22-42d6-836d-75c6af2b2a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:03.803808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-95a0195f-ad22-42d6-836d-75c6af2b2a56 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:03.807758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-95a0195f-ad22-42d6-836d-75c6af2b2a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:03.870450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2328/4673] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:03.874971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fdd51-97b2-447a-9a38-436acd866935 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:03.906000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fdd51-97b2-447a-9a38-436acd866935 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:03.922008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:03.931057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:03.931057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:03.931057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:03.931057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:03.931057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:03.934108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:03.968166 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2346/4674] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:03.972536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0195f-ad22-42d6-836d-75c6af2b2a56 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:03.987409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0195f-ad22-42d6-836d-75c6af2b2a56 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:04.007498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:04.009153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:04.009819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:04.010518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:04.011399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:04.017533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:04.171092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2329/4675] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:03 2022] POST /identity/v3/projects => generated 359 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:04.177928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:04.191003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2218d3-c190-4b1e-b4cd-36ac2fda7aef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:04.343015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:04.343834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:04.344173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:04.344503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:04.345210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:04.347270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:04.491116 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2347/4676] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:04 2022] POST /identity/v3/users => generated 280 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:04.496107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:04.512808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ea02-9241-489c-ac8b-af20b32f0d9a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:04.518812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:04.519626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:04.519913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:04.520186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:04.520847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:04.522509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:04.539297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:04.563523 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2330/4677] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:04.571011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587547-ded9-4d9f-b953-59d37f285d4e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:04.593485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31636bc9-ffec-4e56-ac88-bf8468575dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:04.594673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636bc9-ffec-4e56-ac88-bf8468575dcf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:04.595169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636bc9-ffec-4e56-ac88-bf8468575dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:04.595652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636bc9-ffec-4e56-ac88-bf8468575dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:04.598447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31636bc9-ffec-4e56-ac88-bf8468575dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:04.602295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31636bc9-ffec-4e56-ac88-bf8468575dcf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:04.630514 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2348/4678] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:04.636491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:04.660272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1778f-e254-4692-8d04-2aeca44219cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:04.667816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:04.668834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:04.669307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:04.669788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] PATH_INFO: `/v3/projects/eb1d5573ca0b450581b827de81665890/users/e3e95855fbee4b6faacb5fbb89dbd22e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:04.764311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1d5573ca0b450581b827de81665890, user_id=e3e95855fbee4b6faacb5fbb89dbd22e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:04.767332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:04.879830 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2331/4679] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:04 2022] PUT /identity/v3/projects/eb1d5573ca0b450581b827de81665890/users/e3e95855fbee4b6faacb5fbb89dbd22e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:04.891273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:04.891565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:04.891823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:04.924079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] MFA Rules not processed for user `e3e95855fbee4b6faacb5fbb89dbd22e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:04.925508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:05.021172 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2349/4680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:05.059477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:05.061680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:05.164063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:05.182290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02a21-e88e-49ab-bb7d-649494a33407 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:05.187553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:05.188799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:05.189035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:05.189305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:05.201047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:05.202554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:05.215650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2332/4681] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:07.446037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:07.449494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:07.482090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:07.577699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb21e3-837f-4061-99f0-3ebf40559619 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:07.595761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '398c970cee514f0db52c20124b474c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00d320872c4949c49c3adb10f51bac9f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:07.596414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:07.596702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:07.597292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] PATH_INFO: `/v3/projects/f7a97293f93141f69154a7992d9fd0d0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:07.604911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7a97293f93141f69154a7992d9fd0d0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:07.607240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:07.738089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a97293f93141f69154a7992d9fd0d0', 'request_id': 'req-82b48db1-6699-42cb-bedc-e12f5c52c717'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:07.747955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a97293f93141f69154a7992d9fd0d0', 'request_id': 'req-82b48db1-6699-42cb-bedc-e12f5c52c717'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:07.854245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a97293f93141f69154a7992d9fd0d0', 'request_id': 'req-82b48db1-6699-42cb-bedc-e12f5c52c717'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:07.869050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] The token cache is being invalidate because project f7a97293f93141f69154a7992d9fd0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:07.869347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:07.870000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-82b48db1-6699-42cb-bedc-e12f5c52c717 tempest-QuotasNegativeTest-1041434085 tempest-QuotasNegativeTest-1041434085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:07.875522 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2350/4682] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:07 2022] DELETE /identity/v3/projects/f7a97293f93141f69154a7992d9fd0d0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:07.876756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:07.878667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:07.970893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198bae-a1b4-42c3-8595-2555687b758f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:08.098298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:08.099359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:08.100078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:08.100578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] PATH_INFO: `/v3/users/57254b85da284d8c880520332b1d0fcb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:08.104718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57254b85da284d8c880520332b1d0fcb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:08.107962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:08.390378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57254b85da284d8c880520332b1d0fcb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:08.392251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57254b85da284d8c880520332b1d0fcb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:08.522033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57254b85da284d8c880520332b1d0fcb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:08.523741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57254b85da284d8c880520332b1d0fcb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:08.537638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57254b85da284d8c880520332b1d0fcb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:08.602518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:08.603094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:08.603094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:08.607428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2333/4683] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:07 2022] DELETE /identity/v3/users/57254b85da284d8c880520332b1d0fcb => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:08.651153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:08.655074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:08.775984 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2351/4684] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:08.786007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:08.787590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:08.803248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:08.879693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502a3c-61f0-42e1-be3c-839e85a6eb90 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:08.885892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:08.886538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:08.887553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:08.887839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:08.903265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:08.908336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:08.933795 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2334/4685] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:11.173206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:11.175248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:11.212170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5524a-f7ef-44ba-b785-204714c72945 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:11.225536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:11.227595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:11.228022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:11.228439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] PATH_INFO: `/v3/projects/68246033b1e949c48a3ae510174deced` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:11.230871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68246033b1e949c48a3ae510174deced)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:11.233299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:11.424829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:11.437406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68246033b1e949c48a3ae510174deced', 'request_id': 'req-92ca8a09-0667-4c15-bf6a-f3a586458bf5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:11.447707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68246033b1e949c48a3ae510174deced', 'request_id': 'req-92ca8a09-0667-4c15-bf6a-f3a586458bf5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:11.525338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68246033b1e949c48a3ae510174deced', 'request_id': 'req-92ca8a09-0667-4c15-bf6a-f3a586458bf5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:11.540473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] The token cache is being invalidate because project 68246033b1e949c48a3ae510174deced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:11.541807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:11.543198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:11.545607 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2352/4686] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:11 2022] DELETE /identity/v3/projects/68246033b1e949c48a3ae510174deced => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:11.549317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:11.567570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b700b-1ab6-49a6-a82f-fd0b83209112 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:11.716440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:11.725911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:11.726511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:11.727223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] PATH_INFO: `/v3/users/398c970cee514f0db52c20124b474c01` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:11.729252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=398c970cee514f0db52c20124b474c01)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:11.732362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:12.051068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398c970cee514f0db52c20124b474c01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:12.051759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398c970cee514f0db52c20124b474c01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:12.198926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398c970cee514f0db52c20124b474c01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:12.199593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398c970cee514f0db52c20124b474c01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:12.217094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f95c37f-3a32-4545-b6ea-0a19c958ab8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398c970cee514f0db52c20124b474c01'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:12.296178 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2335/4687] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:11 2022] DELETE /identity/v3/users/398c970cee514f0db52c20124b474c01 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:14.117858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:14.119975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:14.151242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8a09-0667-4c15-bf6a-f3a586458bf5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:14.344623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:14.351357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:14.351942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:14.352399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] PATH_INFO: `/v3/projects/00d320872c4949c49c3adb10f51bac9f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:14.355125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d320872c4949c49c3adb10f51bac9f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:14.357799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:14.586868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d320872c4949c49c3adb10f51bac9f', 'request_id': 'req-3e4d51a3-5170-465d-8035-f17123e275eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:14.607453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d320872c4949c49c3adb10f51bac9f', 'request_id': 'req-3e4d51a3-5170-465d-8035-f17123e275eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:14.707181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d320872c4949c49c3adb10f51bac9f', 'request_id': 'req-3e4d51a3-5170-465d-8035-f17123e275eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:14.737898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] The token cache is being invalidate because project 00d320872c4949c49c3adb10f51bac9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:14.737898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:14.737898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:14.748209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2353/4688] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:14 2022] DELETE /identity/v3/projects/00d320872c4949c49c3adb10f51bac9f => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:14.749264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdfff4-ee4a-4825-84b1-08b77a953ec7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:14.750118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdfff4-ee4a-4825-84b1-08b77a953ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:14.750624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdfff4-ee4a-4825-84b1-08b77a953ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:14.786539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:14.788806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:14.808083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9cdfff4-ee4a-4825-84b1-08b77a953ec7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:14.814523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9cdfff4-ee4a-4825-84b1-08b77a953ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:14.873970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:14.924041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2336/4689] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:14.925660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89d7e8-e9ea-4075-b2a7-ae649b1d345a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:14.925949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89d7e8-e9ea-4075-b2a7-ae649b1d345a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:14.926294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89d7e8-e9ea-4075-b2a7-ae649b1d345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:14.951580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d51a3-5170-465d-8035-f17123e275eb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:14.965703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad89d7e8-e9ea-4075-b2a7-ae649b1d345a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:14.966596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:14.967212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad89d7e8-e9ea-4075-b2a7-ae649b1d345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:14.967693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:14.969546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:14.970648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:14.978805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:14.991201 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2337/4690] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:15.007549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89d7e8-e9ea-4075-b2a7-ae649b1d345a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:15.007704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:15.035286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89d7e8-e9ea-4075-b2a7-ae649b1d345a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:15.056961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:15.059125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:15.059125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:15.059417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:15.060120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:15.060429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:15.062049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:15.098780 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2338/4691] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:15.101113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:15.120493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fe45d-c47e-4f55-b952-60c53551ca67 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:15.130133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:15.137376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:15.156818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:15.157878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:15.159768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:15.161079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:15.164655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:15.169932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:15.180465 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2354/4692] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:15.303145 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2339/4693] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:15 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:15.304092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:15.318439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a3ae-c396-47fe-8fec-4ba7ba6a104b service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:15.435770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:15.438171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:15.438600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:15.439507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:15.440831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:15.448230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:15.566409 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2355/4694] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:15 2022] POST /identity/v3/users => generated 284 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:15.570480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:15.584910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629abd-0a11-49f5-9af4-487f085ec7b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:15.592897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:15.597594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:15.597594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:15.597594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:15.597594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:15.597594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:15.614087 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2340/4695] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:15.617975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:15.632987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff38c6-b73f-4b4e-95d5-75b8f6d2dc7c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:15.638705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577d383-3d06-47e7-a959-24015aa4257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:15.639328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d383-3d06-47e7-a959-24015aa4257b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:15.639626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d383-3d06-47e7-a959-24015aa4257b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:15.639887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d383-3d06-47e7-a959-24015aa4257b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:15.640541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d383-3d06-47e7-a959-24015aa4257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:15.642192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d383-3d06-47e7-a959-24015aa4257b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:15.664510 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2356/4696] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:15.668469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:15.684505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c65dee-e1e8-4b9d-88c8-66c9b73dce31 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:15.695419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:15.696556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:15.697023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:15.697481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] PATH_INFO: `/v3/projects/e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1/users/fa4dc35d0c6d461394ea67ed64e9ecb1/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:15.726731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1, user_id=fa4dc35d0c6d461394ea67ed64e9ecb1, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:15.730368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:15.807947 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2341/4697] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:15 2022] PUT /identity/v3/projects/e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1/users/fa4dc35d0c6d461394ea67ed64e9ecb1/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:15.818547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e12aaf-c384-48dd-aaea-3b6b7dc23c85 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:15.826443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e12aaf-c384-48dd-aaea-3b6b7dc23c85 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:15.826443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e12aaf-c384-48dd-aaea-3b6b7dc23c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:15.862145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-24e12aaf-c384-48dd-aaea-3b6b7dc23c85 None None] MFA Rules not processed for user `fa4dc35d0c6d461394ea67ed64e9ecb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:15.863643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24e12aaf-c384-48dd-aaea-3b6b7dc23c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:16.143259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2357/4698] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:16.147707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:16.249904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1aecb-16dd-4f18-a61c-84a5588f7989 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:16.257109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645bd31-fe5c-464d-bfe8-b4f34950f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:16.257823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bd31-fe5c-464d-bfe8-b4f34950f113 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:16.258157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bd31-fe5c-464d-bfe8-b4f34950f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:16.258770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645bd31-fe5c-464d-bfe8-b4f34950f113 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:16.262568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645bd31-fe5c-464d-bfe8-b4f34950f113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:16.267937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645bd31-fe5c-464d-bfe8-b4f34950f113 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:16.399560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2342/4699] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:16 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:16.403283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e12aaf-c384-48dd-aaea-3b6b7dc23c85 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:16.424240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e12aaf-c384-48dd-aaea-3b6b7dc23c85 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:16.454347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:16.511913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:16.512133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:16.513953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:16.513953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:16.513953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:16.515610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:16.620830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44033c5-cd46-4be0-9441-c5dbf4703b1d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:16.622343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44033c5-cd46-4be0-9441-c5dbf4703b1d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:16.622644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44033c5-cd46-4be0-9441-c5dbf4703b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:16.634255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2358/4700] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:16 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:16.636312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:16.655167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ee37b-db8f-4a80-a59e-730c0e8787a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:16.668172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:16.668808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:16.669088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:16.669366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:16.670573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:16.687231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:16.690475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d44033c5-cd46-4be0-9441-c5dbf4703b1d None None] MFA Rules not processed for user `89acf827045f47d98b97a8a4c2a3e19d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:16.692019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d44033c5-cd46-4be0-9441-c5dbf4703b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:16.704255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2359/4701] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:16.705750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:16.724896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d8d2-369a-44b7-b33d-795187c29db2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:16.738198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:16.738889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:16.739177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:16.739506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] PATH_INFO: `/v3/projects/3f86649d8847478ca27cc667ea51b4d2/users/416e4d9659b04dbd8deb7543d4fa8e9c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:16.746023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:16.773172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f86649d8847478ca27cc667ea51b4d2, user_id=416e4d9659b04dbd8deb7543d4fa8e9c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:16.776435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:16.798652 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2343/4702] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:16.806572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:16.807187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:16.807464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:16.860247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] MFA Rules not processed for user `89acf827045f47d98b97a8a4c2a3e19d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:16.861501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:16.878031 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2360/4703] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:16 2022] PUT /identity/v3/projects/3f86649d8847478ca27cc667ea51b4d2/users/416e4d9659b04dbd8deb7543d4fa8e9c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:16.878283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2344/4704] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:16.878987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:16.888477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:16.893221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:17.011211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac50bb-76a1-4386-a025-8375a711e933 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:17.013493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b79fb-a268-4184-bb92-8c2a5182b9f6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:17.027032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:17.027774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:17.028125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:17.028473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:17.029201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:17.030982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:17.058516 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2361/4705] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:17.059918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:17.078003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7b1b1-ee4b-44e7-a8f5-f384a06a95ab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:17.089788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3e06f-d4af-41e2-836f-ee367f4192a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:17.090629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e06f-d4af-41e2-836f-ee367f4192a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:17.090913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e06f-d4af-41e2-836f-ee367f4192a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:17.091199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3e06f-d4af-41e2-836f-ee367f4192a5 admin admin] PATH_INFO: `/v3/projects/3f86649d8847478ca27cc667ea51b4d2/users/416e4d9659b04dbd8deb7543d4fa8e9c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:17.095430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e06f-d4af-41e2-836f-ee367f4192a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f86649d8847478ca27cc667ea51b4d2, user_id=416e4d9659b04dbd8deb7543d4fa8e9c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:17.101587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3e06f-d4af-41e2-836f-ee367f4192a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:17.150330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2362/4706] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:17 2022] PUT /identity/v3/projects/3f86649d8847478ca27cc667ea51b4d2/users/416e4d9659b04dbd8deb7543d4fa8e9c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:17.176787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:17.180236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:17.180691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:17.186454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:17.187183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:17.187477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:17.187755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:17.291941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] MFA Rules not processed for user `416e4d9659b04dbd8deb7543d4fa8e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:17.293723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:17.378835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:17.380981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:17.402864 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2345/4707] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:43:17.431494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2363/4708] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:17.444631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:17.446398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:17.467668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:17.603430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a4d1-a630-443e-8d0e-8ff2ff9c0422 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:17.712277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688610f7-a244-4246-8705-5d01b435e7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:17.713190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688610f7-a244-4246-8705-5d01b435e7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:17.713535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688610f7-a244-4246-8705-5d01b435e7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:17.713876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688610f7-a244-4246-8705-5d01b435e7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:17.728334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688610f7-a244-4246-8705-5d01b435e7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:17.730887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688610f7-a244-4246-8705-5d01b435e7a5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:17.739738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:17.756112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2346/4709] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:20.827873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:20.830020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:20.962910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536f784-76ff-4638-9c45-cb0212b9d4ba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:20.968844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:20.969902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:20.970495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:20.971009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] PATH_INFO: `/v3/users/fc5360b1bf944dedb99694f87d953e2e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:20.972426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5360b1bf944dedb99694f87d953e2e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:20.974559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:21.213415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5360b1bf944dedb99694f87d953e2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:21.248565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5360b1bf944dedb99694f87d953e2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:21.259513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5360b1bf944dedb99694f87d953e2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:21.302703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5360b1bf944dedb99694f87d953e2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:21.421496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5360b1bf944dedb99694f87d953e2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:21.431075 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2364/4710] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:20 2022] DELETE /identity/v3/users/fc5360b1bf944dedb99694f87d953e2e => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:21.436011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:21.436465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:21.436465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:21.477577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:21.480862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:21.650625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2347/4711] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:21.693413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:21.699776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:21.792826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb0fe-9f17-4805-a39e-5b09c5216d3b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:21.800283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a30ff-f8eb-4f66-8c07-11caf51cb93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:21.800987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a30ff-f8eb-4f66-8c07-11caf51cb93a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:21.801448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a30ff-f8eb-4f66-8c07-11caf51cb93a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:21.801916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a30ff-f8eb-4f66-8c07-11caf51cb93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:21.816727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a30ff-f8eb-4f66-8c07-11caf51cb93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:21.818576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a30ff-f8eb-4f66-8c07-11caf51cb93a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:21.851555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2365/4712] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:22.911916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:22.914026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:22.941142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf438-0820-4d0f-b427-cef14a0dee66 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:22.948986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:22.949634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:22.949915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:22.950217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] PATH_INFO: `/v3/projects/577fc9c75f4f4041be8b80cd77c9aee3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:22.959364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577fc9c75f4f4041be8b80cd77c9aee3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:22.962123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:23.170007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577fc9c75f4f4041be8b80cd77c9aee3', 'request_id': 'req-27ff0117-4190-4e7c-94ee-6e75c869b589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:23.181895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577fc9c75f4f4041be8b80cd77c9aee3', 'request_id': 'req-27ff0117-4190-4e7c-94ee-6e75c869b589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:23.184827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:23.272823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577fc9c75f4f4041be8b80cd77c9aee3', 'request_id': 'req-27ff0117-4190-4e7c-94ee-6e75c869b589'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:23.287187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] The token cache is being invalidate because project 577fc9c75f4f4041be8b80cd77c9aee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:23.287665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:23.288796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-27ff0117-4190-4e7c-94ee-6e75c869b589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:23.291874 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2348/4713] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:22 2022] DELETE /identity/v3/projects/577fc9c75f4f4041be8b80cd77c9aee3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:23.298003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704c82a-6db9-4091-a723-d2cf5683a8be None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:23.298500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704c82a-6db9-4091-a723-d2cf5683a8be None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:23.298611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704c82a-6db9-4091-a723-d2cf5683a8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:23.308119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:23.322692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7704c82a-6db9-4091-a723-d2cf5683a8be None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:23.323793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7704c82a-6db9-4091-a723-d2cf5683a8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:23.395873 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2366/4714] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:23.404081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fac96-ec19-41b5-a491-c21c6b0dd71d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:23.404456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fac96-ec19-41b5-a491-c21c6b0dd71d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:23.404630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fac96-ec19-41b5-a491-c21c6b0dd71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:23.430207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ec5fac96-ec19-41b5-a491-c21c6b0dd71d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:23.431606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec5fac96-ec19-41b5-a491-c21c6b0dd71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:23.440481 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2349/4715] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:23.444915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704c82a-6db9-4091-a723-d2cf5683a8be None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:23.460949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704c82a-6db9-4091-a723-d2cf5683a8be None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:23.482738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:23.482738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:23.483017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:23.483531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:23.484197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:23.485570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:23.487295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:23.512035 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2367/4716] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:23.516617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fac96-ec19-41b5-a491-c21c6b0dd71d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:23.528616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fac96-ec19-41b5-a491-c21c6b0dd71d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:23.534582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:23.535447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:23.536141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:23.536141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:23.536820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:23.539580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:23.729889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2350/4717] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:23 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:23.731062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:23.744456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40c1c2-1850-43fa-8f56-52a9db0eabd6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:23.884905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:23.884905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:23.884905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:23.884905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:23.885287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:23.885287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:24.011272 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2368/4718] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:23 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:24.016185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:24.038970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636953d4-1cb7-4715-bff1-afa984b29afc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:24.053402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:24.054371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:24.055112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:24.055430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:24.057413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:24.061301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:24.081644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:24.089303 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2351/4719] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:24.094371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a547-d5cb-4bb1-be04-c542622f62a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:24.099712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cafa2-6167-4a81-9b11-05423cc175b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:24.101942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cafa2-6167-4a81-9b11-05423cc175b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:24.102383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cafa2-6167-4a81-9b11-05423cc175b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:24.102823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cafa2-6167-4a81-9b11-05423cc175b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:24.103771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cafa2-6167-4a81-9b11-05423cc175b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:24.105612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cafa2-6167-4a81-9b11-05423cc175b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:24.127790 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2369/4720] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:24.130012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:24.147833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e692d-05c0-4fd1-9d18-60c4b81434dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:24.157549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:24.158439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:24.158830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:24.159209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] PATH_INFO: `/v3/projects/1e65dd919ff247ec9da9998cd344e2dc/users/6095a02a33344d98b597ae4061591930/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:24.191057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e65dd919ff247ec9da9998cd344e2dc, user_id=6095a02a33344d98b597ae4061591930, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:24.208839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:24.348868 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2352/4721] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:24 2022] PUT /identity/v3/projects/1e65dd919ff247ec9da9998cd344e2dc/users/6095a02a33344d98b597ae4061591930/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:24.360887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64066-fb20-4d21-8887-89ab7fa591dc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:24.361447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64066-fb20-4d21-8887-89ab7fa591dc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:24.361447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb64066-fb20-4d21-8887-89ab7fa591dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:24.426502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6bb64066-fb20-4d21-8887-89ab7fa591dc None None] MFA Rules not processed for user `6095a02a33344d98b597ae4061591930`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:24.431344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6bb64066-fb20-4d21-8887-89ab7fa591dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:24.641785 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2370/4722] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:24.646388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:24.755354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf843578-bb4c-4015-9da4-8d5bd4d2ec00 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:24.760972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:24.761780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:24.762219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:24.762720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:24.763497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:24.765486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:24.955768 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2353/4723] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:24 2022] POST /identity/v3/projects => generated 367 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:24.959402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb64066-fb20-4d21-8887-89ab7fa591dc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:24.966899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:24.978310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb64066-fb20-4d21-8887-89ab7fa591dc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:25.110633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:25.112668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.113150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.113687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.115159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:25.119080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:25.235677 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2371/4724] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:24 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:25.239545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:25.269713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5ec47-5c57-481a-89d5-643e24bd7223 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:25.277615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:25.278574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.279123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.279639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.280570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:25.282565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:25.305801 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2354/4725] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:25.309683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:25.324333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089f837-3333-4a2d-99fc-8df7417fb955 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:25.334290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:25.335977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.336116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.336407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] PATH_INFO: `/v3/projects/601ca86b1dde429b9663626d51a92522/users/230ab77530a44c339a60d39b443dc968/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.361235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=601ca86b1dde429b9663626d51a92522, user_id=230ab77530a44c339a60d39b443dc968, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:25.364666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:25.408850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:25.414973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:25.443849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972f7e2-093c-4419-ae6e-a54e908bfde7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:25.452292 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2372/4726] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:25 2022] PUT /identity/v3/projects/601ca86b1dde429b9663626d51a92522/users/230ab77530a44c339a60d39b443dc968/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:25.456028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:25.575790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:25.589355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:25.590017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.590372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.590653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] PATH_INFO: `/v3/users/6524b3e0315b48f59a53d7ca47575675` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.595615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6524b3e0315b48f59a53d7ca47575675)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:25.597684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:25.602972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41786a54-8df3-4fe7-8070-7417c90c41bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:25.618999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:25.619861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.620238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.620893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.622038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:25.633969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:25.667135 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2373/4727] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:43:25.683378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:25.693626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d7b09-2bfa-4587-bba9-fabf765934e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:25.698402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc076-154e-41ca-8a7b-43e4819bbd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:25.699063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc076-154e-41ca-8a7b-43e4819bbd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.699348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc076-154e-41ca-8a7b-43e4819bbd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.699617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc076-154e-41ca-8a7b-43e4819bbd06 admin admin] PATH_INFO: `/v3/projects/601ca86b1dde429b9663626d51a92522/users/230ab77530a44c339a60d39b443dc968/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.701766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc076-154e-41ca-8a7b-43e4819bbd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601ca86b1dde429b9663626d51a92522, user_id=230ab77530a44c339a60d39b443dc968, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:25.704560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc076-154e-41ca-8a7b-43e4819bbd06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:25.716341 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2374/4728] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:25 2022] PUT /identity/v3/projects/601ca86b1dde429b9663626d51a92522/users/230ab77530a44c339a60d39b443dc968/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:25.733542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1711838-1530-447c-9a1b-4e206365999e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.733997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1711838-1530-447c-9a1b-4e206365999e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.734257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1711838-1530-447c-9a1b-4e206365999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.775241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c1711838-1530-447c-9a1b-4e206365999e None None] MFA Rules not processed for user `230ab77530a44c339a60d39b443dc968`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:25.777383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1711838-1530-447c-9a1b-4e206365999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:25.838598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:25.862077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6524b3e0315b48f59a53d7ca47575675'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:25.864704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6524b3e0315b48f59a53d7ca47575675'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:25.876313 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2375/4729] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:25.880201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1711838-1530-447c-9a1b-4e206365999e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:25.903190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1711838-1530-447c-9a1b-4e206365999e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:25.915800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:25.916440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:25.919751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:25.920080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:25.920786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:25.925885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:25.947862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6524b3e0315b48f59a53d7ca47575675'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:25.949201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6524b3e0315b48f59a53d7ca47575675'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:25.963519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a163c902-2e61-45f1-937d-808ade31d53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6524b3e0315b48f59a53d7ca47575675'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:26.006267 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2355/4730] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:25 2022] DELETE /identity/v3/users/6524b3e0315b48f59a53d7ca47575675 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:26.010302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:26.010598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:26.010927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:26.014461 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2376/4731] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:43:25 2022] POST /identity/v3/domains => generated 277 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:26.018649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.020866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:26.042449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:26.046370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:26.178104 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2356/4732] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:26.187271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d63aa2-126d-4a62-ac96-3caff3b81cee tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:26.188402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.189718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:26.192202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:26.192854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:26.193140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:26.193492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:26.194509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:26.196057 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:26.196057 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:26.196057 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:26.197276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:26.256117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486afc3b-128e-49ee-89c4-3684611e413a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:26.260462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:26.260856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:26.261137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:26.261474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:26.271413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:26.273366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:26.286120 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2357/4733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:43:26.334113 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2377/4734] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:26 2022] POST /identity/v3/groups => generated 281 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:26.336025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.372704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8c2c-8507-4e64-9395-c92778134246 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:26.391538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:26.392482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:26.392776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:26.393052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:26.422617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:update_group(group_id=c90fddb192d14049bb56f3a35ec4a8e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:26.430559 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:26.430559 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:26.430559 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:26.430559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:26.579447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.586663 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2358/4735] 10.222.0.27 () {60 vars in 1247 bytes} [Tue Oct 18 13:43:26 2022] PATCH /identity/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8 => generated 292 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:26.593412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16e80c-5c43-40ee-ba89-3fe394850bcc tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:26.606820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:26.608538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:26.612115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:26.612631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:26.627042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:get_group(group_id=c90fddb192d14049bb56f3a35ec4a8e8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:26.627042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:26.629477 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2378/4736] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:26 2022] GET /identity/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8 => generated 292 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:43:26.634542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.646310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76267f90-5455-4c3d-8390-7a3e22b1e296 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:26.662759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:26.663430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:26.663726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:26.663991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:26.665274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:update_group(group_id=c90fddb192d14049bb56f3a35ec4a8e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:26.667228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:26.737546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2359/4737] 10.222.0.27 () {60 vars in 1246 bytes} [Tue Oct 18 13:43:26 2022] PATCH /identity/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8 => generated 307 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:26.742382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.754495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d84f6-d92f-4b15-9f1c-a81a61a7b1c5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:26.765377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:26.765377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:26.765377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:26.765907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:26.772302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c90fddb192d14049bb56f3a35ec4a8e8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:26.773859 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:26.773859 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:26.773859 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:26.775656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:26.949314 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2379/4738] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:43:26 2022] DELETE /identity/v3/groups/c90fddb192d14049bb56f3a35ec4a8e8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:26.954303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.965902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0cdb4-6279-4a42-b1e0-4a484f278385 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:26.981640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:26.993639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:26.995455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:27.096575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:27.129546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:27.130469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.130964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.131238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.132414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:27.133438 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:27.133438 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:27.133438 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:27.134896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:27.140093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9927c8f-eead-4d08-a53d-0f01050e0cc5 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:27.146983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:27.148501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.148995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.149946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] PATH_INFO: `/v3/projects/ca6bb7ad775b425fa91bbb81597c2fb0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.152856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6bb7ad775b425fa91bbb81597c2fb0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:27.155113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:27.251316 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2360/4739] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:26 2022] POST /identity/v3/groups => generated 327 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:27.255516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:27.266885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc2993-8571-49ee-b72c-8931d4951ae9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:27.274152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:27.275129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.275644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.276145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.277259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:27.281001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:27.321149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'request_id': 'req-cf484907-83f2-4018-805b-ee05c1317aac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:27.332020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'request_id': 'req-cf484907-83f2-4018-805b-ee05c1317aac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:27.393416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2361/4740] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:27 2022] POST /identity/v3/users => generated 321 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:27.398997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6bb7ad775b425fa91bbb81597c2fb0', 'request_id': 'req-cf484907-83f2-4018-805b-ee05c1317aac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:27.403513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:27.416398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] The token cache is being invalidate because project ca6bb7ad775b425fa91bbb81597c2fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:27.416695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:27.417490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cf484907-83f2-4018-805b-ee05c1317aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:27.422524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c45408-de0b-486b-9440-d99a012ab34a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:27.423662 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2380/4741] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:26 2022] DELETE /identity/v3/projects/ca6bb7ad775b425fa91bbb81597c2fb0 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:27.426460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92e7f-aa05-4f5e-b546-4e8671e1ab2b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.427029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92e7f-aa05-4f5e-b546-4e8671e1ab2b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.427313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92e7f-aa05-4f5e-b546-4e8671e1ab2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.457054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-37f92e7f-aa05-4f5e-b546-4e8671e1ab2b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:27.458340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-37f92e7f-aa05-4f5e-b546-4e8671e1ab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:27.514832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:27.515518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.517831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.517989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/20babb7a48594cf2889027b4d5456894` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.543997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=20babb7a48594cf2889027b4d5456894)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:27.550669 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:27.550669 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:27.550669 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:27.558547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:27.584027 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2381/4742] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:27.672553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64367d3-374c-4684-aa3c-c791c9ca1378 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.673112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64367d3-374c-4684-aa3c-c791c9ca1378 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.673554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64367d3-374c-4684-aa3c-c791c9ca1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.686416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2362/4743] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 13:43:27 2022] PUT /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/20babb7a48594cf2889027b4d5456894 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:27.691148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:27.701654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:27.734383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b64367d3-374c-4684-aa3c-c791c9ca1378 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:27.735680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b64367d3-374c-4684-aa3c-c791c9ca1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:27.864037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c70e3c-b5da-453a-956c-512e6b507a37 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:27.873952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:27.874808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.875199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.875633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.876396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:27.879000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:27.919378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2382/4744] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:27.919378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64367d3-374c-4684-aa3c-c791c9ca1378 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:27.945331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64367d3-374c-4684-aa3c-c791c9ca1378 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:27.956320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:27.957239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:27.957675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:27.958125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:27.958959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:27.959418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:27.964881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:27.994509 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2383/4745] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:27.999332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.023022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025ba26-c487-4af6-b613-b4ff8b27495b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.030110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.035588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.035588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.035588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.035588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.037854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.039040 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2363/4746] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:27 2022] POST /identity/v3/users => generated 321 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:28.043408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.098581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dc038-521f-492b-ba57-77b0ad2e6b79 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.125513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.126261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.126545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.132494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/f1533b51d37e46f98eb5703776e27a51` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.153153 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2384/4747] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:27 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:28.155884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.189072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=f1533b51d37e46f98eb5703776e27a51)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.191227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.281184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7488-182e-4740-b5c8-da981921e75d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.286796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.287696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.288055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.288595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.289327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.291511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.359739 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2364/4748] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 13:43:28 2022] PUT /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/f1533b51d37e46f98eb5703776e27a51 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:28.370138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.460472 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2385/4749] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:28 2022] POST /identity/v3/users => generated 291 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:28.461464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.481522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce181093-a1c1-419c-a0ba-07c228302f4d tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.486545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.487170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.487284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9e404-6069-4d13-903d-d1a08be0551f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.487441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.487718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.488368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.490656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.579295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.585395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.591921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.592203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.597423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.597747 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2365/4750] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:28 2022] POST /identity/v3/users => generated 323 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:28.600021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.601352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.625939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718cf13-5136-4066-b2fd-03b52a10f9fb tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.628832 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2386/4751] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:28.632363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.640254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.640906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.641203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.641461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/9cc808e0236341d5adee0ec77fcf56da` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.654394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b64fc-f18c-4c9c-9aa2-0c6f3bffeba8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.674928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.674928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.674928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.674928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.675234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.675234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.686118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=9cc808e0236341d5adee0ec77fcf56da)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.686331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.690616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:28.731073 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2387/4752] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:28.735156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.747468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f57580-abb4-4daf-960c-0ea72f440cfe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.752848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd0bb-1154-404a-9452-2a487ec13d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:28.754216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd0bb-1154-404a-9452-2a487ec13d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.754700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd0bb-1154-404a-9452-2a487ec13d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.755049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd0bb-1154-404a-9452-2a487ec13d6c admin admin] PATH_INFO: `/v3/projects/0afceb9a2a5b41cb8a7e59f036f57422/users/d50c668c2b2f43798ab247029a8386e5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.774435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd0bb-1154-404a-9452-2a487ec13d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afceb9a2a5b41cb8a7e59f036f57422, user_id=d50c668c2b2f43798ab247029a8386e5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:28.777794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd0bb-1154-404a-9452-2a487ec13d6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:28.796866 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2366/4753] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 13:43:28 2022] PUT /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/9cc808e0236341d5adee0ec77fcf56da => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:28.797914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:28.870268 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2388/4754] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:28 2022] PUT /identity/v3/projects/0afceb9a2a5b41cb8a7e59f036f57422/users/d50c668c2b2f43798ab247029a8386e5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:28.875425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:28.875957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:28.876309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:28.922683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:28.922805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718484c-b78f-4a22-b76f-653f98af0fc2 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:28.922903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:29.033089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2389/4755] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:29.058046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:29.059980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:29.068638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:29.069648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:29.069935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:29.070235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:29.071834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:29.073054 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:29.073054 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:29.073054 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:29.074326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:29.089398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:29.128964 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2367/4756] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:43:28 2022] GET /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users => generated 1081 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:29.133518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:29.152598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa20f4-95bf-4f5f-89be-6a698981f207 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:29.161133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdcd8a-78f6-41c0-a332-a1a783fb092a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:29.163945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:29.165637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:29.166215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:29.166699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/20babb7a48594cf2889027b4d5456894` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:29.169302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=20babb7a48594cf2889027b4d5456894)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:29.170584 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:29.170584 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:29.170584 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:29.172142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:29.172574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:29.172796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:29.173078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:29.173351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:29.193253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:29.194825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:29.204211 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2368/4757] 10.222.0.27 () {58 vars in 1342 bytes} [Tue Oct 18 13:43:29 2022] HEAD /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/20babb7a48594cf2889027b4d5456894 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:29.208447 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2390/4758] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:43:29.209043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:29.222961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e24c0-a91e-4f7e-b176-733ac64805cf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:29.229495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:29.230218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:29.230491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:29.230765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/20babb7a48594cf2889027b4d5456894` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:29.232763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=20babb7a48594cf2889027b4d5456894)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:29.234573 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:29.234573 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:29.234573 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:29.235812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:29.358350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '20babb7a48594cf2889027b4d5456894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:29.460640 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2369/4759] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 13:43:29 2022] DELETE /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/20babb7a48594cf2889027b4d5456894 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:29.463048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:29.479309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb1013-aec3-4e28-935e-972d88c1169f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:29.602931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:29.605085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:29.606969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:29.607560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/f1533b51d37e46f98eb5703776e27a51` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:29.610797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=f1533b51d37e46f98eb5703776e27a51)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:29.613232 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:29.613232 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:29.613232 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:29.614837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:29.636980 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2391/4760] 10.222.0.27 () {58 vars in 1342 bytes} [Tue Oct 18 13:43:29 2022] HEAD /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/f1533b51d37e46f98eb5703776e27a51 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:29.640764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:29.655073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8fd0-6bc4-430b-ae80-5dd3d8a8e648 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:29.683266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:29.685588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:29.685880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:29.686370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/f1533b51d37e46f98eb5703776e27a51` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:29.693535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=f1533b51d37e46f98eb5703776e27a51)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:29.696524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:29.804040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f1533b51d37e46f98eb5703776e27a51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:29.937119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2370/4761] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 13:43:29 2022] DELETE /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/f1533b51d37e46f98eb5703776e27a51 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:29.941032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:29.956521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ac3c-ff70-4e83-a3a1-4190f4993a75 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:30.146674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:30.150608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:30.150608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:30.151345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/9cc808e0236341d5adee0ec77fcf56da` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:30.156272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=9cc808e0236341d5adee0ec77fcf56da)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:30.160715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:30.190462 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2392/4762] 10.222.0.27 () {58 vars in 1342 bytes} [Tue Oct 18 13:43:29 2022] HEAD /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/9cc808e0236341d5adee0ec77fcf56da => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:30.198779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:30.218043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc26a9b-c2cf-4b07-b333-46ae17a4b77b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:30.224381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:30.225841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:30.226154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:30.226671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/9cc808e0236341d5adee0ec77fcf56da` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:30.228597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee, user_id=9cc808e0236341d5adee0ec77fcf56da)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:30.231314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:30.300567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9cc808e0236341d5adee0ec77fcf56da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:30.453632 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2371/4763] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 13:43:30 2022] DELETE /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users/9cc808e0236341d5adee0ec77fcf56da => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:30.457809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:30.487724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac5cc-c0a9-4aab-be51-c9e64186fefd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:30.544611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:30.580816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:30.581639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:30.581930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:30.582261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:30.583478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:30.585077 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:30.585077 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:30.585077 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:30.586325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:30.598685 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2393/4764] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:43:30 2022] GET /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee/users => generated 145 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:30.605379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:30.618726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771b00d-854c-4c33-b3ca-70cff3fed4f9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:30.635549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:30.645998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:30.655391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:30.663924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:30.663924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:30.663924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users/9cc808e0236341d5adee0ec77fcf56da` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:30.663924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9cc808e0236341d5adee0ec77fcf56da)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:30.668331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:30.707523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:30.745033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb876c0-f600-4917-a651-7d0ce9b60d8a tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:30.753620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:30.755172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:30.755172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:30.755172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] PATH_INFO: `/v3/users/e3e95855fbee4b6faacb5fbb89dbd22e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:30.755984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e95855fbee4b6faacb5fbb89dbd22e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:30.758851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:30.829074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc808e0236341d5adee0ec77fcf56da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:30.830049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc808e0236341d5adee0ec77fcf56da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:30.918985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc808e0236341d5adee0ec77fcf56da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:30.919728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc808e0236341d5adee0ec77fcf56da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:30.932517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc808e0236341d5adee0ec77fcf56da'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:30.957030 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2372/4765] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:30 2022] DELETE /identity/v3/users/9cc808e0236341d5adee0ec77fcf56da => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:30.961925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:30.963964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:31.049154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e95855fbee4b6faacb5fbb89dbd22e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.066723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e95855fbee4b6faacb5fbb89dbd22e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.068148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e95855fbee4b6faacb5fbb89dbd22e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.072775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f8b26-3123-431b-8772-1fec29ae0ec9 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:31.074456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:31.075453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:31.075827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:31.076199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users/f1533b51d37e46f98eb5703776e27a51` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:31.077537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f1533b51d37e46f98eb5703776e27a51)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:31.080033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:31.105276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e95855fbee4b6faacb5fbb89dbd22e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.175363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-854fe4a1-677c-400c-ae51-d4b0ccebf15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e95855fbee4b6faacb5fbb89dbd22e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.194160 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2394/4766] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:30 2022] DELETE /identity/v3/users/e3e95855fbee4b6faacb5fbb89dbd22e => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:31.199730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:31.200191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:31.200567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:31.224856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:31.227038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:31.314960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1533b51d37e46f98eb5703776e27a51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.317032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1533b51d37e46f98eb5703776e27a51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.349360 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2395/4767] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:31.393311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1533b51d37e46f98eb5703776e27a51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.396737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1533b51d37e46f98eb5703776e27a51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.406922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1533b51d37e46f98eb5703776e27a51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.422982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:31.424749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:31.474363 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2373/4768] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:30 2022] DELETE /identity/v3/users/f1533b51d37e46f98eb5703776e27a51 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:31.478422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:31.479856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:31.536084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca49d2-49be-4d53-8a45-79322be342ed None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:31.616779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f15bb2-0ebe-4d6e-8d33-9e2dbaf941dd tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:31.636615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:31.637285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:31.637569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:31.637847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users/20babb7a48594cf2889027b4d5456894` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:31.639147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=20babb7a48594cf2889027b4d5456894)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:31.641203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:31.644150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:31.645556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:31.645840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:31.646135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:31.734875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:31.737141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:31.751652 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2396/4769] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:31.793922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20babb7a48594cf2889027b4d5456894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.797173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20babb7a48594cf2889027b4d5456894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.877554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20babb7a48594cf2889027b4d5456894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.877554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20babb7a48594cf2889027b4d5456894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.902128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20babb7a48594cf2889027b4d5456894'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:31.935192 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2374/4770] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:31 2022] DELETE /identity/v3/users/20babb7a48594cf2889027b4d5456894 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:31.939214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:31.958654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd2266-08bd-443a-9c77-b75e20fc5c78 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:32.059859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:32.063859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:32.063859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:32.063859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:32.063859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a1d6dd0a3dc34cc191359c2af847d5ee)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:32.064499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:32.153787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:32.156167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:32.211202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2397/4771] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:43:31 2022] DELETE /identity/v3/groups/a1d6dd0a3dc34cc191359c2af847d5ee => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:32.217561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:32.234204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:32.286360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:32.362142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cb2c9-7158-4667-bda6-b9e14650fa0f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:32.417961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f628c6-bd96-4607-9a84-b49ba8566e4b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:32.433002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:32.437413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:32.437413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:32.437413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:32.437413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:32.438440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:32.507989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:32.508894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:32.509177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:32.509527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] PATH_INFO: `/v3/projects/eb1d5573ca0b450581b827de81665890` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:32.511310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1d5573ca0b450581b827de81665890)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:32.513935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:32.525813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2398/4772] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:32 2022] POST /identity/v3/groups => generated 326 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:32.529644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:32.555698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa7b8c-79bc-4e57-924d-850489297c85 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:32.575129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:32.576018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:32.576304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:32.576584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:32.577221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:32.579165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:32.639656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:32.683497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1d5573ca0b450581b827de81665890', 'request_id': 'req-4bc67b5d-061d-41a5-b255-e411ae579511'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:32.704163 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2399/4773] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:32 2022] POST /identity/v3/groups => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:32.708770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:32.722222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1d5573ca0b450581b827de81665890', 'request_id': 'req-4bc67b5d-061d-41a5-b255-e411ae579511'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:32.731517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b3c3e-a4dc-4dce-ac17-af124c7b2962 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:32.930806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1d5573ca0b450581b827de81665890', 'request_id': 'req-4bc67b5d-061d-41a5-b255-e411ae579511'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:32.954463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] The token cache is being invalidate because project eb1d5573ca0b450581b827de81665890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:32.954758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:32.960113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4bc67b5d-061d-41a5-b255-e411ae579511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:32.976109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2375/4774] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:32 2022] DELETE /identity/v3/projects/eb1d5573ca0b450581b827de81665890 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:32.982475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e9485-1cd9-498d-a920-f1c5e99c91fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:32.982782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e9485-1cd9-498d-a920-f1c5e99c91fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:32.983046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e9485-1cd9-498d-a920-f1c5e99c91fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:32.994918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:32.995564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:32.995852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:32.996134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:32.997126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:32.999133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:33.058827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e34e9485-1cd9-498d-a920-f1c5e99c91fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:33.060414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e34e9485-1cd9-498d-a920-f1c5e99c91fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:33.119746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:33.123108 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2400/4775] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:32 2022] POST /identity/v3/groups => generated 327 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:33.127996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:33.135028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:33.179200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83504678-2eba-404f-b2ca-d1cc05fc303c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:33.203585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:33.205447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:33.205734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:33.208166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:33.208985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:33.215678 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:33.215678 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:33.215678 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:33.216454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:33.252352 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2401/4776] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 18 13:43:33 2022] GET /identity/v3/groups => generated 1488 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:43:33.255977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:33.288197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14143558-a7fb-4c16-b420-dbcc25f51afe tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:33.295580 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2376/4777] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:33.308431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4914aa-9623-4bb4-b865-25b1a6633761 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:33.308740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4914aa-9623-4bb4-b865-25b1a6633761 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:33.309051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4914aa-9623-4bb4-b865-25b1a6633761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:33.313220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:33.320741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:33.321350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:33.321350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/f36b36b24bf343b798f12df2ef6c520d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:33.342472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f36b36b24bf343b798f12df2ef6c520d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:33.344623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:33.361809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2c4914aa-9623-4bb4-b865-25b1a6633761 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:33.362838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c4914aa-9623-4bb4-b865-25b1a6633761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:33.387939 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2377/4778] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:33.389209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4914aa-9623-4bb4-b865-25b1a6633761 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:33.403144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4914aa-9623-4bb4-b865-25b1a6633761 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:33.413800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:33.415142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:33.415844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:33.415844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:33.416926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:33.417305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:33.419417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:33.445960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2378/4779] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:33.482240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:33.499427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bd25-3ad1-4749-a3b8-e3531875293e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:33.505607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:33.506618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:33.507160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:33.507774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:33.508600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:33.510948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:33.536417 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2402/4780] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:43:33 2022] DELETE /identity/v3/groups/f36b36b24bf343b798f12df2ef6c520d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:33.542211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:33.662646 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2379/4781] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:33 2022] POST /identity/v3/projects => generated 353 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:33.663833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:33.683755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c346-056b-4653-a9ff-13536cfaf193 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:33.841509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739e9b-4a49-4016-a0de-e0ab7119846d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:33.843871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:33.849130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:33.849130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:33.849130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/34b267584be24aea93dcd08acc61f701` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:33.852856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:33.853492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:33.853778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:33.854083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:33.854723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:33.857112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:33.865170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_group(group_id=34b267584be24aea93dcd08acc61f701)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:33.873975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:33.978391 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2380/4782] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:33 2022] POST /identity/v3/users => generated 277 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:33.983326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:34.020687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b6c1f-aaae-42f2-abd3-3f7f45a5706f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:34.028143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:34.029032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.029570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.030111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.030972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:34.031959 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2403/4783] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:43:33 2022] DELETE /identity/v3/groups/34b267584be24aea93dcd08acc61f701 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:34.038545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:34.038896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:34.055559 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2381/4784] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:34.056825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:34.073418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f412-f9b7-43f9-8a40-486f7dfaef35 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:34.201570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee5e7-406e-4aaf-b034-847f7d8498d1 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:34.218374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:34.220456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.221947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.221947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/1de63276744b4e799d42f1ecf90d00d6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.238624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:34.239598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.240136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.240613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.241844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:34.249254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:34.249373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1de63276744b4e799d42f1ecf90d00d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:34.251330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:34.261525 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2382/4785] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:34.267375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:34.323932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7de42-b0d7-442f-837d-46e77db42642 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:34.351121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:34.351493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.351781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.352059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] PATH_INFO: `/v3/projects/c65d3c989abd41f8a2241766ead9ca26/users/b5f3674609574563993ec04122ffa507/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.392027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65d3c989abd41f8a2241766ead9ca26, user_id=b5f3674609574563993ec04122ffa507, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:34.394503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:34.500622 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2404/4786] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:43:34 2022] DELETE /identity/v3/groups/1de63276744b4e799d42f1ecf90d00d6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:34.504921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:34.519926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:34.540723 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2383/4787] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:34 2022] PUT /identity/v3/projects/c65d3c989abd41f8a2241766ead9ca26/users/b5f3674609574563993ec04122ffa507/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:34.541629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:34.697043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90afa0d-e9bd-4ac9-9930-e87211a591ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:34.714133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2800cf-1e27-4e68-adb1-2be1d9148209 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:34.720308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2800cf-1e27-4e68-adb1-2be1d9148209 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.720928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2800cf-1e27-4e68-adb1-2be1d9148209 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.721418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2800cf-1e27-4e68-adb1-2be1d9148209 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.723594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2800cf-1e27-4e68-adb1-2be1d9148209 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:34.725770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2800cf-1e27-4e68-adb1-2be1d9148209 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:34.767298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53448f13-1d08-422d-a380-b9ac7d2d6b60 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:34.810545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:34.865196 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2384/4788] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:34 2022] POST /identity/v3/users => generated 323 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:34.872414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ebe93-989d-48dc-be61-22e6a33a4776 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.872698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ebe93-989d-48dc-be61-22e6a33a4776 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.872970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ebe93-989d-48dc-be61-22e6a33a4776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.876333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e4d9659b04dbd8deb7543d4fa8e9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f86649d8847478ca27cc667ea51b4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:34.877520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.877994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.878563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.879512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:34.879972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:34.882591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:34.898267 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2405/4789] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:34.899566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:34.931087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bbcdf-e0de-4956-bad0-0c25176a262d tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:34.932873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b6ebe93-989d-48dc-be61-22e6a33a4776 None None] MFA Rules not processed for user `b5f3674609574563993ec04122ffa507`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:34.936321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b6ebe93-989d-48dc-be61-22e6a33a4776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:34.944641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:34.945528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:34.945837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:34.947272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:34.949395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:34.952165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:35.034163 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2385/4790] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:35.034163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ebe93-989d-48dc-be61-22e6a33a4776 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:35.049010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ebe93-989d-48dc-be61-22e6a33a4776 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:35.054693 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2406/4791] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:34 2022] POST /identity/v3/groups => generated 326 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:35.055963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:35.059519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:35.065824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e4d9659b04dbd8deb7543d4fa8e9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f86649d8847478ca27cc667ea51b4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:35.068437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:35.071461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:35.071461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:35.072073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:35.076858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:35.195984 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2386/4792] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:35 2022] POST /identity/v3/projects => generated 348 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:35.197475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:35.198293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:35.211056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020bd8e-e73a-4e4e-ad46-8aa4b4e3f186 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:35.318552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:35.319945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:35.322522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:35.324474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:35.349325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697d07a-250a-4ab1-be17-e9afe6203593 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:35.362481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:35.364489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:35.370266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:35.370266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/536b6bdbc41c4c16a3907ccd0c3188fe/users/f710d1fac533407498cf1bc540df1418` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:35.437415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=536b6bdbc41c4c16a3907ccd0c3188fe, user_id=f710d1fac533407498cf1bc540df1418)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:35.437415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:35.515311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:35.518043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:35.552314 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2387/4793] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 13:43:35 2022] PUT /identity/v3/groups/536b6bdbc41c4c16a3907ccd0c3188fe/users/f710d1fac533407498cf1bc540df1418 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:35.553935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:35.587626 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2407/4794] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:35.589309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:35.605127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217039f-d5a2-4e50-8607-b78cce79ec2d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:35.684281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4acfb-e6c1-44d8-a84c-d8d9397064b7 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:35.692335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e4d9659b04dbd8deb7543d4fa8e9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f86649d8847478ca27cc667ea51b4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:35.693161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:35.693521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:35.693836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:35.693961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:35.694489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:35.694816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:35.695096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:35.695508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:35.695829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:35.695936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:35.697455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:35.698195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:35.718225 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2388/4795] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:35.747357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:35.824225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2408/4796] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:43:35 2022] POST /identity/v3/groups => generated 326 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:35.828933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:35.859630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231cea-b8b1-4db3-952f-3b5e76d3de57 tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:35.875001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:35.877434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:35.879541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:35.879950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/0c483299cb8e4ce0ad2a74e36ce285c4/users/f710d1fac533407498cf1bc540df1418` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:35.898608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0c483299cb8e4ce0ad2a74e36ce285c4, user_id=f710d1fac533407498cf1bc540df1418)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:35.898608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:36.094410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2389/4797] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 13:43:35 2022] PUT /identity/v3/groups/0c483299cb8e4ce0ad2a74e36ce285c4/users/f710d1fac533407498cf1bc540df1418 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:36.098825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:36.123159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0c363-9ea3-4c43-a14f-ded8aef4b1bf tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:36.305195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:36.306172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:36.306369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:36.312570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users/f710d1fac533407498cf1bc540df1418/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:36.312570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=f710d1fac533407498cf1bc540df1418)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:36.312570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:36.349359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2409/4798] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Oct 18 13:43:36 2022] GET /identity/v3/users/f710d1fac533407498cf1bc540df1418/groups => generated 838 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:36.349948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:36.365281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edd535-2269-458a-a77b-517225c2d25b tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:36.376902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:36.377665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:36.377860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:36.378774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/0c483299cb8e4ce0ad2a74e36ce285c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:36.382168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0c483299cb8e4ce0ad2a74e36ce285c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:36.383202 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:36.383202 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:36.383202 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:36.388574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:36.600565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:36.600999 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2390/4799] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:43:36 2022] DELETE /identity/v3/groups/0c483299cb8e4ce0ad2a74e36ce285c4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:36.613519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce73a3b-f0ba-4b9a-8cdd-239ba4545533 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:36.721401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:36.722378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:36.723456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:36.724057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/groups/536b6bdbc41c4c16a3907ccd0c3188fe` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:36.726158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_group(group_id=536b6bdbc41c4c16a3907ccd0c3188fe)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:36.729446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:36.878882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:36.898746 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2410/4800] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:43:36 2022] DELETE /identity/v3/groups/536b6bdbc41c4c16a3907ccd0c3188fe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:36.903682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:36.918227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b116f6-3aa1-44ab-8020-451f6959edf4 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:37.038873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:37.039614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:37.039963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:37.040312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/users/f710d1fac533407498cf1bc540df1418` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:37.044040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f710d1fac533407498cf1bc540df1418)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:37.046203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:37.185923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f710d1fac533407498cf1bc540df1418'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.186728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f710d1fac533407498cf1bc540df1418'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.262536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:37.266971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:37.278961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f710d1fac533407498cf1bc540df1418'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.280134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f710d1fac533407498cf1bc540df1418'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.292436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f710d1fac533407498cf1bc540df1418'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.350197 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2391/4801] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:36 2022] DELETE /identity/v3/users/f710d1fac533407498cf1bc540df1418 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:37.355447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:37.357120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:37.439533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389252-9730-49ef-a9c0-ceef1093eb2c tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:37.549123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330a184-97c3-42d8-85a0-fccd4e13d051 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:37.562135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:37.562753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:37.563040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:37.563312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/domains/0343510d1a07475da32d927472f8bd49` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:37.564974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0343510d1a07475da32d927472f8bd49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:37.566644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:37.570365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e4d9659b04dbd8deb7543d4fa8e9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f86649d8847478ca27cc667ea51b4d2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:37.571099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:37.571764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:37.571764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] PATH_INFO: `/v3/projects/52292579c3ea4973aa83219d3b8d56f4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:37.576447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52292579c3ea4973aa83219d3b8d56f4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:37.580872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:37.624306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0343510d1a07475da32d927472f8bd49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.625077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0343510d1a07475da32d927472f8bd49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.757033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52292579c3ea4973aa83219d3b8d56f4', 'request_id': 'req-8b1e7524-8d82-4f34-8d09-50ee2e05570a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.786947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0343510d1a07475da32d927472f8bd49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.791046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0343510d1a07475da32d927472f8bd49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.793677 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2392/4802] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:43:37 2022] PATCH /identity/v3/domains/0343510d1a07475da32d927472f8bd49 => generated 278 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:43:37.794627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:37.798003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52292579c3ea4973aa83219d3b8d56f4', 'request_id': 'req-8b1e7524-8d82-4f34-8d09-50ee2e05570a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.799330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:37.839199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=1,keystone:SELECT=91,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:37.890690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52292579c3ea4973aa83219d3b8d56f4', 'request_id': 'req-8b1e7524-8d82-4f34-8d09-50ee2e05570a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.929484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] The token cache is being invalidate because project 52292579c3ea4973aa83219d3b8d56f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:37.930162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.932798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:37.939743 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2411/4803] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:37 2022] DELETE /identity/v3/projects/52292579c3ea4973aa83219d3b8d56f4 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:37.961158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:37.962923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:37.964345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513383a-6bcd-4fa9-8a1e-37f64e7b7912 tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:38.092895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '230ab77530a44c339a60d39b443dc968', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '601ca86b1dde429b9663626d51a92522', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:38.093830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:38.094283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:38.094749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] PATH_INFO: `/v3/domains/0343510d1a07475da32d927472f8bd49` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:38.127013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0343510d1a07475da32d927472f8bd49)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:38.130684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:38.140365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7524-8d82-4f34-8d09-50ee2e05570a tempest-RoutersAdminTest-654254505 tempest-RoutersAdminTest-654254505-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:38.152531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:38.153299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:38.153635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:38.153973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:38.160521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:38.188530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0343510d1a07475da32d927472f8bd49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.209744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0343510d1a07475da32d927472f8bd49'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.305014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:38.306537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:38.323421 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2412/4804] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:38.461911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0343510d1a07475da32d927472f8bd49', 'request_id': 'req-11438da2-33f5-4261-9484-b7e1acea073f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.478338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0343510d1a07475da32d927472f8bd49', 'request_id': 'req-11438da2-33f5-4261-9484-b7e1acea073f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.587199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0343510d1a07475da32d927472f8bd49', 'request_id': 'req-11438da2-33f5-4261-9484-b7e1acea073f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.612253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] The token cache is being invalidate because project 0343510d1a07475da32d927472f8bd49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:38.613258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.615346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.645602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0343510d1a07475da32d927472f8bd49', 'request_id': 'req-11438da2-33f5-4261-9484-b7e1acea073f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.646549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0343510d1a07475da32d927472f8bd49', 'request_id': 'req-11438da2-33f5-4261-9484-b7e1acea073f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.650223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11438da2-33f5-4261-9484-b7e1acea073f tempest-GroupsV3TestJSON-929297748 tempest-GroupsV3TestJSON-929297748-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0343510d1a07475da32d927472f8bd49', 'request_id': 'req-11438da2-33f5-4261-9484-b7e1acea073f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:38.666667 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2393/4805] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:43:37 2022] DELETE /identity/v3/domains/0343510d1a07475da32d927472f8bd49 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:38.671811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:38.673747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:38.812663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6eed-4b94-49d9-9f96-941700ef686e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:38.915240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:38.915894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:38.916218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:38.916492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] PATH_INFO: `/v3/users/6095a02a33344d98b597ae4061591930` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:38.918372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6095a02a33344d98b597ae4061591930)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:38.921114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:38.977582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:39.147781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6095a02a33344d98b597ae4061591930'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:39.156081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6095a02a33344d98b597ae4061591930'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:39.157154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6095a02a33344d98b597ae4061591930'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:39.174641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6095a02a33344d98b597ae4061591930'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:39.249867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6095a02a33344d98b597ae4061591930'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:39.259327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2413/4806] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:38 2022] DELETE /identity/v3/users/6095a02a33344d98b597ae4061591930 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:39.263783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:39.264415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:39.265059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:39.307608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:39.309021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:39.510145 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2394/4807] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:39.586395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:39.589213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:39.590592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:39.729966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ad516-80f6-4d10-8421-733c429f4af2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:39.734839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:39.735637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:39.736090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:39.736508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:39.758398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:39.763045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:39.792348 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2414/4808] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:40.336227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:40.376121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:41.038766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:41.096452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:41.469773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:41.472293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:41.508624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f40c9c-fcf8-4ee4-bf28-c7d11dd19af9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:41.535223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:41.535944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:41.536223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:41.536663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] PATH_INFO: `/v3/projects/1e65dd919ff247ec9da9998cd344e2dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:41.538939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e65dd919ff247ec9da9998cd344e2dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:41.543445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:41.615294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=84,keystone:DELETE=14 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:41.778948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e65dd919ff247ec9da9998cd344e2dc', 'request_id': 'req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:41.814918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e65dd919ff247ec9da9998cd344e2dc', 'request_id': 'req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:41.907804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e65dd919ff247ec9da9998cd344e2dc', 'request_id': 'req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:41.923892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] The token cache is being invalidate because project 1e65dd919ff247ec9da9998cd344e2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:41.924195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:41.924885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c5bdead7-0e5f-41fe-a4ec-3fa9e2e254f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:41.929101 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2395/4809] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:41 2022] DELETE /identity/v3/projects/1e65dd919ff247ec9da9998cd344e2dc => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:41.932824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:41.943142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17952ba9-ac0a-4e36-be55-2417823130ea service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:42.016147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:42.016855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:42.017141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:42.017415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] PATH_INFO: `/v3/users/230ab77530a44c339a60d39b443dc968` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:42.019161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=230ab77530a44c339a60d39b443dc968)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:42.021600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:42.158606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:42.355860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230ab77530a44c339a60d39b443dc968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:42.386392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230ab77530a44c339a60d39b443dc968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:42.388659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230ab77530a44c339a60d39b443dc968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:42.413182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230ab77530a44c339a60d39b443dc968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:42.495180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230ab77530a44c339a60d39b443dc968'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:42.504066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f032-84ed-42a1-a96c-9190ab87a9e9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:42.504578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f032-84ed-42a1-a96c-9190ab87a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:42.504809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f032-84ed-42a1-a96c-9190ab87a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:42.508673 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2415/4810] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:41 2022] DELETE /identity/v3/users/230ab77530a44c339a60d39b443dc968 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:42.562811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:42.565901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:42.591670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a44f032-84ed-42a1-a96c-9190ab87a9e9 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:42.596151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a44f032-84ed-42a1-a96c-9190ab87a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:42.775319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8419e-d98c-4246-b08a-582c2a9b9806 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:42.783455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:42.784239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:42.784596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:42.784916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] PATH_INFO: `/v3/users/b5f3674609574563993ec04122ffa507` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:42.786126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f3674609574563993ec04122ffa507)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:42.789739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:42.813565 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2396/4811] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:42.820656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:42.821724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:42.822091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:42.834660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:42.887715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:42.893414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:42.904302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2397/4812] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:42.924374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:42.926762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:43.076610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dec3a5-0c28-4969-9a75-b571fdb4e713 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:43.094609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914159f-c99c-4e1e-8729-e45dc51576b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:43.095473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914159f-c99c-4e1e-8729-e45dc51576b3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:43.095907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914159f-c99c-4e1e-8729-e45dc51576b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:43.096328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914159f-c99c-4e1e-8729-e45dc51576b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:43.117121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914159f-c99c-4e1e-8729-e45dc51576b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:43.118879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914159f-c99c-4e1e-8729-e45dc51576b3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:43.140235 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2398/4813] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:43.156714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f3674609574563993ec04122ffa507'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:43.191028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f3674609574563993ec04122ffa507'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:43.192139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f3674609574563993ec04122ffa507'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:43.254999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f3674609574563993ec04122ffa507'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:43.388014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f3674609574563993ec04122ffa507'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:43.400099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:43.400383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:43.400650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:43.403411 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2416/4814] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:42 2022] DELETE /identity/v3/users/b5f3674609574563993ec04122ffa507 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:43.436154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:43.437816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:43.473322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:43.530888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2399/4815] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:43.539049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:43.540672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:43.683836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190851-dfb1-4711-9ccd-5545f8a6390e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:43.694584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8f35f-b2d8-4af7-9cc5-09ff0ce14524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:43.695344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f35f-b2d8-4af7-9cc5-09ff0ce14524 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:43.695637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f35f-b2d8-4af7-9cc5-09ff0ce14524 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:43.695915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f35f-b2d8-4af7-9cc5-09ff0ce14524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:43.708679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:43.710398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:43.741972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:43.759135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f35f-b2d8-4af7-9cc5-09ff0ce14524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:43.763031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f35f-b2d8-4af7-9cc5-09ff0ce14524 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:43.775618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7d28-b8a9-4236-89e3-cb5c1b38b439 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:43.790159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:43.792439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:43.792889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:43.793328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] PATH_INFO: `/v3/projects/601ca86b1dde429b9663626d51a92522` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:43.796491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=601ca86b1dde429b9663626d51a92522)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:43.802435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:43.805319 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2417/4816] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:43:44.042472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601ca86b1dde429b9663626d51a92522', 'request_id': 'req-21ba1068-2113-4399-9a9c-6a9429dec738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:44.072017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601ca86b1dde429b9663626d51a92522', 'request_id': 'req-21ba1068-2113-4399-9a9c-6a9429dec738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:44.192296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601ca86b1dde429b9663626d51a92522', 'request_id': 'req-21ba1068-2113-4399-9a9c-6a9429dec738'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:44.231018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] The token cache is being invalidate because project 601ca86b1dde429b9663626d51a92522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:44.231711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:44.234177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-21ba1068-2113-4399-9a9c-6a9429dec738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:44.236283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2400/4817] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:43 2022] DELETE /identity/v3/projects/601ca86b1dde429b9663626d51a92522 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:44.240970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59dbaa-5aed-49b3-92ad-06b7d798cff2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:44.241458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59dbaa-5aed-49b3-92ad-06b7d798cff2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:44.241565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59dbaa-5aed-49b3-92ad-06b7d798cff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:44.296374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1f59dbaa-5aed-49b3-92ad-06b7d798cff2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:44.296374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f59dbaa-5aed-49b3-92ad-06b7d798cff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:44.412773 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2418/4818] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:44.420589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db88f4-010b-4f36-bf7c-1705e274f43d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:44.420879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db88f4-010b-4f36-bf7c-1705e274f43d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:44.421160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db88f4-010b-4f36-bf7c-1705e274f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:44.471945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-06db88f4-010b-4f36-bf7c-1705e274f43d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:44.474857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-06db88f4-010b-4f36-bf7c-1705e274f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:44.500847 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2401/4819] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:44.501780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59dbaa-5aed-49b3-92ad-06b7d798cff2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:44.512409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59dbaa-5aed-49b3-92ad-06b7d798cff2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:44.517391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:44.518018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:44.518343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:44.518617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:44.519309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:44.519752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:44.521171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:44.524925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:44.543287 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2419/4820] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:44.547624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db88f4-010b-4f36-bf7c-1705e274f43d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:44.557784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db88f4-010b-4f36-bf7c-1705e274f43d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:44.564064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:44.565083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:44.565716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:44.566262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:44.567149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:44.570871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:44.693915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:44.694568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:44.717108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdc10-d5a8-4d6b-899a-b6d7a3ae2bc8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:44.725264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:44.726149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:44.726613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:44.727087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] PATH_INFO: `/v3/projects/c65d3c989abd41f8a2241766ead9ca26` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:44.735336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65d3c989abd41f8a2241766ead9ca26)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:44.737763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:44.741493 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2402/4821] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:44 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:44.745237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:44.820194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b31d2-f9b8-4df0-be6d-c18f1685ffb4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:44.825603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:44.826422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:44.826857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:44.827308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:44.828233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:44.830331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:44.909750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65d3c989abd41f8a2241766ead9ca26', 'request_id': 'req-5a1ba8da-1c80-4b4c-b911-47705097dc0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:44.924768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65d3c989abd41f8a2241766ead9ca26', 'request_id': 'req-5a1ba8da-1c80-4b4c-b911-47705097dc0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:44.972840 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2403/4822] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:44 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:44.977061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.013464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9626419-beb5-4980-97fb-5e624d6dac10 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:45.115593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65d3c989abd41f8a2241766ead9ca26', 'request_id': 'req-5a1ba8da-1c80-4b4c-b911-47705097dc0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:45.161969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] The token cache is being invalidate because project c65d3c989abd41f8a2241766ead9ca26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:45.162171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:45.162716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:45.162976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.163263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.163537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.164201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:45.165783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a1ba8da-1c80-4b4c-b911-47705097dc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:45.168589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:45.171192 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2420/4823] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:44 2022] DELETE /identity/v3/projects/c65d3c989abd41f8a2241766ead9ca26 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:45.176490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173e29-fc03-40d0-8cf2-663005f08697 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.177347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173e29-fc03-40d0-8cf2-663005f08697 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.177787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173e29-fc03-40d0-8cf2-663005f08697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.195882 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2404/4824] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:45.199915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.205139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:45.227225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f1173e29-fc03-40d0-8cf2-663005f08697 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:45.228398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1173e29-fc03-40d0-8cf2-663005f08697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:45.237514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b660-9e7d-4626-b1a8-e763499cdecc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:45.249804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2421/4825] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:45.259243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:45.259463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd74a3-604e-4ddf-8c60-4e84e1a0b03c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.259604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd74a3-604e-4ddf-8c60-4e84e1a0b03c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.259870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.260145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.260400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd74a3-604e-4ddf-8c60-4e84e1a0b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.260517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.261451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:45.263108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:45.291180 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2405/4826] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:45.295959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.300150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3acd74a3-604e-4ddf-8c60-4e84e1a0b03c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:45.308625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3acd74a3-604e-4ddf-8c60-4e84e1a0b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:45.326287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124d939-6a35-46a0-9f3e-b1c89e4b0491 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:45.327059 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2422/4827] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:45.328614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd74a3-604e-4ddf-8c60-4e84e1a0b03c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.331611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4889-42e8-4df5-84d3-422924abfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:45.332285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4889-42e8-4df5-84d3-422924abfd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.332564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4889-42e8-4df5-84d3-422924abfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.333233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4889-42e8-4df5-84d3-422924abfd9b admin admin] PATH_INFO: `/v3/projects/2a808fdecd60498fae100df1ad19ebdd/users/6e6fe25d3b11421ea8ca66ecda37d780/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.352682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd74a3-604e-4ddf-8c60-4e84e1a0b03c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:45.369858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:45.370013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d4889-42e8-4df5-84d3-422924abfd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a808fdecd60498fae100df1ad19ebdd, user_id=6e6fe25d3b11421ea8ca66ecda37d780, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:45.370434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.370722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.371137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.372230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:45.372547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:45.374212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:45.374774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d4889-42e8-4df5-84d3-422924abfd9b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:45.391434 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2423/4828] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:45.395757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.410167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428a202-1f77-4e14-86dd-022a415c3415 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:45.415743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:45.416558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.417557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.417557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.418414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:45.420515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:45.483875 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2406/4829] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:45 2022] PUT /identity/v3/projects/2a808fdecd60498fae100df1ad19ebdd/users/6e6fe25d3b11421ea8ca66ecda37d780/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:45.495831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a577-e6ea-4cd6-873a-b262ee290900 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.496313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a577-e6ea-4cd6-873a-b262ee290900 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.496914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a577-e6ea-4cd6-873a-b262ee290900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.534093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9950a577-e6ea-4cd6-873a-b262ee290900 None None] MFA Rules not processed for user `6e6fe25d3b11421ea8ca66ecda37d780`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:45.535479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9950a577-e6ea-4cd6-873a-b262ee290900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:45.558887 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2424/4830] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:45 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:45.563284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.758278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:45.782654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a049-5f6b-4d86-a45a-29310761b0c4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:45.788087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:45.791720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.791720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.791720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.791720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:45.792076 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2407/4831] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:45.792816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:45.815389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a577-e6ea-4cd6-873a-b262ee290900 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.932120 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2425/4832] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:45 2022] POST /identity/v3/users => generated 294 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:45.935866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:45.962710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbd4b-6005-46ec-b1b3-80a8202b478f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:45.984709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:45.985257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:45.985540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:45.985816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:45.986523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:45.988142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:46.006577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a577-e6ea-4cd6-873a-b262ee290900 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:46.008351 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2426/4833] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:43:46.015324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:46.020531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:46.021560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.027083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.027083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.027083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:46.027083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:46.046441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70611c-c75b-4919-b040-7976845f40ab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:46.075729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:46.076523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.076919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.077197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.078031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:46.080442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:46.105555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2427/4834] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:46.110815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:46.143320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35f18f-4ebf-44fd-a09d-db8815730fec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:46.164380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309232-da5e-4119-9ebf-870646454cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:46.165086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309232-da5e-4119-9ebf-870646454cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.165370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309232-da5e-4119-9ebf-870646454cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.165650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309232-da5e-4119-9ebf-870646454cb5 admin admin] PATH_INFO: `/v3/projects/eebd1a82541547918fb7591ce8c7abb5/users/65474459e9c0462d92d227b9299286a3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.210837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309232-da5e-4119-9ebf-870646454cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebd1a82541547918fb7591ce8c7abb5, user_id=65474459e9c0462d92d227b9299286a3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:46.219655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309232-da5e-4119-9ebf-870646454cb5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:46.226128 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2408/4835] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:45 2022] POST /identity/v3/projects => generated 375 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:46.231933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:46.313661 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2428/4836] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:46 2022] PUT /identity/v3/projects/eebd1a82541547918fb7591ce8c7abb5/users/65474459e9c0462d92d227b9299286a3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:46.325258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c15dc-0ce0-4509-baea-144c6d580094 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.326785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c15dc-0ce0-4509-baea-144c6d580094 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.327311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c15dc-0ce0-4509-baea-144c6d580094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.383464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:46.391623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c30e0-7acf-46ce-81ae-31b8e1da9b16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:46.452657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-661c15dc-0ce0-4509-baea-144c6d580094 None None] MFA Rules not processed for user `65474459e9c0462d92d227b9299286a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:46.456335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-661c15dc-0ce0-4509-baea-144c6d580094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:46.533119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:46.534193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.534668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.535941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.536784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:46.539893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:46.610042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:46.619363 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2429/4837] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:46.625289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c15dc-0ce0-4509-baea-144c6d580094 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:46.653201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c15dc-0ce0-4509-baea-144c6d580094 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:46.664855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:46.676848 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2409/4838] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:46 2022] POST /identity/v3/users => generated 294 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:46.678554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:46.680802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.681152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.681419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.682127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:46.684096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:46.712824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede5d2d-aaf2-453b-ba70-e90a8a2a7bf5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:46.734020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:46.735317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.736246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.736864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.739115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:46.744030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:46.802504 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2410/4839] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:46.807076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:46.832193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d3fe-2dc7-4391-93e9-d3a987041a2d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:46.842685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:46.851509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:46.851941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:46.852757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] PATH_INFO: `/v3/projects/c8c182c850f64661bcde84151b9f5853/users/926abc2a390e4e6abd0279c311c6451d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:46.859032 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2430/4840] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:46 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:46.860077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:46.909386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c182c850f64661bcde84151b9f5853, user_id=926abc2a390e4e6abd0279c311c6451d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:46.936493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.020843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5998400-ef24-4116-91dd-d58d76d27f83 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.032204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.032204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.032204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.032204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.032676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.034611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.098772 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2411/4841] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:46 2022] PUT /identity/v3/projects/c8c182c850f64661bcde84151b9f5853/users/926abc2a390e4e6abd0279c311c6451d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:47.103030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.159727 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2431/4842] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:46 2022] POST /identity/v3/users => generated 300 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:47.161113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.187377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da83e7-2156-49e2-8239-a15696059c0d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.296668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.297395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.298247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.298247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.298983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.306119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.364870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b065-b5ed-430d-9654-1ed6d53a50a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.366337 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2432/4843] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:47.367295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.379743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.380344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.380625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.380941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.381600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.384204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.392429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c09df8-ae3a-41e4-a986-4c960967911c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.423569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.423569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.423569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.423569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] PATH_INFO: `/v3/projects/3dc2aa9fc36a4a38b3d338b33e048a0c/users/e04c363b3cac40aa97e9deb9c0921e29/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.424288 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2412/4844] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:47.424288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.443238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833e805-a11b-4e8b-9156-19440a9f4705 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.460190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc2aa9fc36a4a38b3d338b33e048a0c, user_id=e04c363b3cac40aa97e9deb9c0921e29, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.464790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.465736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0733a-685c-4dcb-ac41-42c38481a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.466469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0733a-685c-4dcb-ac41-42c38481a67b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.466747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0733a-685c-4dcb-ac41-42c38481a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.468909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0733a-685c-4dcb-ac41-42c38481a67b admin admin] PATH_INFO: `/v3/projects/c8c182c850f64661bcde84151b9f5853/users/926abc2a390e4e6abd0279c311c6451d/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.471849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0733a-685c-4dcb-ac41-42c38481a67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c182c850f64661bcde84151b9f5853, user_id=926abc2a390e4e6abd0279c311c6451d, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.478041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0733a-685c-4dcb-ac41-42c38481a67b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.492067 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2413/4845] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:47 2022] PUT /identity/v3/projects/c8c182c850f64661bcde84151b9f5853/users/926abc2a390e4e6abd0279c311c6451d/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:47.502417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212ea3-427e-431e-9c76-5cfcad7beec2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.502907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212ea3-427e-431e-9c76-5cfcad7beec2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.503227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212ea3-427e-431e-9c76-5cfcad7beec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.559804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2433/4846] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:47 2022] PUT /identity/v3/projects/3dc2aa9fc36a4a38b3d338b33e048a0c/users/e04c363b3cac40aa97e9deb9c0921e29/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:47.563904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.584928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-af212ea3-427e-431e-9c76-5cfcad7beec2 None None] MFA Rules not processed for user `926abc2a390e4e6abd0279c311c6451d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:47.587263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af212ea3-427e-431e-9c76-5cfcad7beec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:47.736457 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2414/4847] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:47.737686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212ea3-427e-431e-9c76-5cfcad7beec2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.739633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867307-9d72-4f09-9b2a-29e1832198de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.753499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212ea3-427e-431e-9c76-5cfcad7beec2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.763456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.771134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.771134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.771134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.771134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.772223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8242a3-03e2-4e0c-ab6e-e4b3cb59db15 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.772223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8242a3-03e2-4e0c-ab6e-e4b3cb59db15 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.772388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.772472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8242a3-03e2-4e0c-ab6e-e4b3cb59db15 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.772472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8242a3-03e2-4e0c-ab6e-e4b3cb59db15 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.772472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8242a3-03e2-4e0c-ab6e-e4b3cb59db15 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.772761 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-2f8242a3-03e2-4e0c-ab6e-e4b3cb59db15 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:47.772761 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:47.772761 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:47.773760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8242a3-03e2-4e0c-ab6e-e4b3cb59db15 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.804195 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2434/4848] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:47.805151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.846007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484c48-068d-4fd2-8ad8-5dd5bba5ab6e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:47.851370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:47.852144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.852539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.852837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] PATH_INFO: `/v3/projects/3dc2aa9fc36a4a38b3d338b33e048a0c/users/e04c363b3cac40aa97e9deb9c0921e29/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:47.855242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc2aa9fc36a4a38b3d338b33e048a0c, user_id=e04c363b3cac40aa97e9deb9c0921e29, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:47.858554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:47.882410 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2435/4849] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:47 2022] PUT /identity/v3/projects/3dc2aa9fc36a4a38b3d338b33e048a0c/users/e04c363b3cac40aa97e9deb9c0921e29/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:47.906377 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2415/4850] 10.222.0.27 () {60 vars in 1185 bytes} [Tue Oct 18 13:43:47 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:47.914593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:47.988020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:47.988841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:47.989280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.055889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] MFA Rules not processed for user `e04c363b3cac40aa97e9deb9c0921e29`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:48.057753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:48.146330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f293637-38e1-4e70-b133-334998252193 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:48.159111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:48.159788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:48.161937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:48.163620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eb1a8881ba604ea3ba8abfb466664ed3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.169734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=eb1a8881ba604ea3ba8abfb466664ed3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:48.172042 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:48.172042 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:48.172042 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:48.181338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:48.189384 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2436/4851] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:43:47 2022] GET /identity/v3/OS-OAUTH1/consumers/eb1a8881ba604ea3ba8abfb466664ed3 => generated 220 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:43:48.193036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:48.230890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:48.241018 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2416/4852] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:48.255635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:48.257140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:48.258599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec09ed1-1ced-4bdc-8d49-09bd612737b6 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:48.273534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:48.274295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:48.274638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:48.274921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/eb1a8881ba604ea3ba8abfb466664ed3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.275814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=eb1a8881ba604ea3ba8abfb466664ed3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:48.277464 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:48.277464 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:48.277464 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:48.277969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:48.280695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invalidating token cache because consumer eb1a8881ba604ea3ba8abfb466664ed3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:48.281054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:48.290077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:48.360033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5de4f3-d42b-4059-a968-5daca067471e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:48.384729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:48.385389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:48.385671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:48.386153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.391187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:48.399152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:48.400216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'eb1a8881ba604ea3ba8abfb466664ed3', 'request_id': 'req-1c13f78a-a906-47a9-8252-1784942528c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:48.423998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:48.426462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:48.451627 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2417/4853] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:48.528948 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2437/4854] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:43:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/eb1a8881ba604ea3ba8abfb466664ed3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:48.533775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:48.535547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:48.559352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deac360-1011-4faf-87bc-ed5cb5c3fbf4 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:48.565497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:48.566180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:48.566469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:48.567318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.568048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:48.571227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:48.664564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:48.667809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:48.681240 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2418/4855] 10.222.0.27 () {60 vars in 1185 bytes} [Tue Oct 18 13:43:48 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:48.683765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:48.707083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e49b7a-5dde-40c5-ac88-c4dc01bcc676 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:48.716964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:48.717994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:48.722979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:48.722979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.722979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=3b4585c4363b441ea9e808d1059b22a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:48.723503 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:48.723503 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:48.723503 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:48.725501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:48.735183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2419/4856] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:43:48 2022] GET /identity/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4 => generated 221 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:48.742231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:48.770849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13f78a-a906-47a9-8252-1784942528c9 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:48.780454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cb102-3efe-4d64-9cfe-65733fbd8eb4 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:48.782175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:48.783639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:48.783970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:48.785282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] PATH_INFO: `/v3/users/65474459e9c0462d92d227b9299286a3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.788176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65474459e9c0462d92d227b9299286a3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:48.788841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:48.789794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:48.790406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:48.790885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:48.791450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:48.792054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3b4585c4363b441ea9e808d1059b22a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:48.794003 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:48.794003 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:48.794003 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:48.795618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:48.798006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invalidating token cache because consumer 3b4585c4363b441ea9e808d1059b22a4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:48.798677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:48.799752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:48.883314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '3b4585c4363b441ea9e808d1059b22a4', 'request_id': 'req-fb255e25-d352-484b-a960-f0671631a3e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:48.971324 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2420/4857] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:43:48 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:48.975570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:48.977788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:49.023375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255e25-d352-484b-a960-f0671631a3e0 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.060329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.061009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.062378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.064501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.065588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=3b4585c4363b441ea9e808d1059b22a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.071197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 18 13:43:49.104717 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 18 13:43:49.105893 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:43:49.108003 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2421/4858] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:43:48 2022] GET /identity/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4 => generated 74 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:43:49.112544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:49.112752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65474459e9c0462d92d227b9299286a3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.134693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65474459e9c0462d92d227b9299286a3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.135818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620dfb8-e5a5-43b2-a6f8-7c22c1a0a165 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.138461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65474459e9c0462d92d227b9299286a3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.142493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.143861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.144315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.144846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.145626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3b4585c4363b441ea9e808d1059b22a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.148562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.149003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invalidating token cache because consumer 3b4585c4363b441ea9e808d1059b22a4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:49.149900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.151086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 18 13:43:49.171781 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 18 13:43:49.173185 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:43:49.176279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65474459e9c0462d92d227b9299286a3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.176443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:49.176618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2422/4859] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:43:49 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3b4585c4363b441ea9e808d1059b22a4 => generated 74 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:43:49.182882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:49.186519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:49.210257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938d659-52a0-4500-a0a5-7c75bc278e2d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.217602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.218562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.218950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.219331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.220659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.222613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.266331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-48dd6187-3afb-474c-b154-b78f1744f4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65474459e9c0462d92d227b9299286a3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.275154 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2438/4860] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:48 2022] DELETE /identity/v3/users/65474459e9c0462d92d227b9299286a3 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:49.279282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.279779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.280199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.296298 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2423/4861] 10.222.0.27 () {60 vars in 1185 bytes} [Tue Oct 18 13:43:49 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:49.301038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:49.321180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb06240-a47d-4191-98c3-fb8838bcf696 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.328781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:49.330389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:49.459896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.460558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.460840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.461117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.461791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.464786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.471143 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2439/4862] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:49.497098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:49.499602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:49.565617 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2424/4863] 10.222.0.27 () {60 vars in 1185 bytes} [Tue Oct 18 13:43:49 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:49.571474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:49.598374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aacfcd-d295-4705-96ba-594983a112ca tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.614909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.616163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.616441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.616714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.617294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.624308 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:49.624308 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:43:49.624308 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:43:49.634337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.637911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97caa-7ba9-4052-ae63-39ead57f3e38 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.647619 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2425/4864] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Oct 18 13:43:49 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:43:49.648972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:49.656102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.656102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.656102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.656102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.673367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab6996-e26a-493a-ae9d-511063020fb1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.685779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.685779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.685960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.685960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.685960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.686267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/649f1ffde3c3479ea875d42f4228867c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.686577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=649f1ffde3c3479ea875d42f4228867c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.688155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.688545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invalidating token cache because consumer 649f1ffde3c3479ea875d42f4228867c has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:49.688731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.689369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.691743 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2440/4865] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:43:49.797891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '649f1ffde3c3479ea875d42f4228867c', 'request_id': 'req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.923629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2426/4866] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:43:49 2022] DELETE /identity/v3/OS-OAUTH1/consumers/649f1ffde3c3479ea875d42f4228867c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:49.927556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:49.945638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9128b0-d6cf-42e0-bc09-39d5b9e7e0e2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:49.957489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:49.958164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:49.958451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:49.963606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b36fd8c04489465d868a985d85191f9d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:49.966980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b36fd8c04489465d868a985d85191f9d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:49.968814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:49.969097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invalidating token cache because consumer b36fd8c04489465d868a985d85191f9d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:49.969392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.970984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:49.999090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:50.048881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b36fd8c04489465d868a985d85191f9d', 'request_id': 'req-22146964-3c59-4312-890d-f74362e3f06d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:50.147910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2441/4867] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:43:49 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b36fd8c04489465d868a985d85191f9d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:50.153139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:50.154743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:50.187904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cdb7b-449b-45ff-b17c-e933ec4a163c tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:50.210872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:50.211523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:50.211801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:50.212242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:50.213057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:50.216091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:50.291113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2427/4868] 10.222.0.27 () {60 vars in 1185 bytes} [Tue Oct 18 13:43:50 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:50.295277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:50.296905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:50.334641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146964-3c59-4312-890d-f74362e3f06d tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:50.368336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:50.377228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:50.377542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:50.379297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ce00e62713bf4c61b8b9cd174ca41609` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:50.380338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=ce00e62713bf4c61b8b9cd174ca41609)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:50.394406 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:43:50.394406 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:43:50.394406 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:43:50.395365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:50.564364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:50.694941 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2442/4869] 10.222.0.27 () {60 vars in 1285 bytes} [Tue Oct 18 13:43:50 2022] PATCH /identity/v3/OS-OAUTH1/consumers/ce00e62713bf4c61b8b9cd174ca41609 => generated 221 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:50.700038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:50.719287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464be54-a65b-44b2-9b98-f3d847e6dbf1 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:50.730786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:50.735000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:50.735000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:50.735000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ce00e62713bf4c61b8b9cd174ca41609` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:50.735000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=ce00e62713bf4c61b8b9cd174ca41609)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:50.738156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:50.752461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2428/4870] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 13:43:50 2022] GET /identity/v3/OS-OAUTH1/consumers/ce00e62713bf4c61b8b9cd174ca41609 => generated 221 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:50.757800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:50.773269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2fa8d-4388-46f4-84aa-8f159deca167 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:50.795173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '926abc2a390e4e6abd0279c311c6451d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8c182c850f64661bcde84151b9f5853', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:50.796111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:50.796904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:50.797366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/ce00e62713bf4c61b8b9cd174ca41609` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:50.798382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=ce00e62713bf4c61b8b9cd174ca41609)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:50.800192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:50.813991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invalidating token cache because consumer ce00e62713bf4c61b8b9cd174ca41609 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:50.816731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:50.816731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:50.912537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'ce00e62713bf4c61b8b9cd174ca41609', 'request_id': 'req-621a7b41-6fab-42ec-a360-e34d530396ee'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.153055 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2443/4871] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Oct 18 13:43:50 2022] DELETE /identity/v3/OS-OAUTH1/consumers/ce00e62713bf4c61b8b9cd174ca41609 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:51.161130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:51.163854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:51.186029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25059e84-8096-4196-9bc5-f49b4e1b9f66 tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:51.203957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:51.205366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:51.210477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:51.211260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] PATH_INFO: `/v3/users/6e6fe25d3b11421ea8ca66ecda37d780` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:51.218516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6fe25d3b11421ea8ca66ecda37d780)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:51.220932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:51.472526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:51.474264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:51.519435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a7b41-6fab-42ec-a360-e34d530396ee tempest-OAUTHConsumersV3Test-810484205 tempest-OAUTHConsumersV3Test-810484205-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:51.540739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6fe25d3b11421ea8ca66ecda37d780'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.542738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6fe25d3b11421ea8ca66ecda37d780'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.556872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:51.558700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:51.558853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:51.559700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] PATH_INFO: `/v3/projects/eebd1a82541547918fb7591ce8c7abb5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:51.562177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebd1a82541547918fb7591ce8c7abb5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:51.566487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:51.615291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6fe25d3b11421ea8ca66ecda37d780'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.616023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6fe25d3b11421ea8ca66ecda37d780'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.630262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-018c51e7-36d6-4437-8d4d-045fe36df05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6fe25d3b11421ea8ca66ecda37d780'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.657471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2429/4872] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:51 2022] DELETE /identity/v3/users/6e6fe25d3b11421ea8ca66ecda37d780 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:51.661354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:51.661354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:51.661354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:51.689549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:51.691596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:51.725482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebd1a82541547918fb7591ce8c7abb5', 'request_id': 'req-9f18b62d-4cf5-41d7-ae79-67764d3f238b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.741504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebd1a82541547918fb7591ce8c7abb5', 'request_id': 'req-9f18b62d-4cf5-41d7-ae79-67764d3f238b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.802986 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2430/4873] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:51.814404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:51.826652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:51.889638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebd1a82541547918fb7591ce8c7abb5', 'request_id': 'req-9f18b62d-4cf5-41d7-ae79-67764d3f238b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.919385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b82a48-590b-477f-a49b-9dadb0988338 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:51.935461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] The token cache is being invalidate because project eebd1a82541547918fb7591ce8c7abb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:51.935756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.938883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:51.945291 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2444/4874] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:51 2022] DELETE /identity/v3/projects/eebd1a82541547918fb7591ce8c7abb5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:51.949412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:51.953727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:51.957946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:51.997867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:51.999239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:51.999835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:52.000269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:52.003322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:52.105682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18b62d-4cf5-41d7-ae79-67764d3f238b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:52.111712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:52.114042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:52.114547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:52.114984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] PATH_INFO: `/v3/users/e04c363b3cac40aa97e9deb9c0921e29` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:52.116946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04c363b3cac40aa97e9deb9c0921e29)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:52.119880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:52.143884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:52.145330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:52.170318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:52.183251 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2431/4875] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:43:52.444860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04c363b3cac40aa97e9deb9c0921e29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:52.474009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04c363b3cac40aa97e9deb9c0921e29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:52.475345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04c363b3cac40aa97e9deb9c0921e29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:52.521552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04c363b3cac40aa97e9deb9c0921e29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:52.593126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04c363b3cac40aa97e9deb9c0921e29'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:52.600991 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2445/4876] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:51 2022] DELETE /identity/v3/users/e04c363b3cac40aa97e9deb9c0921e29 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:53.267354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:53.729829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:54.101612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:54.199862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:54.201347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:54.237111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12804d-2be6-421d-ac30-357b7db6a282 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:54.376509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:54.377599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:54.378266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:54.378741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] PATH_INFO: `/v3/projects/2a808fdecd60498fae100df1ad19ebdd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:54.381605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a808fdecd60498fae100df1ad19ebdd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:54.384460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:54.460120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:54.462736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:54.492214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce6b20-198f-4e62-8bba-247b89bfea6f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:54.498015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:54.510438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:54.510808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:54.511249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] PATH_INFO: `/v3/projects/3dc2aa9fc36a4a38b3d338b33e048a0c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:54.512786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc2aa9fc36a4a38b3d338b33e048a0c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:54.515605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:54.533305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a808fdecd60498fae100df1ad19ebdd', 'request_id': 'req-73cc86e3-09c4-4666-8adb-39ae2c747655'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.546634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a808fdecd60498fae100df1ad19ebdd', 'request_id': 'req-73cc86e3-09c4-4666-8adb-39ae2c747655'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.643927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a808fdecd60498fae100df1ad19ebdd', 'request_id': 'req-73cc86e3-09c4-4666-8adb-39ae2c747655'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.660251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] The token cache is being invalidate because project 2a808fdecd60498fae100df1ad19ebdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:54.660647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.663775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.666955 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2432/4877] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:54 2022] DELETE /identity/v3/projects/2a808fdecd60498fae100df1ad19ebdd => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:54.669151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc2aa9fc36a4a38b3d338b33e048a0c', 'request_id': 'req-afd5a715-0cf1-45e0-ba64-b34387094df0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.671083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:54.677020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:54.678953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc2aa9fc36a4a38b3d338b33e048a0c', 'request_id': 'req-afd5a715-0cf1-45e0-ba64-b34387094df0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.741499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc2aa9fc36a4a38b3d338b33e048a0c', 'request_id': 'req-afd5a715-0cf1-45e0-ba64-b34387094df0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.762680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] The token cache is being invalidate because project 3dc2aa9fc36a4a38b3d338b33e048a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:54.764240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.765417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-afd5a715-0cf1-45e0-ba64-b34387094df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:54.772103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2446/4878] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:54 2022] DELETE /identity/v3/projects/3dc2aa9fc36a4a38b3d338b33e048a0c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:54.773964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c9ca7-5583-4c49-84c5-119ac3839746 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:54.774480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c9ca7-5583-4c49-84c5-119ac3839746 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:54.774957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c9ca7-5583-4c49-84c5-119ac3839746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:54.809882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc86e3-09c4-4666-8adb-39ae2c747655 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:54.811643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-696c9ca7-5583-4c49-84c5-119ac3839746 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:54.813370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-696c9ca7-5583-4c49-84c5-119ac3839746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:54.855042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:54.921744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:54.922439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:54.922721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:54.923086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] PATH_INFO: `/v3/users/926abc2a390e4e6abd0279c311c6451d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:54.924279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=926abc2a390e4e6abd0279c311c6451d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:54.926265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:54.930624 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2447/4879] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:54.940744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce30f-996b-47c9-a74e-528d2a66a768 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:54.942286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce30f-996b-47c9-a74e-528d2a66a768 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:54.942709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bce30f-996b-47c9-a74e-528d2a66a768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:54.995091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60bce30f-996b-47c9-a74e-528d2a66a768 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:54.996446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60bce30f-996b-47c9-a74e-528d2a66a768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:55.011559 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2448/4880] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:55.012637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bce30f-996b-47c9-a74e-528d2a66a768 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:55.050132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bce30f-996b-47c9-a74e-528d2a66a768 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:55.066503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:55.067441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:55.067874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:55.068372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:55.069200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:55.069656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:55.071942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:55.101160 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2449/4881] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:55.105482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:55.125787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e394-e4bd-45ca-a1d4-17e07b2fa7d0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:55.134472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:55.135818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:55.136405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:55.136942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:55.137858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:55.140545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:55.213252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926abc2a390e4e6abd0279c311c6451d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:55.216314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926abc2a390e4e6abd0279c311c6451d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:55.284092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2450/4882] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:55 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:55.285347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:55.288072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:55.296040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926abc2a390e4e6abd0279c311c6451d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:55.296906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926abc2a390e4e6abd0279c311c6451d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:55.310001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926abc2a390e4e6abd0279c311c6451d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:55.348685 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2433/4883] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:43:54 2022] DELETE /identity/v3/users/926abc2a390e4e6abd0279c311c6451d => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:55.353399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:55.357158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:55.419368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd8667-ed3d-4f1a-918f-6838b602acba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:55.538338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe31c6-fee0-4ca9-ac54-3502e702c5ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:55.544799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:55.545336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:55.545496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:55.545766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:55.549332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:55.551176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:55.551526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:55.553086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:55.554083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:55.554241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:55.563301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:55.717881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2434/4884] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:55 2022] POST /identity/v3/users => generated 289 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:55.722849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:55.743783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:55.744468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf87c39-027c-4c5d-accd-59203dc6b316 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:55.747006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:55.764229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:55.768881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:55.768881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:55.768881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:55.768881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:55.769238 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2451/4885] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:43:55.769333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:55.783208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2435/4886] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:55.786948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:55.799105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236e65-cbdc-4392-bb80-19142f7a5fa0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:55.828777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863e62c-69ef-4d74-9638-873a734abb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:55.829421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e62c-69ef-4d74-9638-873a734abb04 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:55.829730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e62c-69ef-4d74-9638-873a734abb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:55.829979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e62c-69ef-4d74-9638-873a734abb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:55.830665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863e62c-69ef-4d74-9638-873a734abb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:55.837956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863e62c-69ef-4d74-9638-873a734abb04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:55.860219 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2452/4887] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:55.865375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:55.919585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87724-672f-4e36-b38d-e5afbf0b9c9d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:55.928165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:55.929164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:55.929551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:55.929907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] PATH_INFO: `/v3/projects/0925dd86ecca4529859c71418866be1d/users/e73a08ac34954c6e8e9e8c9565cc070b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:55.959373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0925dd86ecca4529859c71418866be1d, user_id=e73a08ac34954c6e8e9e8c9565cc070b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:55.962790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:56.015858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:56.067313 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2436/4888] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:55 2022] PUT /identity/v3/projects/0925dd86ecca4529859c71418866be1d/users/e73a08ac34954c6e8e9e8c9565cc070b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:56.079769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704acf-add1-4ac4-a289-84bc7ad1b900 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:56.080237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704acf-add1-4ac4-a289-84bc7ad1b900 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:56.080686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704acf-add1-4ac4-a289-84bc7ad1b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:56.175565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3704acf-add1-4ac4-a289-84bc7ad1b900 None None] MFA Rules not processed for user `e73a08ac34954c6e8e9e8c9565cc070b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:56.179059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3704acf-add1-4ac4-a289-84bc7ad1b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:56.314535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:56.319278 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2453/4889] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:56.394466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:56.441312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3d6c3-d93c-4932-9cb3-c1d9e995ed7e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:56.452690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:56.452690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:56.452690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:56.452690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:56.453557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:56.460474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:56.624013 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2437/4890] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:56 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:56.626478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704acf-add1-4ac4-a289-84bc7ad1b900 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:56.645103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704acf-add1-4ac4-a289-84bc7ad1b900 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:56.864738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:56.864738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:56.864738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:56.864738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:56.865404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:56.866681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:56.989561 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2454/4891] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:56 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:56.994281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:57.009665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b018-83d9-4098-95cb-aab6b37eb016 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:57.025909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:57.031129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:57.031129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:57.031129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:57.031129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:57.031129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:57.047287 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2438/4892] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:57.049036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:57.075088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0f6a8-7699-4945-823d-ce8c1a118d7e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:57.121907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a20a6-2770-4940-a07b-f93910804d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:57.124221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a20a6-2770-4940-a07b-f93910804d66 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:57.131486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a20a6-2770-4940-a07b-f93910804d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:57.132063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a20a6-2770-4940-a07b-f93910804d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:57.137924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a20a6-2770-4940-a07b-f93910804d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:57.144608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a20a6-2770-4940-a07b-f93910804d66 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:57.186629 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2455/4893] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:57.194018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:57.210741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f93e74-e97d-4072-b6d1-6d73e4661359 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:57.245119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:57.245869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:57.247960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:57.251138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] PATH_INFO: `/v3/projects/07bdd14e766a4192a119834768695ad9/users/d9bb89be0f6543319f95d49a995b52a8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:57.306345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bdd14e766a4192a119834768695ad9, user_id=d9bb89be0f6543319f95d49a995b52a8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:57.312693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:57.402033 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2439/4894] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:57 2022] PUT /identity/v3/projects/07bdd14e766a4192a119834768695ad9/users/d9bb89be0f6543319f95d49a995b52a8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:57.418775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6af95-7756-4f4c-9141-cec9ff745543 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:57.419364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6af95-7756-4f4c-9141-cec9ff745543 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:57.420171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6af95-7756-4f4c-9141-cec9ff745543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:57.564770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-add6af95-7756-4f4c-9141-cec9ff745543 None None] MFA Rules not processed for user `d9bb89be0f6543319f95d49a995b52a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:57.582261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-add6af95-7756-4f4c-9141-cec9ff745543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:57.938515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:57.939345 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2456/4895] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:58.032140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca973238-c20c-4d58-b207-b7ec6044123c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:58.032782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca973238-c20c-4d58-b207-b7ec6044123c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:58.033209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca973238-c20c-4d58-b207-b7ec6044123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:58.079952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ca973238-c20c-4d58-b207-b7ec6044123c None None] MFA Rules not processed for user `725680d81f6f43679703425651a3e207`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:58.090707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca973238-c20c-4d58-b207-b7ec6044123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:58.114898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30b786-c62d-4fbe-bb1c-c35709a4583a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:58.131911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:58.132553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:58.132830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:58.134255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:58.134255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:58.140192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:58.307248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2457/4896] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:43:58.406997 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2440/4897] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:57 2022] POST /identity/v3/projects => generated 377 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:43:58.410717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca973238-c20c-4d58-b207-b7ec6044123c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:58.422408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:58.439871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca973238-c20c-4d58-b207-b7ec6044123c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:58.606804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:58.609138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:58.609439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:58.610676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:58.611355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:58.631460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:58.719564 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2458/4898] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:43:58 2022] POST /identity/v3/users => generated 295 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:43:58.723879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:58.750396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:58.751738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48fb6-1f64-4d2c-9045-1510b6a808c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:58.752398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:58.778365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:58.779314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:58.779491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e5dd4-9c3a-48c1-9271-26477ea3155d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:58.779950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:58.780396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:58.781213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:58.786911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:58.801860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:58.811324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:58.811324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:58.811324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] PATH_INFO: `/v3/projects/c8c182c850f64661bcde84151b9f5853` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:58.811324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c182c850f64661bcde84151b9f5853)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:58.818974 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2441/4899] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:58.822398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:58.824047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:58.851997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536d580-4c48-43ce-a96a-22ffe70b7381 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:58.859526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:58.860668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:58.861145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:58.861702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] PATH_INFO: `/v3/projects/d51b8a21c3f14e4692a8d8f64f01ae73/users/6074c1a90a5641a4bc2d1aaf568f92e6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:58.912385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51b8a21c3f14e4692a8d8f64f01ae73, user_id=6074c1a90a5641a4bc2d1aaf568f92e6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:58.961080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:59.070871 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2442/4900] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:58 2022] PUT /identity/v3/projects/d51b8a21c3f14e4692a8d8f64f01ae73/users/6074c1a90a5641a4bc2d1aaf568f92e6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:59.075635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:59.081656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c182c850f64661bcde84151b9f5853', 'request_id': 'req-3f8cd5d2-5e6f-47df-94b1-13f7be272790'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:59.099980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c182c850f64661bcde84151b9f5853', 'request_id': 'req-3f8cd5d2-5e6f-47df-94b1-13f7be272790'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:59.172779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212e31c-9a5a-4039-881f-d9d7c34fc3fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:59.203685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c182c850f64661bcde84151b9f5853', 'request_id': 'req-3f8cd5d2-5e6f-47df-94b1-13f7be272790'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:59.219749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] The token cache is being invalidate because project c8c182c850f64661bcde84151b9f5853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:43:59.221135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:59.222399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3f8cd5d2-5e6f-47df-94b1-13f7be272790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:43:59.231355 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2459/4901] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:43:58 2022] DELETE /identity/v3/projects/c8c182c850f64661bcde84151b9f5853 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:43:59.235717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a12f2-dca3-48df-b3e2-c60915efe7b3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:59.236090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a12f2-dca3-48df-b3e2-c60915efe7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:59.238102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a12f2-dca3-48df-b3e2-c60915efe7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:59.299240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-512a12f2-dca3-48df-b3e2-c60915efe7b3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:59.308209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-512a12f2-dca3-48df-b3e2-c60915efe7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:59.321115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:59.407526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:59.412987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:59.413414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:59.416160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:59.417251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:59.423457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:59.458217 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2443/4902] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:43:59.459117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:59.476146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:59.524008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eee24a-d5ae-44a7-b94b-58426936c01c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:59.533331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c927b80-6b09-4df3-92f7-3bcb1bf21228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:59.534032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927b80-6b09-4df3-92f7-3bcb1bf21228 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:59.534345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927b80-6b09-4df3-92f7-3bcb1bf21228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:59.534627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c927b80-6b09-4df3-92f7-3bcb1bf21228 admin admin] PATH_INFO: `/v3/projects/d51b8a21c3f14e4692a8d8f64f01ae73/users/6074c1a90a5641a4bc2d1aaf568f92e6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:59.544282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c927b80-6b09-4df3-92f7-3bcb1bf21228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51b8a21c3f14e4692a8d8f64f01ae73, user_id=6074c1a90a5641a4bc2d1aaf568f92e6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:59.548881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2460/4903] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:59.559683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1ecc-c954-4ddb-98c1-55d388b98f19 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:59.560122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1ecc-c954-4ddb-98c1-55d388b98f19 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:59.560218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1ecc-c954-4ddb-98c1-55d388b98f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:59.563625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c927b80-6b09-4df3-92f7-3bcb1bf21228 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:59.594263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2444/4904] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:43:59 2022] PUT /identity/v3/projects/d51b8a21c3f14e4692a8d8f64f01ae73/users/6074c1a90a5641a4bc2d1aaf568f92e6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:43:59.603181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:59.603518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:59.603750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:59.629327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a8ef1ecc-c954-4ddb-98c1-55d388b98f19 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:59.633019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8ef1ecc-c954-4ddb-98c1-55d388b98f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:59.711895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] MFA Rules not processed for user `6074c1a90a5641a4bc2d1aaf568f92e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:43:59.713279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:43:59.878894 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2461/4905] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:59.880190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef1ecc-c954-4ddb-98c1-55d388b98f19 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:59.901413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef1ecc-c954-4ddb-98c1-55d388b98f19 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:43:59.916398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:43:59.919219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:43:59.919506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:43:59.919787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:43:59.921070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:43:59.921402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:43:59.925242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:43:59.963731 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2462/4907] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:43:59.964719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:59.965385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2445/4907] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:43:59.971130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:43:59.972674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:00.015196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e6e6f-85c9-4963-a2e5-cf0d5d9f8a61 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:00.036671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:00.037871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:00.041216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:00.042181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:00.042882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:00.062839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:00.115610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3c06c-332f-4fa3-ac2a-483ef6acaf1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:00.132864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:00.133604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:00.133965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:00.134489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:00.158366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:00.163863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:00.193950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2446/4908] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:43:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:00.221761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:00.223184 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2463/4909] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:43:59 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:00.242169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5428e8d-b95c-4f52-8e30-c468cf15f580 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:00.342916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:00.345384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:00.359627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:00.397909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:00.398686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:00.399082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:00.399468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:00.401428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:00.407468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:00.671159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47c912-a66a-4f29-abdc-4515c959bd59 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:00.671159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:00.671159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:00.671159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:00.674009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:00.674009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:00.685107 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2447/4910] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:00 2022] POST /identity/v3/users => generated 294 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:00.685107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:00.709308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:00.710878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:00.712277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2666a-0570-4d56-b98b-df5a3166bb5c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:00.717804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:00.718556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:00.719103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:00.720205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:00.721108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:00.723124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:00.741066 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2464/4911] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:00.812886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:00.813486 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2448/4912] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:00.825954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c306a-e872-4ba7-ae36-3d3edb7904ea service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:00.843386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787b239-9372-46e2-aff4-e8107fdaacb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:00.844130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787b239-9372-46e2-aff4-e8107fdaacb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:00.844486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787b239-9372-46e2-aff4-e8107fdaacb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:00.844834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787b239-9372-46e2-aff4-e8107fdaacb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:00.845566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787b239-9372-46e2-aff4-e8107fdaacb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:00.847994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787b239-9372-46e2-aff4-e8107fdaacb2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:00.872651 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2465/4913] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:00.876713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:00.900542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7688bd-8845-4cc4-9af6-1f3bd0a8afac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:00.934723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:00.934723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:00.934723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:00.934723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] PATH_INFO: `/v3/projects/222d1574c79049bbb24abfd1bf8a6cf2/users/193080a310344c5297ebd4d982e7dab3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:00.984027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222d1574c79049bbb24abfd1bf8a6cf2, user_id=193080a310344c5297ebd4d982e7dab3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:00.987026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:01.097624 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2449/4914] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:00 2022] PUT /identity/v3/projects/222d1574c79049bbb24abfd1bf8a6cf2/users/193080a310344c5297ebd4d982e7dab3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:01.109032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123843bb-99b8-48e8-8950-086914fc29ab None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:01.109327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123843bb-99b8-48e8-8950-086914fc29ab None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:01.109609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123843bb-99b8-48e8-8950-086914fc29ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:01.172259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-123843bb-99b8-48e8-8950-086914fc29ab None None] MFA Rules not processed for user `193080a310344c5297ebd4d982e7dab3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:01.173720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-123843bb-99b8-48e8-8950-086914fc29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:01.329357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:01.356869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:01.359494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2466/4915] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:01.488605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c12310-d9ea-4fc3-a18a-1a1897d4b786 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:01.496884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:01.497617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:01.497998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:01.498372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:01.499109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:01.501278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:01.662822 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2450/4916] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:01 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:01.663705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123843bb-99b8-48e8-8950-086914fc29ab None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:01.680247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123843bb-99b8-48e8-8950-086914fc29ab None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:01.776346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:01.778151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:01.869191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:01.869865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:01.870176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:01.870454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:01.871109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:01.873355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:01.932955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635eba3-3293-40cc-8d58-fe35ff275acf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:01.940416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:01.942113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:01.942507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:01.942960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] PATH_INFO: `/v3/users/89acf827045f47d98b97a8a4c2a3e19d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:01.945790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89acf827045f47d98b97a8a4c2a3e19d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:01.948443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:02.018233 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2467/4917] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:01 2022] POST /identity/v3/users => generated 299 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:02.022542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:02.060897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fd456-41fb-47dc-846a-23cd8da46640 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:02.085469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:02.089218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:02.090216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:02.091073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:02.093260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:02.099026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:02.157602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2468/4918] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:02.159390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:02.188996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e18d-44f3-4872-b9d3-7e060cda1b75 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:02.239456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:02.246960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:02.246960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:02.247787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] PATH_INFO: `/v3/projects/3430aa8bd79844bf98e5ffec09c365eb/users/d5dc284460cd47eb939826e0a03f7981/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:02.270366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89acf827045f47d98b97a8a4c2a3e19d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:02.273834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89acf827045f47d98b97a8a4c2a3e19d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:02.332368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3430aa8bd79844bf98e5ffec09c365eb, user_id=d5dc284460cd47eb939826e0a03f7981, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:02.345768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:02.365560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89acf827045f47d98b97a8a4c2a3e19d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:02.366769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89acf827045f47d98b97a8a4c2a3e19d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:02.379140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89acf827045f47d98b97a8a4c2a3e19d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:02.447422 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2451/4919] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:01 2022] DELETE /identity/v3/users/89acf827045f47d98b97a8a4c2a3e19d => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:02.460584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:02.467430 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2469/4920] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:02 2022] PUT /identity/v3/projects/3430aa8bd79844bf98e5ffec09c365eb/users/d5dc284460cd47eb939826e0a03f7981/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:02.469116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:02.473213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:02.650027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee37e8-804a-49c5-b462-ab50b4903719 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:02.814791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562c95f-f2b9-44a1-a4ff-3f23f4a8ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:02.815467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c95f-f2b9-44a1-a4ff-3f23f4a8ff7a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:02.815752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c95f-f2b9-44a1-a4ff-3f23f4a8ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:02.816031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562c95f-f2b9-44a1-a4ff-3f23f4a8ff7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:02.816704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562c95f-f2b9-44a1-a4ff-3f23f4a8ff7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:02.819017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562c95f-f2b9-44a1-a4ff-3f23f4a8ff7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:02.870898 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2452/4921] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:02.875082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:02.902698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867d5e-405c-4f96-910f-99f825808947 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:02.916721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:02.919851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:02.920290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:02.921640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] PATH_INFO: `/v3/projects/3430aa8bd79844bf98e5ffec09c365eb/users/d5dc284460cd47eb939826e0a03f7981/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:02.931228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3430aa8bd79844bf98e5ffec09c365eb, user_id=d5dc284460cd47eb939826e0a03f7981, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:02.937106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:02.975623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d288706-8420-48f0-9a4f-f46765c4f16f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:02.975908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d288706-8420-48f0-9a4f-f46765c4f16f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:02.976364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d288706-8420-48f0-9a4f-f46765c4f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:02.986874 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2470/4922] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:02 2022] PUT /identity/v3/projects/3430aa8bd79844bf98e5ffec09c365eb/users/d5dc284460cd47eb939826e0a03f7981/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:03.080777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4d288706-8420-48f0-9a4f-f46765c4f16f None None] MFA Rules not processed for user `d5dc284460cd47eb939826e0a03f7981`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:03.082858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d288706-8420-48f0-9a4f-f46765c4f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:03.360243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:03.362296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:03.403429 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2453/4923] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:03.414773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d288706-8420-48f0-9a4f-f46765c4f16f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:03.441978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:03.466668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d288706-8420-48f0-9a4f-f46765c4f16f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:03.494774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:03.495423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:03.495705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:03.495984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:03.496897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:03.507330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:03.596543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dece1-03cd-470b-aba0-0a3ce2c8b098 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:03.604233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:03.605236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:03.605900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:03.606486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] PATH_INFO: `/v3/projects/f43e41bfbb72427198a878de059fe0f6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:03.607939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43e41bfbb72427198a878de059fe0f6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:03.611076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:03.664070 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2454/4924] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:03 2022] POST /identity/v3/projects => generated 357 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:03.672402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:03.686582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:03.797840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43e41bfbb72427198a878de059fe0f6', 'request_id': 'req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:03.813570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43e41bfbb72427198a878de059fe0f6', 'request_id': 'req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:03.829631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a14f1-b16b-4259-adcb-3b9af0ad3f5f tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:03.946769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43e41bfbb72427198a878de059fe0f6', 'request_id': 'req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:03.961276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] The token cache is being invalidate because project f43e41bfbb72427198a878de059fe0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:03.962032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:03.963758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603775e-57f2-4fd7-8085-4a8167906016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:03.964397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603775e-57f2-4fd7-8085-4a8167906016 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:03.964676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603775e-57f2-4fd7-8085-4a8167906016 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:03.964950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603775e-57f2-4fd7-8085-4a8167906016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:03.965800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:03.972792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c603775e-57f2-4fd7-8085-4a8167906016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:03.976995 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2471/4925] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:03 2022] DELETE /identity/v3/projects/f43e41bfbb72427198a878de059fe0f6 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:03.978096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:03.981850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:04.144940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603775e-57f2-4fd7-8085-4a8167906016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:04.148851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603775e-57f2-4fd7-8085-4a8167906016 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:04.180258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ddb0-ac71-4f52-a1d3-ec5008337dd8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:04.184751 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2455/4926] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:04.186370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f794-a043-492b-b684-43c72d3d26b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:04.190243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f794-a043-492b-b684-43c72d3d26b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:04.190528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f794-a043-492b-b684-43c72d3d26b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:04.196339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:04.197041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:04.197326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:04.197608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-78493749` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:04.198954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=2df8d1c3eda541b991e2527fa665b15d, value=tempest-tag-78493749)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:04.216177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:04.273572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-76c4f794-a043-492b-b684-43c72d3d26b8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:04.275097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76c4f794-a043-492b-b684-43c72d3d26b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:04.434921 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-78493749. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:44:04.434921 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:44:04.434921 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:44:04.455824 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2472/4927] 10.222.0.27 () {60 vars in 1327 bytes} [Tue Oct 18 13:44:03 2022] PUT /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-78493749 => generated 0 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 289 bytes (1 switches on core 0) Oct 18 13:44:04.459554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:04.473445 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2456/4928] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:04.487649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9b1e-a7aa-4198-930f-ecf0d6cc0d6c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:04.488114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9b1e-a7aa-4198-930f-ecf0d6cc0d6c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:04.488501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9b1e-a7aa-4198-930f-ecf0d6cc0d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:04.496308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c78a-601d-41da-a9c5-801d970644b2 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:04.508769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:04.509744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:04.509744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:04.510150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-78493749` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:04.538936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-970e9b1e-a7aa-4198-930f-ecf0d6cc0d6c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:04.546239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-970e9b1e-a7aa-4198-930f-ecf0d6cc0d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:04.556709 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2457/4929] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:04.556930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=2df8d1c3eda541b991e2527fa665b15d, value=tempest-tag-78493749)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:04.558100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e9b1e-a7aa-4198-930f-ecf0d6cc0d6c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:04.559062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:04.573319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e9b1e-a7aa-4198-930f-ecf0d6cc0d6c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:04.579377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:04.580571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:04.581061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:04.581526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:04.582429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:04.583137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:04.585606 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2473/4930] 10.222.0.27 () {58 vars in 1308 bytes} [Tue Oct 18 13:44:04 2022] GET /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-78493749 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:04.586468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:04.591300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:04.606036 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2458/4931] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:04.607219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490e7a-f945-49ce-8248-b90d0d9512b0 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:04.612644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:04.627379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cee02-6bda-454f-9d1b-c18b20a2706b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:04.630140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:04.632497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:04.632838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:04.633487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:04.636113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=2df8d1c3eda541b991e2527fa665b15d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:04.638540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:04.642399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:04.644351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:04.645768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:04.648875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:04.654716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:04.655985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:04.848033 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2459/4932] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:04 2022] POST /identity/v3/projects => generated 399 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:04.849987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.017056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef730775-e7db-47bd-8c66-3ae8224f11d8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.018450 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2474/4933] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Oct 18 13:44:04 2022] PUT /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags => generated 142 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:05.022264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.036626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7862b5d-8e2d-4c18-bfb9-4af8e4d3943a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.037266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.037916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.038225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.038508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.039389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.041354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:05.154537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2460/4934] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:04 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:05.157504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.180489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.181652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.184383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.185847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.197266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed4fff-b60b-42d9-9d40-4354081e8058 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.214947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.215609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.215894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.216173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.217201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.218558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:05.235089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=2df8d1c3eda541b991e2527fa665b15d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.245695 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2461/4935] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:05.247432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.249249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:05.265919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e209c-8a6e-4bd3-af21-2b5717bdecd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.276472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.277115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.277401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.277677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.278381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.279982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:05.282095 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2475/4936] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:44:05 2022] GET /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags => generated 142 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:05.292245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.321162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2f537-0f00-4093-989d-49012a0b108a tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.325511 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2462/4937] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:05.329852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.336146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.337072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.350897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.352839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-1932766555` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.355178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=2df8d1c3eda541b991e2527fa665b15d, value=tempest-tag-1932766555)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.356485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc6fc7-8175-46f9-813e-bf0e2e5bf663 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.363785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:05.367018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c1090-0ffe-4470-8513-cbd49e6b1724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.367251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1090-0ffe-4470-8513-cbd49e6b1724 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.370526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1090-0ffe-4470-8513-cbd49e6b1724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.370526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c1090-0ffe-4470-8513-cbd49e6b1724 admin admin] PATH_INFO: `/v3/projects/51f272b5abc047c49f5eb0bed78f9ed2/users/fb29c723cbc249a781905fdbde1b3ad9/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.422987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c1090-0ffe-4470-8513-cbd49e6b1724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f272b5abc047c49f5eb0bed78f9ed2, user_id=fb29c723cbc249a781905fdbde1b3ad9, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.426009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c1090-0ffe-4470-8513-cbd49e6b1724 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:05.512392 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2463/4938] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:05 2022] PUT /identity/v3/projects/51f272b5abc047c49f5eb0bed78f9ed2/users/fb29c723cbc249a781905fdbde1b3ad9/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:05.519606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.520234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.520723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.569792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:05.573335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:05.597220 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1932766555. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:44:05.597220 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:44:05.597220 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:44:05.618689 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2476/4939] 10.222.0.27 () {58 vars in 1317 bytes} [Tue Oct 18 13:44:05 2022] DELETE /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-1932766555 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:05.623571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.626172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:05.647539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76c10-a304-4335-8b5d-46caac2f5f56 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.765824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:05.790771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.791482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.792474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.797410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-1932766555` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.811371 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2464/4940] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:05.833766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=2df8d1c3eda541b991e2527fa665b15d, value=tempest-tag-1932766555)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.843830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:05.873471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.874836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Could not find project tag: tempest-tag-1932766555.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1932766555. Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 18 13:44:05.914259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 18 13:44:05.915259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:44:05.915259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:44:05.915259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 18 13:44:05.915259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 18 13:44:05.915259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1932766555. Oct 18 13:44:05.915259 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:44:05.922043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2477/4941] 10.222.0.27 () {58 vars in 1314 bytes} [Tue Oct 18 13:44:05 2022] GET /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags/tempest-tag-1932766555 => generated 107 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:44:05.924902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:05.942040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce42a42-f109-4a02-8ecf-44143ee1792e tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:05.959178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:05.960627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:05.960933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:05.961272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:05.963070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=2df8d1c3eda541b991e2527fa665b15d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:05.965363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:06.098755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dfbdc-dae9-47d5-bf95-42eaf05c5868 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:06.103769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:06.104488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:06.104837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:06.105177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:06.127817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:06.130873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:06.160382 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2478/4942] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:44:05 2022] DELETE /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:06.162139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:06.164717 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2465/4943] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:06.200963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9301d7-a8a5-46a0-8fc6-2cd1f5f45a79 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:06.218638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:06.219314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:06.223816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:06.223816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:06.258532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=2df8d1c3eda541b991e2527fa665b15d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:06.260744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:06.294169 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2479/4944] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 13:44:06 2022] GET /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d/tags => generated 66 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 13:44:06.298207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:06.318879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c67b5-5351-47f2-8cc5-52dcd26ef80a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:06.336434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5dc284460cd47eb939826e0a03f7981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3430aa8bd79844bf98e5ffec09c365eb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:06.340003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:06.341110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:06.342431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] PATH_INFO: `/v3/projects/2df8d1c3eda541b991e2527fa665b15d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:06.346506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2df8d1c3eda541b991e2527fa665b15d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:06.350222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:06.564899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df8d1c3eda541b991e2527fa665b15d', 'request_id': 'req-a3148dc3-31f1-4877-95ca-aa05c10a9f51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:06.573609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df8d1c3eda541b991e2527fa665b15d', 'request_id': 'req-a3148dc3-31f1-4877-95ca-aa05c10a9f51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:06.700525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df8d1c3eda541b991e2527fa665b15d', 'request_id': 'req-a3148dc3-31f1-4877-95ca-aa05c10a9f51'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:06.733524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] The token cache is being invalidate because project 2df8d1c3eda541b991e2527fa665b15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:06.733948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:06.734890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3148dc3-31f1-4877-95ca-aa05c10a9f51 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:06.751879 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2466/4945] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:06 2022] DELETE /identity/v3/projects/2df8d1c3eda541b991e2527fa665b15d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:06.761656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:06.767496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:06.797553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b8499-097d-448e-b9be-9062a5613af5 tempest-IdentityV3ProjectTagsTest-679652218 tempest-IdentityV3ProjectTagsTest-679652218-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:06.929416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:06.931203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:06.931203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:06.931399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] PATH_INFO: `/v3/users/193080a310344c5297ebd4d982e7dab3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:06.933118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=193080a310344c5297ebd4d982e7dab3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:06.938678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:07.193706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2c41-04fb-4886-857c-d3eaf5005edf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:07.194143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2c41-04fb-4886-857c-d3eaf5005edf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:07.196693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e2c41-04fb-4886-857c-d3eaf5005edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:07.225209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193080a310344c5297ebd4d982e7dab3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:07.248867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-696e2c41-04fb-4886-857c-d3eaf5005edf None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:07.254535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-696e2c41-04fb-4886-857c-d3eaf5005edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:07.283417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193080a310344c5297ebd4d982e7dab3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:07.298038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193080a310344c5297ebd4d982e7dab3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:07.359737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193080a310344c5297ebd4d982e7dab3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:07.440097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2467/4946] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:07.466566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193080a310344c5297ebd4d982e7dab3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:07.475511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2480/4947] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:06 2022] DELETE /identity/v3/users/193080a310344c5297ebd4d982e7dab3 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:07.480129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:07.480478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:07.480763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:07.524141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:07.525961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:07.700952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2468/4948] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:07.749324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:07.751282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:07.912616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62aea-e329-4556-bd9b-43b0ba2160aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:07.939092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:07.943504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:07.943504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:07.943504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:07.975218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:07.976975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:08.047847 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2481/4949] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:08.723626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:08.765167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:09.713372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:10.392725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:10.749068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:10.758885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:10.787326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8985b-68cd-4e2e-97ea-d4e617b843b4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:10.802928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:10.803856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:10.804287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:10.804761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] PATH_INFO: `/v3/projects/222d1574c79049bbb24abfd1bf8a6cf2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:10.807984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=222d1574c79049bbb24abfd1bf8a6cf2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:10.810312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:11.040305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222d1574c79049bbb24abfd1bf8a6cf2', 'request_id': 'req-6b389ff9-890a-44dd-bd41-2b512e814899'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.048290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222d1574c79049bbb24abfd1bf8a6cf2', 'request_id': 'req-6b389ff9-890a-44dd-bd41-2b512e814899'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.132691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:11.133480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222d1574c79049bbb24abfd1bf8a6cf2', 'request_id': 'req-6b389ff9-890a-44dd-bd41-2b512e814899'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.152743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] The token cache is being invalidate because project 222d1574c79049bbb24abfd1bf8a6cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:11.152968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.153643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.155219 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2469/4950] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:10 2022] DELETE /identity/v3/projects/222d1574c79049bbb24abfd1bf8a6cf2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:11.159786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:11.176634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b934bd-a946-44dc-81c5-26d43b835732 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:11.342616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:11.343555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:11.344022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:11.344909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] PATH_INFO: `/v3/users/d5dc284460cd47eb939826e0a03f7981` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:11.346489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dc284460cd47eb939826e0a03f7981)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:11.349770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:11.622260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dc284460cd47eb939826e0a03f7981'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.652275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dc284460cd47eb939826e0a03f7981'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.653064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dc284460cd47eb939826e0a03f7981'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.670627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dc284460cd47eb939826e0a03f7981'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.764241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dc284460cd47eb939826e0a03f7981'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:11.774440 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2482/4951] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:11 2022] DELETE /identity/v3/users/d5dc284460cd47eb939826e0a03f7981 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:12.147180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:12.322324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:12.323834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:12.347413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b389ff9-890a-44dd-bd41-2b512e814899 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:12.448225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:12.453569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:12.453569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:12.454533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] PATH_INFO: `/v3/users/e73a08ac34954c6e8e9e8c9565cc070b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:12.458881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73a08ac34954c6e8e9e8c9565cc070b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:12.463281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:12.761279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:12.764167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:12.799752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6eaf8-5d6d-47e5-9ee9-3aa767a82d6f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:12.816096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73a08ac34954c6e8e9e8c9565cc070b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:12.818012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73a08ac34954c6e8e9e8c9565cc070b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:12.820855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:12.821866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:12.822397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:12.823560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] PATH_INFO: `/v3/projects/3430aa8bd79844bf98e5ffec09c365eb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:12.826488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3430aa8bd79844bf98e5ffec09c365eb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:12.828650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:12.986550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73a08ac34954c6e8e9e8c9565cc070b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:12.989382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73a08ac34954c6e8e9e8c9565cc070b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:13.005012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-83778dda-8c1b-4bfc-a26e-63ea11585825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73a08ac34954c6e8e9e8c9565cc070b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:13.026438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:13.066075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3430aa8bd79844bf98e5ffec09c365eb', 'request_id': 'req-89897b13-d581-4e32-b969-3e58a8fab7d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:13.099404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3430aa8bd79844bf98e5ffec09c365eb', 'request_id': 'req-89897b13-d581-4e32-b969-3e58a8fab7d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:13.108550 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2470/4952] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:12 2022] DELETE /identity/v3/users/e73a08ac34954c6e8e9e8c9565cc070b => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:13.113250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:13.114564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:13.115702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:13.168767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:13.170775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:13.180947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3430aa8bd79844bf98e5ffec09c365eb', 'request_id': 'req-89897b13-d581-4e32-b969-3e58a8fab7d3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:13.210368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] The token cache is being invalidate because project 3430aa8bd79844bf98e5ffec09c365eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:13.210807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:13.211597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89897b13-d581-4e32-b969-3e58a8fab7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:13.243439 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2483/4953] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:12 2022] DELETE /identity/v3/projects/3430aa8bd79844bf98e5ffec09c365eb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:13.258799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8dfd-a79f-41fe-9f7e-7b8a1fd67308 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:13.258799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8dfd-a79f-41fe-9f7e-7b8a1fd67308 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:13.258799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8dfd-a79f-41fe-9f7e-7b8a1fd67308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:13.370983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-27fa8dfd-a79f-41fe-9f7e-7b8a1fd67308 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:13.377051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-27fa8dfd-a79f-41fe-9f7e-7b8a1fd67308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:13.399604 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2471/4954] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:13.401800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:13.410152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:13.413834 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2484/4955] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:13.421128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f165faf-2556-491d-8467-77b14d60435f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:13.421423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f165faf-2556-491d-8467-77b14d60435f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:13.422287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f165faf-2556-491d-8467-77b14d60435f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:13.480887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8f165faf-2556-491d-8467-77b14d60435f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:13.484285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f165faf-2556-491d-8467-77b14d60435f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:13.541014 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2485/4956] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:13.541014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f165faf-2556-491d-8467-77b14d60435f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:13.547932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8f165faf-2556-491d-8467-77b14d60435f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:13.553745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e8854-fa8f-446d-8330-31997a84897b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:13.560425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:13.561184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:13.561568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:13.561939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:13.563881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:13.577007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:13.578753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:13.590253 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2472/4957] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:13.591464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:13.596875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f165faf-2556-491d-8467-77b14d60435f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:13.609015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:13.609901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:13.610408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:13.611189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:13.613393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d2ba9-2756-4adf-9c28-135958092760 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:13.628422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:13.629401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:13.630280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:13.630886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:13.631312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:13.633627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:13.633872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:13.634382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:13.639751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:13.660039 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2486/4958] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:13.663961 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2473/4959] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:13.668501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:13.681201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cb05c-6c19-4f5e-b260-423f44b915a5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:13.687956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:13.690124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:13.690124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:13.690124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:13.690677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:13.692839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:13.813686 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2487/4960] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:13 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:13.818043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:13.832566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177574d-cd7e-41ca-b493-1a832b9cfa25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:14.007206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:14.007839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:14.008124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:14.008400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:14.009045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:14.015826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:14.158624 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2474/4961] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:13 2022] POST /identity/v3/users => generated 290 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:14.163178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:14.173908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b685-7f6c-40c8-b11d-c8964b3098a6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:14.181500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:14.183084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:14.183530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:14.183984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:14.184885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:14.188333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:14.210277 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2488/4962] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:14.214468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:14.227814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9b5b-506a-4bd5-8fa3-f32067e382cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:14.234376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde53a8-bd30-441c-9548-f8ade3a575b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:14.235910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde53a8-bd30-441c-9548-f8ade3a575b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:14.236715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde53a8-bd30-441c-9548-f8ade3a575b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:14.237090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde53a8-bd30-441c-9548-f8ade3a575b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:14.238268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde53a8-bd30-441c-9548-f8ade3a575b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:14.240027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde53a8-bd30-441c-9548-f8ade3a575b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:14.255306 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2475/4963] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:14.259621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:14.276919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827495-009e-4e7c-a3a3-e8df13d4dc76 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:14.283642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:14.285162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:14.285451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:14.286113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] PATH_INFO: `/v3/projects/ccf67ab5695b402b8849c4e72e790208/users/fc9118d997a94036a918c0985d26dbc8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:14.309258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf67ab5695b402b8849c4e72e790208, user_id=fc9118d997a94036a918c0985d26dbc8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:14.312646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:14.441990 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2489/4964] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:14 2022] PUT /identity/v3/projects/ccf67ab5695b402b8849c4e72e790208/users/fc9118d997a94036a918c0985d26dbc8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:14.444822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:14.445648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:14.446111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:14.542339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] MFA Rules not processed for user `fc9118d997a94036a918c0985d26dbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:14.542339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:14.685620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:14.715828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2476/4965] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:14.724885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:14.727103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:14.889555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7bf5-739f-4c85-ab6d-7da60d984568 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:14.898145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:14.899244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:14.899783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:14.900262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:14.911226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:14.913036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:14.924681 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2490/4966] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:14.927596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:14.929755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:15.087199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59403ca4-a0e1-4135-8157-d5d5b2e52050 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:15.092620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:15.094175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:15.094672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:15.095838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] PATH_INFO: `/v3/projects/0925dd86ecca4529859c71418866be1d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:15.097936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0925dd86ecca4529859c71418866be1d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:15.100842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:15.274881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0925dd86ecca4529859c71418866be1d', 'request_id': 'req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.284273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0925dd86ecca4529859c71418866be1d', 'request_id': 'req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.431909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0925dd86ecca4529859c71418866be1d', 'request_id': 'req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.460703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] The token cache is being invalidate because project 0925dd86ecca4529859c71418866be1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:15.461254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.462010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.483628 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2477/4967] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:14 2022] DELETE /identity/v3/projects/0925dd86ecca4529859c71418866be1d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:15.483818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:15.517490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:15.518394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062bf4a-1add-4b07-a795-403e2727de42 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:15.676138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:15.678153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:15.679940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:15.679940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:15.680351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:15.682578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] PATH_INFO: `/v3/users/d9bb89be0f6543319f95d49a995b52a8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:15.682578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bb89be0f6543319f95d49a995b52a8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:15.684391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:15.702693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480b03c-2ed2-44a9-8a2d-4b2a0a8ffdb0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:15.716868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:15.717591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:15.717875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:15.718231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] PATH_INFO: `/v3/users/fc9118d997a94036a918c0985d26dbc8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:15.720976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9118d997a94036a918c0985d26dbc8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:15.729619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:15.907441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bb89be0f6543319f95d49a995b52a8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.931863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bb89be0f6543319f95d49a995b52a8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.933597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bb89be0f6543319f95d49a995b52a8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:15.960280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bb89be0f6543319f95d49a995b52a8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:16.051366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9118d997a94036a918c0985d26dbc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:16.054197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9118d997a94036a918c0985d26dbc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:16.077979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f2fcd829-a29f-4104-b323-9d8a3102de2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bb89be0f6543319f95d49a995b52a8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:16.093020 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2491/4968] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:15 2022] DELETE /identity/v3/users/d9bb89be0f6543319f95d49a995b52a8 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:16.191403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9118d997a94036a918c0985d26dbc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:16.192268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9118d997a94036a918c0985d26dbc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:16.222480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9118d997a94036a918c0985d26dbc8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:16.272786 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2478/4969] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:15 2022] DELETE /identity/v3/users/fc9118d997a94036a918c0985d26dbc8 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:16.278818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:16.278818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:16.278818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:16.330894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:16.333972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:16.357705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:16.451413 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2492/4970] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:16.487707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:16.490897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:16.583480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ed70-a7ec-4dc2-a99d-4dd0ec5f749a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:16.588181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:16.589456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:16.590154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:16.590645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:16.602544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:16.604231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:16.622808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2479/4971] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:17.106686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:17.353661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:17.356791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:17.378111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27f94b-350b-4d84-addb-9940d51043e6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:17.386783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:17.388810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:17.388810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:17.388810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] PATH_INFO: `/v3/projects/07bdd14e766a4192a119834768695ad9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:17.394762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bdd14e766a4192a119834768695ad9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:17.397461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:17.438699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=15,keystone:SELECT=81,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:17.575878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bdd14e766a4192a119834768695ad9', 'request_id': 'req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:17.592400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bdd14e766a4192a119834768695ad9', 'request_id': 'req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:17.671779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bdd14e766a4192a119834768695ad9', 'request_id': 'req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:17.690024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] The token cache is being invalidate because project 07bdd14e766a4192a119834768695ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:17.690563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:17.694723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:17.695964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:17.697801 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2493/4972] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:17 2022] DELETE /identity/v3/projects/07bdd14e766a4192a119834768695ad9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:17.702162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:17.719289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8112d9-a9d6-4072-b826-9a1a84ce241b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:17.819301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:17.821270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:17.821715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:17.822171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] PATH_INFO: `/v3/users/6074c1a90a5641a4bc2d1aaf568f92e6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:17.823965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6074c1a90a5641a4bc2d1aaf568f92e6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:17.826576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:18.120957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6074c1a90a5641a4bc2d1aaf568f92e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.130918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6074c1a90a5641a4bc2d1aaf568f92e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.189075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:18.190541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:18.210747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ea8b7-03ff-48ca-a76b-1eb16da1989b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:18.213866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6074c1a90a5641a4bc2d1aaf568f92e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.215160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6074c1a90a5641a4bc2d1aaf568f92e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.224065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6074c1a90a5641a4bc2d1aaf568f92e6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.230361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:18.232640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:18.234932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:18.235373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] PATH_INFO: `/v3/users/74035c297a274fbdbc0b51d2e33b6fba` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:18.237352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74035c297a274fbdbc0b51d2e33b6fba)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:18.242590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:18.268940 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2480/4973] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:17 2022] DELETE /identity/v3/users/6074c1a90a5641a4bc2d1aaf568f92e6 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:18.492729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74035c297a274fbdbc0b51d2e33b6fba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.506251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74035c297a274fbdbc0b51d2e33b6fba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.507787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74035c297a274fbdbc0b51d2e33b6fba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.526371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74035c297a274fbdbc0b51d2e33b6fba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.576376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:18.638209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74035c297a274fbdbc0b51d2e33b6fba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:18.651229 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2494/4974] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:18 2022] DELETE /identity/v3/users/74035c297a274fbdbc0b51d2e33b6fba => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:18.723866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:19.115985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:19.117762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:19.340651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ead31-487d-4ab2-8d92-eca2b4be579f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:19.457419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:19.458787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:19.459178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:19.459632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] PATH_INFO: `/v3/projects/ccf67ab5695b402b8849c4e72e790208` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:19.460959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf67ab5695b402b8849c4e72e790208)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:19.464254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:19.579534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:19.581193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:19.605806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab0b0-dac0-4ba8-bd84-68bbdbc0e785 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:19.618524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:19.619296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:19.619784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:19.620235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] PATH_INFO: `/v3/projects/4b1125779ec1410a9c732e26473be4d3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:19.622923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1125779ec1410a9c732e26473be4d3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:19.624887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:19.666267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf67ab5695b402b8849c4e72e790208', 'request_id': 'req-8df61c48-9521-4cee-b15c-b22cf76ee1c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:19.678276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf67ab5695b402b8849c4e72e790208', 'request_id': 'req-8df61c48-9521-4cee-b15c-b22cf76ee1c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:19.790685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf67ab5695b402b8849c4e72e790208', 'request_id': 'req-8df61c48-9521-4cee-b15c-b22cf76ee1c6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:19.807401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] The token cache is being invalidate because project ccf67ab5695b402b8849c4e72e790208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:19.808573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:19.810655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df61c48-9521-4cee-b15c-b22cf76ee1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:19.813880 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2481/4975] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:19 2022] DELETE /identity/v3/projects/ccf67ab5695b402b8849c4e72e790208 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:19.839478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:19.842234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:19.842612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:19.884264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1125779ec1410a9c732e26473be4d3', 'request_id': 'req-7895282e-eb35-4a9f-bcb2-c1759096f703'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:19.905507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1125779ec1410a9c732e26473be4d3', 'request_id': 'req-7895282e-eb35-4a9f-bcb2-c1759096f703'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:19.912935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:19.914575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.037102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2482/4976] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:20.037102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:20.038695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.043404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1125779ec1410a9c732e26473be4d3', 'request_id': 'req-7895282e-eb35-4a9f-bcb2-c1759096f703'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.071996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] The token cache is being invalidate because project 4b1125779ec1410a9c732e26473be4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:20.074700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.076575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7895282e-eb35-4a9f-bcb2-c1759096f703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.084777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2495/4977] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:19 2022] DELETE /identity/v3/projects/4b1125779ec1410a9c732e26473be4d3 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:20.086293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2630e9-8847-4a55-a180-bbb2fdeba6bd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:20.087759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.089463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.092176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.103652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:20.104322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.104959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.104959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] PATH_INFO: `/v3/projects/d51b8a21c3f14e4692a8d8f64f01ae73` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.106015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51b8a21c3f14e4692a8d8f64f01ae73)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:20.107937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:20.152259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:20.153609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.172140 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2496/4978] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:20.173389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:20.175342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.195295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8452e-c103-44a3-bba2-3f2248df6cd6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:20.211335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:20.212162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.212553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.212980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] PATH_INFO: `/v3/users/c9e18942207c44d49cbdaa94ddd763b5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.214568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e18942207c44d49cbdaa94ddd763b5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:20.217609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:20.292472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51b8a21c3f14e4692a8d8f64f01ae73', 'request_id': 'req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.305622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51b8a21c3f14e4692a8d8f64f01ae73', 'request_id': 'req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.307874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:20.408605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51b8a21c3f14e4692a8d8f64f01ae73', 'request_id': 'req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.428939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] The token cache is being invalidate because project d51b8a21c3f14e4692a8d8f64f01ae73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:20.429425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.431078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.441463 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2483/4979] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:20 2022] DELETE /identity/v3/projects/d51b8a21c3f14e4692a8d8f64f01ae73 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:20.443493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:20.445655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.510760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e18942207c44d49cbdaa94ddd763b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.533402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e18942207c44d49cbdaa94ddd763b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.534416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e18942207c44d49cbdaa94ddd763b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.548981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b7e5-16d6-4dce-a1b7-0b8ff159094c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:20.555158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fa277-2d6a-41a2-a694-4de71118a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:20.556343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa277-2d6a-41a2-a694-4de71118a182 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.556468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa277-2d6a-41a2-a694-4de71118a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.556716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e18942207c44d49cbdaa94ddd763b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.557197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa277-2d6a-41a2-a694-4de71118a182 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.558671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fa277-2d6a-41a2-a694-4de71118a182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:20.559001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fa277-2d6a-41a2-a694-4de71118a182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:20.560783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fa277-2d6a-41a2-a694-4de71118a182 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:20.579322 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2484/4980] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:20.580818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.581109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.581389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.607631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:20.609114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.618455 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2485/4981] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:20.629095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:20.631179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.646582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f6264-5465-4726-ab6a-8910d3a80dd7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:20.649060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f04cbf7f-dcef-4344-b6c4-66e376f6f264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e18942207c44d49cbdaa94ddd763b5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:20.653220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:20.654228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.654570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.655055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.655852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:20.665820 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2497/4982] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:20 2022] DELETE /identity/v3/users/c9e18942207c44d49cbdaa94ddd763b5 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:20.666172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:20.666274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba4814-291b-4dbd-847c-d3c5a5bf815d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.666274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba4814-291b-4dbd-847c-d3c5a5bf815d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.666274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba4814-291b-4dbd-847c-d3c5a5bf815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.688177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:20.700254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-89ba4814-291b-4dbd-847c-d3c5a5bf815d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:20.701564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89ba4814-291b-4dbd-847c-d3c5a5bf815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:20.774368 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2486/4983] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:20 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:20.784646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:20.857165 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2498/4984] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:20.861946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba4814-291b-4dbd-847c-d3c5a5bf815d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:20.891337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba4814-291b-4dbd-847c-d3c5a5bf815d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:20.939165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58547a24-b352-435e-bf67-e174c7bcebd2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:20.955489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:20.955489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.955489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.955489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.955912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:20.955912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:20.983866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:20.984509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:20.984831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:20.985071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:20.989119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:20.990304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:20.992052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.005826 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2499/4985] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:21.010740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.030481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2097d-22ec-4f58-a6a5-c1326a785e31 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.045676 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2487/4986] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:20 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:21.046725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.047467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.048837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.049146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.049799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.049938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.051802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.062889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1b8ad-4bf8-4e95-a992-646c6907a624 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.080044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.080789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.081139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.081481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.082349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.084595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.098242 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2488/4987] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:21.101647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.115783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed699-1426-4a3f-876c-c1a782458e49 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.126884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.127585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.128910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.128910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.128910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.132089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.149422 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2489/4988] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:21.158334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.168126 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2500/4989] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:21 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:21.173551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.180288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c7afb-fe7d-4c18-87bc-b55c0672de3a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.280186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3608338-cb94-4931-823a-914f08c8e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.281171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3608338-cb94-4931-823a-914f08c8e99b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.281663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3608338-cb94-4931-823a-914f08c8e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.281945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3608338-cb94-4931-823a-914f08c8e99b admin admin] PATH_INFO: `/v3/projects/68bf536e408a4ecb9c3b596f048b3ea2/users/3223534dfbf543969ec96b0b24b7e459/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.306518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c603-a351-4a18-81f5-c0d0295a4d10 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.314085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3608338-cb94-4931-823a-914f08c8e99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bf536e408a4ecb9c3b596f048b3ea2, user_id=3223534dfbf543969ec96b0b24b7e459, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.323622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.324262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.324544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.324822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.325503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.328548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3608338-cb94-4931-823a-914f08c8e99b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.345243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.559085 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2501/4990] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:21 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:21.565251 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2490/4991] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:21 2022] PUT /identity/v3/projects/68bf536e408a4ecb9c3b596f048b3ea2/users/3223534dfbf543969ec96b0b24b7e459/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:21.566417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.577830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11038eee-7d7d-4b97-af7e-8e2b21616fca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.578558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11038eee-7d7d-4b97-af7e-8e2b21616fca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.585509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b448958-4335-4fa7-9c7e-498ad94ca9a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.585670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11038eee-7d7d-4b97-af7e-8e2b21616fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.642844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-11038eee-7d7d-4b97-af7e-8e2b21616fca None None] MFA Rules not processed for user `3223534dfbf543969ec96b0b24b7e459`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:21.644211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11038eee-7d7d-4b97-af7e-8e2b21616fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:21.696219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.696945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.697298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.697636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.698403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.702098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.726651 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2502/4992] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:21.731735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.757493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ed738-86f8-4d66-a6c1-db180533a05b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.766009 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2491/4993] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:21.770035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.770751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.771031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.771145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11038eee-7d7d-4b97-af7e-8e2b21616fca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.771309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.771960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.773582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.794890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11038eee-7d7d-4b97-af7e-8e2b21616fca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.803062 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2503/4994] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:21.807115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.807674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.808317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.808924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.809205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.809850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.811810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.829698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49feac-cbcc-4915-8287-bebd543d368f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:21.857873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec701b70-9ef0-4602-976a-88047d148b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:21.858595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec701b70-9ef0-4602-976a-88047d148b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.859071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec701b70-9ef0-4602-976a-88047d148b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.859262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec701b70-9ef0-4602-976a-88047d148b68 admin admin] PATH_INFO: `/v3/projects/239ed427a5df4a80abca6805d4f02aa6/users/540ca8588cbf43f594325a37238366d2/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:21.894741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec701b70-9ef0-4602-976a-88047d148b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239ed427a5df4a80abca6805d4f02aa6, user_id=540ca8588cbf43f594325a37238366d2, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:21.897499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec701b70-9ef0-4602-976a-88047d148b68 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:21.946751 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2492/4995] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:21 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:21.955954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:21.975288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2504/4996] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:21 2022] PUT /identity/v3/projects/239ed427a5df4a80abca6805d4f02aa6/users/540ca8588cbf43f594325a37238366d2/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:21.992208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:21.992589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:21.992934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.067639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] MFA Rules not processed for user `540ca8588cbf43f594325a37238366d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:22.074466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:22.164517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abda76-cf6b-43f0-b68d-7ead62206ad9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:22.175928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:22.299857 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2505/4997] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:22.312664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:22.314399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:22.319905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:22.320548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.320828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.321100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.321887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:22.324123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:22.428848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f97f8-0a9a-451d-a3eb-be8adecc9317 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:22.437846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:22.437846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.437846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.439023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.452352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:22.455240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:22.469152 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2506/4998] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:22.480337 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2493/4999] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:21 2022] POST /identity/v3/users => generated 301 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:22.484189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:22.485593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:22.490228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:22.495729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48720365-0066-47d5-bce0-c8c4d27dd5fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:22.506676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:22.506676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.506676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.506676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.507109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:22.507109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:22.519785 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2494/5000] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:22.524841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:22.527933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd6541-c8d7-464f-b063-627badb300c1 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:22.538339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68fecb-d0d3-4e76-8588-41e51e9fadc3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:22.546807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:22.546807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.546807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.546807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] PATH_INFO: `/v3/projects/d92350ca17dc4da5b7d539a17d6983b3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.547439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:22.547439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.547439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.547439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] PATH_INFO: `/v3/projects/a23ec7e691234c6887fe379ccaaa3c2f/users/74d654e346a8430180f279cff2ab2be9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.548914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92350ca17dc4da5b7d539a17d6983b3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:22.566924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ec7e691234c6887fe379ccaaa3c2f, user_id=74d654e346a8430180f279cff2ab2be9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:22.571495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:22.572426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:22.639122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:22.732814 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2495/5001] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:22 2022] PUT /identity/v3/projects/a23ec7e691234c6887fe379ccaaa3c2f/users/74d654e346a8430180f279cff2ab2be9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:22.733908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:22.803052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8679bb1-c975-47df-8fee-a5302cce5cb3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:22.808744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:22.809431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.809881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.810273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.810993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:22.813246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:22.824247 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2496/5002] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:22.828311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:22.838863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56bc35-c014-4d7c-abef-0553d09d4c96 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:22.852217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb13f-66bd-415f-9d1c-fe24a0d27947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:22.854879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb13f-66bd-415f-9d1c-fe24a0d27947 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.855205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb13f-66bd-415f-9d1c-fe24a0d27947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.855443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb13f-66bd-415f-9d1c-fe24a0d27947 admin admin] PATH_INFO: `/v3/projects/a23ec7e691234c6887fe379ccaaa3c2f/users/74d654e346a8430180f279cff2ab2be9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.866608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eb13f-66bd-415f-9d1c-fe24a0d27947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ec7e691234c6887fe379ccaaa3c2f, user_id=74d654e346a8430180f279cff2ab2be9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:22.872396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eb13f-66bd-415f-9d1c-fe24a0d27947 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:22.872544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92350ca17dc4da5b7d539a17d6983b3', 'request_id': 'req-83d3d638-da9b-45bb-8bc8-750917717025'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:22.889349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92350ca17dc4da5b7d539a17d6983b3', 'request_id': 'req-83d3d638-da9b-45bb-8bc8-750917717025'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:22.898991 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2497/5003] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:22 2022] PUT /identity/v3/projects/a23ec7e691234c6887fe379ccaaa3c2f/users/74d654e346a8430180f279cff2ab2be9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:22.909166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1affce-ecc9-4753-a91e-3f6bb9c4d2d1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:22.909503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1affce-ecc9-4753-a91e-3f6bb9c4d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:22.909731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1affce-ecc9-4753-a91e-3f6bb9c4d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:22.987431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92350ca17dc4da5b7d539a17d6983b3', 'request_id': 'req-83d3d638-da9b-45bb-8bc8-750917717025'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.001964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] The token cache is being invalidate because project d92350ca17dc4da5b7d539a17d6983b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:23.003039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.005552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-83d3d638-da9b-45bb-8bc8-750917717025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.007812 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2507/5004] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:22 2022] DELETE /identity/v3/projects/d92350ca17dc4da5b7d539a17d6983b3 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:23.016732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:23.016732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:23.016732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:23.018892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd1affce-ecc9-4753-a91e-3f6bb9c4d2d1 None None] MFA Rules not processed for user `74d654e346a8430180f279cff2ab2be9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:23.019700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd1affce-ecc9-4753-a91e-3f6bb9c4d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:23.068064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:23.069605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:23.203092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2508/5005] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:23.203990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:23.209384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:23.221316 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2498/5006] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:23.221316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:23.221316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:23.221316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:23.239742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d692f24-619c-47b7-8eb8-1e4a611e630a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:23.250692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:23.251971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:23.253554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:23.257192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:23.257499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:23.257776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] PATH_INFO: `/v3/users/62ff0a5713b44b7aac67e73e037e8a6b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:23.261652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ff0a5713b44b7aac67e73e037e8a6b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:23.269909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2499/5007] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:23.269909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:23.270248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:23.270342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:23.492863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf96910-8c0d-4fb9-a2cd-a29845d23f69 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:23.497351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:23.498104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:23.498357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:23.498686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:23.500802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:23.547985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ff0a5713b44b7aac67e73e037e8a6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.564001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ff0a5713b44b7aac67e73e037e8a6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.564686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ff0a5713b44b7aac67e73e037e8a6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.591066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ff0a5713b44b7aac67e73e037e8a6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.597835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:23.599599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:23.610118 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2500/5008] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:23.611259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:23.625028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5810e-eee7-4dfe-8df3-a9296aed006e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:23.632330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:23.633814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:23.634321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:23.635305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:23.636430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:23.636916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:23.638765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:23.657627 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2501/5009] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:23.664500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:23.668213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:23.708920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ff0a5713b44b7aac67e73e037e8a6b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:23.713098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e3b4-6817-41b7-b778-cc59add23d48 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:23.721802 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2509/5010] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:23 2022] DELETE /identity/v3/users/62ff0a5713b44b7aac67e73e037e8a6b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:23.723411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:23.723705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:23.723990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:23.724340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:23.725134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:23.728786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:23.853470 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2502/5011] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:23 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:23.857788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:23.964741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d8e34-8437-4cb0-81fb-cddcbb1bcf7a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.042481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.043442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.044034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.044471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.045268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.047737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.147779 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2510/5012] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:23 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:24.151764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.168798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e68bbc-0c85-4a08-8b97-f8526143fe15 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.195284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.195854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.196135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.196496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.197168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.198818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.221706 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2503/5013] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:24.225905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.237257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be14ae8-c016-4490-aae1-86e6225d1a4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.244025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.244025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.245273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.245812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.247000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.248951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.258898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.260923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:24.266088 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2511/5014] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:24.271147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.287885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43933-8441-49aa-a65c-40c7e7ad780c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.291358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6519-6c98-4e66-b77f-7f369fee9590 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.295813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:24.301840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529bec3-552c-458a-90b0-d9bbd605e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.302179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.303041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.303477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.303917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] PATH_INFO: `/v3/projects/3c6a1e83216c4a3882adbeab292b822f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.304321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529bec3-552c-458a-90b0-d9bbd605e181 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.304717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529bec3-552c-458a-90b0-d9bbd605e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.305137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529bec3-552c-458a-90b0-d9bbd605e181 admin admin] PATH_INFO: `/v3/projects/4f9647dbb8d6440bb1b06508741ed7f9/users/ee93dac8788a4385bdd174bdcd4b277e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.305974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6a1e83216c4a3882adbeab292b822f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.309560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.360466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529bec3-552c-458a-90b0-d9bbd605e181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9647dbb8d6440bb1b06508741ed7f9, user_id=ee93dac8788a4385bdd174bdcd4b277e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.365557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529bec3-552c-458a-90b0-d9bbd605e181 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.477781 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2512/5015] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:24 2022] PUT /identity/v3/projects/4f9647dbb8d6440bb1b06508741ed7f9/users/ee93dac8788a4385bdd174bdcd4b277e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:24.488569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.489130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.490578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.504458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6a1e83216c4a3882adbeab292b822f', 'request_id': 'req-7cacd82b-bd35-490f-9713-c47e48608516'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:24.513537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6a1e83216c4a3882adbeab292b822f', 'request_id': 'req-7cacd82b-bd35-490f-9713-c47e48608516'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:24.531689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] MFA Rules not processed for user `ee93dac8788a4385bdd174bdcd4b277e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:24.533583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:24.574851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6a1e83216c4a3882adbeab292b822f', 'request_id': 'req-7cacd82b-bd35-490f-9713-c47e48608516'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:24.589901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] The token cache is being invalidate because project 3c6a1e83216c4a3882adbeab292b822f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:24.591183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:24.596143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-7cacd82b-bd35-490f-9713-c47e48608516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:24.598253 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2504/5016] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:24 2022] DELETE /identity/v3/projects/3c6a1e83216c4a3882adbeab292b822f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:24.603105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f9bec-ffe0-4dd0-bfab-2175389f1349 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.603593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f9bec-ffe0-4dd0-bfab-2175389f1349 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.603945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f9bec-ffe0-4dd0-bfab-2175389f1349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.646595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d7f9bec-ffe0-4dd0-bfab-2175389f1349 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:24.653016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d7f9bec-ffe0-4dd0-bfab-2175389f1349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:24.666471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:24.670023 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2513/5017] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:24.685947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.687591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:24.796728 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2505/5018] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:24.804545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.805081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.805548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.824802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de38ee-4aa0-4327-a676-5af372a14156 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.836872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.838116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.838417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.838702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.847447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:24.854506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:24.858514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.859983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.870798 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2514/5020] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:24.871051 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2506/5020] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:24.877962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.894902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829cf0-cb03-4016-97b4-4d92eacfeadc service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.899960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.901374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:24.904209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.904847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.905666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.905666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.906230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:24.906577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.909185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.917761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1426d-5c46-4854-954c-ebf7832384eb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.923610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.924533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.925203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.927418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] PATH_INFO: `/v3/users/ee93dac8788a4385bdd174bdcd4b277e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.929237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee93dac8788a4385bdd174bdcd4b277e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.932063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:24.943647 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2515/5021] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:44:24.945176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:24.968818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c39ed-5ced-4570-9503-efe67308d2c9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:24.976094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:24.977648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:24.978121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:24.978568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:24.979355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:24.981492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:25.122202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2516/5022] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:24 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:25.126487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:25.188723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee93dac8788a4385bdd174bdcd4b277e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:25.190320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee93dac8788a4385bdd174bdcd4b277e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:25.202189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c2f4-d8f9-49a7-b145-7d323179b10d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:25.207457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:25.209397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:25.210335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:25.211090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:25.212049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:25.214390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:25.255821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee93dac8788a4385bdd174bdcd4b277e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:25.256581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee93dac8788a4385bdd174bdcd4b277e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:25.267872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d3d916b-e652-4b4f-8f06-f4c328002d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee93dac8788a4385bdd174bdcd4b277e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:25.303408 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2507/5023] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:24 2022] DELETE /identity/v3/users/ee93dac8788a4385bdd174bdcd4b277e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:25.307787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:25.308454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:25.309275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:25.332059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:25.333972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:25.356299 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2517/5024] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:25 2022] POST /identity/v3/users => generated 282 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:25.359373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:25.372230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:25.394544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7c8d-9248-4b30-be4a-6cce15635dde admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:25.447037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2508/5025] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:25.463798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:25.465402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:25.476326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:25.477483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:25.477982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:25.478424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:25.479445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:25.481474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:25.495090 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2518/5026] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:25.498934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:25.527324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0557fe-247d-44da-9a40-1ca755f4a9ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:25.541438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:25.543408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:25.543863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:25.544286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:25.551045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:25.555353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:25.594993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:25.596774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590531bd-71b9-4a2c-b60e-8c3ef93a9ef9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:25.603235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ad57d-2dd2-4c13-a98a-1e8b4f748328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:25.605694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad57d-2dd2-4c13-a98a-1e8b4f748328 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:25.605694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad57d-2dd2-4c13-a98a-1e8b4f748328 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:25.605694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ad57d-2dd2-4c13-a98a-1e8b4f748328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:25.622084 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2519/5027] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:25.622286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ad57d-2dd2-4c13-a98a-1e8b4f748328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:25.624263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:25.625594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ad57d-2dd2-4c13-a98a-1e8b4f748328 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:25.643016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f6f9-4728-4e48-982a-ed3801fe84f9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:25.652011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:25.652853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:25.653568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:25.653952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] PATH_INFO: `/v3/projects/2fa90f115c8848e7a135083d5bd4acac/users/13ec7fa980b34262948e752194ce1a85/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:25.656109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2509/5028] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:25.709490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa90f115c8848e7a135083d5bd4acac, user_id=13ec7fa980b34262948e752194ce1a85, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:25.713149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:25.830290 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2520/5029] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:25 2022] PUT /identity/v3/projects/2fa90f115c8848e7a135083d5bd4acac/users/13ec7fa980b34262948e752194ce1a85/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:25.842618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa545a-92ea-4827-901f-2ac3064dcde4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:25.842914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa545a-92ea-4827-901f-2ac3064dcde4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:25.843193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa545a-92ea-4827-901f-2ac3064dcde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:25.849955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:25.893189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-32fa545a-92ea-4827-901f-2ac3064dcde4 None None] MFA Rules not processed for user `13ec7fa980b34262948e752194ce1a85`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:25.894635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32fa545a-92ea-4827-901f-2ac3064dcde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:25.968354 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2510/5030] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:25.981041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:25.983206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:26.090366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3879cb-a991-48fc-8547-ee3a8af8d309 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:26.096558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:26.097212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.097462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.097738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.106921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:26.108531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:26.124240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2521/5031] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:26.134404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b2ec-8c68-4d20-bb24-99cb392e2a63 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.134682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b2ec-8c68-4d20-bb24-99cb392e2a63 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.134960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b2ec-8c68-4d20-bb24-99cb392e2a63 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.136461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2511/5032] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:44:26.147842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:44:26.170270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:26.182152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a659b-b811-4b55-bb92-1de4ca837cbc service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:26.191821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277ddd-6e39-4182-8db4-474b4622192c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13ec7fa980b34262948e752194ce1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa90f115c8848e7a135083d5bd4acac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:26.193346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277ddd-6e39-4182-8db4-474b4622192c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.193591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277ddd-6e39-4182-8db4-474b4622192c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.193972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277ddd-6e39-4182-8db4-474b4622192c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] PATH_INFO: `/v3/projects/2fa90f115c8848e7a135083d5bd4acac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.195532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277ddd-6e39-4182-8db4-474b4622192c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorizing `identity:get_project(project_id=2fa90f115c8848e7a135083d5bd4acac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:26.197499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277ddd-6e39-4182-8db4-474b4622192c tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:26.199774 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2522/5033] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:44:26 2022] GET /identity/v3/projects/2fa90f115c8848e7a135083d5bd4acac => generated 363 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:26.418406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01fa7-963c-4886-b104-f04b5e323666 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.418406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01fa7-963c-4886-b104-f04b5e323666 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.418406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01fa7-963c-4886-b104-f04b5e323666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.534646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-88c01fa7-963c-4886-b104-f04b5e323666 None None] MFA Rules not processed for user `fb29c723cbc249a781905fdbde1b3ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:26.536319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88c01fa7-963c-4886-b104-f04b5e323666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:26.680727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131982-ee08-48f9-973c-70ae33f29ee5 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.680727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131982-ee08-48f9-973c-70ae33f29ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.682304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131982-ee08-48f9-973c-70ae33f29ee5 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.682387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2523/5034] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:44:26.687373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131982-ee08-48f9-973c-70ae33f29ee5 None None] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:44:26.689963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12131982-ee08-48f9-973c-70ae33f29ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:26.716330 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2512/5035] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:26.719730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f556be-6cd3-4059-a9ba-0fc1be86024f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.720022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f556be-6cd3-4059-a9ba-0fc1be86024f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.720301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f556be-6cd3-4059-a9ba-0fc1be86024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.727385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131982-ee08-48f9-973c-70ae33f29ee5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:26.749685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131982-ee08-48f9-973c-70ae33f29ee5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:26.760815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13ec7fa980b34262948e752194ce1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa90f115c8848e7a135083d5bd4acac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:26.761468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.761749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.762365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] PATH_INFO: `/v3/projects/2fa90f115c8848e7a135083d5bd4acac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.764100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorizing `identity:get_project(project_id=2fa90f115c8848e7a135083d5bd4acac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:26.765912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:26.768078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e4f556be-6cd3-4059-a9ba-0fc1be86024f None None] MFA Rules not processed for user `fb29c723cbc249a781905fdbde1b3ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:26.769353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4f556be-6cd3-4059-a9ba-0fc1be86024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:26.771322 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2524/5036] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:44:26 2022] GET /identity/v3/projects/2fa90f115c8848e7a135083d5bd4acac => generated 363 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:44:26.778592 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2513/5037] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:26.815337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:26.831657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63a24-886d-43ac-a12a-a8de4ee36027 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:26.839485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:26.840228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.840571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.841033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.851180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:26.852883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:26.863910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2525/5038] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:26.899896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0a44-a8be-40f8-b94d-16951f461a43 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.900131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0a44-a8be-40f8-b94d-16951f461a43 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.900409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e0a44-a8be-40f8-b94d-16951f461a43 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.902011 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2514/5039] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:44:26.908710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:44:26.924184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:26.936036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9021845-3da6-43b8-abf0-905a62dc12bf service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:26.941357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13ec7fa980b34262948e752194ce1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa90f115c8848e7a135083d5bd4acac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:26.942008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:26.942386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:26.942667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] PATH_INFO: `/v3/projects/2fa90f115c8848e7a135083d5bd4acac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:26.943891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorizing `identity:get_project(project_id=2fa90f115c8848e7a135083d5bd4acac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:26.946480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:26.953142 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2526/5040] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:44:26 2022] GET /identity/v3/projects/2fa90f115c8848e7a135083d5bd4acac => generated 363 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:27.000305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac13e6e-5643-45a1-84a0-485be84ec118 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.000762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac13e6e-5643-45a1-84a0-485be84ec118 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.001135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac13e6e-5643-45a1-84a0-485be84ec118 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.002889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2515/5041] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:44:27.010784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:44:27.029643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:27.040363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb618ab-b625-4cdb-b247-6eaeaedc0eab tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:27.046460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13ec7fa980b34262948e752194ce1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa90f115c8848e7a135083d5bd4acac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:27.047718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.048126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.048577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] PATH_INFO: `/v3/projects/2fa90f115c8848e7a135083d5bd4acac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.050794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorizing `identity:get_project(project_id=2fa90f115c8848e7a135083d5bd4acac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:27.052874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:27.054937 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2527/5042] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:44:27 2022] GET /identity/v3/projects/2fa90f115c8848e7a135083d5bd4acac => generated 363 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:27.106321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce5373-6c1f-4bd2-a1c1-224ccf45840a None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.109797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce5373-6c1f-4bd2-a1c1-224ccf45840a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.109797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce5373-6c1f-4bd2-a1c1-224ccf45840a None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.109797 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2516/5043] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:44:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:44:27.116853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 13:44:27.137540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:27.150417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694eed4f-2d91-4a5a-b36e-c2ec5b4c49f9 tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:27.158580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13ec7fa980b34262948e752194ce1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa90f115c8848e7a135083d5bd4acac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:27.159487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.160039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.160532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] PATH_INFO: `/v3/projects/2fa90f115c8848e7a135083d5bd4acac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.161925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorizing `identity:get_project(project_id=2fa90f115c8848e7a135083d5bd4acac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:27.164095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:27.167175 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2528/5044] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 13:44:27 2022] GET /identity/v3/projects/2fa90f115c8848e7a135083d5bd4acac => generated 363 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:27.206319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce5373-6c1f-4bd2-a1c1-224ccf45840a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:27.286958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce5373-6c1f-4bd2-a1c1-224ccf45840a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:27.293677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:27.294525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.294912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.295290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] PATH_INFO: `/v3/users/13ec7fa980b34262948e752194ce1a85` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.296684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ec7fa980b34262948e752194ce1a85)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:27.299143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:27.372323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:27.374305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:27.383682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:27.401373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f3693-bc53-4cd3-9a7b-37083c72e61f tempest-QuotasTestJSON-138358526 tempest-QuotasTestJSON-138358526-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:27.407342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:27.408009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.408973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.408973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] PATH_INFO: `/v3/projects/4f9647dbb8d6440bb1b06508741ed7f9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.410092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9647dbb8d6440bb1b06508741ed7f9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:27.414541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:27.557825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ec7fa980b34262948e752194ce1a85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.558659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ec7fa980b34262948e752194ce1a85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.599276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9647dbb8d6440bb1b06508741ed7f9', 'request_id': 'req-211e45d0-7174-408f-a90a-4c13876e1f03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.616694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9647dbb8d6440bb1b06508741ed7f9', 'request_id': 'req-211e45d0-7174-408f-a90a-4c13876e1f03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.626197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ec7fa980b34262948e752194ce1a85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.627229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ec7fa980b34262948e752194ce1a85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.638933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b81a596-1229-40db-80c8-a9fbcc4f15e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ec7fa980b34262948e752194ce1a85'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.678147 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2517/5045] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:27 2022] DELETE /identity/v3/users/13ec7fa980b34262948e752194ce1a85 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:27.682480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab68d68-fb3e-4546-8457-e2bad353aaa5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.682772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab68d68-fb3e-4546-8457-e2bad353aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.683050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab68d68-fb3e-4546-8457-e2bad353aaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.712215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9647dbb8d6440bb1b06508741ed7f9', 'request_id': 'req-211e45d0-7174-408f-a90a-4c13876e1f03'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.722611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7ab68d68-fb3e-4546-8457-e2bad353aaa5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:27.723907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ab68d68-fb3e-4546-8457-e2bad353aaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:27.730856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] The token cache is being invalidate because project 4f9647dbb8d6440bb1b06508741ed7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:27.731153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.733456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-211e45d0-7174-408f-a90a-4c13876e1f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:27.738516 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2529/5046] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:27 2022] DELETE /identity/v3/projects/4f9647dbb8d6440bb1b06508741ed7f9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:27.743317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.743605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.743883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.782263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:27.788677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:27.796288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:27.912109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2518/5047] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:27.931342 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2530/5048] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:27.938884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162990-bc1e-4b7e-8edc-c632855ef190 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:27.939167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162990-bc1e-4b7e-8edc-c632855ef190 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:27.939451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162990-bc1e-4b7e-8edc-c632855ef190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:27.947412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:27.949040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:27.977682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42162990-bc1e-4b7e-8edc-c632855ef190 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:27.978751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42162990-bc1e-4b7e-8edc-c632855ef190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:27.999918 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2519/5049] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:28.003904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42162990-bc1e-4b7e-8edc-c632855ef190 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:28.022451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42162990-bc1e-4b7e-8edc-c632855ef190 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:28.042756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:28.043396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:28.043682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:28.043956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:28.044634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:28.044937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:28.046576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:28.070646 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2520/5050] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:44:28.073433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29a88c-9363-4d30-b8e5-66ff34c39af8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:28.074856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:28.078597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:28.079193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:28.079544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:28.080030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:28.095940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:28.098014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc71f5-3108-4b3b-86ca-8344311d28eb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:28.098473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:28.112277 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2531/5051] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:28.113635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:28.114406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:28.114689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:28.114966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:28.115618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:28.117569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:28.261856 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2521/5052] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:28 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:28.265461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:28.282383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833e38-2ddc-4b9d-8127-16f8f5dfa0e0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:28.437715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:28.438893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:28.439331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:28.439802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:28.440594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:28.444369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:28.620132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2532/5053] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:28 2022] POST /identity/v3/users => generated 288 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:28.621665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:28.635441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f7c77-8ddb-42bd-ae03-e7aefc9e3a05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:28.641116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:28.641983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:28.644297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:28.644297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:28.644297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:28.645641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:28.663732 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2522/5054] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:28.669342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:28.716589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601ee4-65c4-4a61-a77a-d0270523880e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:28.732637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8228f5-bbc5-4d84-ac79-cd76a66db22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:28.733574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8228f5-bbc5-4d84-ac79-cd76a66db22f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:28.733864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8228f5-bbc5-4d84-ac79-cd76a66db22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:28.734184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8228f5-bbc5-4d84-ac79-cd76a66db22f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:28.734806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8228f5-bbc5-4d84-ac79-cd76a66db22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:28.736866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8228f5-bbc5-4d84-ac79-cd76a66db22f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:28.750605 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2533/5055] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:28.758392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:28.789008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b552c59-ce7a-4585-83df-296b1a9bf80d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:28.826109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:28.828674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:28.832136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:28.832502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] PATH_INFO: `/v3/projects/f6b588705e4c4215b5b1cd9fbf5bf3b9/users/6f97512f2fb248698c062b8db2adfa9f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:28.881040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:28.888555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b588705e4c4215b5b1cd9fbf5bf3b9, user_id=6f97512f2fb248698c062b8db2adfa9f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:28.895059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:29.038997 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2523/5056] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:28 2022] PUT /identity/v3/projects/f6b588705e4c4215b5b1cd9fbf5bf3b9/users/6f97512f2fb248698c062b8db2adfa9f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:29.051924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f788e-1533-426a-9770-5b38210a0176 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:29.052217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f788e-1533-426a-9770-5b38210a0176 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:29.064352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f788e-1533-426a-9770-5b38210a0176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:29.149484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fb6f788e-1533-426a-9770-5b38210a0176 None None] MFA Rules not processed for user `6f97512f2fb248698c062b8db2adfa9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:29.151182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb6f788e-1533-426a-9770-5b38210a0176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:29.284226 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2534/5057] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:29.289162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:29.437868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1b5b0-cacb-4474-ac25-4896927b7455 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:29.462712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:29.462712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:29.462712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:29.465348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:29.466167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:29.482825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:29.700954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:29.776001 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2524/5058] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:29 2022] POST /identity/v3/projects => generated 375 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:29.779910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f788e-1533-426a-9770-5b38210a0176 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:29.815138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f788e-1533-426a-9770-5b38210a0176 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:29.916733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:29.917619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:29.917839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:29.918260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:29.919163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:29.921584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:29.932562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:29.935235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:29.963815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19d2de-0956-4a51-815e-56704622fc24 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:29.978256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:29.979585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:29.980020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:29.980770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] PATH_INFO: `/v3/projects/2fa90f115c8848e7a135083d5bd4acac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:29.982411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa90f115c8848e7a135083d5bd4acac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:29.994738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:30.151008 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2535/5059] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:29 2022] POST /identity/v3/users => generated 294 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:30.153569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:30.166705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa90f115c8848e7a135083d5bd4acac', 'request_id': 'req-3552284d-33f5-493c-9e31-aea259fa45d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:30.170043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8777c-81b1-4d7c-9dfc-c956655fcd45 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:30.183904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa90f115c8848e7a135083d5bd4acac', 'request_id': 'req-3552284d-33f5-493c-9e31-aea259fa45d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:30.282837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:30.283751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.284239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.284672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.285709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:30.288757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa90f115c8848e7a135083d5bd4acac', 'request_id': 'req-3552284d-33f5-493c-9e31-aea259fa45d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:30.289508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:30.303455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] The token cache is being invalidate because project 2fa90f115c8848e7a135083d5bd4acac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:30.303748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:30.304555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3552284d-33f5-493c-9e31-aea259fa45d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:30.311290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2525/5060] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:29 2022] DELETE /identity/v3/projects/2fa90f115c8848e7a135083d5bd4acac => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:30.312967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ceb27-a83b-4ac4-a3fd-4f9b6493b081 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.313259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ceb27-a83b-4ac4-a3fd-4f9b6493b081 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.313536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ceb27-a83b-4ac4-a3fd-4f9b6493b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.314959 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2536/5061] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:30.320143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:30.337222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:30.368235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc7ace-2b2c-4338-9192-15d08807c6af admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:30.376691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:30.376810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa2ceb27-a83b-4ac4-a3fd-4f9b6493b081 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:30.379092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.379757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.380218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] PATH_INFO: `/v3/projects/cbf63ece10bc4518925239a8cfb15011/users/7cbf78e2c2384408beeaced212b1e6fc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.382956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa2ceb27-a83b-4ac4-a3fd-4f9b6493b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:30.407987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf63ece10bc4518925239a8cfb15011, user_id=7cbf78e2c2384408beeaced212b1e6fc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:30.416197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:30.419590 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2526/5062] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:30.428716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964602-b85b-41f0-9d6d-9944706a7fcb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.429043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964602-b85b-41f0-9d6d-9944706a7fcb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.429382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8964602-b85b-41f0-9d6d-9944706a7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.480767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8964602-b85b-41f0-9d6d-9944706a7fcb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:30.480767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8964602-b85b-41f0-9d6d-9944706a7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:30.498003 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2527/5063] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:30.500076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964602-b85b-41f0-9d6d-9944706a7fcb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:30.515159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8964602-b85b-41f0-9d6d-9944706a7fcb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:30.523384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:30.524467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.525073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.525513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.526513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:30.527030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:30.529794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:30.538115 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2537/5064] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:30 2022] PUT /identity/v3/projects/cbf63ece10bc4518925239a8cfb15011/users/7cbf78e2c2384408beeaced212b1e6fc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:30.541837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:30.553518 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2528/5065] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:30.557692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:30.577071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38f57c-c535-4db6-9c52-7950ac5b1c5c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:30.757532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f3990-d80f-4f2d-a8e5-fd9fc3a4abee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:30.777213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:30.778020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.778649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.778968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.779747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:30.781379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:30.781768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:30.782555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.782976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.783266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.783909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:30.785814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:30.836033 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2538/5066] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:30.843378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:30.878982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ddf2-aade-4d6f-88d7-54d68c05a729 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:30.893477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265d59d-e2bb-4750-86cb-6d1931b86d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:30.896287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d59d-e2bb-4750-86cb-6d1931b86d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.896634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d59d-e2bb-4750-86cb-6d1931b86d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.896965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d59d-e2bb-4750-86cb-6d1931b86d5f admin admin] PATH_INFO: `/v3/projects/cbf63ece10bc4518925239a8cfb15011/users/7cbf78e2c2384408beeaced212b1e6fc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.901179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265d59d-e2bb-4750-86cb-6d1931b86d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf63ece10bc4518925239a8cfb15011, user_id=7cbf78e2c2384408beeaced212b1e6fc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:30.905008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265d59d-e2bb-4750-86cb-6d1931b86d5f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:30.946759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2539/5067] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:30 2022] PUT /identity/v3/projects/cbf63ece10bc4518925239a8cfb15011/users/7cbf78e2c2384408beeaced212b1e6fc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:30.955371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:30.955665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:30.955945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:30.991191 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2529/5068] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:30 2022] POST /identity/v3/projects => generated 387 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:30.995041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:31.006609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] MFA Rules not processed for user `7cbf78e2c2384408beeaced212b1e6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:31.012703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:31.110352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1da81-1c10-472e-910e-684e36b37e9a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:31.115635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:31.116265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:31.116548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:31.116824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:31.117470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:31.119696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:31.134448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2540/5069] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:31.150271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:31.162601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:31.233581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:31.241112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2530/5070] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:30 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:31.244937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:31.273289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6255a-0764-4e52-b5bd-f5374bacf0fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:31.274344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e137e9-d9a0-4f09-a22d-5da7a99c9503 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:31.293800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:31.297644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:31.299068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:31.309191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:31.309191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:31.309353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e9d40-e1f6-49cd-b7ad-04267d2f618b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:31.309353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9d40-e1f6-49cd-b7ad-04267d2f618b service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:31.309353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9d40-e1f6-49cd-b7ad-04267d2f618b service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:31.309353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9d40-e1f6-49cd-b7ad-04267d2f618b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:31.314405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:31.326895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d70e9d40-e1f6-49cd-b7ad-04267d2f618b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:31.356704 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2531/5071] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:31.357925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:31.384784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98025d-cd7a-471a-89d5-aa55cb08cbf0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:31.402348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:31.403299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:31.403740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:31.404212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:31.405208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:31.408037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:31.420050 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2532/5072] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:31.424203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:31.435965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e9d40-e1f6-49cd-b7ad-04267d2f618b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:31.438119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d810-fcb8-40a0-bf75-78e774b1ccaf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:31.444318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:31.445254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:31.445817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:31.446365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] PATH_INFO: `/v3/projects/655e7fe942384f54a42b3179d40e8cd9/users/867c51013044489d8b85cc9fe4f779e6/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:31.448219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e9d40-e1f6-49cd-b7ad-04267d2f618b service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:31.469660 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2541/5073] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:31.492434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655e7fe942384f54a42b3179d40e8cd9, user_id=867c51013044489d8b85cc9fe4f779e6, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:31.498579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:31.622909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2533/5074] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:31 2022] PUT /identity/v3/projects/655e7fe942384f54a42b3179d40e8cd9/users/867c51013044489d8b85cc9fe4f779e6/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:31.628978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8dc2-2bb3-4af6-ba2d-f885597969ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:31.629273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8dc2-2bb3-4af6-ba2d-f885597969ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:31.629684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8dc2-2bb3-4af6-ba2d-f885597969ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:31.665028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:31.736736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eaae8dc2-2bb3-4af6-ba2d-f885597969ad None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:31.736736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eaae8dc2-2bb3-4af6-ba2d-f885597969ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:31.891168 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2542/5075] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:31.917323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:31.917323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:32.083280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbfe0f-ca18-46d7-8535-12f807eff498 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:32.097417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0552d9-06c1-4362-b711-f08d104c68ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:32.098098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0552d9-06c1-4362-b711-f08d104c68ea service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:32.098412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0552d9-06c1-4362-b711-f08d104c68ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:32.098694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0552d9-06c1-4362-b711-f08d104c68ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:32.111599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0552d9-06c1-4362-b711-f08d104c68ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:32.113217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0552d9-06c1-4362-b711-f08d104c68ea service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:32.135745 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2534/5076] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:33.337250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:33.736565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:34.199563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8dc2-2bb3-4af6-ba2d-f885597969ad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:34.230614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8dc2-2bb3-4af6-ba2d-f885597969ad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:34.236375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:34.238328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:34.238328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:34.238328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:34.242215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:34.401361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:34.403547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:34.461718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2543/5077] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:34 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:34.849373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6f9e8-5d50-40a6-93e7-cca6962768a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:34.849934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6f9e8-5d50-40a6-93e7-cca6962768a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:34.849934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6f9e8-5d50-40a6-93e7-cca6962768a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:34.916563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8e6f9e8-5d50-40a6-93e7-cca6962768a5 None None] MFA Rules not processed for user `867c51013044489d8b85cc9fe4f779e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:34.917794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8e6f9e8-5d50-40a6-93e7-cca6962768a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:35.033116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:35.035649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:35.046967 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2535/5078] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:35.059551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:35.060661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:35.062479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:35.117974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] MFA Rules not processed for user `867c51013044489d8b85cc9fe4f779e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:35.119356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:35.130515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2536/5079] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:35.143139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:35.144785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:35.225965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaf4d0-d83d-4c61-bab6-ab8230179bd3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:35.238375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:35.238716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:35.239045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:35.239327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:35.239607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:35.243400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:35.279341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:35.281041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:35.312654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afa7a0-f3e1-4dc7-91b4-9273311420f8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:35.317512 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2544/5080] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:35.338077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0c83f-d75a-4d37-97f0-949ae2d09c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:35.338077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c83f-d75a-4d37-97f0-949ae2d09c5a service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:35.338077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c83f-d75a-4d37-97f0-949ae2d09c5a service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:35.338077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c83f-d75a-4d37-97f0-949ae2d09c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:35.354938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c83f-d75a-4d37-97f0-949ae2d09c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:35.358758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c83f-d75a-4d37-97f0-949ae2d09c5a service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:35.376162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2537/5081] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:35.398298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:36.077651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:36.079249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:36.094482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295823dd-eeba-43bc-8429-78671d6dc7c2 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:36.099257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:36.100139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:36.100617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:36.101070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:36.103230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:36.118533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:36.120212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:36.130825 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2545/5082] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:36.711989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:36.729098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627980-705a-4c54-8707-d0e19f7a7ed9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:36.730117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627980-705a-4c54-8707-d0e19f7a7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:36.730549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627980-705a-4c54-8707-d0e19f7a7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:36.757479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-45627980-705a-4c54-8707-d0e19f7a7ed9 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:36.759140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-45627980-705a-4c54-8707-d0e19f7a7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:36.878974 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2538/5083] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:37.103479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:37.324431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:37.343576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e000-ee80-4761-a8b6-b928908a713c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:37.353137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:37.353992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:37.354396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:37.354742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] PATH_INFO: `/v3/users/867c51013044489d8b85cc9fe4f779e6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:37.357555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=867c51013044489d8b85cc9fe4f779e6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:37.364754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:37.583774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867c51013044489d8b85cc9fe4f779e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:37.609774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867c51013044489d8b85cc9fe4f779e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:37.612063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867c51013044489d8b85cc9fe4f779e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:37.648008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867c51013044489d8b85cc9fe4f779e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:37.728739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0e2447e-4bb2-4843-b5f3-c9119ca56d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867c51013044489d8b85cc9fe4f779e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:37.739678 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2546/5084] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:37 2022] DELETE /identity/v3/users/867c51013044489d8b85cc9fe4f779e6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:37.861371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:38.409042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:38.447798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627980-705a-4c54-8707-d0e19f7a7ed9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:38.467255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627980-705a-4c54-8707-d0e19f7a7ed9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:38.599641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:38.600320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:38.600606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:38.600886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] PATH_INFO: `/v3/projects/655e7fe942384f54a42b3179d40e8cd9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:38.602084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=655e7fe942384f54a42b3179d40e8cd9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:38.604028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:38.780957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:38.787849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655e7fe942384f54a42b3179d40e8cd9', 'request_id': 'req-42ddfba8-5937-451a-8954-4a61dfdcf67b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:38.797883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655e7fe942384f54a42b3179d40e8cd9', 'request_id': 'req-42ddfba8-5937-451a-8954-4a61dfdcf67b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:38.962661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655e7fe942384f54a42b3179d40e8cd9', 'request_id': 'req-42ddfba8-5937-451a-8954-4a61dfdcf67b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:39.008114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] The token cache is being invalidate because project 655e7fe942384f54a42b3179d40e8cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:39.008114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:39.008114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-42ddfba8-5937-451a-8954-4a61dfdcf67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:39.015385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2539/5085] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:38 2022] DELETE /identity/v3/projects/655e7fe942384f54a42b3179d40e8cd9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:39.017961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a0d0-475b-4ced-ac86-c6bcc88f0a84 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.017961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a0d0-475b-4ced-ac86-c6bcc88f0a84 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.017961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a0d0-475b-4ced-ac86-c6bcc88f0a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.055862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1738a0d0-475b-4ced-ac86-c6bcc88f0a84 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:39.060732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1738a0d0-475b-4ced-ac86-c6bcc88f0a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:39.201716 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2547/5086] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:39.209796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf71d-0400-4d49-98f2-b3312bc3527d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.210123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf71d-0400-4d49-98f2-b3312bc3527d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.210410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf71d-0400-4d49-98f2-b3312bc3527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.241879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f94cf71d-0400-4d49-98f2-b3312bc3527d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:39.243199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f94cf71d-0400-4d49-98f2-b3312bc3527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:39.255073 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2540/5087] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:39.260282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a0d0-475b-4ced-ac86-c6bcc88f0a84 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:39.271504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a0d0-475b-4ced-ac86-c6bcc88f0a84 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:39.277745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:39.279348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.279814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.280475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.281426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:39.281918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:39.289052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:39.324320 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2548/5088] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:39.325783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cf71d-0400-4d49-98f2-b3312bc3527d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:39.340251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cf71d-0400-4d49-98f2-b3312bc3527d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:39.356525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:39.357536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.358138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.358622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.359529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:39.362188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:39.467155 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2541/5089] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:39 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:39.468020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:39.482548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd6077-c5db-4200-b936-ea6a8708fd03 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:39.586344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:39.588216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:39.601529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:39.656849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:39.657493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.657774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.658047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.660822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:39.667070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:39.722886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:39.749001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0842c-85dc-4dac-a1e4-5fee5ec87643 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:39.776121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:39.776803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.777070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.777340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] PATH_INFO: `/v3/users/6f97512f2fb248698c062b8db2adfa9f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.779144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f97512f2fb248698c062b8db2adfa9f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:39.781182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:39.809272 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2549/5090] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:39 2022] POST /identity/v3/users => generated 287 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:39.815310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:39.838344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43efe63-3cba-4552-b545-4768626da9a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:39.850095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:39.850794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.851029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.851311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.851977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:39.853629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:39.884384 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2550/5091] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:39.885311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:39.906567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f134918-2a5d-421f-9c08-4c717fd09ca5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:39.921611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:39.922709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:39.922993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:39.923267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:39.923992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:39.925612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:39.958075 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2551/5092] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:39.962128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:39.985944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0ffe9-9f91-4b15-a3fa-ed36494ee192 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:40.009648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029028a-cf45-465e-980e-878d1c2fcd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:40.010535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029028a-cf45-465e-980e-878d1c2fcd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:40.010937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029028a-cf45-465e-980e-878d1c2fcd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:40.011304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029028a-cf45-465e-980e-878d1c2fcd56 admin admin] PATH_INFO: `/v3/projects/fd68dfcc79d646e68a00aaad0cf71e6e/users/267d6820d336477bbb0626e473ac0327/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:40.065454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029028a-cf45-465e-980e-878d1c2fcd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd68dfcc79d646e68a00aaad0cf71e6e, user_id=267d6820d336477bbb0626e473ac0327, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:40.068549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029028a-cf45-465e-980e-878d1c2fcd56 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:40.073316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f97512f2fb248698c062b8db2adfa9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.074236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f97512f2fb248698c062b8db2adfa9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.157556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f97512f2fb248698c062b8db2adfa9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.158233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f97512f2fb248698c062b8db2adfa9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.172078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a6be51eb-62ed-494b-9c9e-79ccf35d07b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f97512f2fb248698c062b8db2adfa9f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.186854 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2552/5093] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:39 2022] PUT /identity/v3/projects/fd68dfcc79d646e68a00aaad0cf71e6e/users/267d6820d336477bbb0626e473ac0327/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:40.197824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:40.198394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:40.198881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:40.224763 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2542/5094] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:39 2022] DELETE /identity/v3/users/6f97512f2fb248698c062b8db2adfa9f => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:40.229278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:40.229585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:40.229848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:40.276876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] MFA Rules not processed for user `267d6820d336477bbb0626e473ac0327`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:40.278407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:40.283630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:40.285174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:40.417376 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2543/5095] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:40.419329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:40.422046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:40.439544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0266bae-bda3-4376-bc43-4200d5a9ff4b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:40.446524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:40.447691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:40.455383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:40.456447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] PATH_INFO: `/v3/users/540ca8588cbf43f594325a37238366d2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:40.458748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540ca8588cbf43f594325a37238366d2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:40.460598 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2553/5096] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:40.461235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:40.461466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:40.463303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:40.597806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:40.633850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47e573-a693-4104-8281-9ac08dea0f60 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:40.642300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:40.643223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:40.643669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:40.644122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:40.664470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:40.668201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:40.691568 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2554/5097] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:40.695041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:40.697807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:40.701475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540ca8588cbf43f594325a37238366d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.702415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540ca8588cbf43f594325a37238366d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.809188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540ca8588cbf43f594325a37238366d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.810488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540ca8588cbf43f594325a37238366d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.822777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd9c620b-a96e-4fe0-a98b-a9babf3d5638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540ca8588cbf43f594325a37238366d2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:40.869460 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2544/5098] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:40 2022] DELETE /identity/v3/users/540ca8588cbf43f594325a37238366d2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:40.870630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd14771-827f-49fe-980b-5797041ebbcc service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:40.874896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:40.875391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:40.875970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:40.919633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:40.923715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:41.020316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:41.020950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:41.021238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:41.021523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:41.033249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:41.082423 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2545/5099] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:41.163205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:41.165452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:41.173827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:41.180284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:41.207612 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2555/5100] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:41.370896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf6db-a0d4-4d86-a119-efacccd59404 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:41.387608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:41.388516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:41.388914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:41.389296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:41.411448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:41.414137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:41.443416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2546/5101] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:41.970006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:42.025339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:42.025339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.044245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fbf91-a2be-4ac3-beb6-0cafcd04221b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:42.052111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:42.053686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:42.054284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:42.054954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] PATH_INFO: `/v3/users/267d6820d336477bbb0626e473ac0327` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:42.056605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267d6820d336477bbb0626e473ac0327)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:42.059208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:42.325305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267d6820d336477bbb0626e473ac0327'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.334969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267d6820d336477bbb0626e473ac0327'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.336343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267d6820d336477bbb0626e473ac0327'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.353299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267d6820d336477bbb0626e473ac0327'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.392957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:42.396073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.415105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bec6-ad44-48be-9078-ce49b0c0c5fe service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:42.423983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:42.423983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:42.423983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:42.425054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] PATH_INFO: `/v3/projects/f6b588705e4c4215b5b1cd9fbf5bf3b9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:42.444386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b028454-2b5e-4a32-8351-1ef40f76aad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267d6820d336477bbb0626e473ac0327'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.450024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b588705e4c4215b5b1cd9fbf5bf3b9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:42.452557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:42.460532 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2556/5102] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:42 2022] DELETE /identity/v3/users/267d6820d336477bbb0626e473ac0327 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:42.474436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:42.474738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:42.475026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:42.510089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:42.524519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.605118 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2557/5103] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:42.609812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:42.611391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.626407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b588705e4c4215b5b1cd9fbf5bf3b9', 'request_id': 'req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.631081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd9962-0fb2-4f5b-a950-b667ff55fc54 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:42.660645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b588705e4c4215b5b1cd9fbf5bf3b9', 'request_id': 'req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.720641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:42.721859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:42.722577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:42.724042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] PATH_INFO: `/v3/users/3223534dfbf543969ec96b0b24b7e459` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:42.726598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3223534dfbf543969ec96b0b24b7e459)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:42.728704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:42.738729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b588705e4c4215b5b1cd9fbf5bf3b9', 'request_id': 'req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.751295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] The token cache is being invalidate because project f6b588705e4c4215b5b1cd9fbf5bf3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:42.751816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.752459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.754254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2547/5104] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:42 2022] DELETE /identity/v3/projects/f6b588705e4c4215b5b1cd9fbf5bf3b9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:42.755278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:42.756603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.821943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d201fdd-57a0-4b75-9c9a-91ad45dc6ade admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:42.826253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7d808-2b43-4589-8c2e-aec95e03f907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:42.827322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7d808-2b43-4589-8c2e-aec95e03f907 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:42.827607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7d808-2b43-4589-8c2e-aec95e03f907 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:42.827920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7d808-2b43-4589-8c2e-aec95e03f907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:42.829939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-87a7d808-2b43-4589-8c2e-aec95e03f907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.845623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7d808-2b43-4589-8c2e-aec95e03f907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:42.847274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7d808-2b43-4589-8c2e-aec95e03f907 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:42.862259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2548/5105] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:42.863720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:42.864224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:42.864509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:42.892254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:42.899800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.924251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:42.969651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3223534dfbf543969ec96b0b24b7e459'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.979231 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2549/5106] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:42.980122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:42.985889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:42.992147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3223534dfbf543969ec96b0b24b7e459'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:42.994563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3223534dfbf543969ec96b0b24b7e459'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.017781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9208a4-a942-4f93-855e-169f747d60b5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:43.025708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3223534dfbf543969ec96b0b24b7e459'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.045643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:43.046485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.048813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.049458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] PATH_INFO: `/v3/users/7cbf78e2c2384408beeaced212b1e6fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.054020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbf78e2c2384408beeaced212b1e6fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:43.055967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:43.098703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3223534dfbf543969ec96b0b24b7e459'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.113984 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2558/5107] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:42 2022] DELETE /identity/v3/users/3223534dfbf543969ec96b0b24b7e459 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:43.115254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:43.124305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:43.270153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccd74b-904c-4a8b-8e8a-0027d451e810 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:43.277422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:43.278691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.279235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.279986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] PATH_INFO: `/v3/projects/239ed427a5df4a80abca6805d4f02aa6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.281731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] RBAC: Authorizing `identity:delete_project(project_id=239ed427a5df4a80abca6805d4f02aa6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:43.300581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:43.328430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbf78e2c2384408beeaced212b1e6fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.331381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbf78e2c2384408beeaced212b1e6fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.419517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbf78e2c2384408beeaced212b1e6fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.421611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbf78e2c2384408beeaced212b1e6fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.427282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:43.438668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1894948b-cbe1-46cb-a21b-5624eab4f26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbf78e2c2384408beeaced212b1e6fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.481024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239ed427a5df4a80abca6805d4f02aa6', 'request_id': 'req-5255ef30-7898-4cbd-85ca-8d30f2d1812d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.483371 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2550/5108] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:42 2022] DELETE /identity/v3/users/7cbf78e2c2384408beeaced212b1e6fc => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:43.484975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca8ec-539f-4101-b1cb-a49f798e6d6b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.485480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca8ec-539f-4101-b1cb-a49f798e6d6b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.485971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca8ec-539f-4101-b1cb-a49f798e6d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.503985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239ed427a5df4a80abca6805d4f02aa6', 'request_id': 'req-5255ef30-7898-4cbd-85ca-8d30f2d1812d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.532972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-90bca8ec-539f-4101-b1cb-a49f798e6d6b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:43.534435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-90bca8ec-539f-4101-b1cb-a49f798e6d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:43.585650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239ed427a5df4a80abca6805d4f02aa6', 'request_id': 'req-5255ef30-7898-4cbd-85ca-8d30f2d1812d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.599756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] The token cache is being invalidate because project 239ed427a5df4a80abca6805d4f02aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:43.600402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.602195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5255ef30-7898-4cbd-85ca-8d30f2d1812d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:43.604009 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2559/5109] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:43 2022] DELETE /identity/v3/projects/239ed427a5df4a80abca6805d4f02aa6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:43.608905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.611030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.611459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.629321 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2551/5110] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:43.645632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:43.647010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:43.655259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2560/5111] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:43.664214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3e8b-86d6-476f-84e6-695c9ac47259 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.664506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3e8b-86d6-476f-84e6-695c9ac47259 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.664786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3e8b-86d6-476f-84e6-695c9ac47259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.677523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:43.679301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:43.689156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-225b3e8b-86d6-476f-84e6-695c9ac47259 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:43.690475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-225b3e8b-86d6-476f-84e6-695c9ac47259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:43.705929 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2552/5112] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:43.712592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3e8b-86d6-476f-84e6-695c9ac47259 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:43.726800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3e8b-86d6-476f-84e6-695c9ac47259 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:43.739307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:43.743747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.744887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.745243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.750238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:43.750875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:43.754078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:43.760497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e20223-6343-4cf3-9066-ec230fbc6434 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:43.771698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:43.773639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.779411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.779411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.785103 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2553/5113] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:43.786698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:43.799756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:43.799984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a16e-f5a1-4e12-af42-3afbe5af9c7d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:43.800764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:43.806307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:43.807002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:43.807350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:43.807687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:43.808396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:43.810838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:43.812765 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2561/5114] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:43.912652 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2554/5115] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:43 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:43.915606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:43.930177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e4623-e596-4623-9bbd-10f2f86b4da8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.007898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.009325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.009612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.009885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.010573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.012867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.102775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.105433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:44.119818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d01bf7-ebad-4b0c-961e-126bf99b6896 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.125185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.126049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.126358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.126635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] PATH_INFO: `/v3/projects/fd68dfcc79d646e68a00aaad0cf71e6e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.127905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd68dfcc79d646e68a00aaad0cf71e6e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.130859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.140583 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2562/5116] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:43 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:44.144389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.155698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8b85e-6558-454e-baa3-d4101c478476 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.161477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.162286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.162568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.163407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.163523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.165321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.178552 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2563/5117] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:44.181847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.192868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379425be-4836-4bd5-9d1f-0808e876e6c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.197856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.198583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.198929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.199275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.200195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.201982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.214217 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2564/5118] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:44.218571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.229781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a012-4a74-46e1-b555-07701496f83a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.234912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c6ba-bde6-468a-bab8-7a63d6bb02bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.235583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c6ba-bde6-468a-bab8-7a63d6bb02bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.235869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c6ba-bde6-468a-bab8-7a63d6bb02bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.236138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c6ba-bde6-468a-bab8-7a63d6bb02bd admin admin] PATH_INFO: `/v3/projects/7405f32e3e0f481aa20491014aa797bf/users/38e2869c36044198b396704271b42dc0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.253485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c6ba-bde6-468a-bab8-7a63d6bb02bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7405f32e3e0f481aa20491014aa797bf, user_id=38e2869c36044198b396704271b42dc0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.256967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c6ba-bde6-468a-bab8-7a63d6bb02bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.274358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd68dfcc79d646e68a00aaad0cf71e6e', 'request_id': 'req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:44.284023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd68dfcc79d646e68a00aaad0cf71e6e', 'request_id': 'req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:44.350114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2565/5119] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:44 2022] PUT /identity/v3/projects/7405f32e3e0f481aa20491014aa797bf/users/38e2869c36044198b396704271b42dc0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:44.360024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.360539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.360816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.396907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd68dfcc79d646e68a00aaad0cf71e6e', 'request_id': 'req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:44.413564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] MFA Rules not processed for user `38e2869c36044198b396704271b42dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:44.414171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] The token cache is being invalidate because project fd68dfcc79d646e68a00aaad0cf71e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:44.414660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:44.415549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:44.415812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a5c93d7-a93f-476f-aed9-ca6fd4eda01e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:44.423195 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2555/5120] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:44 2022] DELETE /identity/v3/projects/fd68dfcc79d646e68a00aaad0cf71e6e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:44.432333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c76a91-a206-4338-bafa-45e52ed94926 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.432333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c76a91-a206-4338-bafa-45e52ed94926 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.432333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c76a91-a206-4338-bafa-45e52ed94926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.467245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f8c76a91-a206-4338-bafa-45e52ed94926 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:44.482373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8c76a91-a206-4338-bafa-45e52ed94926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:44.541582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2566/5121] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:44.558080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.560010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:44.630112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2556/5122] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:44.637603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3999-b5dc-4179-8761-0d80154dda85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.637997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3999-b5dc-4179-8761-0d80154dda85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.638338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3999-b5dc-4179-8761-0d80154dda85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.695886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a32c3999-b5dc-4179-8761-0d80154dda85 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:44.697490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7610329-eb0a-4bc9-9064-8f10847353d9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.698272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a32c3999-b5dc-4179-8761-0d80154dda85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:44.706488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.707311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.722798 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2557/5123] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:44.724161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.724161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.729789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c3999-b5dc-4179-8761-0d80154dda85 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.743784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.745665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.752779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c3999-b5dc-4179-8761-0d80154dda85 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.763999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.764775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.765155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.765538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.766340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:44.766753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.768089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2567/5124] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:44.777278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.780799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:44.783277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.807362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214cea5-7db9-4b1d-aa1b-918c7fe137fd service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.822671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.823323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.823791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.824061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] PATH_INFO: `/v3/projects/cbf63ece10bc4518925239a8cfb15011` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.825280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf63ece10bc4518925239a8cfb15011)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.831158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.832110 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2558/5125] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:44.836542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:44.846909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:44.871661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f41d0-16f6-4913-89c2-e69eb19d5189 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:44.877713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:44.878572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:44.878837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:44.879112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] PATH_INFO: `/v3/projects/68bf536e408a4ecb9c3b596f048b3ea2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:44.880307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68bf536e408a4ecb9c3b596f048b3ea2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:44.882803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:44.965232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf63ece10bc4518925239a8cfb15011', 'request_id': 'req-dee8824b-c39a-4551-953e-2dcc6b69c214'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:44.975070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf63ece10bc4518925239a8cfb15011', 'request_id': 'req-dee8824b-c39a-4551-953e-2dcc6b69c214'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.032239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:45.033041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf63ece10bc4518925239a8cfb15011', 'request_id': 'req-dee8824b-c39a-4551-953e-2dcc6b69c214'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.049323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68bf536e408a4ecb9c3b596f048b3ea2', 'request_id': 'req-07f5677b-c13b-42b7-93c4-84fa65063549'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.053459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] The token cache is being invalidate because project cbf63ece10bc4518925239a8cfb15011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:45.053754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.056097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.059015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2568/5126] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:44 2022] DELETE /identity/v3/projects/cbf63ece10bc4518925239a8cfb15011 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:45.059551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:45.063340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:45.065062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68bf536e408a4ecb9c3b596f048b3ea2', 'request_id': 'req-07f5677b-c13b-42b7-93c4-84fa65063549'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.165080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8824b-c39a-4551-953e-2dcc6b69c214 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:45.169284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68bf536e408a4ecb9c3b596f048b3ea2', 'request_id': 'req-07f5677b-c13b-42b7-93c4-84fa65063549'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.200986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] The token cache is being invalidate because project 68bf536e408a4ecb9c3b596f048b3ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:45.203339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.204635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07f5677b-c13b-42b7-93c4-84fa65063549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:45.213717 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2559/5127] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:44 2022] DELETE /identity/v3/projects/68bf536e408a4ecb9c3b596f048b3ea2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:45.213717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:45.213717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:45.213717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:45.304088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:45.310899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:45.406534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b2b40-d884-425e-81c2-c9eee4bb7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:45.407556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2b40-d884-425e-81c2-c9eee4bb7694 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:45.414571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:45.421145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2b40-d884-425e-81c2-c9eee4bb7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:45.422615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2b40-d884-425e-81c2-c9eee4bb7694 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:45.423425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b2b40-d884-425e-81c2-c9eee4bb7694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:45.428468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b2b40-d884-425e-81c2-c9eee4bb7694 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:45.528011 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2560/5128] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:45.529975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:45.537249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:45.560141 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2569/5129] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:45 2022] POST /identity/v3/projects => generated 383 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:45.561815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:45.563549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:45.564726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:45.600696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240478-2b44-4062-9db6-bb9e6b715626 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:45.665918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:45.675051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:45.814912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:45.815934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:45.816587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:45.817801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] PATH_INFO: `/v3/users/74d654e346a8430180f279cff2ab2be9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:45.821468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d654e346a8430180f279cff2ab2be9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:45.827583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:45.887838 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2570/5130] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:45.887838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:45.895606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:45.908565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287f1ba-7793-419e-9200-e036b39bb76e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:45.918265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:45.918910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:45.919189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:45.919460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:45.921748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:45.924126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.008474 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2571/5131] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:45 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:46.008474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.032823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d654e346a8430180f279cff2ab2be9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:46.033530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd90e03-1fbe-446f-a7fe-05d6b205d2ed admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.035291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d654e346a8430180f279cff2ab2be9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:46.058125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.058125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.058125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.058125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.058555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:46.058555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.061803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.082141 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2572/5132] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:46.082141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.085620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:46.099859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c10d85-5e50-4c4f-bbe8-ba69647ea4bf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.104954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.108926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.108926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.108926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.108926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.108926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.119482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2573/5133] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:46.120470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.124864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:46.148746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda78fc0-b89a-4b17-aedc-808309f9e20e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.152950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d654e346a8430180f279cff2ab2be9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:46.153931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d654e346a8430180f279cff2ab2be9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:46.154156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.154766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.155216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.155495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.156132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.158249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.169061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d654e346a8430180f279cff2ab2be9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:46.196542 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2561/5134] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:45 2022] DELETE /identity/v3/users/74d654e346a8430180f279cff2ab2be9 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:46.196542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.257044 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2574/5135] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:46 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:46.261367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.278930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020804d7-b946-48f5-8c4a-13fa95ffe84c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.380278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b78f70-93d3-4567-a364-a2c7c769b9a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.394915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.395681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.396026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.396371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.397140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.399972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.421134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.422408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.422770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.423152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.424061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.426995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.440889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2562/5136] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:46.446553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.473403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e702cc5-7641-441d-9f2e-8af43fe7d4e6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.478698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66356ee-5325-4cb2-b5fb-032e580b296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.479376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66356ee-5325-4cb2-b5fb-032e580b296d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.479655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66356ee-5325-4cb2-b5fb-032e580b296d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.479928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66356ee-5325-4cb2-b5fb-032e580b296d admin admin] PATH_INFO: `/v3/projects/a50e59c86c074f8191733ff7702206fb/users/09a17e4ff54c40cab7f9de0bf958ca96/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.501074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66356ee-5325-4cb2-b5fb-032e580b296d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50e59c86c074f8191733ff7702206fb, user_id=09a17e4ff54c40cab7f9de0bf958ca96, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.503788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66356ee-5325-4cb2-b5fb-032e580b296d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.550367 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2575/5137] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:46 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:46.552208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.564493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba20e5-bbb1-4a58-8d19-6bb6c63fa7e5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.570377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.571109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.571492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.571867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.572760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.578632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.588473 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2576/5138] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:46.589474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.617495 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2563/5139] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:46 2022] PUT /identity/v3/projects/a50e59c86c074f8191733ff7702206fb/users/09a17e4ff54c40cab7f9de0bf958ca96/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:46.619911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aef10-db9a-45e4-a134-5fb0ea17e0ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.626245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aef10-db9a-45e4-a134-5fb0ea17e0ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.627288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aef10-db9a-45e4-a134-5fb0ea17e0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.638463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2907f8b-62e1-4950-a289-5be0617ab064 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.684642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-169aef10-db9a-45e4-a134-5fb0ea17e0ef None None] MFA Rules not processed for user `09a17e4ff54c40cab7f9de0bf958ca96`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:46.686036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-169aef10-db9a-45e4-a134-5fb0ea17e0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:46.755737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.757205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.757205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.758255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.759175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.761212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.776117 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2577/5140] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:46.784614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.810153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220d5c2-894f-435d-86bf-69eac8b6909b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.830187 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2564/5141] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:46.834292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aef10-db9a-45e4-a134-5fb0ea17e0ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:46.838337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.839134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.839477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.841693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] PATH_INFO: `/v3/projects/cdecaa6d60314a2e8365ab21545ba675/users/636efdb31d874043866bc0bd177acf25/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.850626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aef10-db9a-45e4-a134-5fb0ea17e0ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:46.860846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bbc65-b568-4246-a2ea-4cc39d782b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:46.861726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bbc65-b568-4246-a2ea-4cc39d782b44 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:46.862198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bbc65-b568-4246-a2ea-4cc39d782b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:46.864177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bbc65-b568-4246-a2ea-4cc39d782b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:46.864177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bbc65-b568-4246-a2ea-4cc39d782b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.866340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bbc65-b568-4246-a2ea-4cc39d782b44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:46.899329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdecaa6d60314a2e8365ab21545ba675, user_id=636efdb31d874043866bc0bd177acf25, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:46.902455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:47.018904 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2578/5142] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:46 2022] PUT /identity/v3/projects/cdecaa6d60314a2e8365ab21545ba675/users/636efdb31d874043866bc0bd177acf25/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:47.026012 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2565/5143] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:46 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:44:47.026246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:47.026339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc36c9-1d74-465e-8070-524db20edbd7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.026339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc36c9-1d74-465e-8070-524db20edbd7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.026630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc36c9-1d74-465e-8070-524db20edbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.027884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.055298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17cc36c9-1d74-465e-8070-524db20edbd7 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:47.057311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17cc36c9-1d74-465e-8070-524db20edbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.176328 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2566/5144] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:47.177155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc36c9-1d74-465e-8070-524db20edbd7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:47.189160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092cd9-d0a8-455e-94cb-fe3c17991fe1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:47.293394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:47.294556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.294556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.295918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] PATH_INFO: `/v3/projects/a23ec7e691234c6887fe379ccaaa3c2f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.298667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23ec7e691234c6887fe379ccaaa3c2f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:47.299818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc36c9-1d74-465e-8070-524db20edbd7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:47.300828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:47.313211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b21fb-7d79-4a09-8e28-097c37ca7a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:47.314043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b21fb-7d79-4a09-8e28-097c37ca7a62 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.314930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b21fb-7d79-4a09-8e28-097c37ca7a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.316989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b21fb-7d79-4a09-8e28-097c37ca7a62 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.321319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b21fb-7d79-4a09-8e28-097c37ca7a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:47.321319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b21fb-7d79-4a09-8e28-097c37ca7a62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:47.422834 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2567/5145] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:47 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:47.427952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1765-9a1b-4de7-8161-9c04ca3b7430 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.428329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1765-9a1b-4de7-8161-9c04ca3b7430 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.428649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1765-9a1b-4de7-8161-9c04ca3b7430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.445461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23ec7e691234c6887fe379ccaaa3c2f', 'request_id': 'req-861b6822-dc53-4611-88d1-74fea419ac76'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:47.451183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23ec7e691234c6887fe379ccaaa3c2f', 'request_id': 'req-861b6822-dc53-4611-88d1-74fea419ac76'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:47.477895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:47.506861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-394f1765-9a1b-4de7-8161-9c04ca3b7430 None None] MFA Rules not processed for user `636efdb31d874043866bc0bd177acf25`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:47.508634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-394f1765-9a1b-4de7-8161-9c04ca3b7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.598049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23ec7e691234c6887fe379ccaaa3c2f', 'request_id': 'req-861b6822-dc53-4611-88d1-74fea419ac76'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:47.605590 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2568/5146] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:47.607060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1765-9a1b-4de7-8161-9c04ca3b7430 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:47.617269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] The token cache is being invalidate because project a23ec7e691234c6887fe379ccaaa3c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:47.618272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:47.619693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:47.626261 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2579/5147] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:47 2022] DELETE /identity/v3/projects/a23ec7e691234c6887fe379ccaaa3c2f => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:47.627255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:47.630915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.683712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:47.723138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6822-dc53-4611-88d1-74fea419ac76 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:47.727960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb477196-af4a-4657-a92a-0745ab8c1327 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:47.728779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477196-af4a-4657-a92a-0745ab8c1327 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.729237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477196-af4a-4657-a92a-0745ab8c1327 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.729644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477196-af4a-4657-a92a-0745ab8c1327 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.731931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb477196-af4a-4657-a92a-0745ab8c1327 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.737985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1765-9a1b-4de7-8161-9c04ca3b7430 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:47.743620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37df8ad-accd-4fbf-a1b7-301d0423343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:47.744448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df8ad-accd-4fbf-a1b7-301d0423343f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.744728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df8ad-accd-4fbf-a1b7-301d0423343f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.745003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37df8ad-accd-4fbf-a1b7-301d0423343f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.746255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df8ad-accd-4fbf-a1b7-301d0423343f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:47.747535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37df8ad-accd-4fbf-a1b7-301d0423343f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:47.759052 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2569/5148] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:47.760498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.760711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.761198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.781157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:47.782408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.788931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477196-af4a-4657-a92a-0745ab8c1327 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:47.791412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477196-af4a-4657-a92a-0745ab8c1327 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:47.802324 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2570/5149] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:47.802324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:47.802324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.808876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f2b31-2522-4385-883b-638a20594324 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:47.813785 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2580/5150] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:47.813953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:47.814401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.814678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.814952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] PATH_INFO: `/v3/projects/87e345cbba5b4c69a6b865c4e0de880e/users/0ef43781f8d44406ba301906703fd186/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.815494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a163-5de6-44d3-afb0-817ce7154e2d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.815936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a163-5de6-44d3-afb0-817ce7154e2d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.816418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a163-5de6-44d3-afb0-817ce7154e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.832784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e345cbba5b4c69a6b865c4e0de880e, user_id=0ef43781f8d44406ba301906703fd186, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:47.835871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:47.873433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-10e5a163-5de6-44d3-afb0-817ce7154e2d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:47.876105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-10e5a163-5de6-44d3-afb0-817ce7154e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:47.898286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2581/5151] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:47.903187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5a163-5de6-44d3-afb0-817ce7154e2d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:47.926746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5a163-5de6-44d3-afb0-817ce7154e2d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:47.940211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:47.943596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:47.944196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:47.944753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:47.945538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:47.946042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:47.947984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:47.950408 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2571/5152] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:47 2022] PUT /identity/v3/projects/87e345cbba5b4c69a6b865c4e0de880e/users/0ef43781f8d44406ba301906703fd186/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:47.955121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:47.990630 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2582/5153] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:47.990630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:48.012511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7c008-0762-4783-9445-2e0bccaf5007 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:48.099242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b706e-925c-4f07-bc8f-8013e40e7461 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:48.106957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:48.107589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.107879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.108151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.108809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:48.110498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:48.112474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f9478-f18a-4960-b67d-05f4ac4c2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:48.113145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9478-f18a-4960-b67d-05f4ac4c2112 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.113422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9478-f18a-4960-b67d-05f4ac4c2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.114001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f9478-f18a-4960-b67d-05f4ac4c2112 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.114805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9478-f18a-4960-b67d-05f4ac4c2112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:48.116904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f9478-f18a-4960-b67d-05f4ac4c2112 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:48.122461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2572/5154] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:48.126488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:48.141800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac7287-93f3-4b9e-a322-346b3f52ed68 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:48.154114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a41ec5-fdbc-40d6-928e-d03d32c2fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:48.154114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41ec5-fdbc-40d6-928e-d03d32c2fa3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.154114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41ec5-fdbc-40d6-928e-d03d32c2fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.154114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41ec5-fdbc-40d6-928e-d03d32c2fa3c admin admin] PATH_INFO: `/v3/projects/87e345cbba5b4c69a6b865c4e0de880e/users/0ef43781f8d44406ba301906703fd186/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.154505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a41ec5-fdbc-40d6-928e-d03d32c2fa3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e345cbba5b4c69a6b865c4e0de880e, user_id=0ef43781f8d44406ba301906703fd186, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:48.156392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a41ec5-fdbc-40d6-928e-d03d32c2fa3c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:48.169577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2573/5155] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:48 2022] PUT /identity/v3/projects/87e345cbba5b4c69a6b865c4e0de880e/users/0ef43781f8d44406ba301906703fd186/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:48.186711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c378-3e23-4885-8120-01a82a07f5f4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.186999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c378-3e23-4885-8120-01a82a07f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.187278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39c378-3e23-4885-8120-01a82a07f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.250576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1f39c378-3e23-4885-8120-01a82a07f5f4 None None] MFA Rules not processed for user `0ef43781f8d44406ba301906703fd186`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:48.253094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1f39c378-3e23-4885-8120-01a82a07f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:48.283208 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2583/5156] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:47 2022] POST /identity/v3/projects => generated 383 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:48.286072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648558-a23e-438d-aadb-cb4013a6dc32 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.286551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648558-a23e-438d-aadb-cb4013a6dc32 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.286993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d648558-a23e-438d-aadb-cb4013a6dc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.341583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d648558-a23e-438d-aadb-cb4013a6dc32 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:48.341583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d648558-a23e-438d-aadb-cb4013a6dc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:48.382420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2574/5157] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:48.383288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c378-3e23-4885-8120-01a82a07f5f4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:48.438448 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2584/5158] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:48.439389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d648558-a23e-438d-aadb-cb4013a6dc32 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:48.522309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39c378-3e23-4885-8120-01a82a07f5f4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:48.592416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d648558-a23e-438d-aadb-cb4013a6dc32 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:48.608236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef43781f8d44406ba301906703fd186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87e345cbba5b4c69a6b865c4e0de880e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:48.609231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.609611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.610003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.615007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:48.617080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:48.657948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:48.659083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.659611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.660111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.661022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:48.663846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:48.781732 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2575/5159] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:48 2022] POST /identity/v3/users => generated 292 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:48.783200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:48.789081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2585/5160] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:48 2022] POST /identity/v3/projects => generated 355 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:48.795632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:48.804381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:48.806590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ca34f-0725-412c-88cc-76d5e52c8ea3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:48.952063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:48.952063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:48.952063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:48.952063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:48.952371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:48.953735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:48.983245 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2576/5161] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:48.985265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:49.016370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e88a-0488-4079-a59a-074623d376a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:49.016461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeba55a-e1bb-421b-83b3-a500909b4ac9 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:49.020502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:49.026717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.026717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.026717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.026717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:49.026717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:49.031763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09a17e4ff54c40cab7f9de0bf958ca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50e59c86c074f8191733ff7702206fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:49.031763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.031763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.032041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] PATH_INFO: `/v3/projects/0ebcd48ce58b4add849e9ae5da5fcc3c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.035940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] RBAC: Authorizing `identity:delete_project(project_id=0ebcd48ce58b4add849e9ae5da5fcc3c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 18 13:44:49.049351 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 18 13:44:49.050466 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:44:49.053978 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2586/5162] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:48 2022] DELETE /identity/v3/projects/0ebcd48ce58b4add849e9ae5da5fcc3c => generated 136 bytes in 259 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:44:49.056008 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2577/5163] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:49.057810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:49.064853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:49.081599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:49.096364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c932e-7bcc-4b3b-9499-20b56907f4a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:49.115671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2dac3-3e35-4bbe-939f-34b3069563b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:49.119055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2dac3-3e35-4bbe-939f-34b3069563b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.119055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2dac3-3e35-4bbe-939f-34b3069563b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.119055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2dac3-3e35-4bbe-939f-34b3069563b4 admin admin] PATH_INFO: `/v3/projects/79ccf94503d44567b843435b805eec40/users/c7f63f5af2114d4bbdc50e8a889c069c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.144905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:49.163147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2dac3-3e35-4bbe-939f-34b3069563b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ccf94503d44567b843435b805eec40, user_id=c7f63f5af2114d4bbdc50e8a889c069c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:49.168778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2dac3-3e35-4bbe-939f-34b3069563b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:49.206333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb257b-9443-49d4-b902-7e9100a16f08 tempest-ProjectsNegativeTestJSON-119084284 tempest-ProjectsNegativeTestJSON-119084284-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:49.212781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ef43781f8d44406ba301906703fd186', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87e345cbba5b4c69a6b865c4e0de880e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:49.213581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.214204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.214485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] PATH_INFO: `/v3/projects/0ebcd48ce58b4add849e9ae5da5fcc3c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.215672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ebcd48ce58b4add849e9ae5da5fcc3c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:49.217755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:49.275344 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2578/5164] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:49 2022] PUT /identity/v3/projects/79ccf94503d44567b843435b805eec40/users/c7f63f5af2114d4bbdc50e8a889c069c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:49.287723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fe16-39ba-4b00-a343-3e5628e7189e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.289688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fe16-39ba-4b00-a343-3e5628e7189e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.289688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fe16-39ba-4b00-a343-3e5628e7189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.345093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6bd3fe16-39ba-4b00-a343-3e5628e7189e None None] MFA Rules not processed for user `c7f63f5af2114d4bbdc50e8a889c069c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:49.346715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bd3fe16-39ba-4b00-a343-3e5628e7189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:49.419086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebcd48ce58b4add849e9ae5da5fcc3c', 'request_id': 'req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:49.441812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebcd48ce58b4add849e9ae5da5fcc3c', 'request_id': 'req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:49.520733 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2579/5165] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:49.522183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.522471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.522751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.557159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebcd48ce58b4add849e9ae5da5fcc3c', 'request_id': 'req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:49.557262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:49.557262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:49.576029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] The token cache is being invalidate because project 0ebcd48ce58b4add849e9ae5da5fcc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:49.576337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:49.577146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:49.579866 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2587/5166] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:49 2022] DELETE /identity/v3/projects/0ebcd48ce58b4add849e9ae5da5fcc3c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:49.579866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:49.586469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:49.718790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f3f72-71ff-4c18-9731-24aa38ecb9a6 tempest-ProjectsNegativeTestJSON-151287304 tempest-ProjectsNegativeTestJSON-151287304-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:49.724645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:49.729116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.729116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.729116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.729116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:49.729116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:49.743219 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2580/5167] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:49.764665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:49.775005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:49.816700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e876ad3-78db-44ee-bfd2-f8da7955f631 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:49.833264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:49.833926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:49.834262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:49.834563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] PATH_INFO: `/v3/users/09a17e4ff54c40cab7f9de0bf958ca96` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:49.839871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a17e4ff54c40cab7f9de0bf958ca96)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:49.841880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:49.912361 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2588/5168] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:49 2022] POST /identity/v3/projects => generated 383 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:49.920368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:50.117606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a17e4ff54c40cab7f9de0bf958ca96'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:50.117923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a17e4ff54c40cab7f9de0bf958ca96'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:50.144060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632a701-dfb1-4fc9-8f63-1e5853f1562d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:50.162662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:50.163300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:50.163589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:50.163900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:50.164626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:50.167967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:50.219979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a17e4ff54c40cab7f9de0bf958ca96'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:50.220908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a17e4ff54c40cab7f9de0bf958ca96'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:50.233199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9bc8485d-36d2-42f2-90a3-790d9b926b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a17e4ff54c40cab7f9de0bf958ca96'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:50.278434 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2589/5169] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:49 2022] POST /identity/v3/users => generated 298 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:50.282303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:50.284532 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2581/5170] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:49 2022] DELETE /identity/v3/users/09a17e4ff54c40cab7f9de0bf958ca96 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:50.287261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:50.291930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:50.292383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:50.301230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:50.321944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:50.342356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80abbdb-a8fd-40b0-9267-2eaa4a55705c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:50.369138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:50.375262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:50.511459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:50.512514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:50.513061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:50.513352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:50.515020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:50.516762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:50.525866 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2582/5171] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:50.547970 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2590/5172] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:50.550937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:50.554577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:50.554994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:50.570289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702ddf3-4d3c-48f0-a196-9cdda09c60d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:50.576326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:50.584923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:50.584923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:50.584923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] PATH_INFO: `/v3/projects/fdddf4ce7c3e4635a45ae5ebee85e1f1/users/8bfeac9e336a48d7a63a9404ee97c6eb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:50.606013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdddf4ce7c3e4635a45ae5ebee85e1f1, user_id=8bfeac9e336a48d7a63a9404ee97c6eb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:50.610306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:50.719119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063496-82eb-4d58-a29a-defbd2b3a9dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:50.726510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b83a9f-2f04-4b78-b450-1077a03693e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:50.727149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83a9f-2f04-4b78-b450-1077a03693e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:50.727430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83a9f-2f04-4b78-b450-1077a03693e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:50.727706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83a9f-2f04-4b78-b450-1077a03693e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:50.733686 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2591/5173] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:50 2022] PUT /identity/v3/projects/fdddf4ce7c3e4635a45ae5ebee85e1f1/users/8bfeac9e336a48d7a63a9404ee97c6eb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:50.739373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:50.752548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:50.755045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b83a9f-2f04-4b78-b450-1077a03693e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:50.757469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b83a9f-2f04-4b78-b450-1077a03693e3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:50.814748 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2583/5174] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:50.818345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609504-df2e-4f72-8ff4-8cc153dc32e7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:50.819312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609504-df2e-4f72-8ff4-8cc153dc32e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:50.819663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609504-df2e-4f72-8ff4-8cc153dc32e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:50.848540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-55609504-df2e-4f72-8ff4-8cc153dc32e7 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:50.850321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55609504-df2e-4f72-8ff4-8cc153dc32e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:50.893148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19425d1-37d4-4ec6-94bb-f8729e2033b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:50.919897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67183b21-8f9c-4e84-a7e0-7e9e51f5dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:50.920821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67183b21-8f9c-4e84-a7e0-7e9e51f5dd5b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:50.922625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67183b21-8f9c-4e84-a7e0-7e9e51f5dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:50.923071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67183b21-8f9c-4e84-a7e0-7e9e51f5dd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:50.927077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67183b21-8f9c-4e84-a7e0-7e9e51f5dd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:50.929111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67183b21-8f9c-4e84-a7e0-7e9e51f5dd5b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:50.932200 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2584/5175] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:50.969440 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2592/5176] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:50.969971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55609504-df2e-4f72-8ff4-8cc153dc32e7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:50.989344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55609504-df2e-4f72-8ff4-8cc153dc32e7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:51.007045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:51.007045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:51.007045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:51.007045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] PATH_INFO: `/v3/projects/fdddf4ce7c3e4635a45ae5ebee85e1f1/users/8bfeac9e336a48d7a63a9404ee97c6eb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:51.013504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdddf4ce7c3e4635a45ae5ebee85e1f1, user_id=8bfeac9e336a48d7a63a9404ee97c6eb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:51.018493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:51.054577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2585/5177] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:50 2022] PUT /identity/v3/projects/fdddf4ce7c3e4635a45ae5ebee85e1f1/users/8bfeac9e336a48d7a63a9404ee97c6eb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:44:51.059830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:51.060119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:51.060471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:51.168540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] MFA Rules not processed for user `8bfeac9e336a48d7a63a9404ee97c6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:51.169765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:51.389657 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2593/5178] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:51.408912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:51.567509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:51.582138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:51.642989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:51.684119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31e4c-8d4f-4721-b7a7-d3b381063369 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:51.689119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fb24d-edbb-410a-ad2d-0e84815163b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:51.690413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb24d-edbb-410a-ad2d-0e84815163b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:51.690746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb24d-edbb-410a-ad2d-0e84815163b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:51.691057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb24d-edbb-410a-ad2d-0e84815163b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:51.703919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fb24d-edbb-410a-ad2d-0e84815163b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:51.705393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fb24d-edbb-410a-ad2d-0e84815163b6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:51.720074 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2586/5179] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:51.804957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:52.036011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:52.037547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:52.133630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92032f89-c01e-4e0b-a23b-0865fb47769c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:52.140488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:52.141270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:52.141770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:52.142156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] PATH_INFO: `/v3/projects/a50e59c86c074f8191733ff7702206fb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:52.143901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50e59c86c074f8191733ff7702206fb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:52.146545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:52.273723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bafa8f-7522-4d60-b7cd-bf29da51f2e3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:52.274701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bafa8f-7522-4d60-b7cd-bf29da51f2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:52.275196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bafa8f-7522-4d60-b7cd-bf29da51f2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:52.306815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-87bafa8f-7522-4d60-b7cd-bf29da51f2e3 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:52.308409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-87bafa8f-7522-4d60-b7cd-bf29da51f2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:52.425375 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2587/5180] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:52.498361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50e59c86c074f8191733ff7702206fb', 'request_id': 'req-66b0268a-cae7-4452-842b-b98d61bd7b43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:52.523134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50e59c86c074f8191733ff7702206fb', 'request_id': 'req-66b0268a-cae7-4452-842b-b98d61bd7b43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:52.558199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:52.590979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50e59c86c074f8191733ff7702206fb', 'request_id': 'req-66b0268a-cae7-4452-842b-b98d61bd7b43'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:52.609515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] The token cache is being invalidate because project a50e59c86c074f8191733ff7702206fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:52.609895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:52.614388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:52.616645 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2594/5181] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:52 2022] DELETE /identity/v3/projects/a50e59c86c074f8191733ff7702206fb => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:52.620888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bafa8f-7522-4d60-b7cd-bf29da51f2e3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:52.643289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bafa8f-7522-4d60-b7cd-bf29da51f2e3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:52.741991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:52.745820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:52.840541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:52.857367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:52.861967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:52.862604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:52.863164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] PATH_INFO: `/v3/users/0ef43781f8d44406ba301906703fd186` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:52.868254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef43781f8d44406ba301906703fd186)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:52.875488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:52.960990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0268a-cae7-4452-842b-b98d61bd7b43 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:52.968505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e7e51-cdec-4716-a307-a0cda877fb9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:52.972371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7e51-cdec-4716-a307-a0cda877fb9c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:52.972371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7e51-cdec-4716-a307-a0cda877fb9c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:52.972371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7e51-cdec-4716-a307-a0cda877fb9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:52.972371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c60e7e51-cdec-4716-a307-a0cda877fb9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:52.992085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7e51-cdec-4716-a307-a0cda877fb9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:52.995555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7e51-cdec-4716-a307-a0cda877fb9c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:53.010152 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2595/5182] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:53.180430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36d26-a0ff-492f-8a7a-26de7e03fbe3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:53.206790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36d26-a0ff-492f-8a7a-26de7e03fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:53.206790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36d26-a0ff-492f-8a7a-26de7e03fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:53.217898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5da36d26-a0ff-492f-8a7a-26de7e03fbe3 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:53.221823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5da36d26-a0ff-492f-8a7a-26de7e03fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:53.248340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef43781f8d44406ba301906703fd186'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:53.249574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef43781f8d44406ba301906703fd186'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:53.302114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2596/5183] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:53.356389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef43781f8d44406ba301906703fd186'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:53.357071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef43781f8d44406ba301906703fd186'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:53.385546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef43781f8d44406ba301906703fd186'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:53.444123 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2588/5184] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:52 2022] DELETE /identity/v3/users/0ef43781f8d44406ba301906703fd186 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:53.870227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:54.128125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:54.245436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:54.246049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:54.250197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:54.281375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:54.283664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:54.344413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:54.346251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:54.443151 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2597/5185] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:54.483935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812d252-c7aa-4730-be01-2106e09e74d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:54.500334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:54.500334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:54.500334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:54.500334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] PATH_INFO: `/v3/users/38e2869c36044198b396704271b42dc0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:54.501101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e2869c36044198b396704271b42dc0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:54.501101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:54.558988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:54.565566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:54.588312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0f173-8335-48fd-8ddd-913fb564c9e7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:54.601293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:54.601293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:54.601500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:54.601696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] PATH_INFO: `/v3/projects/87e345cbba5b4c69a6b865c4e0de880e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:54.604524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e345cbba5b4c69a6b865c4e0de880e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:54.606798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:54.763767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e2869c36044198b396704271b42dc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:54.773628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e2869c36044198b396704271b42dc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:54.802573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e345cbba5b4c69a6b865c4e0de880e', 'request_id': 'req-8049b21e-97b1-4215-ba53-8c2e4e88da67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:54.815446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e345cbba5b4c69a6b865c4e0de880e', 'request_id': 'req-8049b21e-97b1-4215-ba53-8c2e4e88da67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:54.877852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e2869c36044198b396704271b42dc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:54.878510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e2869c36044198b396704271b42dc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:54.891841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cc7125e8-fff5-49d9-899c-8954ab94047f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e2869c36044198b396704271b42dc0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:54.905864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:54.937586 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2589/5186] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:54 2022] DELETE /identity/v3/users/38e2869c36044198b396704271b42dc0 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:54.948030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:54.948498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:54.948949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:54.997648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:55.003187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:55.008353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e345cbba5b4c69a6b865c4e0de880e', 'request_id': 'req-8049b21e-97b1-4215-ba53-8c2e4e88da67'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:55.023731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] The token cache is being invalidate because project 87e345cbba5b4c69a6b865c4e0de880e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:55.024164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:55.030170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8049b21e-97b1-4215-ba53-8c2e4e88da67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:55.031895 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2598/5187] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:54 2022] DELETE /identity/v3/projects/87e345cbba5b4c69a6b865c4e0de880e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:55.037429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d5f1-5a76-4b82-bd2a-bbd811e929e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:55.037891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d5f1-5a76-4b82-bd2a-bbd811e929e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:55.038409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d5f1-5a76-4b82-bd2a-bbd811e929e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:55.100875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9cb3d5f1-5a76-4b82-bd2a-bbd811e929e3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:55.104814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9cb3d5f1-5a76-4b82-bd2a-bbd811e929e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:55.227213 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2590/5188] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:55.268617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:55.310399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:55.313024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:55.321891 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2599/5189] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:55.331510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b3d18-94f2-4eab-9f98-a69e0eaa5bbd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:55.338817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b3d18-94f2-4eab-9f98-a69e0eaa5bbd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:55.339099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b3d18-94f2-4eab-9f98-a69e0eaa5bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:55.384270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-173b3d18-94f2-4eab-9f98-a69e0eaa5bbd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:55.385764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-173b3d18-94f2-4eab-9f98-a69e0eaa5bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:55.408955 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2600/5190] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:55.415422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b3d18-94f2-4eab-9f98-a69e0eaa5bbd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:55.434438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b3d18-94f2-4eab-9f98-a69e0eaa5bbd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:55.447239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:55.448267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:55.448832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:55.449504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:55.450956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:55.451493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:55.454140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:55.492370 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2601/5191] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:55.498103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:55.509363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d9522-8c1a-4084-9d6e-10733efe361b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:55.517481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb377a8e-5bf2-430e-a513-e177784a9dd9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:55.518327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:55.519356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:55.519852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:55.520322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:55.563218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:55.564309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:55.566106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:55.567135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:55.569250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:55.571566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:55.574708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:55.576375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:55.618789 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2591/5192] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:44:55.703061 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2602/5193] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:55 2022] POST /identity/v3/projects => generated 369 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:55.707620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:55.734400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e41c8-045d-4c8a-8ff8-815bff6fb2dc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:55.827726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:55.832074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:55.832074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:55.832074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:55.832074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:55.832074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:55.941366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:55.946715 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2592/5194] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:55 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:55.955709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fc358-e682-4cd8-a13c-5f5fe41a2807 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:55.961845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:55.964329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:55.965433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:55.966238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:55.966860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:55.967994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:55.970585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:55.988156 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2603/5195] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:55.994146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:56.009388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49f39-3ee9-4510-b038-f003dcfe8e95 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:56.014961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722a4a8-c247-45c7-ac7f-e43f27f197a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:56.015978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a4a8-c247-45c7-ac7f-e43f27f197a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:56.016324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a4a8-c247-45c7-ac7f-e43f27f197a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:56.016841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722a4a8-c247-45c7-ac7f-e43f27f197a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:56.018434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a4a8-c247-45c7-ac7f-e43f27f197a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:56.020804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722a4a8-c247-45c7-ac7f-e43f27f197a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:56.042112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2593/5196] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:56.043854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:56.056219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493190-3a39-4ca8-94c8-54a82c514c98 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:56.062273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:56.062955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:56.063373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:56.063701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] PATH_INFO: `/v3/projects/754eefb2935949bba7dab8c27cc57874/users/0ca379cf6a3d4a0dbfb20cdc197bd9a0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:56.082732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:56.097200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754eefb2935949bba7dab8c27cc57874, user_id=0ca379cf6a3d4a0dbfb20cdc197bd9a0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:56.106843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:56.190796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2604/5197] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:56 2022] PUT /identity/v3/projects/754eefb2935949bba7dab8c27cc57874/users/0ca379cf6a3d4a0dbfb20cdc197bd9a0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:56.202215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd30b6-9cbe-43d7-9301-163eda2ccb94 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:56.202508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd30b6-9cbe-43d7-9301-163eda2ccb94 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:56.202775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd30b6-9cbe-43d7-9301-163eda2ccb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:56.246675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-72dd30b6-9cbe-43d7-9301-163eda2ccb94 None None] MFA Rules not processed for user `0ca379cf6a3d4a0dbfb20cdc197bd9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:56.248594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72dd30b6-9cbe-43d7-9301-163eda2ccb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:56.407214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:56.410381 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2594/5198] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:56.524143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:56.540577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cb80-84da-4af3-b431-62b9782b0a53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:56.549697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7fbfb-6ea0-40e1-ba3b-db26a4d210f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:56.550441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7fbfb-6ea0-40e1-ba3b-db26a4d210f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:56.552522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7fbfb-6ea0-40e1-ba3b-db26a4d210f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:56.552522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7fbfb-6ea0-40e1-ba3b-db26a4d210f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:56.552522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7fbfb-6ea0-40e1-ba3b-db26a4d210f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:56.554220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7fbfb-6ea0-40e1-ba3b-db26a4d210f2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:56.671647 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2605/5199] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:56 2022] POST /identity/v3/projects => generated 369 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:56.675467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd30b6-9cbe-43d7-9301-163eda2ccb94 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:56.697285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd30b6-9cbe-43d7-9301-163eda2ccb94 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:56.744191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:56.799519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:56.800149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:56.800429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:56.801491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:56.802321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:56.804795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:56.825256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833531e-bf33-4c6a-9aff-6a033acbe87b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:56.828822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833531e-bf33-4c6a-9aff-6a033acbe87b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:56.828822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833531e-bf33-4c6a-9aff-6a033acbe87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:56.861768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6833531e-bf33-4c6a-9aff-6a033acbe87b None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:56.863242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6833531e-bf33-4c6a-9aff-6a033acbe87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:56.946442 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2606/5200] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:56.967429 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2595/5201] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:56 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:56.968627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833531e-bf33-4c6a-9aff-6a033acbe87b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:56.972212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:56.982549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:56.993057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833531e-bf33-4c6a-9aff-6a033acbe87b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:57.006460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:57.007299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.008085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.010686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f1643-1bc4-49e1-ad29-353a19e37bd9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:57.012423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.013137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:57.016382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:57.017034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.017377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.017661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] PATH_INFO: `/v3/users/fa4dc35d0c6d461394ea67ed64e9ecb1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.018767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:57.019248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4dc35d0c6d461394ea67ed64e9ecb1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:57.021263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:57.037858 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2607/5202] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:57.039359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:57.055496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2416f-ba01-4860-9986-5de95719c3d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:57.062353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:57.062353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.062353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.062353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] PATH_INFO: `/v3/projects/d8f89b9cc7534bca9674f355374fd2cc/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.081161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f89b9cc7534bca9674f355374fd2cc, user_id=c283a82f90e34928b20e535bbb5b9ef9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:57.084638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:57.194455 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2608/5203] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:57 2022] PUT /identity/v3/projects/d8f89b9cc7534bca9674f355374fd2cc/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:57.198353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:57.294210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4dc35d0c6d461394ea67ed64e9ecb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:57.297063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4dc35d0c6d461394ea67ed64e9ecb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:57.352960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac030f-1cfb-4dae-a006-425a051a3cb8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:57.378036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:57.378737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.379653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.379932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.380592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:57.387677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:57.397162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4dc35d0c6d461394ea67ed64e9ecb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:57.397806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4dc35d0c6d461394ea67ed64e9ecb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:57.410323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec109c4d-91be-4a2e-9e92-895861386677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4dc35d0c6d461394ea67ed64e9ecb1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:57.415050 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2609/5204] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:57.420730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:57.431265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:57.444954 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2596/5205] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:44:56 2022] DELETE /identity/v3/users/fa4dc35d0c6d461394ea67ed64e9ecb1 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:57.451010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aa951-fe85-49d5-935e-7d2d3a61d1cc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.451610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aa951-fe85-49d5-935e-7d2d3a61d1cc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.452346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aa951-fe85-49d5-935e-7d2d3a61d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.461235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727caed-dcc9-48c0-b759-e3efb4141203 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:57.503070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-064aa951-fe85-49d5-935e-7d2d3a61d1cc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:57.505278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-064aa951-fe85-49d5-935e-7d2d3a61d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:57.599336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:57.600116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.600398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.600713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] PATH_INFO: `/v3/projects/d8f89b9cc7534bca9674f355374fd2cc/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.605165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f89b9cc7534bca9674f355374fd2cc, user_id=c283a82f90e34928b20e535bbb5b9ef9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:57.608846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:57.649916 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2610/5206] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:57 2022] PUT /identity/v3/projects/d8f89b9cc7534bca9674f355374fd2cc/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:57.649916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:57.649916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:57.670769 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2597/5207] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:57.674271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.674891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.675320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.687645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:57.719169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] MFA Rules not processed for user `c283a82f90e34928b20e535bbb5b9ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:57.721580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:57.793616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1eaa4-0735-4fc1-9fac-d9dcac2fa185 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:57.810934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:57.811392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.811676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.811954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] PATH_INFO: `/v3/projects/7405f32e3e0f481aa20491014aa797bf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.813612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7405f32e3e0f481aa20491014aa797bf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:57.814748 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2598/5208] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:57.817794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:57.820813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:57.822314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:57.952080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ff18d-0176-4aae-8e64-f544f89087f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:57.955743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:57.959767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:57.960501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:57.961329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:57.961923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:57.977380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:57.978762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:57.997384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7405f32e3e0f481aa20491014aa797bf', 'request_id': 'req-d1096ba4-c64c-4a7a-8f48-9a889bca422d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:57.999766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2599/5209] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:44:58.002862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.016067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7405f32e3e0f481aa20491014aa797bf', 'request_id': 'req-d1096ba4-c64c-4a7a-8f48-9a889bca422d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:58.024214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97421-6f34-4238-b05b-a272775fa814 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.109923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7405f32e3e0f481aa20491014aa797bf', 'request_id': 'req-d1096ba4-c64c-4a7a-8f48-9a889bca422d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:58.126643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] The token cache is being invalidate because project 7405f32e3e0f481aa20491014aa797bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:44:58.127186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:58.129718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d1096ba4-c64c-4a7a-8f48-9a889bca422d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:44:58.133754 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2611/5210] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:44:57 2022] DELETE /identity/v3/projects/7405f32e3e0f481aa20491014aa797bf => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:58.138983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f80d-befa-4230-9d12-9e28ab4e0504 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.140427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f80d-befa-4230-9d12-9e28ab4e0504 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.145738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f80d-befa-4230-9d12-9e28ab4e0504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.163805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.166048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.170155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.173062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.173812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.175963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:58.198023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0f14f80d-befa-4230-9d12-9e28ab4e0504 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:58.199409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0f14f80d-befa-4230-9d12-9e28ab4e0504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:58.218557 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2612/5211] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:44:58.222399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4e6f-766f-4433-aa5a-a0b2cc282158 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.222709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4e6f-766f-4433-aa5a-a0b2cc282158 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.223029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4e6f-766f-4433-aa5a-a0b2cc282158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.283118 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2600/5212] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:57 2022] POST /identity/v3/projects => generated 369 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:58.287733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.288856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a46d4e6f-766f-4433-aa5a-a0b2cc282158 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:58.290794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:58.290979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a46d4e6f-766f-4433-aa5a-a0b2cc282158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:58.464861 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2613/5213] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:58.466702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d4e6f-766f-4433-aa5a-a0b2cc282158 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.493250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d4e6f-766f-4433-aa5a-a0b2cc282158 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.493805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761e583-6b0b-4b4d-9d48-fb68e80405dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.501793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.502929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.504622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.505931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.506345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.506983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.507529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.507857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.508139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:44:58.508707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.508959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.511321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:58.514595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:58.541031 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2614/5214] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:44:58.543393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.562528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02352ea-8644-4160-aeda-925478aa71cd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.582483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.586108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.586108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.586108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.586108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.595329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:58.607664 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2601/5215] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:58 2022] POST /identity/v3/users => generated 285 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:58.611309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.632774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683991af-0cc3-4b6d-a16a-5238598c9918 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.644873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.645598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.645886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.646189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.646852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.648466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:58.671994 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2602/5216] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:44:58.679090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.695778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f36c4-5436-463b-b30a-d3f0b93c458d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.703859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.712329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.713021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.721910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2615/5217] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:58 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:58.722396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.723993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.727156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.727289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:58.743587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2603/5218] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:58.756611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:58.776038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c150ac4-647e-4259-b0ee-6139ce034974 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.915545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65671e9-d4c1-416e-aec5-00abb0fcb807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.916226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65671e9-d4c1-416e-aec5-00abb0fcb807 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.916508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65671e9-d4c1-416e-aec5-00abb0fcb807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.916785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65671e9-d4c1-416e-aec5-00abb0fcb807 admin admin] PATH_INFO: `/v3/projects/252ec0f53f234aacaf1b4b8a14b4ae22/users/18e936015258418a8956c47c48fe38c9/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.951337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65671e9-d4c1-416e-aec5-00abb0fcb807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252ec0f53f234aacaf1b4b8a14b4ae22, user_id=18e936015258418a8956c47c48fe38c9, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.954346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65671e9-d4c1-416e-aec5-00abb0fcb807 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:58.968131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949b3a8-2b12-4389-974a-d9bb55b5837e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:58.985344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:58.985344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:58.988800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:58.988800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:58.988800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:58.996864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:59.009782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:59.041917 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2604/5219] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:58 2022] PUT /identity/v3/projects/252ec0f53f234aacaf1b4b8a14b4ae22/users/18e936015258418a8956c47c48fe38c9/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:59.052716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:59.052992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:59.053268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:59.126480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] MFA Rules not processed for user `18e936015258418a8956c47c48fe38c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:59.129983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:59.148124 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2616/5220] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:44:58 2022] POST /identity/v3/users => generated 287 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:59.149319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:59.184447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d87f9-cb32-4107-8451-1497495b6af7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:59.290808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:59.338337 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2605/5221] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:59.340446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:59.347369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:59.360456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:59.364840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:59.367645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:59.367957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:59.368653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:59.370343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:59.416366 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2617/5222] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:59.419237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:59.440586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adac7e-7a78-458c-a574-a1a0babe49b6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:59.452935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:59.455063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:59.455063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:59.455063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:59.458663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:59.461816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:59.496109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79e41-5b9f-4d41-b904-b75d3a534497 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:59.509665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:59.510461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:59.510948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:59.512392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:59.513541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:59.517291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:59.520537 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2618/5223] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:44:59.521474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:59.534329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec95d4-0f71-4210-8106-a126181e6f86 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:44:59.542294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684487c-fc62-4660-8da3-c62aee45e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:44:59.542294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684487c-fc62-4660-8da3-c62aee45e075 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:59.542294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684487c-fc62-4660-8da3-c62aee45e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:59.542294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684487c-fc62-4660-8da3-c62aee45e075 admin admin] PATH_INFO: `/v3/projects/542982a27b444e0a9b994ad663b88b47/users/16538eade00c4b9299f30e38be4dca4b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:59.559259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684487c-fc62-4660-8da3-c62aee45e075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542982a27b444e0a9b994ad663b88b47, user_id=16538eade00c4b9299f30e38be4dca4b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:44:59.563430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684487c-fc62-4660-8da3-c62aee45e075 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:44:59.610002 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2606/5224] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:44:59 2022] POST /identity/v3/domains => generated 275 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:44:59.613926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:59.637761 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2619/5225] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:44:59 2022] PUT /identity/v3/projects/542982a27b444e0a9b994ad663b88b47/users/16538eade00c4b9299f30e38be4dca4b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:44:59.651826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb57457-d631-4769-8424-8e01a5279c9a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:44:59.652161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb57457-d631-4769-8424-8e01a5279c9a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:44:59.652372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb57457-d631-4769-8424-8e01a5279c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:44:59.700052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0cb57457-d631-4769-8424-8e01a5279c9a None None] MFA Rules not processed for user `16538eade00c4b9299f30e38be4dca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:44:59.701481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0cb57457-d631-4769-8424-8e01a5279c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:44:59.814508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:59.837108 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2620/5226] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:44:59.840048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb57457-d631-4769-8424-8e01a5279c9a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:44:59.858723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d095d9d-6f3e-4044-abc3-f75af499b6b2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:00.035142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:00.041365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:00.044163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:00.046033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:00.047786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:00.052537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb57457-d631-4769-8424-8e01a5279c9a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:00.052947 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:45:00.052947 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:45:00.052947 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:45:00.058273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:00.065508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:00.066207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:00.067080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:00.067565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:00.067986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:00.070727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:00.071111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:00.187881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2607/5227] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:44:59 2022] POST /identity/v3/roles => generated 240 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:00.189278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:00.193597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:00.220963 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2621/5228] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:44:59 2022] POST /identity/v3/projects => generated 377 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:00.221895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:00.244874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295fc69-5636-4ebe-98dc-f90b51cfbce6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:00.375197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abb599-e6c1-4300-944a-d364172734db admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:00.387987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:00.389050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:00.389406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:00.391957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9f2092e88efe4f1fa93210ab66146a2e/users/18e936015258418a8956c47c48fe38c9/roles/f2ad240fdd3e422e8232cad66195696a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:00.420932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9f2092e88efe4f1fa93210ab66146a2e, user_id=18e936015258418a8956c47c48fe38c9, role_id=f2ad240fdd3e422e8232cad66195696a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:00.425166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:00.427485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:00.428336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:00.428834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:00.429259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] PATH_INFO: `/v3/users/c7f63f5af2114d4bbdc50e8a889c069c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:00.431869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f63f5af2114d4bbdc50e8a889c069c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:00.436104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:00.524763 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2622/5229] 10.222.0.27 () {60 vars in 1480 bytes} [Tue Oct 18 13:45:00 2022] PUT /identity/v3/domains/9f2092e88efe4f1fa93210ab66146a2e/users/18e936015258418a8956c47c48fe38c9/roles/f2ad240fdd3e422e8232cad66195696a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:00.528078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:00.699422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f63f5af2114d4bbdc50e8a889c069c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:00.705115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f63f5af2114d4bbdc50e8a889c069c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:00.706420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c57eb-a841-411a-b271-193ea6ded80f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:00.727368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:00.736442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:00.741773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:00.742199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:00.742484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:00.743180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:00.745176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:00.814693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f63f5af2114d4bbdc50e8a889c069c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:00.815394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f63f5af2114d4bbdc50e8a889c069c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:00.826679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f63f5af2114d4bbdc50e8a889c069c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:00.853911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2623/5230] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:00 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:00.855135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:00.862485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:00.902261 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2608/5231] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:00 2022] DELETE /identity/v3/users/c7f63f5af2114d4bbdc50e8a889c069c => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:00.906364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:00.908546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:01.032343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9ff1a-1c14-46e9-bbbe-e11382e671ed admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:01.039128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:01.045446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:01.045446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:01.045446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] PATH_INFO: `/v3/projects/e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:01.045446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:01.046198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:01.082184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8ce6-ab9f-416f-9de2-c50e53a05a9e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:01.209022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:01.247140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1', 'request_id': 'req-ac2abda7-7a78-408e-bc4a-48cc55dab0df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:01.260613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:01.261263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:01.262327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:01.264978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:01.265692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:01.273743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:01.299308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1', 'request_id': 'req-ac2abda7-7a78-408e-bc4a-48cc55dab0df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:01.394342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1', 'request_id': 'req-ac2abda7-7a78-408e-bc4a-48cc55dab0df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:01.401316 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2624/5232] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:45:00 2022] POST /identity/v3/domains => generated 277 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:01.406003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:01.414112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:01.436279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] The token cache is being invalidate because project e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:01.436880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:01.439998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac2abda7-7a78-408e-bc4a-48cc55dab0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:01.449437 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2609/5233] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:00 2022] DELETE /identity/v3/projects/e95d1f0d3f8f45ecbdc2ef7fa6f0f6e1 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:01.451541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:01.452066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:01.452806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:01.503872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:01.505729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:01.627817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb36d-c938-4849-8619-6c59fc78011f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:01.640576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:01.641245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:01.641530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:01.641803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:01.642758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:01.647043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:01.659998 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2610/5234] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:01.659998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:01.662542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:01.672829 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2625/5235] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:01 2022] GET /identity/v3/roles => generated 1651 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:01.674915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:01.680573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:01.705325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6be1d5-4ce9-44eb-b7a6-eef97a1a83b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:01.721478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:01.722176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:01.722460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:01.722766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] PATH_INFO: `/v3/users/416e4d9659b04dbd8deb7543d4fa8e9c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:01.724162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416e4d9659b04dbd8deb7543d4fa8e9c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:01.726153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:01.796181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e570c-efb8-407d-98cc-a12fec280f1a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:01.802043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:01.802705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:01.803738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:01.804050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:01.804738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:01.806571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:01.831744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:01.959322 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2611/5236] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:45:01 2022] POST /identity/v3/roles => generated 239 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:01.961623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:01.965635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:02.009208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431c2c2-659d-45ff-a7d7-c74c238ac0a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:02.020342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416e4d9659b04dbd8deb7543d4fa8e9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:02.025125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:02.026285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:02.026852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:02.027135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:02.027810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:02.033186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:02.038674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416e4d9659b04dbd8deb7543d4fa8e9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:02.040420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416e4d9659b04dbd8deb7543d4fa8e9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:02.060949 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2612/5237] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:01 2022] GET /identity/v3/roles => generated 1881 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:02.062843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:02.067923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:02.072599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416e4d9659b04dbd8deb7543d4fa8e9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:02.139144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:02.155444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16143e-e0a5-4c46-b8ed-18fd44d1ce4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:02.159786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:02.160576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:02.160870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:02.161150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:02.164109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:02.168348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416e4d9659b04dbd8deb7543d4fa8e9c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:02.176906 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2626/5238] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:01 2022] DELETE /identity/v3/users/416e4d9659b04dbd8deb7543d4fa8e9c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:02.178941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:02.180401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:02.189032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:02.193877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:02.218832 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2613/5239] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:02.220198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:02.222030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:02.237493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700d0fa-eb72-4c72-90fe-edb8108ab1cc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:02.312108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:02.336962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98709c0f-27d7-4d63-bb50-669b560711c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:02.338437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709c0f-27d7-4d63-bb50-669b560711c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:02.344254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709c0f-27d7-4d63-bb50-669b560711c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:02.344254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709c0f-27d7-4d63-bb50-669b560711c3 admin admin] PATH_INFO: `/v3/projects/13e5f13f907d460f98600d1eada31367/users/49c3bcaa2c92428bbf179ad437b7eb74/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:02.348650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d65ea-3dc0-4974-8cb3-9851e0a32238 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:02.360415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:02.362182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:02.362182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:02.362441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:02.367933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:02.368061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:02.368151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:02.379756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98709c0f-27d7-4d63-bb50-669b560711c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e5f13f907d460f98600d1eada31367, user_id=49c3bcaa2c92428bbf179ad437b7eb74, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:02.386011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98709c0f-27d7-4d63-bb50-669b560711c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:02.487639 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2627/5240] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:02 2022] POST /identity/v3/groups => generated 325 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:02.490471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:02.505929 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2614/5241] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:02 2022] PUT /identity/v3/projects/13e5f13f907d460f98600d1eada31367/users/49c3bcaa2c92428bbf179ad437b7eb74/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:02.507572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a943f-e53f-4e9b-99ad-6de1269fd4c6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:02.507861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a943f-e53f-4e9b-99ad-6de1269fd4c6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:02.508148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a943f-e53f-4e9b-99ad-6de1269fd4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:02.516440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff689-88f5-4364-96f4-433086ef5a37 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:02.616956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9c3a943f-e53f-4e9b-99ad-6de1269fd4c6 None None] MFA Rules not processed for user `49c3bcaa2c92428bbf179ad437b7eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:02.618730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9c3a943f-e53f-4e9b-99ad-6de1269fd4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:02.737633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:02.738862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:02.739152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:02.739430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups/118b7e3d818e4107b6545b48f91d8325/users/18e936015258418a8956c47c48fe38c9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:02.752095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=118b7e3d818e4107b6545b48f91d8325, user_id=18e936015258418a8956c47c48fe38c9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:02.753143 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:45:02.753143 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:45:02.753143 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:45:02.754999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:02.786193 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2615/5242] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:02.786973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a943f-e53f-4e9b-99ad-6de1269fd4c6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:02.840097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:02.878396 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2628/5243] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 13:45:02 2022] PUT /identity/v3/groups/118b7e3d818e4107b6545b48f91d8325/users/18e936015258418a8956c47c48fe38c9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:02.883215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:02.957773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a943f-e53f-4e9b-99ad-6de1269fd4c6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:02.966091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:03.064017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c1aad-02b3-4132-b9a8-e66599eb19cd tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:03.077806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:03.080479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:03.080479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:03.080479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9b9236990a7c4c9c83357245352f876e/groups/118b7e3d818e4107b6545b48f91d8325/roles/286ecb2af5b2461686de8f0d62bb1fb8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:03.087020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9b9236990a7c4c9c83357245352f876e, group_id=118b7e3d818e4107b6545b48f91d8325, role_id=286ecb2af5b2461686de8f0d62bb1fb8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:03.090613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:03.091763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:03.092506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:03.092997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:03.093955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:03.094742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:03.104679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:03.234772 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2629/5244] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:02 2022] PUT /identity/v3/domains/9b9236990a7c4c9c83357245352f876e/groups/118b7e3d818e4107b6545b48f91d8325/roles/286ecb2af5b2461686de8f0d62bb1fb8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:03.239247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:03.259067 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2616/5245] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:02 2022] POST /identity/v3/projects => generated 375 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:03.259067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:03.272388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:03.537719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603bbad-9de7-40f7-88d3-4126f2112637 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:03.569887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fabc-1bb8-4217-8200-8e8979ceb444 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:03.577533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:03.578606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:03.578934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:03.579382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] PATH_INFO: `/v3/projects/3f86649d8847478ca27cc667ea51b4d2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:03.580680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f86649d8847478ca27cc667ea51b4d2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:03.583858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:03.700769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:03.701347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:03.701635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:03.701915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:03.702625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:03.707225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:03.727332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f86649d8847478ca27cc667ea51b4d2', 'request_id': 'req-af20a845-6dd1-4264-b1c0-31a1c1ba1533'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:03.739080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f86649d8847478ca27cc667ea51b4d2', 'request_id': 'req-af20a845-6dd1-4264-b1c0-31a1c1ba1533'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:03.860537 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2630/5246] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:45:03 2022] POST /identity/v3/domains => generated 276 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:03.860537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:03.876040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f86649d8847478ca27cc667ea51b4d2', 'request_id': 'req-af20a845-6dd1-4264-b1c0-31a1c1ba1533'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:03.895268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] The token cache is being invalidate because project 3f86649d8847478ca27cc667ea51b4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:03.895576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:03.897649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:03.900389 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2617/5247] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:03 2022] DELETE /identity/v3/projects/3f86649d8847478ca27cc667ea51b4d2 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:03.901524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:03.909004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:04.016624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0840e-f9c5-49de-b73b-dd6353511522 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:04.024245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:04.024245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:04.024245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:04.024245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:04.028287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:04.028373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20a845-6dd1-4264-b1c0-31a1c1ba1533 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:04.028877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:04.031862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:04.033085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:04.033085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:04.033293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] PATH_INFO: `/v3/projects/79ccf94503d44567b843435b805eec40` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:04.034610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ccf94503d44567b843435b805eec40)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:04.036739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:04.170724 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2631/5248] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:03 2022] POST /identity/v3/users => generated 294 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:04.172006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:04.179696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:04.193175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ccf94503d44567b843435b805eec40', 'request_id': 'req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:04.201325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ccf94503d44567b843435b805eec40', 'request_id': 'req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:04.275389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ccf94503d44567b843435b805eec40', 'request_id': 'req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:04.308664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] The token cache is being invalidate because project 79ccf94503d44567b843435b805eec40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:04.308962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:04.311069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c6f6e12f-4d6e-4c70-ae81-7074305d4e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:04.314999 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2618/5249] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:03 2022] DELETE /identity/v3/projects/79ccf94503d44567b843435b805eec40 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:04.317003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:04.317290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:04.317564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:04.336512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed8f13-3ecc-4054-96ad-032ef0400548 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:04.412345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:04.422980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:04.423735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:04.424902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:04.425097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:04.426346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:04.428225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:04.429161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:04.523566 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2632/5250] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:45:04 2022] POST /identity/v3/roles => generated 239 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:04.524810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:04.533225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:04.540806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:04.664495 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2619/5251] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:04.667648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:04.675166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:04.679053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:04.718917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352a93d-d444-4a1b-9f5b-600b822dcfd2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:04.734287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:04.736832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:04.737952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:04.738619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] PATH_INFO: `/v3/users/8bfeac9e336a48d7a63a9404ee97c6eb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:04.741231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfeac9e336a48d7a63a9404ee97c6eb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:04.747623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:04.766265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337c90b-09e4-47ef-a0f1-3dff9cb6de22 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:04.782633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:04.800242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:04.800689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:04.801556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:04.803318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:04.810515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:04.847032 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2633/5252] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:04 2022] GET /identity/v3/roles => generated 2111 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:04.848465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:04.851787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:04.882548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68aac4-09a6-4a0c-aa26-93320c6a0dcf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:04.888736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29da9-85ae-4292-acf3-8a3e6c039e50 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:04.889074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29da9-85ae-4292-acf3-8a3e6c039e50 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:04.890077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29da9-85ae-4292-acf3-8a3e6c039e50 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:04.890442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29da9-85ae-4292-acf3-8a3e6c039e50 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/a69ae24f0d574516b7508b764c800ebc/users/18e936015258418a8956c47c48fe38c9/roles/0289da397c1542b4a4d4838b1af9beb1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:04.905635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29da9-85ae-4292-acf3-8a3e6c039e50 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a69ae24f0d574516b7508b764c800ebc, user_id=18e936015258418a8956c47c48fe38c9, role_id=0289da397c1542b4a4d4838b1af9beb1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:04.908562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29da9-85ae-4292-acf3-8a3e6c039e50 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:05.065969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfeac9e336a48d7a63a9404ee97c6eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.067962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfeac9e336a48d7a63a9404ee97c6eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.167047 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2634/5253] 10.222.0.27 () {60 vars in 1480 bytes} [Tue Oct 18 13:45:04 2022] PUT /identity/v3/domains/a69ae24f0d574516b7508b764c800ebc/users/18e936015258418a8956c47c48fe38c9/roles/0289da397c1542b4a4d4838b1af9beb1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:05.169672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:05.169672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:05.169672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:05.188947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfeac9e336a48d7a63a9404ee97c6eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.190107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfeac9e336a48d7a63a9404ee97c6eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.198043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfeac9e336a48d7a63a9404ee97c6eb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.201707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:05.203305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:05.221384 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2620/5254] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:04 2022] DELETE /identity/v3/users/8bfeac9e336a48d7a63a9404ee97c6eb => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:05.224060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:05.226565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:05.319611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec96c3c-a686-4a1b-b880-1f5cb4062fc2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:05.326707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:05.327395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:05.327896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:05.328227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] PATH_INFO: `/v3/users/725680d81f6f43679703425651a3e207` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:05.328663 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2635/5255] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:05.330481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725680d81f6f43679703425651a3e207)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:05.330608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:05.331693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:05.332372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:05.366040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521e5d-ebe7-4e54-ac21-8544b6e954cd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:05.372345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206e21f-4ed7-4b27-8e3f-a0529e581dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:05.373472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e21f-4ed7-4b27-8e3f-a0529e581dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:05.373824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e21f-4ed7-4b27-8e3f-a0529e581dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:05.374478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206e21f-4ed7-4b27-8e3f-a0529e581dfb admin admin] PATH_INFO: `/v3/projects/2198f7e9b0ca48bd9caa40b584186b00/users/87d8c9ea553246e6b65399e452133156/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:05.405747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206e21f-4ed7-4b27-8e3f-a0529e581dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2198f7e9b0ca48bd9caa40b584186b00, user_id=87d8c9ea553246e6b65399e452133156, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:05.409567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206e21f-4ed7-4b27-8e3f-a0529e581dfb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:05.499054 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2636/5256] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:05 2022] PUT /identity/v3/projects/2198f7e9b0ca48bd9caa40b584186b00/users/87d8c9ea553246e6b65399e452133156/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:05.501562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:05.503480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:05.503480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:05.527866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:05.529102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:05.599270 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2637/5257] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:05.600143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:05.604834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:05.615887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725680d81f6f43679703425651a3e207'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.616941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725680d81f6f43679703425651a3e207'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.693687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725680d81f6f43679703425651a3e207'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.694359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725680d81f6f43679703425651a3e207'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.703748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725680d81f6f43679703425651a3e207'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:05.706835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e81829-fcef-44b6-86d0-0f6bb6e84b61 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:05.714344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:05.714958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:05.715243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:05.715549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:05.716247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:05.717888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:05.726417 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2621/5258] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:05 2022] DELETE /identity/v3/users/725680d81f6f43679703425651a3e207 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:05.729682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:05.729682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:05.829881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2638/5259] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:45:05 2022] POST /identity/v3/domains => generated 276 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:05.830930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:05.835989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:05.853428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e67e0-d898-4c28-9e7b-1c6f1c760737 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:05.936186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e0a92-c59d-4b49-aec2-882378cb7302 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:05.944078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:05.945951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:05.946270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:05.946555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] PATH_INFO: `/v3/users/fb29c723cbc249a781905fdbde1b3ad9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:05.950517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:05.951277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:05.951396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb29c723cbc249a781905fdbde1b3ad9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:05.951876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:05.952242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:05.953073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:05.953335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:05.953558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:05.955281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:05.974446 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2622/5260] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:05.976315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:05.978435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:06.010658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dbd96-cace-4e21-8067-70c5885f1f8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:06.018988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:06.019665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:06.019986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:06.020264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:06.021250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:06.023168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:06.043750 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2623/5261] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:05 2022] GET /identity/v3/roles => generated 2111 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:06.043750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:06.045640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:06.062585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9409-a0b0-4a29-af7a-4c3bc0242375 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:06.069032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:06.069786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:06.069968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:06.070315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] PATH_INFO: `/v3/projects/fdddf4ce7c3e4635a45ae5ebee85e1f1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:06.072041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdddf4ce7c3e4635a45ae5ebee85e1f1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:06.074478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:06.556224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:06.576752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdddf4ce7c3e4635a45ae5ebee85e1f1', 'request_id': 'req-fb2765be-656b-42b5-8f0d-6f05e77d5e77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.586112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdddf4ce7c3e4635a45ae5ebee85e1f1', 'request_id': 'req-fb2765be-656b-42b5-8f0d-6f05e77d5e77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.587447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb29c723cbc249a781905fdbde1b3ad9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.597103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb29c723cbc249a781905fdbde1b3ad9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.598479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb29c723cbc249a781905fdbde1b3ad9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.613958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb29c723cbc249a781905fdbde1b3ad9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.677027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdddf4ce7c3e4635a45ae5ebee85e1f1', 'request_id': 'req-fb2765be-656b-42b5-8f0d-6f05e77d5e77'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.688646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] The token cache is being invalidate because project fdddf4ce7c3e4635a45ae5ebee85e1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:06.690168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.690168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.691491 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2624/5262] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:06 2022] DELETE /identity/v3/projects/fdddf4ce7c3e4635a45ae5ebee85e1f1 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:06.692050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:06.693595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:06.745391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb29c723cbc249a781905fdbde1b3ad9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:06.752315 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2639/5263] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:05 2022] DELETE /identity/v3/users/fb29c723cbc249a781905fdbde1b3ad9 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:06.753162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:06.754558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:06.774088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2765be-656b-42b5-8f0d-6f05e77d5e77 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:06.845895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:06.847130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:06.848306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:06.848978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:06.849678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:06.851386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:06.863727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9a306-2674-453d-bdca-e57a2a958ae8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:06.869596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae295194-1193-4735-953b-201371139354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:06.870330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae295194-1193-4735-953b-201371139354 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:06.875560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae295194-1193-4735-953b-201371139354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:06.875560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae295194-1193-4735-953b-201371139354 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:06.875560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae295194-1193-4735-953b-201371139354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:06.875560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae295194-1193-4735-953b-201371139354 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:06.958645 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2625/5264] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:45:06 2022] POST /identity/v3/roles => generated 240 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:06.959482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:06.961039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:06.975044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31abb03-3673-4e0f-afea-aa9984865803 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:06.983576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:06.991170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:06.991170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:06.991170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] PATH_INFO: `/v3/projects/2198f7e9b0ca48bd9caa40b584186b00/users/87d8c9ea553246e6b65399e452133156/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:06.991170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2198f7e9b0ca48bd9caa40b584186b00, user_id=87d8c9ea553246e6b65399e452133156, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:06.991557 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2640/5265] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:06 2022] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:06.991557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f7787-56fe-45d3-b592-003e395ad8f9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:06.991557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f7787-56fe-45d3-b592-003e395ad8f9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:06.991557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f7787-56fe-45d3-b592-003e395ad8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:06.992224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:07.011899 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2626/5266] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:06 2022] PUT /identity/v3/projects/2198f7e9b0ca48bd9caa40b584186b00/users/87d8c9ea553246e6b65399e452133156/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:07.011899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.011899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.012511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-195f7787-56fe-45d3-b592-003e395ad8f9 None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:07.012511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-195f7787-56fe-45d3-b592-003e395ad8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.078578 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2641/5267] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:07.079876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894aec-30ee-4b16-b00e-54c8be78846f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.080208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894aec-30ee-4b16-b00e-54c8be78846f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.080479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894aec-30ee-4b16-b00e-54c8be78846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.104512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131fdba-4eeb-4bdd-893c-fd2e24e7e068 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.110714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.111369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.111874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.114214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] PATH_INFO: `/v3/projects/097aa0eadf644bcebb1726180c126259` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.114422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:07.114422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c894aec-30ee-4b16-b00e-54c8be78846f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:07.114571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097aa0eadf644bcebb1726180c126259)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:07.115636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c894aec-30ee-4b16-b00e-54c8be78846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.117210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:07.127831 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2642/5268] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:07.127831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c894aec-30ee-4b16-b00e-54c8be78846f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.210904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c894aec-30ee-4b16-b00e-54c8be78846f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.215560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.216173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.216459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.216736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.217370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:07.219583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:07.241896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097aa0eadf644bcebb1726180c126259', 'request_id': 'req-c90fd4d9-f36b-480e-85c1-a43c1a107c08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.250146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097aa0eadf644bcebb1726180c126259', 'request_id': 'req-c90fd4d9-f36b-480e-85c1-a43c1a107c08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.312378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2643/5269] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:07 2022] POST /identity/v3/groups => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:07.312378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.314912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.330132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4c82-df69-4794-a322-74b2d7a03d06 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.335078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097aa0eadf644bcebb1726180c126259', 'request_id': 'req-c90fd4d9-f36b-480e-85c1-a43c1a107c08'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.349779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] The token cache is being invalidate because project 097aa0eadf644bcebb1726180c126259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:07.350843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.352279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c90fd4d9-f36b-480e-85c1-a43c1a107c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.357570 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2627/5270] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:07 2022] DELETE /identity/v3/projects/097aa0eadf644bcebb1726180c126259 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:07.357570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.357570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.357570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.392542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] MFA Rules not processed for user `87d8c9ea553246e6b65399e452133156`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:07.393773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.415325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f2c3b-4671-4cd9-a5fa-302f44e84df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.416407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2c3b-4671-4cd9-a5fa-302f44e84df1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.416697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2c3b-4671-4cd9-a5fa-302f44e84df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.416979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2c3b-4671-4cd9-a5fa-302f44e84df1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.417779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f2c3b-4671-4cd9-a5fa-302f44e84df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:07.419800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f2c3b-4671-4cd9-a5fa-302f44e84df1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:07.478350 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2628/5271] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:07.478982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.480462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.498151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234402b-afe7-41d6-a65f-b00cf7ae0b27 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.507809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2644/5272] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:07 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:07.507809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.507809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.507809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.517289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.517947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.518262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.518536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] PATH_INFO: `/v3/projects/51f272b5abc047c49f5eb0bed78f9ed2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.519710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f272b5abc047c49f5eb0bed78f9ed2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:07.522728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:07.536438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:07.537216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.551620 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2645/5273] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:07.552470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.553785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.624727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e8feb-08d9-41f9-8519-f4d16a78ac9f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.629562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a1ada-c92d-4850-82fa-eacb5602df47 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.630308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1ada-c92d-4850-82fa-eacb5602df47 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.630578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1ada-c92d-4850-82fa-eacb5602df47 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.630856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1ada-c92d-4850-82fa-eacb5602df47 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups/9c00c30521494420baa090ad8e8e9234/users/18e936015258418a8956c47c48fe38c9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.637306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a1ada-c92d-4850-82fa-eacb5602df47 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9c00c30521494420baa090ad8e8e9234, user_id=18e936015258418a8956c47c48fe38c9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:07.639445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a1ada-c92d-4850-82fa-eacb5602df47 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:07.663554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f272b5abc047c49f5eb0bed78f9ed2', 'request_id': 'req-97ee6495-a060-405a-a5e5-f1e0344395b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.670339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f272b5abc047c49f5eb0bed78f9ed2', 'request_id': 'req-97ee6495-a060-405a-a5e5-f1e0344395b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.745351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f272b5abc047c49f5eb0bed78f9ed2', 'request_id': 'req-97ee6495-a060-405a-a5e5-f1e0344395b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.752469 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2646/5274] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 13:45:07 2022] PUT /identity/v3/groups/9c00c30521494420baa090ad8e8e9234/users/18e936015258418a8956c47c48fe38c9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:07.753874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.755409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.755556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.762241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] The token cache is being invalidate because project 51f272b5abc047c49f5eb0bed78f9ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:07.762534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.764625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:07.768128 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2629/5275] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:07 2022] DELETE /identity/v3/projects/51f272b5abc047c49f5eb0bed78f9ed2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:07.768955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.773380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.803670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:07.805167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.859031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:07.874419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee6495-a060-405a-a5e5-f1e0344395b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.888650 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2647/5276] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:07.889951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.895124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.909169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e022de2-95bb-40fe-9751-e8117b07ff28 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.915807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.918853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.918853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.918853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.918853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:07.919670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:07.936110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2648/5277] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:07 2022] GET /identity/v3/roles => generated 2342 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:07.936732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:07.942021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.946289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c1af9-4501-4155-81fc-a2afddd07dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.947127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1af9-4501-4155-81fc-a2afddd07dba service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.947541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1af9-4501-4155-81fc-a2afddd07dba service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.948072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c1af9-4501-4155-81fc-a2afddd07dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.950239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f99c1af9-4501-4155-81fc-a2afddd07dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:07.955187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbcb16-5dc1-4622-a354-33ca01c1e82a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:07.966821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:07.967457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:07.967839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:07.968014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:07.969188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:07.969188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:07.988269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.014258 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2649/5278] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:08.017249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.021323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:08.032122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:08.041591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c1af9-4501-4155-81fc-a2afddd07dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.043648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c1af9-4501-4155-81fc-a2afddd07dba service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.055260 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2630/5279] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:08.057238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951142b3-ceb7-4cdc-9309-aad3ebc40098 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.057471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951142b3-ceb7-4cdc-9309-aad3ebc40098 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.060007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951142b3-ceb7-4cdc-9309-aad3ebc40098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.083582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-951142b3-ceb7-4cdc-9309-aad3ebc40098 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:08.084811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-951142b3-ceb7-4cdc-9309-aad3ebc40098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:08.095583 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2631/5280] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:08.097312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c50d-b5eb-4785-bb95-2d6ef3d5fb21 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.098422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c50d-b5eb-4785-bb95-2d6ef3d5fb21 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.098703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c50d-b5eb-4785-bb95-2d6ef3d5fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.106002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4149b3c-9749-4e88-a487-75e9efb72cc1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.111673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8fc90-c805-47ee-8e59-f0b8cb96f928 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.112351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fc90-c805-47ee-8e59-f0b8cb96f928 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.112637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fc90-c805-47ee-8e59-f0b8cb96f928 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.112922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8fc90-c805-47ee-8e59-f0b8cb96f928 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/88227b78d45c4e84a6f0f4e905307b42/groups/9c00c30521494420baa090ad8e8e9234/roles/ed6a94bd42ae45eea089ff874a286d69` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.115270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8fc90-c805-47ee-8e59-f0b8cb96f928 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=88227b78d45c4e84a6f0f4e905307b42, group_id=9c00c30521494420baa090ad8e8e9234, role_id=ed6a94bd42ae45eea089ff874a286d69)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.118730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8fc90-c805-47ee-8e59-f0b8cb96f928 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.122878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7198c50d-b5eb-4785-bb95-2d6ef3d5fb21 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:08.124263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7198c50d-b5eb-4785-bb95-2d6ef3d5fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:08.133995 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2632/5281] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:08.134825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c50d-b5eb-4785-bb95-2d6ef3d5fb21 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.146867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c50d-b5eb-4785-bb95-2d6ef3d5fb21 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.151893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.152527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.152808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.153078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.153717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.155396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.167769 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2633/5282] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:08 2022] GET /identity/v3/roles => generated 2342 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:08.168620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.178495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffc38-e621-4a79-a1fb-5a61399e5ff9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.183482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.184079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.184360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.184634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.185262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.187221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.210914 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2650/5283] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:08 2022] PUT /identity/v3/domains/88227b78d45c4e84a6f0f4e905307b42/groups/9c00c30521494420baa090ad8e8e9234/roles/ed6a94bd42ae45eea089ff874a286d69 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:08.210914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07104458-a8c7-4c35-b74e-0d6e0a2b870b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.210914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07104458-a8c7-4c35-b74e-0d6e0a2b870b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.210914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07104458-a8c7-4c35-b74e-0d6e0a2b870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.238591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07104458-a8c7-4c35-b74e-0d6e0a2b870b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:08.239668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07104458-a8c7-4c35-b74e-0d6e0a2b870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:08.281859 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2634/5284] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:08 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:08.282935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.359957 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2651/5285] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:08.361509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07104458-a8c7-4c35-b74e-0d6e0a2b870b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.377310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07104458-a8c7-4c35-b74e-0d6e0a2b870b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.405615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc094165-7e96-460e-81a0-5ce27554ed8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.411137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.411798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.412084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.412358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.413205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:08.413432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.414981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.430640 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2635/5286] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:08.431587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.433314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:08.458687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.465253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.465253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.465253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] PATH_INFO: `/v3/projects/e58475bed97544eea65e37da4cf2f99a/users/2f218bab38e346d3a769665dc32d965f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.484938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58475bed97544eea65e37da4cf2f99a, user_id=2f218bab38e346d3a769665dc32d965f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.492504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.540599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e84c62-0245-477d-94bb-685ff638a9e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.545828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e936015258418a8956c47c48fe38c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '252ec0f53f234aacaf1b4b8a14b4ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.546472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.546762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.547040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] PATH_INFO: `/v3/auth/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.547646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.548709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.591968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2652/5287] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:08 2022] PUT /identity/v3/projects/e58475bed97544eea65e37da4cf2f99a/users/2f218bab38e346d3a769665dc32d965f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:08.592690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.627489 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2636/5288] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Oct 18 13:45:08 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:08.628786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.642544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9133a-3341-4ba8-9019-d6bd4efcc81d tempest-TokensV3TestJSON-1933218600 tempest-TokensV3TestJSON-1933218600-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.684612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028bce3-eaac-4176-8ed4-acb90594e6dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.689635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4092a9-b85e-496f-b7dd-f13bd3b854ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.690290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4092a9-b85e-496f-b7dd-f13bd3b854ef admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.690570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4092a9-b85e-496f-b7dd-f13bd3b854ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.690969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4092a9-b85e-496f-b7dd-f13bd3b854ef admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.691753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4092a9-b85e-496f-b7dd-f13bd3b854ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.694709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4092a9-b85e-496f-b7dd-f13bd3b854ef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.743306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.744158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.745424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.745424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.745908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:08.746342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.748951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:08.768608 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2637/5289] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:08.768608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:08.778939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4ddc-d7f1-4676-ba24-62f5fa5e75e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:08.784787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:08.786099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:08.786384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:08.786685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:08.787319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:08.791022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:09.693668 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2653/5290] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:08 2022] POST /identity/v3/users => generated 285 bytes in 1101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:09.695075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:09.695310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:09.695591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:09.699350 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2638/5291] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:08 2022] POST /identity/v3/projects => generated 387 bytes in 933 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:09.700805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:09.755519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] MFA Rules not processed for user `2f218bab38e346d3a769665dc32d965f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:09.757292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:09.787239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db352a7-fbe8-469e-9731-c5f1e5923e86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:09.793018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:09.794341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:09.794694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:09.796676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/88227b78d45c4e84a6f0f4e905307b42/groups/9c00c30521494420baa090ad8e8e9234/roles/ed6a94bd42ae45eea089ff874a286d69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:09.799258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=88227b78d45c4e84a6f0f4e905307b42, group_id=9c00c30521494420baa090ad8e8e9234, role_id=ed6a94bd42ae45eea089ff874a286d69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:09.801628 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:45:09.801628 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:45:09.801628 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:45:09.803738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:09.811559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role ed6a94bd42ae45eea089ff874a286d69 was removed from group 9c00c30521494420baa090ad8e8e9234 on domain 88227b78d45c4e84a6f0f4e905307b42. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:09.811929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:09.812713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:09.841869 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2654/5292] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:09.842771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:09.844314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:09.937487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f692c-186e-42e1-8b8d-2eb14dfc6afe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:09.940842 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2639/5293] 10.222.0.27 () {58 vars in 1467 bytes} [Tue Oct 18 13:45:09 2022] DELETE /identity/v3/domains/88227b78d45c4e84a6f0f4e905307b42/groups/9c00c30521494420baa090ad8e8e9234/roles/ed6a94bd42ae45eea089ff874a286d69 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:09.941903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:09.943440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:09.999915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.000645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.000999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.001345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.002084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.004136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.018186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:10.024614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f054-8d8a-4be3-a68b-4e37c3f1cb55 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.025244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.026097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.026333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.026679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.027407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.029671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.130134 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2640/5294] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:09 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:10.138865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.138865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:10.139068 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2655/5295] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:09 2022] POST /identity/v3/projects => generated 395 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:10.139068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.139235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:10.147013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbce25-d37d-4a50-a21e-dab7a9a0905b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.170661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:10.204113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2490-cee0-4cf4-8d9f-e12f99254e64 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.209098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.209895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.210262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.210557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.211565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.212288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.212651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.213022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.213675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.215316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.229447 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2641/5296] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:10 2022] GET /identity/v3/roles => generated 2342 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:10.233802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.237134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:10.294084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.296058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.310248 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2656/5297] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:10.312564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.325640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff283a1-487b-446f-9c62-ac57fc1192d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.326114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df257d-36c5-40b2-9bdd-2027d7ce2868 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.334803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.334994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.334994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.335226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.335328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.335425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.335523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.335631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups/9c00c30521494420baa090ad8e8e9234/users/18e936015258418a8956c47c48fe38c9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.336199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.337321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=9c00c30521494420baa090ad8e8e9234, user_id=18e936015258418a8956c47c48fe38c9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.338436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.339477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.360118 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2657/5298] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:10 2022] GET /identity/v3/roles => generated 2342 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:10.360118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.373210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6724b-4c76-4ef7-9838-e32ce8c9a6a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.378284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.378873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.379159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.379480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.380104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.382024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.423263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '18e936015258418a8956c47c48fe38c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:10.499535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2658/5299] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:10 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:10.500581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.511753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aafcb-9f3f-4080-9b15-21b50ba0c58f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.516740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.517426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.517919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.518303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.519301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.520816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.532532 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2642/5300] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 13:45:10 2022] DELETE /identity/v3/groups/9c00c30521494420baa090ad8e8e9234/users/18e936015258418a8956c47c48fe38c9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:10.534450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.536851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:10.541420 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2659/5301] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:10 2022] GET /identity/v3/roles => generated 2342 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:10.541420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.553160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5e353-b56c-450e-a43a-1773c55c8e1c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.620791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.621825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.622488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.622839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.623626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.625403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.642540 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2660/5302] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:10 2022] GET /identity/v3/roles => generated 2342 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:10.643457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.645983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1f01-35c7-4811-8705-937242a50e16 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.654206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb16af-45af-4998-b67a-50f72bae3d7e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.655305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.656305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.657002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.657590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] PATH_INFO: `/v3/users/2f218bab38e346d3a769665dc32d965f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.658994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f218bab38e346d3a769665dc32d965f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.662289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.685940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.687348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.687348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.687348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.687819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.689424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.701809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2661/5303] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:10 2022] GET /identity/v3/roles => generated 2342 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:10.703328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:10.771764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f9ff0-798c-4852-9d45-776ac37ae371 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:10.777397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:10.790331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:10.790331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:10.790331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups/9c00c30521494420baa090ad8e8e9234` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:10.790331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9c00c30521494420baa090ad8e8e9234)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:10.790331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:10.961386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f218bab38e346d3a769665dc32d965f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:10.963516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f218bab38e346d3a769665dc32d965f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:10.991778 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2662/5304] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:45:10 2022] DELETE /identity/v3/groups/9c00c30521494420baa090ad8e8e9234 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:10.995274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.001970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.098814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d14218-3ac2-48bb-b97e-940ffbe3f9c1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.099711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f218bab38e346d3a769665dc32d965f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:11.100348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f218bab38e346d3a769665dc32d965f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:11.104169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.104841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.105200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.105392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] PATH_INFO: `/v3/projects/e80de6081f5f4cd3bdb5cb04c90b7b1a/users/9622fc7415344c798e80d9259e62c0e5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.108050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f218bab38e346d3a769665dc32d965f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:11.127033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80de6081f5f4cd3bdb5cb04c90b7b1a, user_id=9622fc7415344c798e80d9259e62c0e5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:11.127033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:11.127324 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2643/5305] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:10 2022] DELETE /identity/v3/users/2f218bab38e346d3a769665dc32d965f => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:11.130614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.132008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.197874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f388-01cb-4b5d-90a0-888265419c99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.202779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.203454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.203744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.205253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] PATH_INFO: `/v3/projects/3da657bc46794b2c84e755ed48250a86/users/371dc522b1db4365900595d2fb0df7b8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.219939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da657bc46794b2c84e755ed48250a86, user_id=371dc522b1db4365900595d2fb0df7b8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:11.223733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:11.225298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:11.234883 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2663/5306] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:10 2022] PUT /identity/v3/projects/e80de6081f5f4cd3bdb5cb04c90b7b1a/users/9622fc7415344c798e80d9259e62c0e5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:11.235882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.237572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.313550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145358c6-90fe-44fa-bc42-b0358b22ec24 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.315319 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2644/5307] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:11 2022] PUT /identity/v3/projects/3da657bc46794b2c84e755ed48250a86/users/371dc522b1db4365900595d2fb0df7b8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:11.316554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.318676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.393416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207e44-6ef5-4282-9f15-674f23f4f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.393416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207e44-6ef5-4282-9f15-674f23f4f830 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.393416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207e44-6ef5-4282-9f15-674f23f4f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.393416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207e44-6ef5-4282-9f15-674f23f4f830 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.394936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207e44-6ef5-4282-9f15-674f23f4f830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:11.397618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207e44-6ef5-4282-9f15-674f23f4f830 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:11.414192 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2664/5308] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:11 2022] GET /identity/v3/roles => generated 2342 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:11.414444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365559-3af2-4d5a-8e27-7dc22b3199bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.414775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365559-3af2-4d5a-8e27-7dc22b3199bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.415126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95365559-3af2-4d5a-8e27-7dc22b3199bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.424793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5673504-df10-407d-9744-04ce9c4c1373 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.430455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.431402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.431696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.432078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles/ed6a94bd42ae45eea089ff874a286d69` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.433813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ed6a94bd42ae45eea089ff874a286d69)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:11.434884 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:45:11.434884 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:45:11.434884 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:45:11.435778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:11.438228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95365559-3af2-4d5a-8e27-7dc22b3199bc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:11.439474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95365559-3af2-4d5a-8e27-7dc22b3199bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.458584 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2665/5309] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:11.459852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d9ac-5406-40b1-bee7-8ce18f84c2fa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.460144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d9ac-5406-40b1-bee7-8ce18f84c2fa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.460425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d9ac-5406-40b1-bee7-8ce18f84c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.501046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a9a9d9ac-5406-40b1-bee7-8ce18f84c2fa None None] MFA Rules not processed for user `9622fc7415344c798e80d9259e62c0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:11.502828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a9a9d9ac-5406-40b1-bee7-8ce18f84c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.563484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role ed6a94bd42ae45eea089ff874a286d69 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:11.564102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:11.564996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1423256f-3d93-488f-b702-2713c22153f5 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:11.572688 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2645/5310] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:11 2022] DELETE /identity/v3/roles/ed6a94bd42ae45eea089ff874a286d69 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:11.572688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.572688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.573618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.579114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2666/5311] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:11.580195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d9ac-5406-40b1-bee7-8ce18f84c2fa None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.596842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:11.598453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.607088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d9ac-5406-40b1-bee7-8ce18f84c2fa None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.680179 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2646/5312] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:11.682747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.686091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.710440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.711129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.711460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.711757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] PATH_INFO: `/v3/projects/4f5ed305028c40ada3e3aaee0be3d381/users/c6645faffbfd4c489cd4bbd7fc49a3ac/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.730444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ed305028c40ada3e3aaee0be3d381, user_id=c6645faffbfd4c489cd4bbd7fc49a3ac, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:11.734270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:11.757122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b3b12-0238-4a4c-ba09-4aebd95c5fd0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.767734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.767734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.767734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.767734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.768385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.776230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:11.777639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:11.790135 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2647/5313] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:11.795611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.795611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.820949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:11.830394 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2667/5314] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:11 2022] PUT /identity/v3/projects/4f5ed305028c40ada3e3aaee0be3d381/users/c6645faffbfd4c489cd4bbd7fc49a3ac/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:11.831610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:11.833512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.875215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3550fb-2501-41e9-a81b-297b765303a8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.908944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae354-b569-4aa4-bff2-e2945f05f60b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:11.920446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.921914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.922321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.922665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.924828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:11.951919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:11.952576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:11.953008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:11.953286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/88227b78d45c4e84a6f0f4e905307b42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:11.954628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=88227b78d45c4e84a6f0f4e905307b42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:11.969613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:11.993959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:11.995176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.058459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:12.061078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:12.074583 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2668/5315] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:12.075074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:12.085756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107a044-c8d9-41f4-a457-18d7cc0e0e10 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:12.169759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.171373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-58cd061b-f7ec-48f9-9748-200990653039 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.176767 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2648/5316] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:11 2022] PATCH /identity/v3/domains/88227b78d45c4e84a6f0f4e905307b42 => generated 277 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:12.176767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:12.176767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:12.176767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:12.219324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] MFA Rules not processed for user `c6645faffbfd4c489cd4bbd7fc49a3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:12.221619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:12.233669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:12.233669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:12.233669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:12.233669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:12.234007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:12.350112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:12.350112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:12.351162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2649/5317] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:12.352304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:12.357953 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2669/5318] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:12.359300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:12.361184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:12.365292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:12.457408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9f4de-20ea-4035-928d-23c47b5ba7c8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:12.462140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:12.462769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:12.466386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:12.466938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:12.469859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:12.506768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febbd4a-c248-46a5-ab13-2fea1ccd974f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:12.513163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:12.514113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:12.514617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:12.515151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/88227b78d45c4e84a6f0f4e905307b42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:12.528204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=88227b78d45c4e84a6f0f4e905307b42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:12.530527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:12.580415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.602187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.607190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:12.609199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:12.622246 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2670/5319] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:12.623337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:12.626034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:12.658944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa1d9-e28c-4bf9-99d0-924647115fbf service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:12.670581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:12.672959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:12.673287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:12.673565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] PATH_INFO: `/v3/projects/e58475bed97544eea65e37da4cf2f99a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:12.677643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58475bed97544eea65e37da4cf2f99a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:12.679901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:12.759918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42', 'request_id': 'req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.766953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42', 'request_id': 'req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.851995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42', 'request_id': 'req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.852551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:12.886038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58475bed97544eea65e37da4cf2f99a', 'request_id': 'req-613808ad-abc5-412b-9aca-27dec9a1788c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.895912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] The token cache is being invalidate because project 88227b78d45c4e84a6f0f4e905307b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:12.897526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.899695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.906536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58475bed97544eea65e37da4cf2f99a', 'request_id': 'req-613808ad-abc5-412b-9aca-27dec9a1788c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.917538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42', 'request_id': 'req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.918895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42', 'request_id': 'req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.919915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '88227b78d45c4e84a6f0f4e905307b42', 'request_id': 'req-6bb4fc58-6fcd-4daa-acc3-42437d8c19df'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:12.948357 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2650/5320] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:45:12 2022] DELETE /identity/v3/domains/88227b78d45c4e84a6f0f4e905307b42 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:12.965136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a348-e334-4e07-b349-aecf7d3aecd6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:12.965136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a348-e334-4e07-b349-aecf7d3aecd6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:12.965136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a348-e334-4e07-b349-aecf7d3aecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:12.998269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e64a348-e334-4e07-b349-aecf7d3aecd6 None None] MFA Rules not processed for user `c6645faffbfd4c489cd4bbd7fc49a3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:13.001619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e64a348-e334-4e07-b349-aecf7d3aecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.008464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58475bed97544eea65e37da4cf2f99a', 'request_id': 'req-613808ad-abc5-412b-9aca-27dec9a1788c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:13.029788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] The token cache is being invalidate because project e58475bed97544eea65e37da4cf2f99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:13.031800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:13.034719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:13.037171 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2671/5321] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:12 2022] DELETE /identity/v3/projects/e58475bed97544eea65e37da4cf2f99a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:13.041670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:13.048286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.109217 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2651/5322] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:13.111205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.111723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.112214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.146885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:13.148543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.200704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613808ad-abc5-412b-9aca-27dec9a1788c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:13.212843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:13.213547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.213830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.214137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/a69ae24f0d574516b7508b764c800ebc/users/18e936015258418a8956c47c48fe38c9/roles/0289da397c1542b4a4d4838b1af9beb1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.216430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a69ae24f0d574516b7508b764c800ebc, user_id=18e936015258418a8956c47c48fe38c9, role_id=0289da397c1542b4a4d4838b1af9beb1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:13.217446 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:45:13.217446 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:45:13.217446 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:45:13.219416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:13.226690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role 0289da397c1542b4a4d4838b1af9beb1 was removed from user 18e936015258418a8956c47c48fe38c9 on domain a69ae24f0d574516b7508b764c800ebc. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:13.226985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:13.227926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32d2ce26-5d9a-40cc-bbb6-a5e044569259 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:13.232827 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2652/5323] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:13.233530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:13.242359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.325663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05232c61-b624-40c6-8e8f-b58934c3f50c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:13.332047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:13.332720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.333020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.333277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.335381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.340053 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2672/5324] 10.222.0.27 () {58 vars in 1464 bytes} [Tue Oct 18 13:45:13 2022] DELETE /identity/v3/domains/a69ae24f0d574516b7508b764c800ebc/users/18e936015258418a8956c47c48fe38c9/roles/0289da397c1542b4a4d4838b1af9beb1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:13.340053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3a6a6-3cfa-458b-ab47-9feef33a1cdd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.340053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3a6a6-3cfa-458b-ab47-9feef33a1cdd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.340053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3a6a6-3cfa-458b-ab47-9feef33a1cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.352023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:13.354157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:13.361009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b5d3a6a6-3cfa-458b-ab47-9feef33a1cdd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:13.362281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5d3a6a6-3cfa-458b-ab47-9feef33a1cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.368310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2653/5325] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:13 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:13.372442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:13.375112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.411680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b043be-8329-4e4c-87f2-2789a57ef264 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:13.492867 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2673/5326] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:13.494736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e83d7-57bc-4565-b7b5-77ee365ef40f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.495021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e83d7-57bc-4565-b7b5-77ee365ef40f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.495297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e83d7-57bc-4565-b7b5-77ee365ef40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.518762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:13.522410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d22e83d7-57bc-4565-b7b5-77ee365ef40f None None] MFA Rules not processed for user `c6645faffbfd4c489cd4bbd7fc49a3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:13.523649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d22e83d7-57bc-4565-b7b5-77ee365ef40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.524620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.526761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.533655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles/0289da397c1542b4a4d4838b1af9beb1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.533655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0289da397c1542b4a4d4838b1af9beb1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:13.537218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:13.598415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:13.665779 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2674/5327] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:13.665779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e83d7-57bc-4565-b7b5-77ee365ef40f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:13.704994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e83d7-57bc-4565-b7b5-77ee365ef40f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:13.711408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6a8d-ea22-4c81-b889-b4c890346e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:13.712169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6a8d-ea22-4c81-b889-b4c890346e81 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.712453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6a8d-ea22-4c81-b889-b4c890346e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.712730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6a8d-ea22-4c81-b889-b4c890346e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.713478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6a8d-ea22-4c81-b889-b4c890346e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:13.713785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6a8d-ea22-4c81-b889-b4c890346e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:13.716193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6a8d-ea22-4c81-b889-b4c890346e81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:13.729144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role 0289da397c1542b4a4d4838b1af9beb1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:13.729740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:13.731892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:13.739078 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2675/5329] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:13.740751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.740890 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2654/5329] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:13 2022] DELETE /identity/v3/roles/0289da397c1542b4a4d4838b1af9beb1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:13.741089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.741364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.741763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:13.746752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.778232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] MFA Rules not processed for user `c6645faffbfd4c489cd4bbd7fc49a3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:13.783057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:13.877158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f64709-ff70-4723-9316-a8b9c2a0259e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:13.883657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b75c-9140-4367-bee1-33e4524144d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:13.884491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b75c-9140-4367-bee1-33e4524144d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:13.885003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b75c-9140-4367-bee1-33e4524144d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:13.885810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b75c-9140-4367-bee1-33e4524144d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:13.886598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556b75c-9140-4367-bee1-33e4524144d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:13.889230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556b75c-9140-4367-bee1-33e4524144d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:13.904328 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2676/5330] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:13.905213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:13.914284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:14.006089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:14.040640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e46818-0e1c-4862-8e31-cd943a8b49ca None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:14.045736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:14.046696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:14.047176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:14.047645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/a69ae24f0d574516b7508b764c800ebc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:14.048900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a69ae24f0d574516b7508b764c800ebc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:14.051075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:14.077229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.077937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.081196 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2655/5331] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:13 2022] POST /identity/v3/projects => generated 371 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:14.087375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:14.087375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:14.087375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:14.109373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] MFA Rules not processed for user `c6645faffbfd4c489cd4bbd7fc49a3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:14.115078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:14.189498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.189790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.195225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2677/5332] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:13 2022] PATCH /identity/v3/domains/a69ae24f0d574516b7508b764c800ebc => generated 277 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:14.217646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:14.220963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:14.240022 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2656/5333] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:14.241074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:14.243263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:14.415567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332dcfb-474a-4867-ac91-aeaa0e03012f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:14.427042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:14.427914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:14.428667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:14.429000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/a69ae24f0d574516b7508b764c800ebc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:14.452521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a69ae24f0d574516b7508b764c800ebc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:14.456979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:14.491488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff9ace-1b8b-4976-84e8-8d4cf000e3b0 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:14.499247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9c2c1-b72f-4e3a-a3a4-c1482cced32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:14.499880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c2c1-b72f-4e3a-a3a4-c1482cced32a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:14.500160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c2c1-b72f-4e3a-a3a4-c1482cced32a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:14.500433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c2c1-b72f-4e3a-a3a4-c1482cced32a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:14.501071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9c2c1-b72f-4e3a-a3a4-c1482cced32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:14.504291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.507906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9c2c1-b72f-4e3a-a3a4-c1482cced32a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:14.520056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.641591 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2678/5334] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:14 2022] POST /identity/v3/users => generated 286 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:14.642391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:14.644090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:14.644090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:14.723531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc', 'request_id': 'req-f94f745a-7ffd-4a6e-b909-7a7022026ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.729718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] MFA Rules not processed for user `c6645faffbfd4c489cd4bbd7fc49a3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:14.734658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:14.735732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc', 'request_id': 'req-f94f745a-7ffd-4a6e-b909-7a7022026ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.813502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc', 'request_id': 'req-f94f745a-7ffd-4a6e-b909-7a7022026ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.834529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] The token cache is being invalidate because project a69ae24f0d574516b7508b764c800ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:14.835246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.839256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.855226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc', 'request_id': 'req-f94f745a-7ffd-4a6e-b909-7a7022026ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.856388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc', 'request_id': 'req-f94f745a-7ffd-4a6e-b909-7a7022026ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.857333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a69ae24f0d574516b7508b764c800ebc', 'request_id': 'req-f94f745a-7ffd-4a6e-b909-7a7022026ba1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:14.858039 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2679/5335] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:14.859241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:14.864231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:14.901462 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2657/5336] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:45:14 2022] DELETE /identity/v3/domains/a69ae24f0d574516b7508b764c800ebc => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:14.905325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:14.908465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:14.973854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd19d9-8717-403e-9fad-f50b5f67dd5b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:14.980262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:14.980850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:14.981137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:14.981406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:14.982182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:14.983920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:15.002023 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2680/5337] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:14 2022] GET /identity/v3/roles => generated 1881 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:15.003193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:15.005740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:15.021266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eea6f0-fc13-4535-8fea-d830fcf2bbe6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:15.029356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:15.030523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:15.030523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:15.030798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] PATH_INFO: `/v3/users/c6645faffbfd4c489cd4bbd7fc49a3ac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:15.031956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6645faffbfd4c489cd4bbd7fc49a3ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:15.033380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f745a-7ffd-4a6e-b909-7a7022026ba1 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:15.034148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:15.043867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:15.044623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:15.044973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:15.045324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:15.051244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:15.174851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:15.177107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:15.187875 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2658/5338] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:15.188784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:15.192826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:15.279845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb641b0-a126-44d1-9ffd-efe99a0bd361 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:15.286537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:15.287473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:15.287942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:15.288354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9b9236990a7c4c9c83357245352f876e/groups/118b7e3d818e4107b6545b48f91d8325/roles/286ecb2af5b2461686de8f0d62bb1fb8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:15.291755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9b9236990a7c4c9c83357245352f876e, group_id=118b7e3d818e4107b6545b48f91d8325, role_id=286ecb2af5b2461686de8f0d62bb1fb8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:15.294775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:15.302315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role 286ecb2af5b2461686de8f0d62bb1fb8 was removed from group 118b7e3d818e4107b6545b48f91d8325 on domain 9b9236990a7c4c9c83357245352f876e. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:15.302611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:15.306369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b5453be-0030-436c-b2e5-2389f94ba2bb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:15.330882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6645faffbfd4c489cd4bbd7fc49a3ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:15.339318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6645faffbfd4c489cd4bbd7fc49a3ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:15.340133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6645faffbfd4c489cd4bbd7fc49a3ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:15.367489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6645faffbfd4c489cd4bbd7fc49a3ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:15.414303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:15.488412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6645faffbfd4c489cd4bbd7fc49a3ac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:15.498884 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2681/5339] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:15 2022] DELETE /identity/v3/users/c6645faffbfd4c489cd4bbd7fc49a3ac => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:15.501173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2659/5340] 10.222.0.27 () {58 vars in 1467 bytes} [Tue Oct 18 13:45:15 2022] DELETE /identity/v3/domains/9b9236990a7c4c9c83357245352f876e/groups/118b7e3d818e4107b6545b48f91d8325/roles/286ecb2af5b2461686de8f0d62bb1fb8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:15.503215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:15.505698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:15.507670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d15c3-9564-44c2-ba88-237481248d51 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:15.508792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d15c3-9564-44c2-ba88-237481248d51 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:15.509176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d15c3-9564-44c2-ba88-237481248d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:15.567812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a8d15c3-9564-44c2-ba88-237481248d51 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:15.571022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a8d15c3-9564-44c2-ba88-237481248d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:15.668081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96d847-28bd-44c3-b03a-57c54d85978f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:15.673317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:15.673944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:15.674299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:15.674576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:15.675308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:15.677071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:15.695972 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2682/5341] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:15 2022] GET /identity/v3/roles => generated 1881 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:15.697247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:15.699378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:15.720923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:15.784637 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2660/5342] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:15.786931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d15c3-9564-44c2-ba88-237481248d51 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:15.807266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d15c3-9564-44c2-ba88-237481248d51 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:15.830841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:15.832507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:15.832940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:15.833061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] PATH_INFO: `/v3/projects/87e62506bcd44ec0a8c0fb44a3948ee2/users/a02ed19a63a941d4854c16ca47a122d3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:15.838719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e50f7-e61e-49d2-80ab-c12f6cc61c77 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:15.856022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:15.858134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:15.858459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:15.858762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups/118b7e3d818e4107b6545b48f91d8325/users/18e936015258418a8956c47c48fe38c9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:15.862838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=118b7e3d818e4107b6545b48f91d8325, user_id=18e936015258418a8956c47c48fe38c9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:15.865566 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:45:15.865566 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:45:15.865566 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:45:15.869262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:15.877245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e62506bcd44ec0a8c0fb44a3948ee2, user_id=a02ed19a63a941d4854c16ca47a122d3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:15.880919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:15.970290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a561e5f-6571-4b66-921a-156d81f1186c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '18e936015258418a8956c47c48fe38c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:16.017288 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2661/5343] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:15 2022] PUT /identity/v3/projects/87e62506bcd44ec0a8c0fb44a3948ee2/users/a02ed19a63a941d4854c16ca47a122d3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:16.028705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:16.028705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:16.103717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2683/5344] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 13:45:15 2022] DELETE /identity/v3/groups/118b7e3d818e4107b6545b48f91d8325/users/18e936015258418a8956c47c48fe38c9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:16.103717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175579d9-f6d6-4898-a502-2ee94ed5d807 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:16.103717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175579d9-f6d6-4898-a502-2ee94ed5d807 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:16.103717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175579d9-f6d6-4898-a502-2ee94ed5d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:16.131182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1ecf9-0ae5-4201-94aa-f14883ad40fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:16.188083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-175579d9-f6d6-4898-a502-2ee94ed5d807 None None] MFA Rules not processed for user `a02ed19a63a941d4854c16ca47a122d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:16.189236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-175579d9-f6d6-4898-a502-2ee94ed5d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:16.258168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:16.260530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:16.261093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:16.261741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:16.357142 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2684/5345] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:16.360940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175579d9-f6d6-4898-a502-2ee94ed5d807 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:16.462435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:16.471053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:16.498997 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2662/5346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:16.498997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:16.498997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:16.515268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d9d83-8b53-4983-bc58-eebbeaaf6460 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:16.516191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175579d9-f6d6-4898-a502-2ee94ed5d807 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:16.523670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:16.524327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:16.524588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:16.524766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:16.524958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:16.526297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:16.526808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:16.527436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/groups/118b7e3d818e4107b6545b48f91d8325` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:16.528974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_group(group_id=118b7e3d818e4107b6545b48f91d8325)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:16.532130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:16.537236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:16.539524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:16.549892 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2663/5347] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:16.686469 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2685/5348] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:45:16 2022] DELETE /identity/v3/groups/118b7e3d818e4107b6545b48f91d8325 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:16.719600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:16.744101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef9a2c-412d-4829-8f20-0e367fcf445b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:16.837646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:16.838409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:16.838686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:16.838984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles/286ecb2af5b2461686de8f0d62bb1fb8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:16.840667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_role(role_id=286ecb2af5b2461686de8f0d62bb1fb8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:16.842590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:16.989864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role 286ecb2af5b2461686de8f0d62bb1fb8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:16.990551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:16.991487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:16.998858 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2664/5349] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:16 2022] DELETE /identity/v3/roles/286ecb2af5b2461686de8f0d62bb1fb8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:16.999949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:17.001980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:17.030433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a36e5-3727-4059-9767-c93c6e74a7ab tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:17.165600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:17.166831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:17.166831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:17.166831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9b9236990a7c4c9c83357245352f876e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:17.179524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9b9236990a7c4c9c83357245352f876e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:17.181234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:17.232003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9b9236990a7c4c9c83357245352f876e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.232947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9b9236990a7c4c9c83357245352f876e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.405062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9b9236990a7c4c9c83357245352f876e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.406012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9b9236990a7c4c9c83357245352f876e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.409748 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2686/5350] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:16 2022] PATCH /identity/v3/domains/9b9236990a7c4c9c83357245352f876e => generated 278 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:17.416571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:17.430505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e968e6-56f5-4142-8ab0-d6376584082b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:17.498259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:17.601835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:17.603111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:17.603467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:17.604222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9b9236990a7c4c9c83357245352f876e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:17.620999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9b9236990a7c4c9c83357245352f876e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:17.623177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:17.658568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9b9236990a7c4c9c83357245352f876e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.680317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9b9236990a7c4c9c83357245352f876e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.823522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9236990a7c4c9c83357245352f876e', 'request_id': 'req-9a58416c-6999-4447-98dd-3bb8a63d981e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.841281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9236990a7c4c9c83357245352f876e', 'request_id': 'req-9a58416c-6999-4447-98dd-3bb8a63d981e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.949128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9236990a7c4c9c83357245352f876e', 'request_id': 'req-9a58416c-6999-4447-98dd-3bb8a63d981e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.970007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] The token cache is being invalidate because project 9b9236990a7c4c9c83357245352f876e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:17.970477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.971283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.982907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9b9236990a7c4c9c83357245352f876e', 'request_id': 'req-9a58416c-6999-4447-98dd-3bb8a63d981e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.985126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9b9236990a7c4c9c83357245352f876e', 'request_id': 'req-9a58416c-6999-4447-98dd-3bb8a63d981e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:17.986635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9b9236990a7c4c9c83357245352f876e', 'request_id': 'req-9a58416c-6999-4447-98dd-3bb8a63d981e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:18.004779 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2665/5351] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:45:17 2022] DELETE /identity/v3/domains/9b9236990a7c4c9c83357245352f876e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:18.005299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:18.006769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:18.022510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4530ce-8c73-49c6-a387-4de19de6a823 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:18.117277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:18.118614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:18.121877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:18.122696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9f2092e88efe4f1fa93210ab66146a2e/users/18e936015258418a8956c47c48fe38c9/roles/f2ad240fdd3e422e8232cad66195696a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:18.125377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9f2092e88efe4f1fa93210ab66146a2e, user_id=18e936015258418a8956c47c48fe38c9, role_id=f2ad240fdd3e422e8232cad66195696a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:18.131252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:18.142310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role f2ad240fdd3e422e8232cad66195696a was removed from user 18e936015258418a8956c47c48fe38c9 on domain 9f2092e88efe4f1fa93210ab66146a2e. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:18.142875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:18.144641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:18.196559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:18.241171 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2687/5352] 10.222.0.27 () {58 vars in 1464 bytes} [Tue Oct 18 13:45:18 2022] DELETE /identity/v3/domains/9f2092e88efe4f1fa93210ab66146a2e/users/18e936015258418a8956c47c48fe38c9/roles/f2ad240fdd3e422e8232cad66195696a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:45:18.245614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:18.247314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:18.249094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:18.250132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:18.484051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe088afb-e6f8-4ec5-93f9-2c08832d9d27 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:18.498804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:18.500037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:18.500509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:18.500942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles/f2ad240fdd3e422e8232cad66195696a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:18.501344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58416c-6999-4447-98dd-3bb8a63d981e tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:18.505550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f2ad240fdd3e422e8232cad66195696a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:18.509088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:18.614819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:18.617408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:18.617408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:18.617408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] PATH_INFO: `/v3/projects/4f5ed305028c40ada3e3aaee0be3d381` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:18.619022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5ed305028c40ada3e3aaee0be3d381)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:18.630164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:18.666355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role f2ad240fdd3e422e8232cad66195696a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:18.666879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:18.668857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:18.674985 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2688/5353] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:18 2022] DELETE /identity/v3/roles/f2ad240fdd3e422e8232cad66195696a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:18.679994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:18.687019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:18.820641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5ed305028c40ada3e3aaee0be3d381', 'request_id': 'req-bb7a4991-aed5-438d-a5da-db499f50c262'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:18.824956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:18.865200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5ed305028c40ada3e3aaee0be3d381', 'request_id': 'req-bb7a4991-aed5-438d-a5da-db499f50c262'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:18.912129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c51c78-d91c-4730-8178-4e1d962892d7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:19.002374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5ed305028c40ada3e3aaee0be3d381', 'request_id': 'req-bb7a4991-aed5-438d-a5da-db499f50c262'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.021277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] The token cache is being invalidate because project 4f5ed305028c40ada3e3aaee0be3d381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:19.021836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.023244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb7a4991-aed5-438d-a5da-db499f50c262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.030254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2666/5354] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:18 2022] DELETE /identity/v3/projects/4f5ed305028c40ada3e3aaee0be3d381 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:19.032005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0339-4273-41b7-81f9-d5b09775c6ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:19.033612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0339-4273-41b7-81f9-d5b09775c6ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:19.035570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d0339-4273-41b7-81f9-d5b09775c6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:19.063995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:19.064982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:19.065426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:19.065888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9f2092e88efe4f1fa93210ab66146a2e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:19.071187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9f2092e88efe4f1fa93210ab66146a2e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:19.075951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:19.076548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-741d0339-4273-41b7-81f9-d5b09775c6ac None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:19.078025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-741d0339-4273-41b7-81f9-d5b09775c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:19.124468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.125875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.168085 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2667/5355] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:19.177922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73c17-09e8-4e3a-84de-0ac5ce6993db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:19.178333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73c17-09e8-4e3a-84de-0ac5ce6993db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:19.178681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73c17-09e8-4e3a-84de-0ac5ce6993db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:19.210663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-05c73c17-09e8-4e3a-84de-0ac5ce6993db None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:19.213087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05c73c17-09e8-4e3a-84de-0ac5ce6993db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:19.352261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.355189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.368213 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2689/5356] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:18 2022] PATCH /identity/v3/domains/9f2092e88efe4f1fa93210ab66146a2e => generated 276 bytes in 688 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:19.372979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:19.375480 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2668/5357] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:19.379403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73c17-09e8-4e3a-84de-0ac5ce6993db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:19.383678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:19.402971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73c17-09e8-4e3a-84de-0ac5ce6993db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:19.419211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:19.420823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:19.423089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:19.423640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:19.427406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:19.428179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:19.436335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:19.486147 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2669/5358] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:19.490522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:19.512608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c0255-542b-4d13-8cb9-82dd1bf3f515 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:19.524867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:19.525513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:19.525795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:19.526095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:19.529213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:19.534949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:19.585036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37f72-c78d-41a9-9a7a-b6374dd28425 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:19.596346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:19.597843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:19.598148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:19.598573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9f2092e88efe4f1fa93210ab66146a2e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:19.625532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9f2092e88efe4f1fa93210ab66146a2e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:19.627905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:19.673968 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2670/5359] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:19 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:19.676062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:19.699002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.718346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.858846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640011ca-b028-4157-b528-ad35c5918307 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:19.888617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e', 'request_id': 'req-60fbd5ba-baf7-4c24-8baa-49da3242e04c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.916936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e', 'request_id': 'req-60fbd5ba-baf7-4c24-8baa-49da3242e04c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:19.996406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e', 'request_id': 'req-60fbd5ba-baf7-4c24-8baa-49da3242e04c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:20.017921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] The token cache is being invalidate because project 9f2092e88efe4f1fa93210ab66146a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:20.018734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:20.022154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:20.065755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e', 'request_id': 'req-60fbd5ba-baf7-4c24-8baa-49da3242e04c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:20.075352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:20.076305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:20.076774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:20.077205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:20.078068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e', 'request_id': 'req-60fbd5ba-baf7-4c24-8baa-49da3242e04c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:20.079047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:20.083519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:20.090729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9f2092e88efe4f1fa93210ab66146a2e', 'request_id': 'req-60fbd5ba-baf7-4c24-8baa-49da3242e04c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:20.111126 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2690/5360] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:45:19 2022] DELETE /identity/v3/domains/9f2092e88efe4f1fa93210ab66146a2e => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:20.118733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:20.123371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:20.275081 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2671/5361] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:19 2022] POST /identity/v3/users => generated 290 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:45:20.280769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:20.287088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:20.324197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f728a2b-d7dc-4bd6-b79e-e557453bf66b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:20.339319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd5ba-baf7-4c24-8baa-49da3242e04c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:20.342946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:20.343888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:20.344492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:20.345782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:20.346545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:20.353013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:20.361796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:20.362477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:20.363328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:20.364603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:20.367809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:20.372276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:20.375824 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2672/5362] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:20.380179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:20.412186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d42b-0512-4fe4-8fb2-b99f6908afcc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:20.414604 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2691/5363] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:20.415800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:20.430153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:20.431119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:20.432742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:20.433282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:20.434041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:20.438332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:20.464330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2902112-fc39-44e9-8a78-f116b28e76aa tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:20.479547 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2673/5364] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:20.481831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:20.483544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:20.484298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:20.484626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:20.484905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects/754eefb2935949bba7dab8c27cc57874/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:20.497977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_grant(project_id=754eefb2935949bba7dab8c27cc57874, user_id=c283a82f90e34928b20e535bbb5b9ef9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:20.507521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:20.508694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698f081-a631-4980-92c0-9f2a6ddf5192 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:20.526799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb2e24-0ca9-4926-97cf-e4533c95e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:20.527523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2e24-0ca9-4926-97cf-e4533c95e6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:20.527811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2e24-0ca9-4926-97cf-e4533c95e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:20.528094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2e24-0ca9-4926-97cf-e4533c95e6d9 admin admin] PATH_INFO: `/v3/projects/b2b1fda987b644a9a17f18abab81eac8/users/1403c0b2a05241aaa2eb56c217e00eaa/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:20.577314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb2e24-0ca9-4926-97cf-e4533c95e6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b1fda987b644a9a17f18abab81eac8, user_id=1403c0b2a05241aaa2eb56c217e00eaa, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:20.577314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb2e24-0ca9-4926-97cf-e4533c95e6d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:20.700806 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2692/5365] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:20 2022] PUT /identity/v3/projects/754eefb2935949bba7dab8c27cc57874/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:20.707625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:20.715400 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2674/5366] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:20 2022] PUT /identity/v3/projects/b2b1fda987b644a9a17f18abab81eac8/users/1403c0b2a05241aaa2eb56c217e00eaa/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:20.724467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:20.724769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:20.725192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:20.841935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:20.851061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:20.889644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d4e2f-e569-4083-be34-ae65cdb5c6a7 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:21.034511 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2675/5367] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:21.061370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:21.064686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:21.065326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:21.065691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:21.066439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:21.071017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:21.129292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:21.153811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:21.160636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:21.245006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2693/5368] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Oct 18 13:45:20 2022] GET /identity/v3/auth/projects => generated 828 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:21.245006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:21.271640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471e2d3-d399-4ff9-8c71-e5f2144977f9 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:21.297776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:21.299738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:21.301705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:21.302010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects/754eefb2935949bba7dab8c27cc57874/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:21.306291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=754eefb2935949bba7dab8c27cc57874, user_id=c283a82f90e34928b20e535bbb5b9ef9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:21.313276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:21.333066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role 6896c84ae1cb498793bc04c2699d3e70 was removed from user c283a82f90e34928b20e535bbb5b9ef9 on project 754eefb2935949bba7dab8c27cc57874. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:21.333374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:21.334350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:21.352854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d092ec-2673-4a44-8fdd-c5647c5b76ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:21.356859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:21.357537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:21.357971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:21.358332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:21.360384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:21.376162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:21.379036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:21.393918 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2676/5369] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:21.468726 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2694/5370] 10.222.0.27 () {58 vars in 1467 bytes} [Tue Oct 18 13:45:21 2022] DELETE /identity/v3/projects/754eefb2935949bba7dab8c27cc57874/users/c283a82f90e34928b20e535bbb5b9ef9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:45:21.474107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:21.475912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:21.502265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5553-a7cd-49da-aefc-a8c7fd6cd89c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:21.597763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:21.598491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:21.598732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:21.598992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:21.599664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:21.601763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:21.718180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:21.763054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:21.763401 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2677/5371] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:21 2022] POST /identity/v3/users => generated 321 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:21.778005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dab3e-6915-4396-8e90-e4956f1c1c1c tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:21.791324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:21.791964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:21.792294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:21.792524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:21.793396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:21.795378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:21.955289 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2695/5372] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:21 2022] POST /identity/v3/projects => generated 364 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:45:21.956530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:21.973326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b07255-f6de-4251-a8a6-0bb84df0cfb2 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:22.084973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:22.085788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:22.086249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:22.089148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:22.089148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:22.089375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:22.211989 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2678/5373] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:21 2022] POST /identity/v3/projects => generated 364 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:22.218559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:22.237394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6d64e-6768-4efb-a449-60c9500f052f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:22.399381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:22.400391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:22.400829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:22.401216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:22.403120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:22.417566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:22.418426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:22.520868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2696/5374] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:45:22 2022] POST /identity/v3/roles => generated 239 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:22.525090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:22.543447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c527b-ad0b-4bcb-b2ba-c7f2d0c3175f tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:22.553541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd97cb8-9cae-4c69-99d5-b505ef56babe tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:22.554493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97cb8-9cae-4c69-99d5-b505ef56babe tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:22.556175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97cb8-9cae-4c69-99d5-b505ef56babe tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:22.556583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97cb8-9cae-4c69-99d5-b505ef56babe tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects/9cb6a5a1482542b2a47aacadd2dc46b4/users/22f8b654969f41ffbf58af69e3451c33/roles/a3284761f66a42a1af9a01bbc13e82a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:22.632628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97cb8-9cae-4c69-99d5-b505ef56babe tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6a5a1482542b2a47aacadd2dc46b4, user_id=22f8b654969f41ffbf58af69e3451c33, role_id=a3284761f66a42a1af9a01bbc13e82a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:22.635496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97cb8-9cae-4c69-99d5-b505ef56babe tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:22.755244 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2679/5375] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:22 2022] PUT /identity/v3/projects/9cb6a5a1482542b2a47aacadd2dc46b4/users/22f8b654969f41ffbf58af69e3451c33/roles/a3284761f66a42a1af9a01bbc13e82a4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:22.756429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:22.772628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e9697-a264-48d9-bd62-049d1ddaa20b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:22.780910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51ee2-8470-4a4b-b273-76cd8ee9102f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:22.781211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51ee2-8470-4a4b-b273-76cd8ee9102f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:22.781493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c51ee2-8470-4a4b-b273-76cd8ee9102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:22.831026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d6c51ee2-8470-4a4b-b273-76cd8ee9102f None None] MFA Rules not processed for user `d50c668c2b2f43798ab247029a8386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:22.832338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d6c51ee2-8470-4a4b-b273-76cd8ee9102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:22.960131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1836a4-cbab-4a89-8c36-ae5c03bd68cb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:22.960829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1836a4-cbab-4a89-8c36-ae5c03bd68cb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:22.961114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1836a4-cbab-4a89-8c36-ae5c03bd68cb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:22.961386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1836a4-cbab-4a89-8c36-ae5c03bd68cb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects/e16901ceadf54cfba301045e27ecbdcb/users/22f8b654969f41ffbf58af69e3451c33/roles/a3284761f66a42a1af9a01bbc13e82a4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:22.972692 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2680/5376] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:22.972906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1836a4-cbab-4a89-8c36-ae5c03bd68cb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e16901ceadf54cfba301045e27ecbdcb, user_id=22f8b654969f41ffbf58af69e3451c33, role_id=a3284761f66a42a1af9a01bbc13e82a4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:22.975731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1836a4-cbab-4a89-8c36-ae5c03bd68cb tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:23.099563 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2697/5377] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:22 2022] PUT /identity/v3/projects/e16901ceadf54cfba301045e27ecbdcb/users/22f8b654969f41ffbf58af69e3451c33/roles/a3284761f66a42a1af9a01bbc13e82a4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:23.105073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17dd2c-a015-4028-abbd-f300c74f683b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:23.107088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17dd2c-a015-4028-abbd-f300c74f683b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:23.107553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17dd2c-a015-4028-abbd-f300c74f683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:23.165786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5d17dd2c-a015-4028-abbd-f300c74f683b None None] MFA Rules not processed for user `22f8b654969f41ffbf58af69e3451c33`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:23.167378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d17dd2c-a015-4028-abbd-f300c74f683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:23.176395 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2681/5378] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:23 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:23.176982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635802c-de54-4691-9732-e863a00a2193 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:23.177275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635802c-de54-4691-9732-e863a00a2193 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:23.177552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635802c-de54-4691-9732-e863a00a2193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:23.200229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3635802c-de54-4691-9732-e863a00a2193 None None] MFA Rules not processed for user `22f8b654969f41ffbf58af69e3451c33`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:23.201971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3635802c-de54-4691-9732-e863a00a2193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:23.384560 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2698/5379] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 18 13:45:23.398507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17dd2c-a015-4028-abbd-f300c74f683b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:23.432929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:23.433216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:23.433697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:23.505220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] MFA Rules not processed for user `371dc522b1db4365900595d2fb0df7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:23.506491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:23.569254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17dd2c-a015-4028-abbd-f300c74f683b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:23.583794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723699a8-5699-491a-8803-064544fde110 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:23.583794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723699a8-5699-491a-8803-064544fde110 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:23.583794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723699a8-5699-491a-8803-064544fde110 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:23.584121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723699a8-5699-491a-8803-064544fde110 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:23.613834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723699a8-5699-491a-8803-064544fde110 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:23.618622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723699a8-5699-491a-8803-064544fde110 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:23.664247 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2699/5380] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:23.680207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:23.680207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:23.728190 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2682/5381] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Oct 18 13:45:23 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:23.738332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700970e-36a3-4790-9330-15f16e07493c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:23.738332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700970e-36a3-4790-9330-15f16e07493c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:23.738332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700970e-36a3-4790-9330-15f16e07493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:23.754621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9700970e-36a3-4790-9330-15f16e07493c None None] MFA Rules not processed for user `22f8b654969f41ffbf58af69e3451c33`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:23.755864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9700970e-36a3-4790-9330-15f16e07493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:23.788928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e34f8-028e-44ef-aab6-354ed0115e8d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:23.795749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:23.799941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:23.801212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:23.801569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:23.801967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:23.804250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:23.806382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:23.857004 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2683/5382] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 18 13:45:23.858232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700970e-36a3-4790-9330-15f16e07493c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:23.875398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700970e-36a3-4790-9330-15f16e07493c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:23.881018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:23.881847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:23.882164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:23.883288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/roles/a3284761f66a42a1af9a01bbc13e82a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:23.884271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a3284761f66a42a1af9a01bbc13e82a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:23.886027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:23.964853 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2700/5383] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:23 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:45:23.966245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:24.071810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c1f7f-a16c-4135-891e-ab51a91b2e68 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:24.077152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:24.077784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:24.078087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:24.078399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:24.079145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:24.081103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:24.165654 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2701/5384] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:23 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:24.169549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:24.173269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invalidating the token cache because role a3284761f66a42a1af9a01bbc13e82a4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:24.173654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:24.174548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:24.177245 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2684/5385] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:23 2022] DELETE /identity/v3/roles/a3284761f66a42a1af9a01bbc13e82a4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:24.181181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:24.182940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:24.193306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230940af-b7e4-47f3-af57-9414cf1e96e8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:24.339308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3e9a0-334f-420c-9f1a-d93659910d7b tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:24.343856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:24.345544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:24.346411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:24.348244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:24.350021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:24.359119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:24.362363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:24.362363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:24.363304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:24.365185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects/e16901ceadf54cfba301045e27ecbdcb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:24.371914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e16901ceadf54cfba301045e27ecbdcb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:24.378674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:24.395432 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2702/5386] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:45:24.397745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:24.417711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:24.441087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5565e-8b1b-4ac7-b5ce-4237757a8f38 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:24.457412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:24.465124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:24.466733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:24.467145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] PATH_INFO: `/v3/projects/261a21adc58343c2919f1e029317f3ea/users/9db4fb751a8a47139dede519c8b7481c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:24.476635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:24.533393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a21adc58343c2919f1e029317f3ea, user_id=9db4fb751a8a47139dede519c8b7481c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:24.537851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:24.577523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16901ceadf54cfba301045e27ecbdcb', 'request_id': 'req-ffb04b5f-b00d-45d2-8809-a4d66a32c384'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:24.587958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16901ceadf54cfba301045e27ecbdcb', 'request_id': 'req-ffb04b5f-b00d-45d2-8809-a4d66a32c384'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:24.661330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2703/5387] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:24 2022] PUT /identity/v3/projects/261a21adc58343c2919f1e029317f3ea/users/9db4fb751a8a47139dede519c8b7481c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:24.665279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:24.682467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16901ceadf54cfba301045e27ecbdcb', 'request_id': 'req-ffb04b5f-b00d-45d2-8809-a4d66a32c384'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:24.712747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] The token cache is being invalidate because project e16901ceadf54cfba301045e27ecbdcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:24.713083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:24.713952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:24.720465 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2685/5388] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:24 2022] DELETE /identity/v3/projects/e16901ceadf54cfba301045e27ecbdcb => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:24.722870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:24.724959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:24.866975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb04b5f-b00d-45d2-8809-a4d66a32c384 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:24.889549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff209c16-aeca-4df7-ad94-72cf14f310ad admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:24.905964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:24.906929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:24.907640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:24.908078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:24.908891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:24.910739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:24.948113 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2704/5389] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:24.954467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:24.959007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:24.990704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82681e-75ed-453c-9ded-9fa7425669d8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:25.010607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:25.011471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:25.016511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:25.016511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] PATH_INFO: `/v3/projects/261a21adc58343c2919f1e029317f3ea/users/9db4fb751a8a47139dede519c8b7481c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:25.017006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:25.017006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:25.020491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=261a21adc58343c2919f1e029317f3ea, user_id=9db4fb751a8a47139dede519c8b7481c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:25.023368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:25.023750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:25.025295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects/e16901ceadf54cfba301045e27ecbdcb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:25.050965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e16901ceadf54cfba301045e27ecbdcb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:25.053712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:25.063460 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2705/5390] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:24 2022] PUT /identity/v3/projects/261a21adc58343c2919f1e029317f3ea/users/9db4fb751a8a47139dede519c8b7481c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Could not find project: e16901ceadf54cfba301045e27ecbdcb.: keystone.exception.ProjectNotFound: Could not find project: e16901ceadf54cfba301045e27ecbdcb. Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 18 13:45:25.086935 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e16901ceadf54cfba301045e27ecbdcb. Oct 18 13:45:25.088120 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:25.090483 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2686/5391] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:24 2022] DELETE /identity/v3/projects/e16901ceadf54cfba301045e27ecbdcb => generated 113 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:45:25.095436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:25.100946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:25.201955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821539e4-44a9-4d5c-ad46-8561a43e8e2d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:25.219798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:25.220587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:25.220969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:25.222458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/projects/9cb6a5a1482542b2a47aacadd2dc46b4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:25.225804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9cb6a5a1482542b2a47aacadd2dc46b4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:25.230672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:25.493843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb6a5a1482542b2a47aacadd2dc46b4', 'request_id': 'req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:25.508637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb6a5a1482542b2a47aacadd2dc46b4', 'request_id': 'req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:25.636454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb6a5a1482542b2a47aacadd2dc46b4', 'request_id': 'req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:25.667501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] The token cache is being invalidate because project 9cb6a5a1482542b2a47aacadd2dc46b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:25.668517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:25.671803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:25.697452 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2706/5392] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:25 2022] DELETE /identity/v3/projects/9cb6a5a1482542b2a47aacadd2dc46b4 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:25.698312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:25.700152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:25.718122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57621f7d-8055-4283-997e-c3bf3fce9027 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:25.883229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:25.891642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:25.892305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:25.892780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:25.893067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/users/22f8b654969f41ffbf58af69e3451c33` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:25.895112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorizing `identity:delete_user(user_id=22f8b654969f41ffbf58af69e3451c33)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:25.896650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:26.097891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f8b654969f41ffbf58af69e3451c33'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:26.099455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f8b654969f41ffbf58af69e3451c33'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:26.199143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f8b654969f41ffbf58af69e3451c33'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:26.201007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f8b654969f41ffbf58af69e3451c33'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:26.216999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f8b654969f41ffbf58af69e3451c33'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:26.264462 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2687/5393] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:25 2022] DELETE /identity/v3/users/22f8b654969f41ffbf58af69e3451c33 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:26.272694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:26.283686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13379f-f1b6-4477-8f65-9ab34b8d3d2a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:26.422812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:26.427555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:26.428120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:26.428575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/88227b78d45c4e84a6f0f4e905307b42` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:26.444287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Could not find domain: 88227b78d45c4e84a6f0f4e905307b42.: keystone.exception.DomainNotFound: Could not find domain: 88227b78d45c4e84a6f0f4e905307b42. Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 88227b78d45c4e84a6f0f4e905307b42. Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:45:26.457015 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:26.458394 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 88227b78d45c4e84a6f0f4e905307b42. Oct 18 13:45:26.459587 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:45:26.475029 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2707/5394] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:26 2022] PATCH /identity/v3/domains/88227b78d45c4e84a6f0f4e905307b42 => generated 112 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:45:26.475986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:26.477640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:26.517213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d457ec7-7ac5-4154-8da6-7bf19579516a tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:26.522771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:26.534208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:26.537490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:26.539080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:26.539380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/a69ae24f0d574516b7508b764c800ebc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:26.566754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Could not find domain: a69ae24f0d574516b7508b764c800ebc.: keystone.exception.DomainNotFound: Could not find domain: a69ae24f0d574516b7508b764c800ebc. Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a69ae24f0d574516b7508b764c800ebc. Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:45:26.585496 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:26.586897 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a69ae24f0d574516b7508b764c800ebc. Oct 18 13:45:26.588082 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:26.593860 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2688/5395] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:26 2022] PATCH /identity/v3/domains/a69ae24f0d574516b7508b764c800ebc => generated 112 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:45:26.597689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:26.609365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee773ca-8de8-4e1f-b59b-898aca44ef42 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:26.626172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:26.626986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:26.627350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:26.627723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9b9236990a7c4c9c83357245352f876e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:26.647319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Could not find domain: 9b9236990a7c4c9c83357245352f876e.: keystone.exception.DomainNotFound: Could not find domain: 9b9236990a7c4c9c83357245352f876e. Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9b9236990a7c4c9c83357245352f876e. Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:45:26.655882 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:26.657279 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9b9236990a7c4c9c83357245352f876e. Oct 18 13:45:26.658509 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:45:26.665796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:26.674697 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2708/5396] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:26 2022] PATCH /identity/v3/domains/9b9236990a7c4c9c83357245352f876e => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:45:26.684545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d17d5-10d0-459c-9972-f961e08d8d21 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:26.716324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78508c1-d920-4cc6-99fe-5f23e7575a97 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c283a82f90e34928b20e535bbb5b9ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f89b9cc7534bca9674f355374fd2cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:26.716994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78508c1-d920-4cc6-99fe-5f23e7575a97 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:26.718385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78508c1-d920-4cc6-99fe-5f23e7575a97 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:26.718385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78508c1-d920-4cc6-99fe-5f23e7575a97 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] PATH_INFO: `/v3/domains/9f2092e88efe4f1fa93210ab66146a2e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:26.730921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78508c1-d920-4cc6-99fe-5f23e7575a97 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e78508c1-d920-4cc6-99fe-5f23e7575a97 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Could not find domain: 9f2092e88efe4f1fa93210ab66146a2e.: keystone.exception.DomainNotFound: Could not find domain: 9f2092e88efe4f1fa93210ab66146a2e. Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9f2092e88efe4f1fa93210ab66146a2e. Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:45:26.736193 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:26.738044 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9f2092e88efe4f1fa93210ab66146a2e. Oct 18 13:45:26.741977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:26.743683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:26.745461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:26.755454 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2689/5397] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:45:26 2022] PATCH /identity/v3/domains/9f2092e88efe4f1fa93210ab66146a2e => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:45:26.883718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a7c6-9803-4584-a6fb-85a2ec8c31c6 tempest-TokensV3TestJSON-2023218714 tempest-TokensV3TestJSON-2023218714-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:26.898885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:26.900081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:26.900369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:26.900646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] PATH_INFO: `/v3/users/0ca379cf6a3d4a0dbfb20cdc197bd9a0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:26.901928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca379cf6a3d4a0dbfb20cdc197bd9a0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:26.903873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:27.229358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca379cf6a3d4a0dbfb20cdc197bd9a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:27.245817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca379cf6a3d4a0dbfb20cdc197bd9a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:27.246628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca379cf6a3d4a0dbfb20cdc197bd9a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:27.296510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca379cf6a3d4a0dbfb20cdc197bd9a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:27.409534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca379cf6a3d4a0dbfb20cdc197bd9a0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:27.418315 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2709/5398] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:26 2022] DELETE /identity/v3/users/0ca379cf6a3d4a0dbfb20cdc197bd9a0 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:27.422540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:27.423202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:27.423202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:27.459768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:27.461231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:27.597412 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2690/5399] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:27.608908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:27.610455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:27.702826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a0e9-bd01-414e-828a-7cca71bc9cc4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:27.710748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:27.711393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:27.712021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:27.712237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:27.725720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:27.727726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:27.741653 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2710/5400] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:27.871031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:28.979984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:29.366690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:29.368205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:29.388855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac7363-e05e-4524-b338-0dbbfe9f3250 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:29.403786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:29.404635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:29.405067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:29.405492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] PATH_INFO: `/v3/projects/754eefb2935949bba7dab8c27cc57874` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:29.406874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754eefb2935949bba7dab8c27cc57874)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:29.409032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:29.480533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:29.577514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754eefb2935949bba7dab8c27cc57874', 'request_id': 'req-ae530290-8837-4750-a779-d2a176588264'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:29.594984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754eefb2935949bba7dab8c27cc57874', 'request_id': 'req-ae530290-8837-4750-a779-d2a176588264'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:29.688342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754eefb2935949bba7dab8c27cc57874', 'request_id': 'req-ae530290-8837-4750-a779-d2a176588264'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:29.716335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] The token cache is being invalidate because project 754eefb2935949bba7dab8c27cc57874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:29.717572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:29.717572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:29.718911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2691/5401] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:29 2022] DELETE /identity/v3/projects/754eefb2935949bba7dab8c27cc57874 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:29.723363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:29.749923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ea3da-15a3-45fe-b707-385b21d35fa6 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:29.880422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:29.881459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:29.885535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:29.885535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] PATH_INFO: `/v3/users/c283a82f90e34928b20e535bbb5b9ef9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:29.885535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c283a82f90e34928b20e535bbb5b9ef9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:29.885535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:30.235695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:30.238045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:30.251774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c283a82f90e34928b20e535bbb5b9ef9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.265667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c283a82f90e34928b20e535bbb5b9ef9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.267286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c283a82f90e34928b20e535bbb5b9ef9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.271282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae530290-8837-4750-a779-d2a176588264 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:30.286402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c283a82f90e34928b20e535bbb5b9ef9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.291747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:30.298889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:30.299175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:30.299457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] PATH_INFO: `/v3/users/16538eade00c4b9299f30e38be4dca4b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:30.305450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16538eade00c4b9299f30e38be4dca4b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:30.320791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:30.378923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ea543bb-31f8-42c1-bf5e-7c869a7ad446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c283a82f90e34928b20e535bbb5b9ef9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.390143 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2711/5402] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:29 2022] DELETE /identity/v3/users/c283a82f90e34928b20e535bbb5b9ef9 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:30.499959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:30.596103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16538eade00c4b9299f30e38be4dca4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.597598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16538eade00c4b9299f30e38be4dca4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.744790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16538eade00c4b9299f30e38be4dca4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.745529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16538eade00c4b9299f30e38be4dca4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.758038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16538eade00c4b9299f30e38be4dca4b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:30.806087 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2692/5403] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:30 2022] DELETE /identity/v3/users/16538eade00c4b9299f30e38be4dca4b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:45:30.808122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:30.808589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:30.808694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:30.847404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:30.848646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:30.983018 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2712/5404] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:31.096311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:31.097901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:31.207066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:31.251502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a2aa-e6d4-49a8-8c9e-eb748d098e94 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:31.256707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:31.257543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:31.258120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:31.258559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:31.278504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:31.280794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:31.299311 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2693/5405] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:31.328658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:31.888848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:32.102509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:32.105024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:32.128884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc474847-b5a8-4eec-a7f9-d808b8aaa0a7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:32.140834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:32.141559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:32.141844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:32.142171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] PATH_INFO: `/v3/projects/d8f89b9cc7534bca9674f355374fd2cc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:32.145992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f89b9cc7534bca9674f355374fd2cc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:32.148133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:32.261227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:32.322498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f89b9cc7534bca9674f355374fd2cc', 'request_id': 'req-6ed6d51e-2029-4ffd-b3af-b62269973dc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.332096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f89b9cc7534bca9674f355374fd2cc', 'request_id': 'req-6ed6d51e-2029-4ffd-b3af-b62269973dc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.503164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f89b9cc7534bca9674f355374fd2cc', 'request_id': 'req-6ed6d51e-2029-4ffd-b3af-b62269973dc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.523356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] The token cache is being invalidate because project d8f89b9cc7534bca9674f355374fd2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:32.524724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.527170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.530374 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2713/5406] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:32 2022] DELETE /identity/v3/projects/d8f89b9cc7534bca9674f355374fd2cc => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:32.534906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:32.549375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f5a96-1744-49e0-a30e-d5b0375b18c1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:32.635028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:32.636022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:32.636463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:32.636952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] PATH_INFO: `/v3/users/18e936015258418a8956c47c48fe38c9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:32.638625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e936015258418a8956c47c48fe38c9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:32.641561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:32.724538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:32.726398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:32.751779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d51e-2029-4ffd-b3af-b62269973dc7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:32.771493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:32.775579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:32.775873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:32.776274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] PATH_INFO: `/v3/projects/542982a27b444e0a9b994ad663b88b47` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:32.782799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] RBAC: Authorizing `identity:delete_project(project_id=542982a27b444e0a9b994ad663b88b47)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:32.782799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:32.942266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e936015258418a8956c47c48fe38c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.943279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e936015258418a8956c47c48fe38c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.984132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542982a27b444e0a9b994ad663b88b47', 'request_id': 'req-ce47a7e3-a525-448e-8462-cc3d25c4fead'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:32.997376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542982a27b444e0a9b994ad663b88b47', 'request_id': 'req-ce47a7e3-a525-448e-8462-cc3d25c4fead'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.040399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e936015258418a8956c47c48fe38c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.041789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:33.042794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e936015258418a8956c47c48fe38c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.056853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e936015258418a8956c47c48fe38c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.119366 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2694/5407] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:32 2022] DELETE /identity/v3/users/18e936015258418a8956c47c48fe38c9 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:33.131858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542982a27b444e0a9b994ad663b88b47', 'request_id': 'req-ce47a7e3-a525-448e-8462-cc3d25c4fead'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.149519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] The token cache is being invalidate because project 542982a27b444e0a9b994ad663b88b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:33.150581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.151464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.153545 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2714/5408] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:32 2022] DELETE /identity/v3/projects/542982a27b444e0a9b994ad663b88b47 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:33.158227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:33.160947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:33.275510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c4abd-40fe-4ea2-9212-93819d7c127d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:33.287789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:33.290519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:33.290802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:33.292356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] PATH_INFO: `/v3/users/49c3bcaa2c92428bbf179ad437b7eb74` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:33.294443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c3bcaa2c92428bbf179ad437b7eb74)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:33.300758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:33.471293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:33.586668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c3bcaa2c92428bbf179ad437b7eb74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.587659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c3bcaa2c92428bbf179ad437b7eb74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.654825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c3bcaa2c92428bbf179ad437b7eb74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.656269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c3bcaa2c92428bbf179ad437b7eb74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.668517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ca62ea6c-e0a6-42dc-8988-6977f4c08ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c3bcaa2c92428bbf179ad437b7eb74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:33.745906 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2695/5409] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:33 2022] DELETE /identity/v3/users/49c3bcaa2c92428bbf179ad437b7eb74 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:34.408275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:34.474897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:34.977614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:34.979145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:35.173953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47a7e3-a525-448e-8462-cc3d25c4fead admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:35.423397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:35.424834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:35.425129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:35.425407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] PATH_INFO: `/v3/projects/252ec0f53f234aacaf1b4b8a14b4ae22` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:35.427126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=252ec0f53f234aacaf1b4b8a14b4ae22)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:35.477452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:35.479877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:35.579469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:35.762028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252ec0f53f234aacaf1b4b8a14b4ae22', 'request_id': 'req-daa89fe5-5dfb-4148-8511-9885664d06ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:35.771439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252ec0f53f234aacaf1b4b8a14b4ae22', 'request_id': 'req-daa89fe5-5dfb-4148-8511-9885664d06ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:35.881921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252ec0f53f234aacaf1b4b8a14b4ae22', 'request_id': 'req-daa89fe5-5dfb-4148-8511-9885664d06ca'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:35.903328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] The token cache is being invalidate because project 252ec0f53f234aacaf1b4b8a14b4ae22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:35.903551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:35.904297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:35.906433 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2715/5410] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:34 2022] DELETE /identity/v3/projects/252ec0f53f234aacaf1b4b8a14b4ae22 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:35.913732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad88f4-a0dd-4838-9315-03358c82acb6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:35.914809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad88f4-a0dd-4838-9315-03358c82acb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:35.916134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad88f4-a0dd-4838-9315-03358c82acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:35.932194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:35.933783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:36.009452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e5ad88f4-a0dd-4838-9315-03358c82acb6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:36.013512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e5ad88f4-a0dd-4838-9315-03358c82acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:36.113488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89fe5-5dfb-4148-8511-9885664d06ca admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:36.134644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:36.135103 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2696/5411] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:36.139720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:36.139720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:36.139720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] PATH_INFO: `/v3/projects/13e5f13f907d460f98600d1eada31367` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:36.139720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e5f13f907d460f98600d1eada31367)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:36.139720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:36.144090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc006-1a9e-417f-9c96-73277ea9ee97 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:36.144610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc006-1a9e-417f-9c96-73277ea9ee97 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:36.145036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc006-1a9e-417f-9c96-73277ea9ee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:36.198208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3ffbc006-1a9e-417f-9c96-73277ea9ee97 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:36.199514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3ffbc006-1a9e-417f-9c96-73277ea9ee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:36.226544 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2697/5412] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:36.230229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbc006-1a9e-417f-9c96-73277ea9ee97 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:36.283623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbc006-1a9e-417f-9c96-73277ea9ee97 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:36.326675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:36.327923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:36.328546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:36.328693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:36.332438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:36.333584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:36.343596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:36.387262 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2698/5413] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:36.392222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:36.394087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e5f13f907d460f98600d1eada31367', 'request_id': 'req-3b8d1758-2b92-4385-9ce3-2be6d269da12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:36.416261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a261d-2e11-4106-80d7-3c2a62f1e859 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:36.427096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e5f13f907d460f98600d1eada31367', 'request_id': 'req-3b8d1758-2b92-4385-9ce3-2be6d269da12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:36.533403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e5f13f907d460f98600d1eada31367', 'request_id': 'req-3b8d1758-2b92-4385-9ce3-2be6d269da12'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:36.560227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] The token cache is being invalidate because project 13e5f13f907d460f98600d1eada31367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:36.560227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:36.562435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:36.579240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2716/5414] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:35 2022] DELETE /identity/v3/projects/13e5f13f907d460f98600d1eada31367 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:36.584315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:36.591138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:36.626429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:36.627077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:36.627424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:36.632855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:36.632855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:36.636017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:36.744863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:36.789155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d1758-2b92-4385-9ce3-2be6d269da12 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:36.796596 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2699/5415] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:36 2022] POST /identity/v3/projects => generated 371 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:36.799760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:36.800622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:36.801185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:36.802344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] PATH_INFO: `/v3/users/87d8c9ea553246e6b65399e452133156` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:36.811959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:36.812122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d8c9ea553246e6b65399e452133156)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:36.812122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:36.812281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:36.981684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d545ca-9a5c-4056-843e-8ac2ca694aa3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:36.987757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:36.988502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:36.988787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:36.989097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:36.989750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:36.991811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:37.096230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d8c9ea553246e6b65399e452133156'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:37.127040 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2700/5416] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:36 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:37.136629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:37.140519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d8c9ea553246e6b65399e452133156'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:37.142978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d8c9ea553246e6b65399e452133156'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:37.157067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:37.186568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5260058-3842-4b54-b937-98520cbdc07c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:37.204383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d8c9ea553246e6b65399e452133156'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:37.213141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:37.213991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:37.214342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:37.214660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:37.215406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:37.220075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:37.241740 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2701/5417] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:37.246399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:37.251399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:37.306951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee1cb-13ea-4895-a137-ac769cb1e51b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:37.309525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d8c9ea553246e6b65399e452133156'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:37.336070 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2717/5418] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:36 2022] DELETE /identity/v3/users/87d8c9ea553246e6b65399e452133156 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:45:37.338473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005e6a0-91d4-4cd6-8d16-ec124c6d9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:37.339167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005e6a0-91d4-4cd6-8d16-ec124c6d9476 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:37.339923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005e6a0-91d4-4cd6-8d16-ec124c6d9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:37.339923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005e6a0-91d4-4cd6-8d16-ec124c6d9476 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:37.340408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005e6a0-91d4-4cd6-8d16-ec124c6d9476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:37.342085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005e6a0-91d4-4cd6-8d16-ec124c6d9476 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:37.381850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:37.382543 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2702/5419] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:37.551148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e4767-5f34-43fd-ad2f-fe751db91536 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:37.566287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:37.566549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:37.568437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:37.568758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] PATH_INFO: `/v3/projects/7bfc217caa114860999c207df15e977e/users/37b691a1e9034dd08821c0e627062673/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:37.624481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfc217caa114860999c207df15e977e, user_id=37b691a1e9034dd08821c0e627062673, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:37.640975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:37.729860 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2718/5420] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:37 2022] PUT /identity/v3/projects/7bfc217caa114860999c207df15e977e/users/37b691a1e9034dd08821c0e627062673/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:37.746915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822590-4887-4efa-a36f-cf40b64468ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:37.747770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822590-4887-4efa-a36f-cf40b64468ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:37.747770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822590-4887-4efa-a36f-cf40b64468ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:37.844063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-17822590-4887-4efa-a36f-cf40b64468ee None None] MFA Rules not processed for user `37b691a1e9034dd08821c0e627062673`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:37.849223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17822590-4887-4efa-a36f-cf40b64468ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:38.070658 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2703/5421] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:38.072698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:38.084905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d5fbd-1046-48e3-a7a4-3ddb5b25b5f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:38.089447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:38.089965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:38.094886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:38.095258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:38.096410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:create_application_credential(user_id=37b691a1e9034dd08821c0e627062673)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:38.097842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:38.305134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:38.453936 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2719/5422] 10.222.0.27 () {60 vars in 1315 bytes} [Tue Oct 18 13:45:38 2022] POST /identity/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials => generated 921 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:38.460287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822590-4887-4efa-a36f-cf40b64468ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:38.497487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822590-4887-4efa-a36f-cf40b64468ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:38.505341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:38.506030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:38.506884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:38.506884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/access_rules/8f835a6c06374fd387975e45f11bcd52` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:38.507876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:delete_access_rule(user_id=37b691a1e9034dd08821c0e627062673, access_rule_id=8f835a6c06374fd387975e45f11bcd52)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:38.509676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:38.561896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.delete(ref) Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:45:38.591587 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:45:38.593220 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._synchronize( Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise AssertionError( Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 18 13:45:38.594240 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:38.595293 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:38.597572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 18 13:45:38.597572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 18 13:45:38.597572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 18 13:45:38.597572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 18 13:45:38.597572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 18 13:45:38.597572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:38.597572 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2704/5423] 10.222.0.27 () {58 vars in 1362 bytes} [Tue Oct 18 13:45:38 2022] DELETE /identity/v3/users/37b691a1e9034dd08821c0e627062673/access_rules/8f835a6c06374fd387975e45f11bcd52 => generated 89 bytes in 136 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:45:38.599262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:38.614920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce34c2-ee56-4cf8-b2fa-a18361c36ddb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:38.627524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:38.628258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:38.628544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:38.628824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials/069b6f3470ee416ea19275c587626101` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:38.680356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:delete_application_credential(user_id=37b691a1e9034dd08821c0e627062673, application_credential_id=069b6f3470ee416ea19275c587626101)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:38.681874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:38.867939 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2720/5424] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:38 2022] DELETE /identity/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials/069b6f3470ee416ea19275c587626101 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:38.873079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:38.891823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d70af4-5787-4232-98a5-2a7b48a01277 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:38.903953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:38.904708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:38.905158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:38.905441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/access_rules` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:38.907275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:list_access_rules(user_id=37b691a1e9034dd08821c0e627062673)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:38.909015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:38.917755 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2705/5425] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:45:38 2022] GET /identity/v3/users/37b691a1e9034dd08821c0e627062673/access_rules => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:38.922431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:38.943548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a5106-4762-48e0-9006-6ed6a6e49101 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:38.955424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:38.956496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:38.956799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:38.957086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/access_rules/8f835a6c06374fd387975e45f11bcd52` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:38.958545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:delete_access_rule(user_id=37b691a1e9034dd08821c0e627062673, access_rule_id=8f835a6c06374fd387975e45f11bcd52)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:38.964975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:39.060591 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2721/5426] 10.222.0.27 () {58 vars in 1362 bytes} [Tue Oct 18 13:45:38 2022] DELETE /identity/v3/users/37b691a1e9034dd08821c0e627062673/access_rules/8f835a6c06374fd387975e45f11bcd52 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:39.068273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:39.082813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09c54-4b6d-4b90-8383-22c487cb347b tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:39.107259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:39.108501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:39.109016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:39.109716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/access_rules` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:39.111586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:list_access_rules(user_id=37b691a1e9034dd08821c0e627062673)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:39.113862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:39.121121 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2706/5427] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:45:39 2022] GET /identity/v3/users/37b691a1e9034dd08821c0e627062673/access_rules => generated 158 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:39.129037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:39.150442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c24a2-2359-4879-b796-87bcb273103c tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:39.162871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:39.166175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:39.166519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:39.166883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:39.167588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:create_application_credential(user_id=37b691a1e9034dd08821c0e627062673)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:39.168837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:39.442672 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2722/5428] 10.222.0.27 () {60 vars in 1315 bytes} [Tue Oct 18 13:45:39 2022] POST /identity/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials => generated 920 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:39.446449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:39.457665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a8a49-8497-430a-8862-e91869b0e961 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:39.468475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:39.469707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:39.470179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:39.470638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/access_rules` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:39.472736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:list_access_rules(user_id=37b691a1e9034dd08821c0e627062673)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:39.474485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:39.486678 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2707/5429] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 13:45:39 2022] GET /identity/v3/users/37b691a1e9034dd08821c0e627062673/access_rules => generated 369 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:39.493086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:39.520511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3e621-0460-477a-9d81-552e95170025 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:39.527795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:39.528479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:39.528958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:39.529297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:39.530109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:create_application_credential(user_id=37b691a1e9034dd08821c0e627062673)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:39.532094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:39.656001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:39.658301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:39.797162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9cc4-46d8-4814-91b3-6f136c862cbb tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:39.816557 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2723/5430] 10.222.0.27 () {60 vars in 1315 bytes} [Tue Oct 18 13:45:39 2022] POST /identity/v3/users/37b691a1e9034dd08821c0e627062673/application_credentials => generated 921 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:39.816557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:39.818281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:39.818281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:39.818281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:39.818281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] PATH_INFO: `/v3/projects/2198f7e9b0ca48bd9caa40b584186b00` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:39.819059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2198f7e9b0ca48bd9caa40b584186b00)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:39.819059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:39.820920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6c089-688f-47f2-9b3b-492c7302f3c1 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:39.831452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37b691a1e9034dd08821c0e627062673', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfc217caa114860999c207df15e977e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:39.832291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:39.832814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:39.833187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673/access_rules/49d9b20f95bf4a51846d73b6ac2f12a9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:39.834701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorizing `identity:get_access_rule(user_id=37b691a1e9034dd08821c0e627062673, access_rule_id=49d9b20f95bf4a51846d73b6ac2f12a9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:39.836590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:39.857871 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2724/5431] 10.222.0.27 () {58 vars in 1359 bytes} [Tue Oct 18 13:45:39 2022] GET /identity/v3/users/37b691a1e9034dd08821c0e627062673/access_rules/49d9b20f95bf4a51846d73b6ac2f12a9 => generated 229 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:39.859777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:39.880749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245eb21-872c-4d08-95ea-8b49af320b26 tempest-AccessRulesV3Test-1653059315 tempest-AccessRulesV3Test-1653059315-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:39.890040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:39.891175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:39.891823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:39.892163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] PATH_INFO: `/v3/users/37b691a1e9034dd08821c0e627062673` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:39.895019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b691a1e9034dd08821c0e627062673)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:39.898393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:40.185958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2198f7e9b0ca48bd9caa40b584186b00', 'request_id': 'req-ef79b6a1-e456-46f9-b305-dc05fe617479'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.203287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2198f7e9b0ca48bd9caa40b584186b00', 'request_id': 'req-ef79b6a1-e456-46f9-b305-dc05fe617479'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.263476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:40.358185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2198f7e9b0ca48bd9caa40b584186b00', 'request_id': 'req-ef79b6a1-e456-46f9-b305-dc05fe617479'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.433912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] The token cache is being invalidate because project 2198f7e9b0ca48bd9caa40b584186b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:40.434236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.437474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b691a1e9034dd08821c0e627062673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.438072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef79b6a1-e456-46f9-b305-dc05fe617479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.444613 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2708/5432] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:39 2022] DELETE /identity/v3/projects/2198f7e9b0ca48bd9caa40b584186b00 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:45:40.459528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a699-940e-4733-be59-95e5ac11a2c1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:40.460144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a699-940e-4733-be59-95e5ac11a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:40.460589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a699-940e-4733-be59-95e5ac11a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:40.464270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b691a1e9034dd08821c0e627062673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.465051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b691a1e9034dd08821c0e627062673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.529555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:40.529555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aa44a699-940e-4733-be59-95e5ac11a2c1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:40.531986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa44a699-940e-4733-be59-95e5ac11a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:40.765455 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2709/5433] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:40.772878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0349e-e29f-448d-be09-cb8bdf05c57f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:40.773166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0349e-e29f-448d-be09-cb8bdf05c57f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:40.773443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0349e-e29f-448d-be09-cb8bdf05c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:40.794548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b691a1e9034dd08821c0e627062673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.867253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fdd0349e-e29f-448d-be09-cb8bdf05c57f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:40.869630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdd0349e-e29f-448d-be09-cb8bdf05c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:40.883520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cb13f61f-937d-4631-b873-95e2429e7b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b691a1e9034dd08821c0e627062673'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:40.891741 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2725/5434] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:39 2022] DELETE /identity/v3/users/37b691a1e9034dd08821c0e627062673 => generated 0 bytes in 1032 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:40.896007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76e24-5943-4b57-896e-6920d03db9d3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:40.896301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76e24-5943-4b57-896e-6920d03db9d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:40.896590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76e24-5943-4b57-896e-6920d03db9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:40.923808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2710/5435] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:40.932898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fcc76e24-5943-4b57-896e-6920d03db9d3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:40.932898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcc76e24-5943-4b57-896e-6920d03db9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:40.933139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0349e-e29f-448d-be09-cb8bdf05c57f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:40.953668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0349e-e29f-448d-be09-cb8bdf05c57f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:41.091644 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2726/5436] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:41.111901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:41.112935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:41.113259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:41.113544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:41.115774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:41.116113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:41.117816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:41.133260 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2711/5437] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:41.138012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76e24-5943-4b57-896e-6920d03db9d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:41.175049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76e24-5943-4b57-896e-6920d03db9d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:41.212063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:41.215805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:41.215805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:41.215805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:41.215805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:41.216268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:41.278839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:41.280858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:41.412911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2727/5438] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:41 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:41.414146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:41.476712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:41.510993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ae80-29db-47f0-9c4b-f842311d7346 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:41.673845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a10a57-e044-4eb9-882e-68ef6002deff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:41.691867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:41.693596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:41.694301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:41.694804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:41.695731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:41.702397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:41.881288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2728/5439] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:41 2022] POST /identity/v3/users => generated 293 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:41.891408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:41.933417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3952e-604e-4d1c-b809-9e9875c433cb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:41.944771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:41.945666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:41.946019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:41.946615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:41.947673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:41.951400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:42.026579 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2729/5440] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:42.042390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:42.060765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac9569-87c7-4ff4-a29f-75ab7bcddbd6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:42.068188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:42.068915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:42.069206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:42.069441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:42.070200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:42.072245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:42.091198 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2730/5441] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:42.095331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:42.121601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcf3ce-048d-4721-9d04-c5f49299075a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:42.128736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603b21-3920-47d3-a2a0-428da88b3c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:42.129479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603b21-3920-47d3-a2a0-428da88b3c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:42.129766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603b21-3920-47d3-a2a0-428da88b3c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:42.130042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603b21-3920-47d3-a2a0-428da88b3c53 admin admin] PATH_INFO: `/v3/projects/c44d6e26637a40c1b0189bb8272f6955/users/7d21b7b5df224e92880219c38ad2fc47/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:42.132216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69202b-8ac5-45da-a6a8-2a51fbfc940f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:42.133179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69202b-8ac5-45da-a6a8-2a51fbfc940f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:42.133912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69202b-8ac5-45da-a6a8-2a51fbfc940f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:42.134453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69202b-8ac5-45da-a6a8-2a51fbfc940f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:42.152297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69202b-8ac5-45da-a6a8-2a51fbfc940f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:42.154798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69202b-8ac5-45da-a6a8-2a51fbfc940f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:42.174622 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2712/5442] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 896 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:45:42.181667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75603b21-3920-47d3-a2a0-428da88b3c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44d6e26637a40c1b0189bb8272f6955, user_id=7d21b7b5df224e92880219c38ad2fc47, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:42.186322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75603b21-3920-47d3-a2a0-428da88b3c53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:42.289878 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2731/5443] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:42 2022] PUT /identity/v3/projects/c44d6e26637a40c1b0189bb8272f6955/users/7d21b7b5df224e92880219c38ad2fc47/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:42.300674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22845534-b74e-4153-97b4-676d723029c9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:42.301686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22845534-b74e-4153-97b4-676d723029c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:42.301686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22845534-b74e-4153-97b4-676d723029c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:42.330483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:42.330483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:42.331480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:42.370314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-22845534-b74e-4153-97b4-676d723029c9 None None] MFA Rules not processed for user `7d21b7b5df224e92880219c38ad2fc47`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:42.374476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22845534-b74e-4153-97b4-676d723029c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:42.420784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] MFA Rules not processed for user `9db4fb751a8a47139dede519c8b7481c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:42.427733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:42.477009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:42.634423 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2713/5444] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:42.635490 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2732/5445] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:42.642264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22845534-b74e-4153-97b4-676d723029c9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:42.648028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:42.650181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:42.868643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:42.885461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22845534-b74e-4153-97b4-676d723029c9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:42.895115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506309a1-feeb-431b-9f34-3c9e2f23b891 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:42.906340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd1939-b347-4579-8ce2-66c7a4be364b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:42.907050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd1939-b347-4579-8ce2-66c7a4be364b service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:42.907339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd1939-b347-4579-8ce2-66c7a4be364b service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:42.907577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:42.919865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:42.920226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:42.920474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:42.921172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:42.921649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd1939-b347-4579-8ce2-66c7a4be364b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:42.929515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48dd1939-b347-4579-8ce2-66c7a4be364b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:42.935801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:43.089041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2714/5446] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:42 2022] POST /identity/v3/projects => generated 383 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:43.089302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd1939-b347-4579-8ce2-66c7a4be364b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:43.090374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:43.092176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd1939-b347-4579-8ce2-66c7a4be364b service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:43.121473 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2733/5447] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:43.156169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:43.288992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d836e42-6ed4-45a3-8ba0-8ce061432407 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:43.294846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:43.295790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:43.296443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:43.296969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:43.297846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:43.301594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:43.385596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:43.385884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:43.386217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:43.455343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] MFA Rules not processed for user `1403c0b2a05241aaa2eb56c217e00eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:43.456979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:43.519937 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2715/5448] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:43 2022] POST /identity/v3/users => generated 292 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:43.523172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:43.551024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31943581-f6d8-4dd9-807f-5e352b737051 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:43.594695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:43.595533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:43.595818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:43.596187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:43.597349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:43.601468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:43.632654 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2716/5449] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:43.634289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:43.653575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb8b84-adc2-43a5-86a9-a46ff329bf0a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:43.657897 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2734/5450] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:43.667136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:43.667977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:43.668467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:43.669400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:43.671574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:43.675466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:43.675627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:43.679893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:43.715169 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2717/5451] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:43.718293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:43.743615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec8d65-ac58-4bc2-97ea-b578ae01276d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:43.755267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:43.756900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:43.757665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:43.758989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] PATH_INFO: `/v3/projects/dd58d0871394465187f849467897eabc/users/95950e573df041df878af85d8bb75dcc/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:43.797067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd58d0871394465187f849467897eabc, user_id=95950e573df041df878af85d8bb75dcc, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:43.806251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:43.879155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6e529-23f7-478c-bba6-db57dd40672a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:43.896367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04832b6f-1461-40b1-a640-cb63b6debdba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:43.897078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832b6f-1461-40b1-a640-cb63b6debdba service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:43.897360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832b6f-1461-40b1-a640-cb63b6debdba service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:43.897740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832b6f-1461-40b1-a640-cb63b6debdba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:43.913674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04832b6f-1461-40b1-a640-cb63b6debdba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:43.918596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04832b6f-1461-40b1-a640-cb63b6debdba service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:43.943229 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2735/5452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:44.002214 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2718/5453] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:43 2022] PUT /identity/v3/projects/dd58d0871394465187f849467897eabc/users/95950e573df041df878af85d8bb75dcc/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:44.012983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75216a6-fd43-4bae-849d-c71f8d2dae4c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:44.012983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75216a6-fd43-4bae-849d-c71f8d2dae4c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:44.013444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75216a6-fd43-4bae-849d-c71f8d2dae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:44.148051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b75216a6-fd43-4bae-849d-c71f8d2dae4c None None] MFA Rules not processed for user `95950e573df041df878af85d8bb75dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:44.152166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b75216a6-fd43-4bae-849d-c71f8d2dae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:44.430786 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2736/5454] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:44.440528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:44.593254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e1ee-b40b-48d0-834a-bd6657056a42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:44.596051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:44.607321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:44.608430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:44.609837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:44.610159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:44.611119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:44.618478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:44.793626 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2719/5455] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:44 2022] POST /identity/v3/projects => generated 385 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:44.795154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75216a6-fd43-4bae-849d-c71f8d2dae4c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:44.813814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75216a6-fd43-4bae-849d-c71f8d2dae4c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:44.952020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:44.953016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:44.953417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:44.955332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:44.956636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:44.960560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:45.107591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:45.121332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:45.128203 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2737/5456] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:44 2022] POST /identity/v3/users => generated 299 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:45.150855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2489c-87a8-4854-8220-859cc72ef3e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:45.166037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:45.167449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:45.168127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:45.168768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:45.169660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:45.171594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:45.186839 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2720/5457] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:45.191179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:45.212058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86d25d-9f72-47a6-8299-cbe33474f050 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:45.230779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:45.232203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:45.232333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:45.232979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:45.234750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] PATH_INFO: `/v3/projects/38b5c19328dc49e38824cf6e5bd155b9/users/3ed6990576b44d43b5812a28d97b66ec/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:45.241030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:45.274881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b5c19328dc49e38824cf6e5bd155b9, user_id=3ed6990576b44d43b5812a28d97b66ec, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:45.280115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:45.325259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b134-e0aa-4863-9cbb-c4485dfd7d1a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:45.342989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:45.347317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:45.348051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:45.348656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] PATH_INFO: `/v3/projects/7bfc217caa114860999c207df15e977e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:45.351519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfc217caa114860999c207df15e977e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:45.365289 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2738/5458] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:45 2022] PUT /identity/v3/projects/38b5c19328dc49e38824cf6e5bd155b9/users/3ed6990576b44d43b5812a28d97b66ec/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:45.370876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:45.376835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:45.533565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358e675-4e5a-4b56-888b-3e88145d24f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:45.574807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfc217caa114860999c207df15e977e', 'request_id': 'req-0801729d-bad2-4416-aac9-734111f201e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:45.645011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfc217caa114860999c207df15e977e', 'request_id': 'req-0801729d-bad2-4416-aac9-734111f201e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:45.677530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:45.678383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:45.678775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:45.679148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:45.680015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:45.684217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:45.728039 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2739/5459] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:45.729423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:45.742378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfc217caa114860999c207df15e977e', 'request_id': 'req-0801729d-bad2-4416-aac9-734111f201e0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:45.770720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364ac14-fbf3-4383-b538-f1d62d31e8e7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:45.788542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab8083-1180-4dc5-9400-9fb3818d5b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:45.794671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab8083-1180-4dc5-9400-9fb3818d5b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:45.794671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab8083-1180-4dc5-9400-9fb3818d5b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:45.794671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab8083-1180-4dc5-9400-9fb3818d5b71 admin admin] PATH_INFO: `/v3/projects/38b5c19328dc49e38824cf6e5bd155b9/users/3ed6990576b44d43b5812a28d97b66ec/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:45.795038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] The token cache is being invalidate because project 7bfc217caa114860999c207df15e977e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:45.795038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:45.801860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0801729d-bad2-4416-aac9-734111f201e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:45.805525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab8083-1180-4dc5-9400-9fb3818d5b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b5c19328dc49e38824cf6e5bd155b9, user_id=3ed6990576b44d43b5812a28d97b66ec, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:45.809314 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2721/5460] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:45 2022] DELETE /identity/v3/projects/7bfc217caa114860999c207df15e977e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:45.816780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42943d-06f8-4923-b54a-07295c25474b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:45.820724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42943d-06f8-4923-b54a-07295c25474b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:45.821239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42943d-06f8-4923-b54a-07295c25474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:45.824647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab8083-1180-4dc5-9400-9fb3818d5b71 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:45.870092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2740/5461] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:45 2022] PUT /identity/v3/projects/38b5c19328dc49e38824cf6e5bd155b9/users/3ed6990576b44d43b5812a28d97b66ec/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:45.891696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:45.892697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:45.894017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:45.909968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3e42943d-06f8-4923-b54a-07295c25474b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:45.924411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3e42943d-06f8-4923-b54a-07295c25474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:46.039175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] MFA Rules not processed for user `3ed6990576b44d43b5812a28d97b66ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:46.040396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:46.146022 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2722/5462] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:46.148074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9750417-887e-4f01-97f4-a36f94bdd8b2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:46.148806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9750417-887e-4f01-97f4-a36f94bdd8b2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:46.149569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9750417-887e-4f01-97f4-a36f94bdd8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:46.186594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9750417-887e-4f01-97f4-a36f94bdd8b2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:46.193832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9750417-887e-4f01-97f4-a36f94bdd8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:46.223882 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2723/5463] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:46.228293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9750417-887e-4f01-97f4-a36f94bdd8b2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:46.251035 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2741/5464] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:45:46.259926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9750417-887e-4f01-97f4-a36f94bdd8b2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:46.264062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:46.268483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:46.278045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:46.278712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:46.278989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:46.279268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:46.279945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:46.280232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:46.281875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:46.330185 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2724/5465] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:46.331226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:46.360492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cabcb-50bd-4414-a656-14494518a985 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:46.373164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:46.373798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:46.375428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:46.375742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:46.376432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:46.385159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:46.445591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc61b01-23ac-48dd-9aae-edca309a298b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:46.465250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:46.466415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:46.466415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:46.466415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:46.474013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:46.563872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2725/5466] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:46 2022] POST /identity/v3/projects => generated 391 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:46.568992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:46.626556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:46.649201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:46.650793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:46.705143 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2742/5467] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:46.795530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b85449-161f-44da-8af4-ad9150835c52 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:46.812835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:46.813963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:46.817133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:46.817592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:46.818605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:46.825480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:46.848504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:47.015690 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2726/5468] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:46 2022] POST /identity/v3/users => generated 296 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:47.019087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:47.052023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406a13-d7bf-434c-bf0d-8c8a9df1ba5b service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:47.073724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:47.075829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:47.076187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:47.076548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:47.078019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:47.084965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:47.101042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:47.101835 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2743/5469] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:47.127218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1526b-c3ef-4ac2-abf2-70d6dff44a3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:47.141855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89dbe4-e5de-4154-832d-ae9c619ff52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:47.141855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dbe4-e5de-4154-832d-ae9c619ff52d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:47.141855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dbe4-e5de-4154-832d-ae9c619ff52d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:47.153045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dbe4-e5de-4154-832d-ae9c619ff52d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:47.153863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89dbe4-e5de-4154-832d-ae9c619ff52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:47.156373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89dbe4-e5de-4154-832d-ae9c619ff52d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:47.184682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2727/5470] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:45:47.186292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:47.225534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ddf6-ae44-455f-aff6-da7007ddfeaa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:47.250596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:47.252450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:47.252806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:47.253085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] PATH_INFO: `/v3/projects/9db9966b73454c259c209721a98a72a2/users/464dbc2a8f6547c6a90313b1d707aaaa/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:47.289599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db9966b73454c259c209721a98a72a2, user_id=464dbc2a8f6547c6a90313b1d707aaaa, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:47.294502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:47.398435 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2744/5471] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:47 2022] PUT /identity/v3/projects/9db9966b73454c259c209721a98a72a2/users/464dbc2a8f6547c6a90313b1d707aaaa/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:47.414453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28084b34-1062-4899-8a4d-78712305867d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:47.414772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28084b34-1062-4899-8a4d-78712305867d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:47.415086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28084b34-1062-4899-8a4d-78712305867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:47.536400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-28084b34-1062-4899-8a4d-78712305867d None None] MFA Rules not processed for user `464dbc2a8f6547c6a90313b1d707aaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:47.545613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-28084b34-1062-4899-8a4d-78712305867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:47.722351 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2728/5472] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:47.724114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:47.740345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47c83-ce7f-4a1f-8a14-19b1d4b8f8f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:47.749943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59023197-44c2-4cda-b921-425f38d698e0 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:47.751418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023197-44c2-4cda-b921-425f38d698e0 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:47.752089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023197-44c2-4cda-b921-425f38d698e0 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:47.753855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59023197-44c2-4cda-b921-425f38d698e0 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:47.755522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59023197-44c2-4cda-b921-425f38d698e0 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:create_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:47.758896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59023197-44c2-4cda-b921-425f38d698e0 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:48.091749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2745/5473] 10.222.0.27 () {60 vars in 1314 bytes} [Tue Oct 18 13:45:47 2022] POST /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 788 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:48.105290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28084b34-1062-4899-8a4d-78712305867d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:48.115042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28084b34-1062-4899-8a4d-78712305867d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:48.147025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:48.147025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:48.147025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:48.147682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/2e6210cf89db47c99b2d82fc5a10a4c5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:48.221615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:get_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=2e6210cf89db47c99b2d82fc5a10a4c5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:48.223501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:48.227739 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2729/5474] 10.222.0.27 () {58 vars in 1392 bytes} [Tue Oct 18 13:45:48 2022] GET /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/2e6210cf89db47c99b2d82fc5a10a4c5 => generated 688 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:48.232469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eb7e5-9753-4e4a-b7a7-6eea733925ed None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:48.232773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eb7e5-9753-4e4a-b7a7-6eea733925ed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:48.233106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eb7e5-9753-4e4a-b7a7-6eea733925ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:48.274599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-238eb7e5-9753-4e4a-b7a7-6eea733925ed None None] MFA Rules not processed for user `464dbc2a8f6547c6a90313b1d707aaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:48.275981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-238eb7e5-9753-4e4a-b7a7-6eea733925ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:48.518876 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2746/5475] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:48 2022] POST /identity/v3/auth/tokens => generated 3424 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 18 13:45:48.523186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:48.573337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f810b-4017-4bcb-930e-07b163036f68 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:48.587381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:48.591231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:48.591231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:48.591231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/2e6210cf89db47c99b2d82fc5a10a4c5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:48.591231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=2e6210cf89db47c99b2d82fc5a10a4c5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:48.592417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:48.783677 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2730/5476] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:48 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/2e6210cf89db47c99b2d82fc5a10a4c5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:45:48.789098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238eb7e5-9753-4e4a-b7a7-6eea733925ed None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:48.803489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238eb7e5-9753-4e4a-b7a7-6eea733925ed None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:48.819963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:48.822693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:48.823844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:48.824295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:48.824729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:48.828159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:create_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:48.832096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:49.104443 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2747/5477] 10.222.0.27 () {60 vars in 1315 bytes} [Tue Oct 18 13:45:48 2022] POST /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 920 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:49.105134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:49.116363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c6f5-9720-463d-8c44-f2470a988ab9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:49.163244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:49.166132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:49.179443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:49.180097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/b02823687a9842b78e8090660bd35203` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:49.223646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:49.230868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=b02823687a9842b78e8090660bd35203)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:49.233969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:49.391624 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2731/5478] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:49 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/b02823687a9842b78e8090660bd35203 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:49.397239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:49.416434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537753b-b061-47de-9db2-718c552c89c6 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:49.425768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:49.426471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:49.426759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:49.427039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:49.427707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:create_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:49.428886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:49.618945 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2748/5479] 10.222.0.27 () {60 vars in 1315 bytes} [Tue Oct 18 13:45:49 2022] POST /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 812 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:49.620081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:49.634988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b35b-dedb-4f0e-9dec-a86565c1c4af tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:49.648057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:49.648975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:49.649257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:49.651520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/ba65019a59a140c8b1030a34fdc0ae63` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:49.674010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=ba65019a59a140c8b1030a34fdc0ae63)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:49.679795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:49.800166 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2732/5480] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:49 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/ba65019a59a140c8b1030a34fdc0ae63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:49.805155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:49.818648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed2211-307a-43da-9d49-338d29c9ba6a tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:49.836772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:49.837607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:49.838000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:49.838421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:49.839188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:create_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:49.840493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:50.112567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2749/5481] 10.222.0.27 () {60 vars in 1314 bytes} [Tue Oct 18 13:45:49 2022] POST /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 789 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:50.117438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:50.142571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd54fe-9b84-4d9f-874f-3056fb4378e9 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:50.153719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:50.153719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:50.154848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:50.155241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:50.156053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:create_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:50.157840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:50.405617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:50.497876 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2733/5482] 10.222.0.27 () {60 vars in 1314 bytes} [Tue Oct 18 13:45:50 2022] POST /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 789 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:50.515749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:50.530847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9445bd3-5c44-47f8-8d2d-ea1190aef649 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:50.560049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:50.560736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:50.561025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:50.561296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:50.570716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:list_application_credentials(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:50.575992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:50.637255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:50.649247 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2750/5483] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 13:45:50 2022] GET /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 1502 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:50.653481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976f62f-0f71-4616-b252-01cc3a681d6e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:50.681678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:50.681678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:50.681678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:50.681954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/0f051b74522d40e2a848e3f106ff45fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:50.718779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=0f051b74522d40e2a848e3f106ff45fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:50.724880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:50.866720 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2734/5484] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:50 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/0f051b74522d40e2a848e3f106ff45fc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:50.874004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:50.901598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f36b4-20fd-4ce9-b046-57200cf24673 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:50.912245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:50.913252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:50.913730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:50.914258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/93638dd3652a42c89041361dceea3603` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:50.931983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:50.942761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=93638dd3652a42c89041361dceea3603)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:50.947539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:51.109452 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2751/5485] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:50 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/93638dd3652a42c89041361dceea3603 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:51.110886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:51.132686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e8556-0bd1-4727-a16c-7c91851babbc tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:51.147548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:51.149112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:51.151023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:51.151585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:51.154281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:create_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:51.162894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:51.553533 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2735/5486] 10.222.0.27 () {60 vars in 1314 bytes} [Tue Oct 18 13:45:51 2022] POST /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 788 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:51.559440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:51.593822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b5fb4-1151-4561-839b-0d6456026515 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:51.614554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:51.615438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:51.616098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:51.616570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:51.619229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:create_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:51.624479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:51.882911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2752/5487] 10.222.0.27 () {60 vars in 1314 bytes} [Tue Oct 18 13:45:51 2022] POST /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials => generated 788 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:51.887742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:51.893932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:51.904544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7f44-3a60-45de-9159-363059d99f67 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:51.925163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:51.926135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:51.926499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:51.926850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:51.929373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Adding query filter params (name=tempest-application_credential-149751160) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:51.930903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:list_application_credentials(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:51.932892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:51.980909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2736/5488] 10.222.0.27 () {58 vars in 1384 bytes} [Tue Oct 18 13:45:51 2022] GET /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials?name=tempest-application_credential-149751160 => generated 885 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:51.981534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:51.996500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:52.003925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6ecab-0fc8-4a68-84d4-1ee21a67bbb4 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:52.016652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:52.019503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:52.019996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:52.020546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/ae24fdcddda048fdaf1c4d690f82987d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:52.075239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=ae24fdcddda048fdaf1c4d690f82987d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:52.079284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:52.110919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:INSERT=8,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:52.146945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61ee79-47d2-44d8-b21f-18c8f1c4c42e tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:52.157536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:52.157536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:52.157536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:52.157536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:52.158374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:52.229530 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2753/5489] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:51 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/ae24fdcddda048fdaf1c4d690f82987d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:52.231525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:52.242978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565979-655c-453c-834e-29bf77a05262 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:52.248364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea34765-86d6-4375-b8e3-ec366b4527a7 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '464dbc2a8f6547c6a90313b1d707aaaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9db9966b73454c259c209721a98a72a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:52.249631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea34765-86d6-4375-b8e3-ec366b4527a7 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:52.250199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea34765-86d6-4375-b8e3-ec366b4527a7 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:52.250686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea34765-86d6-4375-b8e3-ec366b4527a7 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/772e70a8ee6f42009fa9a712af0ad2bb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:52.264177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea34765-86d6-4375-b8e3-ec366b4527a7 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorizing `identity:delete_application_credential(user_id=464dbc2a8f6547c6a90313b1d707aaaa, application_credential_id=772e70a8ee6f42009fa9a712af0ad2bb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:52.266965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea34765-86d6-4375-b8e3-ec366b4527a7 tempest-ApplicationCredentialsV3Test-863673604 tempest-ApplicationCredentialsV3Test-863673604-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:52.273227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:52.277364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:52.295161 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2737/5490] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:45:52.404531 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2754/5491] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:45:52 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa/application_credentials/772e70a8ee6f42009fa9a712af0ad2bb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:52.406211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:52.618430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927e304-3889-4c01-ba47-58a6ef9d43ab service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:52.630844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:52.631681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:52.633942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:52.634429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] PATH_INFO: `/v3/users/464dbc2a8f6547c6a90313b1d707aaaa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:52.635979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=464dbc2a8f6547c6a90313b1d707aaaa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:52.639010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:52.905818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464dbc2a8f6547c6a90313b1d707aaaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:52.907538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464dbc2a8f6547c6a90313b1d707aaaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:53.042778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464dbc2a8f6547c6a90313b1d707aaaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:53.044084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464dbc2a8f6547c6a90313b1d707aaaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:53.061333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464dbc2a8f6547c6a90313b1d707aaaa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:53.364204 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2738/5492] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:45:52 2022] DELETE /identity/v3/users/464dbc2a8f6547c6a90313b1d707aaaa => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:53.374140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e35914-7a26-481b-aca7-bdf0d0862f58 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:53.374675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e35914-7a26-481b-aca7-bdf0d0862f58 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:53.375940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e35914-7a26-481b-aca7-bdf0d0862f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:53.411928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-74e35914-7a26-481b-aca7-bdf0d0862f58 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:53.413566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-74e35914-7a26-481b-aca7-bdf0d0862f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:53.626743 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2755/5493] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:53.777304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:53.782412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:54.001259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6791fb-1aa3-45ed-8e4b-fd41a0e6ef78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:54.014554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:54.023052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:54.024607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:54.025488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:54.095693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:54.099889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:54.136489 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2739/5494] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:54.189697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:54.352351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:54.815260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:54.819969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:54.819969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:55.142645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:55.145664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:55.180937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:55.187438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:55.410387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e94bb9-3df8-4d57-a4d1-dbfdaaf0f5c2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:55.422204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:55.422814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:55.426288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2756/5495] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:45:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:55.437624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:55.440681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:55.471224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:55.615166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:55.616887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:55.639400 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2740/5496] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:45:55.695906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:55.700367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:55.983739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c556224-e4be-4f53-ab59-f557acd0dcfd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:55.998979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:55.999753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:56.000277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:56.000768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:56.017490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:56.019431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:56.042432 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2757/5497] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:45:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:56.190773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:56.193201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:56.406604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c63957-5a7d-425a-a071-ec232683e4cd service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:56.425881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95890db-ed61-4328-ae8d-87ff3018e28f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:56.426526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95890db-ed61-4328-ae8d-87ff3018e28f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:56.427088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95890db-ed61-4328-ae8d-87ff3018e28f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:56.427367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95890db-ed61-4328-ae8d-87ff3018e28f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:56.437793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d95890db-ed61-4328-ae8d-87ff3018e28f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:56.500904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95890db-ed61-4328-ae8d-87ff3018e28f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:56.502967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95890db-ed61-4328-ae8d-87ff3018e28f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:56.534611 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2741/5498] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:45:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:45:56.551757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:56.773589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:56.836071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:56.836071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:56.855677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5b33-19f6-4e1f-9051-32d66a82c1e3 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:56.864095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:56.864994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:56.865484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:56.865921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] PATH_INFO: `/v3/projects/9db9966b73454c259c209721a98a72a2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:56.870852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db9966b73454c259c209721a98a72a2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:56.873252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:57.118279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db9966b73454c259c209721a98a72a2', 'request_id': 'req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:57.151045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db9966b73454c259c209721a98a72a2', 'request_id': 'req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:57.270176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db9966b73454c259c209721a98a72a2', 'request_id': 'req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:57.296556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] The token cache is being invalidate because project 9db9966b73454c259c209721a98a72a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:45:57.297093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:57.302379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dde5e31-41d7-47c1-9d1a-dc77042d19c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:45:57.304516 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2758/5499] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:45:56 2022] DELETE /identity/v3/projects/9db9966b73454c259c209721a98a72a2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:57.309227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543aadb-13f7-4f0b-bff7-e3a7b787c9cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:57.309730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543aadb-13f7-4f0b-bff7-e3a7b787c9cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:57.313826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543aadb-13f7-4f0b-bff7-e3a7b787c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:57.400896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6543aadb-13f7-4f0b-bff7-e3a7b787c9cb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:57.403212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6543aadb-13f7-4f0b-bff7-e3a7b787c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:57.550483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:57.588326 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2742/5500] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:57.597243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a2e46-78b1-498e-83d0-bcf23eda7be9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:57.597727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a2e46-78b1-498e-83d0-bcf23eda7be9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:57.598270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a2e46-78b1-498e-83d0-bcf23eda7be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:57.616711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:57.663450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-243a2e46-78b1-498e-83d0-bcf23eda7be9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:57.665010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-243a2e46-78b1-498e-83d0-bcf23eda7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:57.703828 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2759/5501] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:57.709127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543aadb-13f7-4f0b-bff7-e3a7b787c9cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:57.729344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543aadb-13f7-4f0b-bff7-e3a7b787c9cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:57.742480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:57.745245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:57.745658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:57.746306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:57.748234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:45:57.748614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:57.750938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:57.785185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:57.790966 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2743/5502] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:45:57.795177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a2e46-78b1-498e-83d0-bcf23eda7be9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:57.806917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a2e46-78b1-498e-83d0-bcf23eda7be9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:57.836084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:57.836084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:57.836084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:57.836084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:57.836495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:57.848486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:58.014607 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2760/5503] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:45:57 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:58.022874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:58.037929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f678-0510-4721-bf70-a6f191d7d608 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:58.156622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:58.173785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:58.176030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:58.176319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:58.176590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:58.183462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:58.185643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:58.280753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:58.317756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2744/5504] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:45:58 2022] POST /identity/v3/users => generated 281 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:45:58.327280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:58.357283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921708b5-a3db-4792-b79b-b32809d67ae1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:58.385789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:58.385789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:58.385789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:58.385789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:58.386364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:58.386364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:58.458647 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2761/5505] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:58.466301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:58.481013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e15f9-60f7-4a44-be92-6d5d4c2d5bc0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:58.494893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353349fa-ab5a-435f-9517-cf6e2c67af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:58.495926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353349fa-ab5a-435f-9517-cf6e2c67af66 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:58.496453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353349fa-ab5a-435f-9517-cf6e2c67af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:58.496942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353349fa-ab5a-435f-9517-cf6e2c67af66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:58.499366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353349fa-ab5a-435f-9517-cf6e2c67af66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:58.501284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353349fa-ab5a-435f-9517-cf6e2c67af66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:58.531494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:58.532328 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2745/5506] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:45:58.544328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c3a6e-f2b8-4e5a-a1b5-9ed22a53c61f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:58.552527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bba86-7007-4a87-8120-d35f4e8f3dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:58.554038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bba86-7007-4a87-8120-d35f4e8f3dce admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:58.555099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bba86-7007-4a87-8120-d35f4e8f3dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:58.555957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bba86-7007-4a87-8120-d35f4e8f3dce admin admin] PATH_INFO: `/v3/projects/e267c5bce6164090b4ea149c8115a207/users/835185a0fc164c1892d98120b4854fcd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:58.617469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bba86-7007-4a87-8120-d35f4e8f3dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e267c5bce6164090b4ea149c8115a207, user_id=835185a0fc164c1892d98120b4854fcd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:58.620801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bba86-7007-4a87-8120-d35f4e8f3dce admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:58.634693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:58.795572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2762/5507] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:45:58 2022] PUT /identity/v3/projects/e267c5bce6164090b4ea149c8115a207/users/835185a0fc164c1892d98120b4854fcd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:58.806355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caab02-6dac-4ff5-8d9d-8e30eb028b52 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:58.806964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caab02-6dac-4ff5-8d9d-8e30eb028b52 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:58.807420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caab02-6dac-4ff5-8d9d-8e30eb028b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:58.887152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68caab02-6dac-4ff5-8d9d-8e30eb028b52 None None] MFA Rules not processed for user `835185a0fc164c1892d98120b4854fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:58.894103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68caab02-6dac-4ff5-8d9d-8e30eb028b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:59.126853 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2746/5508] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:45:59.132731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd98db8-215c-481a-9839-854525067c16 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.133268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd98db8-215c-481a-9839-854525067c16 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.133795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd98db8-215c-481a-9839-854525067c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:59.182745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3dd98db8-215c-481a-9839-854525067c16 None None] MFA Rules not processed for user `835185a0fc164c1892d98120b4854fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:59.184771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3dd98db8-215c-481a-9839-854525067c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:59.195585 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2763/5509] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:59 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:45:59.201555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bff16-98e8-4a40-9034-2f0c90c86641 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.202208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bff16-98e8-4a40-9034-2f0c90c86641 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.202697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bff16-98e8-4a40-9034-2f0c90c86641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:59.237988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-206bff16-98e8-4a40-9034-2f0c90c86641 None None] MFA Rules not processed for user `835185a0fc164c1892d98120b4854fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:59.243384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-206bff16-98e8-4a40-9034-2f0c90c86641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:59.249143 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2747/5510] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:59 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:59.253243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd98db8-215c-481a-9839-854525067c16 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:59.305531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd98db8-215c-481a-9839-854525067c16 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:59.312740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835185a0fc164c1892d98120b4854fcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e267c5bce6164090b4ea149c8115a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:59.314356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.315588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.316304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:59.327395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorizing `identity:check_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:59.338604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:59.359233 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2764/5511] 10.222.0.27 () {56 vars in 1264 bytes} [Tue Oct 18 13:45:59 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:59.364750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bff16-98e8-4a40-9034-2f0c90c86641 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:59.384141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:59.392764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bff16-98e8-4a40-9034-2f0c90c86641 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:59.402620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835185a0fc164c1892d98120b4854fcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e267c5bce6164090b4ea149c8115a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:59.403707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.404219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.405765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:59.422398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:59.429602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:59.483976 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2748/5512] 10.222.0.27 () {56 vars in 1263 bytes} [Tue Oct 18 13:45:59 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:59.485213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:59.501095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e2f46-e79d-400a-aa8e-d64c57e8940b tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:59.513146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc7d64-94a6-4cdc-a33a-f914983dd374 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835185a0fc164c1892d98120b4854fcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e267c5bce6164090b4ea149c8115a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:59.514115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc7d64-94a6-4cdc-a33a-f914983dd374 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.515019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc7d64-94a6-4cdc-a33a-f914983dd374 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.516741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc7d64-94a6-4cdc-a33a-f914983dd374 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:59.534985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc7d64-94a6-4cdc-a33a-f914983dd374 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:45:59.537931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc7d64-94a6-4cdc-a33a-f914983dd374 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:45:59.540511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:59.628586 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2765/5513] 10.222.0.27 () {56 vars in 1266 bytes} [Tue Oct 18 13:45:59 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:45:59.631409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:59.678665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f3fc-e43b-443b-be2e-1445fe809f8c tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:59.702907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835185a0fc164c1892d98120b4854fcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e267c5bce6164090b4ea149c8115a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:59.709894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.710896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.711715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:59.718727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 18 13:45:59.797004 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 18 13:45:59.799017 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 18 13:45:59.801822 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:45:59.801822 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:45:59.801822 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 18 13:45:59.801822 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 18 13:45:59.801822 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 18 13:45:59.801822 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:45:59.813401 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2749/5514] 10.222.0.27 () {56 vars in 1264 bytes} [Tue Oct 18 13:45:59 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 18 13:45:59.814248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.814248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.814248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:45:59.892425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] MFA Rules not processed for user `835185a0fc164c1892d98120b4854fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:45:59.893832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:45:59.907646 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2766/5515] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:45:59 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:59.909014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:45:59.937719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eda9c-6588-4fca-8c62-a3c61dd27730 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:45:59.963263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835185a0fc164c1892d98120b4854fcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e267c5bce6164090b4ea149c8115a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:45:59.965345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:45:59.974767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:45:59.978487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:00.008023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:00.013490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:00.020618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:00.049334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:00.050982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:00.065131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2750/5516] 10.222.0.27 () {56 vars in 1263 bytes} [Tue Oct 18 13:45:59 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:00.071914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:00.126441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8143c4c-b8ce-46b1-831f-9ae463c2ffaf tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:00.156938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835185a0fc164c1892d98120b4854fcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e267c5bce6164090b4ea149c8115a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:00.159781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:00.160489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:00.163784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:00.193742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:00.196914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:00.325654 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2751/5517] 10.222.0.27 () {56 vars in 1266 bytes} [Tue Oct 18 13:46:00 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:00.327025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:00.343431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe23ea-8e39-4e5c-ba46-26365f09b822 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:00.352640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5446d6a-5a5e-4862-881d-13040b4eba0a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:00.355093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835185a0fc164c1892d98120b4854fcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e267c5bce6164090b4ea149c8115a207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:00.356425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:00.357651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:00.358017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:00.364209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:00.373123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:00.375792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:00.379840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:00.382943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] PATH_INFO: `/v3/users/1403c0b2a05241aaa2eb56c217e00eaa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:00.391269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1403c0b2a05241aaa2eb56c217e00eaa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:00.396459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 18 13:46:00.411455 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 18 13:46:00.412900 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 18 13:46:00.414009 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:46:00.414009 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:46:00.414009 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 18 13:46:00.414009 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 18 13:46:00.414009 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 18 13:46:00.414009 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:46:00.421414 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2752/5518] 10.222.0.27 () {56 vars in 1263 bytes} [Tue Oct 18 13:46:00 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 13:46:00.422679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:00.464067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63250288-c2bd-43e0-b855-6a95e2291149 tempest-TokensV3Test-1326945332 tempest-TokensV3Test-1326945332-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:00.488275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:00.488275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:00.488275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:00.488275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] PATH_INFO: `/v3/users/835185a0fc164c1892d98120b4854fcd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:00.499280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835185a0fc164c1892d98120b4854fcd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:00.505545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:00.548272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:00.752924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1403c0b2a05241aaa2eb56c217e00eaa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:00.768545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1403c0b2a05241aaa2eb56c217e00eaa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:00.768545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1403c0b2a05241aaa2eb56c217e00eaa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:00.811943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1403c0b2a05241aaa2eb56c217e00eaa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:00.917452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:00.950350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835185a0fc164c1892d98120b4854fcd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:00.959419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835185a0fc164c1892d98120b4854fcd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:00.986737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7da1f39-c012-4b09-a715-1d6460f4827c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1403c0b2a05241aaa2eb56c217e00eaa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:01.011493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2767/5519] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:00 2022] DELETE /identity/v3/users/1403c0b2a05241aaa2eb56c217e00eaa => generated 0 bytes in 963 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:01.093351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835185a0fc164c1892d98120b4854fcd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:01.094030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835185a0fc164c1892d98120b4854fcd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:01.108430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835185a0fc164c1892d98120b4854fcd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:01.162855 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2753/5520] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:00 2022] DELETE /identity/v3/users/835185a0fc164c1892d98120b4854fcd => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:01.167342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:01.167759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:01.168407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:01.218743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:01.221460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:01.391076 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2768/5521] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:01.408545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:01.410692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:01.501651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:01.599625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94888e1-bc3e-4411-a444-8513f41b2559 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:01.608540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255dbe5-b41b-40de-af1b-183c5c1ae41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:01.608540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255dbe5-b41b-40de-af1b-183c5c1ae41a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:01.608540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255dbe5-b41b-40de-af1b-183c5c1ae41a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:01.609136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255dbe5-b41b-40de-af1b-183c5c1ae41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:01.627925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255dbe5-b41b-40de-af1b-183c5c1ae41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:01.629901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255dbe5-b41b-40de-af1b-183c5c1ae41a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:01.656712 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2754/5522] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:01.965627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:02.231049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:02.259149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:03.405092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:03.406999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:03.431377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa1f0c-e31d-423f-9bb2-8947a24eeb5b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:03.460639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:03.461322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:03.461603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:03.461878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] PATH_INFO: `/v3/projects/b2b1fda987b644a9a17f18abab81eac8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:03.477463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b1fda987b644a9a17f18abab81eac8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:03.479564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:03.678044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b1fda987b644a9a17f18abab81eac8', 'request_id': 'req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:03.687858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b1fda987b644a9a17f18abab81eac8', 'request_id': 'req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:03.804550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b1fda987b644a9a17f18abab81eac8', 'request_id': 'req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:03.879513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] The token cache is being invalidate because project b2b1fda987b644a9a17f18abab81eac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:03.879981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:03.881934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dbc81fc7-7e8f-40f9-babc-bcbc311d9f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:03.883804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2769/5523] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:03 2022] DELETE /identity/v3/projects/b2b1fda987b644a9a17f18abab81eac8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:03.890117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659312-f2f3-4b1c-8673-1b1821e5e132 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:03.890716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659312-f2f3-4b1c-8673-1b1821e5e132 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:03.891103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659312-f2f3-4b1c-8673-1b1821e5e132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:03.931034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2e659312-f2f3-4b1c-8673-1b1821e5e132 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:03.932712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e659312-f2f3-4b1c-8673-1b1821e5e132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:04.218584 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2755/5524] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:04.226132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8289-01d1-45e6-8fc3-d9c7f0878c8e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:04.230187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8289-01d1-45e6-8fc3-d9c7f0878c8e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:04.230187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8289-01d1-45e6-8fc3-d9c7f0878c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:04.275175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c63a8289-01d1-45e6-8fc3-d9c7f0878c8e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:04.283696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c63a8289-01d1-45e6-8fc3-d9c7f0878c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:04.334293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659312-f2f3-4b1c-8673-1b1821e5e132 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:04.341769 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2770/5525] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:04.349697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659312-f2f3-4b1c-8673-1b1821e5e132 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:04.379483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:04.381277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:04.381562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:04.383891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:04.384856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:46:04.387695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:04.399265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:04.403756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:04.440923 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2756/5526] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:46:04.445017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8289-01d1-45e6-8fc3-d9c7f0878c8e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:04.464022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8289-01d1-45e6-8fc3-d9c7f0878c8e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:04.491715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:04.492703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:04.493215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:04.493727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:04.494631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:04.498300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:04.567312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:04.569374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:04.602557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7f10a-f665-42d1-ad89-be94c4d341b2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:04.629895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:04.641250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:04.641250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:04.641250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] PATH_INFO: `/v3/projects/e267c5bce6164090b4ea149c8115a207` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:04.645562 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2771/5527] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:04 2022] POST /identity/v3/projects => generated 391 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:04.645804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e267c5bce6164090b4ea149c8115a207)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:04.650151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:04.662835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:04.914028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:04.931167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e267c5bce6164090b4ea149c8115a207', 'request_id': 'req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:04.980222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab091be-3e0f-427f-a203-2ce3c9427d7f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:04.980394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e267c5bce6164090b4ea149c8115a207', 'request_id': 'req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:05.108938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e267c5bce6164090b4ea149c8115a207', 'request_id': 'req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:05.132475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] The token cache is being invalidate because project e267c5bce6164090b4ea149c8115a207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:05.137098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:05.139079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f6c3d4c5-728d-42c9-870e-b29b2b278ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:05.153026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2757/5528] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:04 2022] DELETE /identity/v3/projects/e267c5bce6164090b4ea149c8115a207 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:05.157345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea55ac7-5fdc-4fcd-9cb1-4ed6132bb349 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.157663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea55ac7-5fdc-4fcd-9cb1-4ed6132bb349 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.163217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea55ac7-5fdc-4fcd-9cb1-4ed6132bb349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.170784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:05.171420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.171702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.171973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.172622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:05.178242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:05.305509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bea55ac7-5fdc-4fcd-9cb1-4ed6132bb349 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:05.307965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bea55ac7-5fdc-4fcd-9cb1-4ed6132bb349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:05.346693 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2758/5529] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:05.351064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a79d-ecda-434d-b88b-23ed9a76be2a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.351904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a79d-ecda-434d-b88b-23ed9a76be2a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.352220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a79d-ecda-434d-b88b-23ed9a76be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.400312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b56a79d-ecda-434d-b88b-23ed9a76be2a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:05.405497 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2772/5530] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:04 2022] POST /identity/v3/users => generated 296 bytes in 752 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:05.405657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b56a79d-ecda-434d-b88b-23ed9a76be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:05.409757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:05.415023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:05.433015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2759/5531] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:05.441021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a79d-ecda-434d-b88b-23ed9a76be2a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:05.464306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a79d-ecda-434d-b88b-23ed9a76be2a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:05.491862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721226dc-93ab-4e1c-9ef9-e655bc61ed79 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:05.499730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:05.500420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.505366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.505366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.505366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:46:05.505366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:05.506944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:05.519401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:05.521032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.523630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.528348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.528348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:05.530107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:05.557669 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2760/5532] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:46:05.559496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:05.576507 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2773/5533] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:46:05.578542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:05.593670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dbf0d-ff4d-4874-8c98-f840677bfa29 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:05.612193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:05.616217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.616217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.616217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.619716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:05.625463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:05.631756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9de5a1-da2e-4d80-b4c3-198e16e487e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:05.651362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:05.659871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.660377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.661113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.661938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:05.667233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:05.719614 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2774/5534] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:05.720702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:05.754538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d899b6-6bbc-4204-be2e-328ad2b50c34 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:05.767231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b5c02-f227-4e69-96ba-b431fde83cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:05.768235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b5c02-f227-4e69-96ba-b431fde83cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.769548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b5c02-f227-4e69-96ba-b431fde83cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.777723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b5c02-f227-4e69-96ba-b431fde83cb2 admin admin] PATH_INFO: `/v3/projects/6742e113ada149739d921ce92ff153ec/users/b29dba1f338c4a3ebe1f1b4db9bc45c5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:05.814642 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2761/5535] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:05 2022] POST /identity/v3/projects => generated 397 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:05.817368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:05.832766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b5c02-f227-4e69-96ba-b431fde83cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6742e113ada149739d921ce92ff153ec, user_id=b29dba1f338c4a3ebe1f1b4db9bc45c5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:05.844462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b5c02-f227-4e69-96ba-b431fde83cb2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:05.947152 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2775/5536] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:05 2022] PUT /identity/v3/projects/6742e113ada149739d921ce92ff153ec/users/b29dba1f338c4a3ebe1f1b4db9bc45c5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:05.952237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:05.952526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:05.952807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:06.069076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:06.070396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:06.096704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bac58-137a-4a13-a8cb-2366756d15a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:06.356323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:06.364852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:06.367812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:06.368120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:06.368400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:06.369090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:06.403888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:06.456179 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2776/5537] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:06.482543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:06.484602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:06.560075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2762/5538] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:05 2022] POST /identity/v3/users => generated 305 bytes in 744 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:06.567170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:06.589531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:06.594959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645afbe-0f60-445e-a962-ee0662155757 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:06.620711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:06.621618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:06.622109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:06.622805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:06.623712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:06.627976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:06.667747 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2763/5539] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:46:06.672306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:06.701315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:06.713478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfc55-dbee-4cb1-baf1-839e5c8e3ab8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:06.719402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:06.720082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:06.720368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:06.720653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] PATH_INFO: `/v3/projects/bc47b1a708284420a781feba1a58f9fc/users/7b2e8e7494294ab49d56c4e0ec618d2a/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:06.772189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc47b1a708284420a781feba1a58f9fc, user_id=7b2e8e7494294ab49d56c4e0ec618d2a, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:06.779928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:06.808239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e350d-61d8-42cd-95bc-b6480e146598 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:06.837800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:06.843290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:06.849521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:06.849521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:06.881768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:06.884416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2764/5540] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:06 2022] PUT /identity/v3/projects/bc47b1a708284420a781feba1a58f9fc/users/7b2e8e7494294ab49d56c4e0ec618d2a/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:06.885471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:06.888238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:06.937155 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2777/5541] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:07.161802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6fc89-b367-4e7a-b4a3-99e0e1ecd001 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:07.179776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751d95-e796-43c3-abd1-c4aee6f52ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:07.180415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751d95-e796-43c3-abd1-c4aee6f52ccb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:07.180696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751d95-e796-43c3-abd1-c4aee6f52ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:07.180976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751d95-e796-43c3-abd1-c4aee6f52ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:07.181638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751d95-e796-43c3-abd1-c4aee6f52ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:07.187831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751d95-e796-43c3-abd1-c4aee6f52ccb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:07.217167 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2765/5542] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:07.221495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:07.235197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce562985-8c85-4fd0-8630-c24ca4089679 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:07.280384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:07.281093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:07.281372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:07.281644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] PATH_INFO: `/v3/projects/bc47b1a708284420a781feba1a58f9fc/users/7b2e8e7494294ab49d56c4e0ec618d2a/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:07.298617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc47b1a708284420a781feba1a58f9fc, user_id=7b2e8e7494294ab49d56c4e0ec618d2a, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:07.311979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:07.387590 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2778/5543] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:07 2022] PUT /identity/v3/projects/bc47b1a708284420a781feba1a58f9fc/users/7b2e8e7494294ab49d56c4e0ec618d2a/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:07.397854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be84d-563e-48e0-8024-2d5c5fbcaefc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:07.402919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be84d-563e-48e0-8024-2d5c5fbcaefc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:07.402919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be84d-563e-48e0-8024-2d5c5fbcaefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:07.598044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-057be84d-563e-48e0-8024-2d5c5fbcaefc None None] MFA Rules not processed for user `7b2e8e7494294ab49d56c4e0ec618d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:07.600686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-057be84d-563e-48e0-8024-2d5c5fbcaefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:07.810589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:07.833891 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2766/5544] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:07 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:07.837504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:07.966557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3963aa1-591c-400e-957e-ae0928518c75 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:07.975949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:07.977752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:07.978284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:07.978925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:07.990764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:07.990764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:08.168909 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2779/5545] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:07 2022] POST /identity/v3/projects => generated 395 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:08.169278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057be84d-563e-48e0-8024-2d5c5fbcaefc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:08.196290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057be84d-563e-48e0-8024-2d5c5fbcaefc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:08.461094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:08.461769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:08.462073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:08.462361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:08.463030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:08.465075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:09.251381 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2767/5546] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:08 2022] POST /identity/v3/users => generated 298 bytes in 1083 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:09.256874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:09.273610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:09.278337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa8bb-9fc0-4e30-9373-3ebb60b6325c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:09.285316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:09.285947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:09.286693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:09.287022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:09.287729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:09.291465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:09.375333 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2780/5547] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:09.376150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:09.402338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae58e9-438e-485c-82c3-fa3034866749 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:09.425016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb80cb8-1191-48bb-be43-6c3bba9b3cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:09.435270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb80cb8-1191-48bb-be43-6c3bba9b3cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:09.435599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb80cb8-1191-48bb-be43-6c3bba9b3cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:09.440896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb80cb8-1191-48bb-be43-6c3bba9b3cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:09.445603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb80cb8-1191-48bb-be43-6c3bba9b3cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:09.461525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb80cb8-1191-48bb-be43-6c3bba9b3cb2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:09.518830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:09.521771 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2768/5548] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:09.534951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dbe63-b7c3-4c6e-8dc3-099f1e5131a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:09.548193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:09.548193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:09.548193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:09.548193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] PATH_INFO: `/v3/projects/b7037befa9554ea8b9ec3aecbab8f49f/users/343c89bd9ff44547a17447f2e11256fd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:09.591428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7037befa9554ea8b9ec3aecbab8f49f, user_id=343c89bd9ff44547a17447f2e11256fd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:09.595751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:09.723338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2781/5549] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:09 2022] PUT /identity/v3/projects/b7037befa9554ea8b9ec3aecbab8f49f/users/343c89bd9ff44547a17447f2e11256fd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:09.733905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:09.734584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:09.735094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:09.784682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] MFA Rules not processed for user `343c89bd9ff44547a17447f2e11256fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:09.788041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:09.983229 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2769/5550] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:10.508134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:11.959065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:14.638956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:14.640778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:14.823471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae84c-9e90-45df-8a69-13aaa3957749 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:14.845018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f9d44-dc7a-43f6-95c0-b9ca805052cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:14.845709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9d44-dc7a-43f6-95c0-b9ca805052cd service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:14.845993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9d44-dc7a-43f6-95c0-b9ca805052cd service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:14.846311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9d44-dc7a-43f6-95c0-b9ca805052cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:15.032507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f9d44-dc7a-43f6-95c0-b9ca805052cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:15.034744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f9d44-dc7a-43f6-95c0-b9ca805052cd service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:15.066491 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2782/5551] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:14 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:16.011640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:16.016836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:16.219608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7f46-6e77-40ba-af0d-7d1a41c87660 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:16.238004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:16.242809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:16.243428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:16.244133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] PATH_INFO: `/v3/users/7d21b7b5df224e92880219c38ad2fc47` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:16.248630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d21b7b5df224e92880219c38ad2fc47)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:16.251731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:16.640226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d21b7b5df224e92880219c38ad2fc47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:16.642179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d21b7b5df224e92880219c38ad2fc47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:16.647781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:16.764146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d21b7b5df224e92880219c38ad2fc47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:16.772185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d21b7b5df224e92880219c38ad2fc47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:16.790129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d21b7b5df224e92880219c38ad2fc47'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:16.843662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:16.846430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:16.847496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:16.864837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2770/5552] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:16 2022] DELETE /identity/v3/users/7d21b7b5df224e92880219c38ad2fc47 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:16.888522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:16.890989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:17.007847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:17.009641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:17.061048 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2783/5553] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:17.067456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:17.070425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:17.118437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:17.205953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe2208-b584-42ec-a8cb-6082a2b3e743 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:17.212063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43289ed0-74b9-4adf-80c9-b845c7266d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:17.213931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43289ed0-74b9-4adf-80c9-b845c7266d08 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:17.215488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43289ed0-74b9-4adf-80c9-b845c7266d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:17.216011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43289ed0-74b9-4adf-80c9-b845c7266d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:17.221781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60109f-0000-4438-af3f-ba25be583225 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:17.234578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:17.235392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:17.235678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:17.235949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] PATH_INFO: `/v3/users/7b2e8e7494294ab49d56c4e0ec618d2a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:17.238141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2e8e7494294ab49d56c4e0ec618d2a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:17.240109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:17.243374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43289ed0-74b9-4adf-80c9-b845c7266d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:17.245314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43289ed0-74b9-4adf-80c9-b845c7266d08 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:17.272046 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2784/5554] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:17.541485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2e8e7494294ab49d56c4e0ec618d2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:17.542229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2e8e7494294ab49d56c4e0ec618d2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:17.675681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2e8e7494294ab49d56c4e0ec618d2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:17.676644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2e8e7494294ab49d56c4e0ec618d2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:17.688794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2e8e7494294ab49d56c4e0ec618d2a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:17.804645 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2771/5555] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:17 2022] DELETE /identity/v3/users/7b2e8e7494294ab49d56c4e0ec618d2a => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:17.806665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:17.811376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:17.811376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:17.871444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:17.876348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:18.037128 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2785/5556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:18.197716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:18.199335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:18.365349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:18.390090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315708-72a6-4106-955a-6b0507bdd305 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:18.395926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:18.396940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:18.397423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:18.397896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:18.425227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:18.425227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:18.463692 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2772/5557] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:19.084108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:19.088190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:19.110036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b79113-b71c-4402-a558-9ff61c613de4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:19.134088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:19.135147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:19.135670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:19.136142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] PATH_INFO: `/v3/projects/c44d6e26637a40c1b0189bb8272f6955` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:19.138849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44d6e26637a40c1b0189bb8272f6955)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:19.145495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:19.315366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44d6e26637a40c1b0189bb8272f6955', 'request_id': 'req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:19.333601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44d6e26637a40c1b0189bb8272f6955', 'request_id': 'req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:19.425917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44d6e26637a40c1b0189bb8272f6955', 'request_id': 'req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:19.473595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] The token cache is being invalidate because project c44d6e26637a40c1b0189bb8272f6955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:19.480112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:19.480112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:19.480112 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2786/5558] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:19 2022] DELETE /identity/v3/projects/c44d6e26637a40c1b0189bb8272f6955 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:19.481471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:19.503862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80947115-71f5-4b99-80e4-1f26577afaac service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:19.651561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:19.654093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:19.654948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:19.655963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] PATH_INFO: `/v3/users/95950e573df041df878af85d8bb75dcc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:19.664447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95950e573df041df878af85d8bb75dcc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:19.672532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:20.390625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95950e573df041df878af85d8bb75dcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:20.393359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95950e573df041df878af85d8bb75dcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:20.509890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95950e573df041df878af85d8bb75dcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:20.512252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95950e573df041df878af85d8bb75dcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:20.526762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95950e573df041df878af85d8bb75dcc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:20.634634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2773/5559] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:19 2022] DELETE /identity/v3/users/95950e573df041df878af85d8bb75dcc => generated 0 bytes in 1153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:20.858665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:20.869053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:20.916221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d343-f36d-4fe1-ba7f-1ec5e41495fd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:21.137803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:21.171845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:21.172752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:21.173043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:21.176548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] PATH_INFO: `/v3/projects/bc47b1a708284420a781feba1a58f9fc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:21.182410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc47b1a708284420a781feba1a58f9fc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:21.187774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:21.549173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc47b1a708284420a781feba1a58f9fc', 'request_id': 'req-3edba96f-1d1d-49ab-bb20-ad5882371ead'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:21.566432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc47b1a708284420a781feba1a58f9fc', 'request_id': 'req-3edba96f-1d1d-49ab-bb20-ad5882371ead'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:21.662894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc47b1a708284420a781feba1a58f9fc', 'request_id': 'req-3edba96f-1d1d-49ab-bb20-ad5882371ead'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:21.679816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] The token cache is being invalidate because project bc47b1a708284420a781feba1a58f9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:21.680170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:21.682203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:21.688049 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2787/5560] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:20 2022] DELETE /identity/v3/projects/bc47b1a708284420a781feba1a58f9fc => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:21.692579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:21.696486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:21.735777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88b377-ee5c-4407-86e8-60645bc79796 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:21.947995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:21.948956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:21.950404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:21.950692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] PATH_INFO: `/v3/users/343c89bd9ff44547a17447f2e11256fd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:21.953905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343c89bd9ff44547a17447f2e11256fd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:21.959058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:21.980556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:22.283594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343c89bd9ff44547a17447f2e11256fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:22.284878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343c89bd9ff44547a17447f2e11256fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:22.381940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343c89bd9ff44547a17447f2e11256fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:22.383015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343c89bd9ff44547a17447f2e11256fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:22.399120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343c89bd9ff44547a17447f2e11256fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:22.513457 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2774/5561] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:21 2022] DELETE /identity/v3/users/343c89bd9ff44547a17447f2e11256fd => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:22.866573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:22.868091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:22.904819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba96f-1d1d-49ab-bb20-ad5882371ead admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:23.163889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:23.164564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:23.164851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:23.165134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] PATH_INFO: `/v3/projects/dd58d0871394465187f849467897eabc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:23.174718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd58d0871394465187f849467897eabc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:23.176740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:23.469475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd58d0871394465187f849467897eabc', 'request_id': 'req-1cd917ed-1f78-49f1-8665-b83387891bda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:23.496482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd58d0871394465187f849467897eabc', 'request_id': 'req-1cd917ed-1f78-49f1-8665-b83387891bda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:23.587985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd58d0871394465187f849467897eabc', 'request_id': 'req-1cd917ed-1f78-49f1-8665-b83387891bda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:23.623000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] The token cache is being invalidate because project dd58d0871394465187f849467897eabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:23.643844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:23.647550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:23.654640 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2788/5562] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:22 2022] DELETE /identity/v3/projects/dd58d0871394465187f849467897eabc => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:23.655029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:23.656503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:23.696833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbbf95-0190-4edc-80e7-778cd6377c76 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:23.847705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:23.848372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:23.848655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:23.848930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] PATH_INFO: `/v3/users/3ed6990576b44d43b5812a28d97b66ec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:23.851788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed6990576b44d43b5812a28d97b66ec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:23.856019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:24.176084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed6990576b44d43b5812a28d97b66ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:24.177096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed6990576b44d43b5812a28d97b66ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:24.290776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed6990576b44d43b5812a28d97b66ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:24.299283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed6990576b44d43b5812a28d97b66ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:24.316271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c54f14b9-5bed-439d-99f7-ed72e4b1cc2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed6990576b44d43b5812a28d97b66ec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:24.508336 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2775/5563] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:23 2022] DELETE /identity/v3/users/3ed6990576b44d43b5812a28d97b66ec => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:24.532311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:24.535577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:24.573230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd917ed-1f78-49f1-8665-b83387891bda admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:24.589651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:24.895087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:24.897441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:24.898530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:24.899382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] PATH_INFO: `/v3/projects/b7037befa9554ea8b9ec3aecbab8f49f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:24.904944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7037befa9554ea8b9ec3aecbab8f49f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:24.916479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:25.138700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7037befa9554ea8b9ec3aecbab8f49f', 'request_id': 'req-cfd76051-bc98-42d2-aaf7-23e9238dea21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:25.156829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7037befa9554ea8b9ec3aecbab8f49f', 'request_id': 'req-cfd76051-bc98-42d2-aaf7-23e9238dea21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:25.284972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7037befa9554ea8b9ec3aecbab8f49f', 'request_id': 'req-cfd76051-bc98-42d2-aaf7-23e9238dea21'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:25.313276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] The token cache is being invalidate because project b7037befa9554ea8b9ec3aecbab8f49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:25.317426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:25.319695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cfd76051-bc98-42d2-aaf7-23e9238dea21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:25.325542 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2789/5564] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:24 2022] DELETE /identity/v3/projects/b7037befa9554ea8b9ec3aecbab8f49f => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:25.331674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19140-cdf7-413d-9692-45b295d50e77 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:25.332641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19140-cdf7-413d-9692-45b295d50e77 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:25.333468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19140-cdf7-413d-9692-45b295d50e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:25.358334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:25.399132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3dd19140-cdf7-413d-9692-45b295d50e77 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:25.400402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3dd19140-cdf7-413d-9692-45b295d50e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:25.647533 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2776/5565] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:25.656649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568d34-111b-4ecf-89f3-92f5b75feafb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:25.657191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568d34-111b-4ecf-89f3-92f5b75feafb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:25.657191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568d34-111b-4ecf-89f3-92f5b75feafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:25.731741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-01568d34-111b-4ecf-89f3-92f5b75feafb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:25.733842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01568d34-111b-4ecf-89f3-92f5b75feafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:25.745964 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2790/5566] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:25.750739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19140-cdf7-413d-9692-45b295d50e77 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:25.769090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19140-cdf7-413d-9692-45b295d50e77 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:25.796598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:25.804450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:25.804732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:25.805005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:25.805864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:46:25.806225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:25.816888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:25.899618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2777/5567] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:46:25.901445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01568d34-111b-4ecf-89f3-92f5b75feafb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:25.931704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01568d34-111b-4ecf-89f3-92f5b75feafb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:25.945912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:25.946589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:25.946869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:25.947144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:25.947794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:25.969618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:26.233234 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2791/5568] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:25 2022] POST /identity/v3/projects => generated 399 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:26.234424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:26.250875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b3fe1-8cff-4873-8e6c-882333ece287 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:26.368611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:26.369959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:26.372330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:26.373225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:26.374289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:26.376965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:26.525950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2778/5569] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:26 2022] POST /identity/v3/users => generated 306 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:26.533029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:26.601341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc10d4-4998-4412-9829-fe1ed03774ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:26.619345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:26.621144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:26.628284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:26.628604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:26.631393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:26.633083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:26.687595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:26.705238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bb96c-c579-47fb-b77e-71e8f3cb5de0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:26.705497 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2792/5570] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:26.720248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:26.721221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:26.729603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:26.729603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] PATH_INFO: `/v3/projects/02b67fd6111748199cbb2efea0d5621d/users/7308591063514bb0b720873edbca603e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:26.790091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b67fd6111748199cbb2efea0d5621d, user_id=7308591063514bb0b720873edbca603e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:26.792899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:26.940628 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2779/5571] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:26 2022] PUT /identity/v3/projects/02b67fd6111748199cbb2efea0d5621d/users/7308591063514bb0b720873edbca603e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:46:26.947600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:27.018384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede63d8-9be1-47a6-83a3-d428f635ec13 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:27.248600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:27.262027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:27.262699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:27.263010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:27.263254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:27.271453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:27.273792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:27.313972 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2793/5572] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:27.314400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:27.335752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802d45-c612-403d-a8f3-2e0b24c775fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:27.368690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf97a58-00d8-441b-936f-c63be22fc85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:27.370851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf97a58-00d8-441b-936f-c63be22fc85e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:27.371543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf97a58-00d8-441b-936f-c63be22fc85e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:27.372278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf97a58-00d8-441b-936f-c63be22fc85e admin admin] PATH_INFO: `/v3/projects/02b67fd6111748199cbb2efea0d5621d/users/7308591063514bb0b720873edbca603e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:27.384222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf97a58-00d8-441b-936f-c63be22fc85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b67fd6111748199cbb2efea0d5621d, user_id=7308591063514bb0b720873edbca603e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:27.398003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:27.400716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:27.420660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf97a58-00d8-441b-936f-c63be22fc85e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:27.480654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2281-70dd-4b18-9b47-78b0698958b5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:27.506599 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2780/5573] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:27 2022] PUT /identity/v3/projects/02b67fd6111748199cbb2efea0d5621d/users/7308591063514bb0b720873edbca603e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:46:27.521611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb74bb-2108-4358-9d9e-19e82c6c8935 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:27.522020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb74bb-2108-4358-9d9e-19e82c6c8935 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:27.522406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb74bb-2108-4358-9d9e-19e82c6c8935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:27.643457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:27.644794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:27.645253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:27.646047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] PATH_INFO: `/v3/projects/38b5c19328dc49e38824cf6e5bd155b9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:27.647060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0bcb74bb-2108-4358-9d9e-19e82c6c8935 None None] MFA Rules not processed for user `7308591063514bb0b720873edbca603e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:27.647762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b5c19328dc49e38824cf6e5bd155b9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:27.656225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:27.656354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0bcb74bb-2108-4358-9d9e-19e82c6c8935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:27.806878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:27.867781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b5c19328dc49e38824cf6e5bd155b9', 'request_id': 'req-606425e3-d2d6-4beb-a047-14ebb1998516'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:27.893188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b5c19328dc49e38824cf6e5bd155b9', 'request_id': 'req-606425e3-d2d6-4beb-a047-14ebb1998516'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:27.922302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2781/5574] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:27.923414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb74bb-2108-4358-9d9e-19e82c6c8935 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:27.967071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb74bb-2108-4358-9d9e-19e82c6c8935 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:28.040250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b5c19328dc49e38824cf6e5bd155b9', 'request_id': 'req-606425e3-d2d6-4beb-a047-14ebb1998516'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:28.060393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] The token cache is being invalidate because project 38b5c19328dc49e38824cf6e5bd155b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:28.061016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:28.066077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-606425e3-d2d6-4beb-a047-14ebb1998516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:28.069223 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2794/5575] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:27 2022] DELETE /identity/v3/projects/38b5c19328dc49e38824cf6e5bd155b9 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:46:28.078917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee830e-5b72-4afa-8d54-c9eb5ab027f7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:28.079753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee830e-5b72-4afa-8d54-c9eb5ab027f7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:28.084906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee830e-5b72-4afa-8d54-c9eb5ab027f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:28.149807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fcee830e-5b72-4afa-8d54-c9eb5ab027f7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:28.149807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcee830e-5b72-4afa-8d54-c9eb5ab027f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:28.155301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:28.155996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:28.156208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:28.156559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:28.157220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:28.159711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:28.197039 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2795/5576] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:28.210341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab6b3-b2c2-4fbd-a392-cecbf671373a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:28.210789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab6b3-b2c2-4fbd-a392-cecbf671373a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:28.211075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab6b3-b2c2-4fbd-a392-cecbf671373a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:28.272849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26fab6b3-b2c2-4fbd-a392-cecbf671373a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:28.274170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26fab6b3-b2c2-4fbd-a392-cecbf671373a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:28.296548 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2796/5577] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:46:28.300736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab6b3-b2c2-4fbd-a392-cecbf671373a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:28.330733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab6b3-b2c2-4fbd-a392-cecbf671373a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:28.339923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:28.340839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:28.341231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:28.341608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:28.343793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:46:28.344134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:28.352179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:28.409416 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2797/5578] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:46:28.413737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:28.487925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71f4cf-c497-495d-a8d4-239c3502bed7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:28.496495 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2782/5579] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:27 2022] POST /identity/v3/projects => generated 393 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:28.501242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:28.503118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:28.507565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:28.508671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:28.510596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:28.513308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:28.514166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:28.521904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:28.723373 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2798/5580] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:28 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:28.729233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:28.729579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6c5db-30b8-4f8d-9536-ff23793b3c10 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:28.888246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:28.959870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a40a-048e-4e4e-91ce-3cb5133ce8d7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:28.972395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd226cd9-a9cb-4422-b61f-f3626dab247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:28.973034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd226cd9-a9cb-4422-b61f-f3626dab247a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:28.973313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd226cd9-a9cb-4422-b61f-f3626dab247a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:28.973587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd226cd9-a9cb-4422-b61f-f3626dab247a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:28.974439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd226cd9-a9cb-4422-b61f-f3626dab247a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:28.976372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd226cd9-a9cb-4422-b61f-f3626dab247a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:28.989135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:28.989779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:28.990093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:28.990359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:28.991009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:28.991753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:28.993093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:29.194662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2783/5581] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:28 2022] POST /identity/v3/users => generated 297 bytes in 693 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:29.194767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc088-7a48-40b3-ad5a-e22002cf03c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:29.194983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc088-7a48-40b3-ad5a-e22002cf03c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:29.195319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cc088-7a48-40b3-ad5a-e22002cf03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:29.277813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-695cc088-7a48-40b3-ad5a-e22002cf03c7 None None] MFA Rules not processed for user `b29dba1f338c4a3ebe1f1b4db9bc45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:29.279054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-695cc088-7a48-40b3-ad5a-e22002cf03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:29.324230 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2799/5582] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:28 2022] POST /identity/v3/users => generated 289 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:29.325113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:29.350029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efb6f4-28e4-434c-a3ae-06463144b980 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:29.376559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:29.377471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:29.377872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:29.378313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:29.379324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:29.396036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:29.462414 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2800/5583] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:29.463737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:29.464491 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2784/5584] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:29.465917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc088-7a48-40b3-ad5a-e22002cf03c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:29.493536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cc088-7a48-40b3-ad5a-e22002cf03c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:29.502901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bade25-801b-4921-b278-633d1238a953 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:29.506882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aec492-09bd-485e-87b8-a723679e7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:29.514236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec492-09bd-485e-87b8-a723679e7d1b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:29.514236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec492-09bd-485e-87b8-a723679e7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:29.514236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec492-09bd-485e-87b8-a723679e7d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:29.514236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aec492-09bd-485e-87b8-a723679e7d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:29.514236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aec492-09bd-485e-87b8-a723679e7d1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:29.538807 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2785/5585] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:29.540975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70238e5-1db9-460a-b595-03b8e3a4ddef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:29.543818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70238e5-1db9-460a-b595-03b8e3a4ddef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:29.544373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70238e5-1db9-460a-b595-03b8e3a4ddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:29.552728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:29.553369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:29.553660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:29.553946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:29.554659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:29.556374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:29.590691 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2801/5586] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:29.595644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f70238e5-1db9-460a-b595-03b8e3a4ddef None None] MFA Rules not processed for user `b29dba1f338c4a3ebe1f1b4db9bc45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:29.597313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f70238e5-1db9-460a-b595-03b8e3a4ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:29.605365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:29.622228 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2786/5587] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:29.624066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70238e5-1db9-460a-b595-03b8e3a4ddef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:29.643932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fa48a-85ba-4d06-b700-2acd166fa5ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:29.646655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70238e5-1db9-460a-b595-03b8e3a4ddef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:29.653413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:29.654302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:29.654689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:29.655071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] PATH_INFO: `/v3/projects/47f1e690e3a843f99747323703f2d52c/users/23ba786e413e4e5687822e9bebf083a5/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:29.664735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:29.665678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:29.666201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:29.666625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:29.667441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:29.669339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:29.696539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2787/5588] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:29.697702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:29.700623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f1e690e3a843f99747323703f2d52c, user_id=23ba786e413e4e5687822e9bebf083a5, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:29.705140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:29.709184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:29.825995 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2802/5589] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:29 2022] PUT /identity/v3/projects/47f1e690e3a843f99747323703f2d52c/users/23ba786e413e4e5687822e9bebf083a5/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:29.837655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:29.873334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6748d-d75e-43bc-a1e7-cc141c8fef0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:30.022575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:30.105353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24e2a8-899d-4285-8d16-a1e72f5769ae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:30.113698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c2463-98bb-4beb-8cae-7e8a0e84b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:30.114463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c2463-98bb-4beb-8cae-7e8a0e84b53b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:30.114749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c2463-98bb-4beb-8cae-7e8a0e84b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:30.115072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c2463-98bb-4beb-8cae-7e8a0e84b53b admin admin] PATH_INFO: `/v3/projects/48109b15977e4ee6ade3105f08df50d9/users/4c2d3742a2f64ada878a9495e44cd701/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:30.124679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1fa3-fd32-482a-8f63-1a2a680f0713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:30.124679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1fa3-fd32-482a-8f63-1a2a680f0713 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:30.124679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1fa3-fd32-482a-8f63-1a2a680f0713 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:30.288779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1fa3-fd32-482a-8f63-1a2a680f0713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:30.291338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c2463-98bb-4beb-8cae-7e8a0e84b53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48109b15977e4ee6ade3105f08df50d9, user_id=4c2d3742a2f64ada878a9495e44cd701, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:30.291338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c2463-98bb-4beb-8cae-7e8a0e84b53b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:30.291495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1fa3-fd32-482a-8f63-1a2a680f0713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:30.291495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1fa3-fd32-482a-8f63-1a2a680f0713 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:30.291495 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2788/5590] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:30.291495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:30.291495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:30.291495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:30.291931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] MFA Rules not processed for user `23ba786e413e4e5687822e9bebf083a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:30.291931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:30.362573 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2789/5591] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:30.395582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:30.397204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:30.534797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2803/5592] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:29 2022] PUT /identity/v3/projects/48109b15977e4ee6ade3105f08df50d9/users/4c2d3742a2f64ada878a9495e44cd701/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:30.551042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:30.551180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:30.554107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:30.570408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc621c61-8929-4c23-8be7-0ac758fa01ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:30.628995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] MFA Rules not processed for user `4c2d3742a2f64ada878a9495e44cd701`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:30.631592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:30.695541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:30.696183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:30.696459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:30.696737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:30.706898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:30.763861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:30.773933 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2804/5593] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:30.785701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:30.787615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:31.012872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:31.016907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:31.023377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc204ee-ba93-4af5-89f3-8c3ac1b27018 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:31.040305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:31.041104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:31.041850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:31.042626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:31.062563 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2790/5594] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:31.064102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:31.067243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:31.088676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:31.102006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:31.132582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2805/5595] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:46:31.278810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efc278-a8dc-481d-832f-8669e3ead4bd service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:31.303246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:31.304201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:31.304593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:31.304974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:31.312425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:31.356149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:31.359140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:31.394930 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2791/5596] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:31.751741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:32.824716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:32.827810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:32.882299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:33.058595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d40db-5979-41bb-a85f-65f365ac4c39 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:33.067399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:33.068069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:33.068351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:33.068742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] PATH_INFO: `/v3/users/7308591063514bb0b720873edbca603e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:33.070453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7308591063514bb0b720873edbca603e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:33.074636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:33.083232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a653-f025-4b80-8e66-b049566a7ccb service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:33.085394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace404ef-ff85-48ad-a80e-24db2e097e66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:33.087940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace404ef-ff85-48ad-a80e-24db2e097e66 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:33.088294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace404ef-ff85-48ad-a80e-24db2e097e66 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:33.088581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace404ef-ff85-48ad-a80e-24db2e097e66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:33.096536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ace404ef-ff85-48ad-a80e-24db2e097e66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:33.122271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace404ef-ff85-48ad-a80e-24db2e097e66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:33.129438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace404ef-ff85-48ad-a80e-24db2e097e66 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:33.166106 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2806/5597] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:33.167543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525591f5-d96f-4c7f-aca2-838e8591bd99 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:33.178596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525591f5-d96f-4c7f-aca2-838e8591bd99 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:33.178987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525591f5-d96f-4c7f-aca2-838e8591bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:33.204339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-525591f5-d96f-4c7f-aca2-838e8591bd99 None None] MFA Rules not processed for user `b29dba1f338c4a3ebe1f1b4db9bc45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:33.205913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-525591f5-d96f-4c7f-aca2-838e8591bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:33.300392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:33.330030 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2807/5598] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:33.437549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7308591063514bb0b720873edbca603e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:33.439362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7308591063514bb0b720873edbca603e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:33.556788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7308591063514bb0b720873edbca603e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:33.560880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7308591063514bb0b720873edbca603e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:33.570676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7308591063514bb0b720873edbca603e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:33.653648 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2792/5599] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:32 2022] DELETE /identity/v3/users/7308591063514bb0b720873edbca603e => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:46:33.655122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:33.655464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:33.655744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:33.717198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:33.719444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:33.803614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:33.906629 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2808/5600] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:33.953038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:33.956611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:34.080314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:34.082163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:34.159642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c7491-8e39-425f-8562-1d1dd155ad8b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:34.166466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:34.167189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:34.167544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:34.170930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:34.183277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:34.185192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:34.203106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169be662-14c6-41ec-b8f9-f168ecffc1a9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:34.210851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:34.214842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:34.215129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:34.215732 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2793/5601] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:34.217763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:34.221947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:34.261698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:34.268337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:34.290079 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2809/5602] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:46:35.912648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:35.913132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:35.949427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b85bd-343d-41c8-8cc3-9faac4d3c8ef service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:35.967859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:35.967859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:35.967859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:35.967859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] PATH_INFO: `/v3/projects/02b67fd6111748199cbb2efea0d5621d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:35.968220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b67fd6111748199cbb2efea0d5621d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:35.979240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:36.321663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b67fd6111748199cbb2efea0d5621d', 'request_id': 'req-cb32cf51-f65d-4049-b358-48c82154894a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:36.321663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b67fd6111748199cbb2efea0d5621d', 'request_id': 'req-cb32cf51-f65d-4049-b358-48c82154894a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:36.524139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b67fd6111748199cbb2efea0d5621d', 'request_id': 'req-cb32cf51-f65d-4049-b358-48c82154894a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:36.552505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] The token cache is being invalidate because project 02b67fd6111748199cbb2efea0d5621d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:36.553285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:36.554008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:36.555782 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2794/5603] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:35 2022] DELETE /identity/v3/projects/02b67fd6111748199cbb2efea0d5621d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:46:36.560476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:36.607154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975966ae-2e11-4305-a896-e94ce00c3a30 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:36.855921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:36.881059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:36.881754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:36.882040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] PATH_INFO: `/v3/users/23ba786e413e4e5687822e9bebf083a5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:36.888787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ba786e413e4e5687822e9bebf083a5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:36.894693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:37.562733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ba786e413e4e5687822e9bebf083a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:37.601244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ba786e413e4e5687822e9bebf083a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:37.604139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ba786e413e4e5687822e9bebf083a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:37.680027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ba786e413e4e5687822e9bebf083a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:37.682397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:37.809912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-42eb4eb0-4417-47d5-9433-c2195ec37e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ba786e413e4e5687822e9bebf083a5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:37.831185 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2810/5604] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:36 2022] DELETE /identity/v3/users/23ba786e413e4e5687822e9bebf083a5 => generated 0 bytes in 1268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:39.476176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:39.483428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:39.532760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32cf51-f65d-4049-b358-48c82154894a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:39.703673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:39.836648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:39.837337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:39.837618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:39.837893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] PATH_INFO: `/v3/projects/47f1e690e3a843f99747323703f2d52c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:39.850042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f1e690e3a843f99747323703f2d52c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:39.861647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:40.130836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f1e690e3a843f99747323703f2d52c', 'request_id': 'req-245cdde6-6fff-4eda-a19d-8e14c69ecb20'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:40.144222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f1e690e3a843f99747323703f2d52c', 'request_id': 'req-245cdde6-6fff-4eda-a19d-8e14c69ecb20'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:40.261205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f1e690e3a843f99747323703f2d52c', 'request_id': 'req-245cdde6-6fff-4eda-a19d-8e14c69ecb20'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:40.293285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] The token cache is being invalidate because project 47f1e690e3a843f99747323703f2d52c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:40.293593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:40.295324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-245cdde6-6fff-4eda-a19d-8e14c69ecb20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:40.306167 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2795/5605] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:39 2022] DELETE /identity/v3/projects/47f1e690e3a843f99747323703f2d52c => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:40.307386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285a94-2617-453d-afe7-ed94b51a3c90 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:40.308952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285a94-2617-453d-afe7-ed94b51a3c90 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:40.309431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285a94-2617-453d-afe7-ed94b51a3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:40.362280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-84285a94-2617-453d-afe7-ed94b51a3c90 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:40.364415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84285a94-2617-453d-afe7-ed94b51a3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:40.634933 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2811/5606] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:40.638966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee7b71-197f-470c-8131-3689d8c88d53 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:40.639868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee7b71-197f-470c-8131-3689d8c88d53 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:40.640337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee7b71-197f-470c-8131-3689d8c88d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:40.670489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0cee7b71-197f-470c-8131-3689d8c88d53 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:40.672131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0cee7b71-197f-470c-8131-3689d8c88d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:40.687380 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2796/5607] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:40.687887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285a94-2617-453d-afe7-ed94b51a3c90 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:40.711249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285a94-2617-453d-afe7-ed94b51a3c90 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:40.723339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:40.724856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:40.726740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:40.727202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:40.728047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:46:40.730846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:40.733523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:40.786766 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2812/5608] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:46:40.791253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee7b71-197f-470c-8131-3689d8c88d53 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:40.813046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee7b71-197f-470c-8131-3689d8c88d53 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:40.822374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:40.825177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:40.829335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:40.829808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:40.830746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:40.832930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:41.054244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:41.061527 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2797/5609] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:40 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:41.070392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23145dff-2705-4946-8037-77fdd7b9cfcf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:41.194641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:41.195975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:41.196593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:41.196827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:41.197492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:41.200475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:41.288500 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2813/5610] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:41 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:41.292733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:41.310880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47432fa-2253-4bea-847b-4f445482f340 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:41.317428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:41.321163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:41.321163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:41.321163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:41.321163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:41.321697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:41.339758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:41.350634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2798/5611] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:41.357824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967489-19a1-46e0-9b12-5210f3670dd1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:41.366210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1b385-41ac-4a76-8b38-d23305144289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:41.366975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1b385-41ac-4a76-8b38-d23305144289 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:41.367484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1b385-41ac-4a76-8b38-d23305144289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:41.367841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1b385-41ac-4a76-8b38-d23305144289 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:41.368848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1b385-41ac-4a76-8b38-d23305144289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:41.371332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1b385-41ac-4a76-8b38-d23305144289 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:41.404204 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2814/5612] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:41.409007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:41.420870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b64a6f-2eab-4c91-91fd-906054a794cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:41.434046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:41.436460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:41.436872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:41.437255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] PATH_INFO: `/v3/projects/c589a6a017fe4a5b8ef2050fd0928ae7/users/9e4014ebf0f048f2a34565646570dde2/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:41.491017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c589a6a017fe4a5b8ef2050fd0928ae7, user_id=9e4014ebf0f048f2a34565646570dde2, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:41.493371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:41.619968 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2799/5613] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:41 2022] PUT /identity/v3/projects/c589a6a017fe4a5b8ef2050fd0928ae7/users/9e4014ebf0f048f2a34565646570dde2/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:41.631186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab6cd9-9f45-4d83-bffb-20cf5921b03a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:41.631749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab6cd9-9f45-4d83-bffb-20cf5921b03a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:41.632182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab6cd9-9f45-4d83-bffb-20cf5921b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:41.716878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-82ab6cd9-9f45-4d83-bffb-20cf5921b03a None None] MFA Rules not processed for user `9e4014ebf0f048f2a34565646570dde2`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:41.720734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-82ab6cd9-9f45-4d83-bffb-20cf5921b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:41.841119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:41.896511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2815/5614] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:41.910201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:41.912438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:42.052215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29bee4-d582-4a97-9d77-9ea09f3fe7fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:42.059773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db754b-52af-468d-9219-1403fff3c9d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:42.060942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db754b-52af-468d-9219-1403fff3c9d8 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:42.061564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db754b-52af-468d-9219-1403fff3c9d8 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:42.062048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db754b-52af-468d-9219-1403fff3c9d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:42.082350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db754b-52af-468d-9219-1403fff3c9d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:42.083943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db754b-52af-468d-9219-1403fff3c9d8 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:42.100260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:42.125557 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2800/5615] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:42.258584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab6cd9-9f45-4d83-bffb-20cf5921b03a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:42.380506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab6cd9-9f45-4d83-bffb-20cf5921b03a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:42.390546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:42.394325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:42.399008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:42.399553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] PATH_INFO: `/v3/users/9e4014ebf0f048f2a34565646570dde2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:42.402373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4014ebf0f048f2a34565646570dde2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:42.405336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:42.693760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4014ebf0f048f2a34565646570dde2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:42.770913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4014ebf0f048f2a34565646570dde2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:42.773349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4014ebf0f048f2a34565646570dde2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:42.836563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4014ebf0f048f2a34565646570dde2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:42.918948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4014ebf0f048f2a34565646570dde2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:42.918948 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2816/5616] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:42 2022] DELETE /identity/v3/users/9e4014ebf0f048f2a34565646570dde2 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:42.941964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:42.942558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:42.942646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:43.002452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:43.003713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:43.162272 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2801/5617] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:43.239842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:43.241317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:43.402107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfc09b-3977-4ff7-a566-4c89b0796202 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:43.404120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:43.404983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:43.406481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:43.406935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:43.448775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:43.450635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:43.471631 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2817/5618] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:45.305401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:45.307311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:45.491908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecb33a-cf8c-48c3-ad64-0eaa750bacb2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:45.504767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:45.506236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:45.506628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:45.507010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:45.517666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:45.766165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:45.768247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:45.806408 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2802/5619] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:46.099345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:46.100724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:46.120049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733761-357d-48df-b27d-1c458b2036e4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:46.133893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:46.134558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:46.134845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:46.135126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:46.136918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:46.154047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:46.159069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:46.161365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:46.175649 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2818/5620] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:46.781214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:46.799685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe6e71-0e43-4c12-842f-b518dbef9d24 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:46.801449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:46.804385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:46.817033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d6cf-8ac1-4551-a59f-e88b3ae02f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:46.817670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d6cf-8ac1-4551-a59f-e88b3ae02f33 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:46.817948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d6cf-8ac1-4551-a59f-e88b3ae02f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:46.818262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d6cf-8ac1-4551-a59f-e88b3ae02f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:46.825607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79a7d6cf-8ac1-4551-a59f-e88b3ae02f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:46.835119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a087a-d02f-4c5d-be00-e8dc27396841 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:46.854498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:46.858071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:46.859838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:46.860389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] PATH_INFO: `/v3/projects/c589a6a017fe4a5b8ef2050fd0928ae7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:46.865723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c589a6a017fe4a5b8ef2050fd0928ae7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:46.870866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d6cf-8ac1-4551-a59f-e88b3ae02f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:46.872330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d6cf-8ac1-4551-a59f-e88b3ae02f33 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:46.878104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:46.915169 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2803/5621] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:47.107670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c589a6a017fe4a5b8ef2050fd0928ae7', 'request_id': 'req-af7ef95a-a2fa-4f98-98c3-c5183815aec7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:47.121479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c589a6a017fe4a5b8ef2050fd0928ae7', 'request_id': 'req-af7ef95a-a2fa-4f98-98c3-c5183815aec7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:47.222388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c589a6a017fe4a5b8ef2050fd0928ae7', 'request_id': 'req-af7ef95a-a2fa-4f98-98c3-c5183815aec7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:47.242511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] The token cache is being invalidate because project c589a6a017fe4a5b8ef2050fd0928ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:47.242720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:47.243894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-af7ef95a-a2fa-4f98-98c3-c5183815aec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:47.248295 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2819/5622] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:46 2022] DELETE /identity/v3/projects/c589a6a017fe4a5b8ef2050fd0928ae7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:47.252857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eda3f-47ea-4ee6-846e-459de8c5f810 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:47.253142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eda3f-47ea-4ee6-846e-459de8c5f810 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:47.253493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eda3f-47ea-4ee6-846e-459de8c5f810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:47.285713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a3eda3f-47ea-4ee6-846e-459de8c5f810 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:47.286994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a3eda3f-47ea-4ee6-846e-459de8c5f810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:47.337087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:47.436494 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2804/5623] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:47.444925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2845205-934b-41d2-94d5-8ddfaed7dff6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:47.445306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2845205-934b-41d2-94d5-8ddfaed7dff6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:47.445757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2845205-934b-41d2-94d5-8ddfaed7dff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:47.487198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d2845205-934b-41d2-94d5-8ddfaed7dff6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:47.490863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2845205-934b-41d2-94d5-8ddfaed7dff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:47.515955 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2820/5624] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:47.521971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3eda3f-47ea-4ee6-846e-459de8c5f810 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:47.534330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3eda3f-47ea-4ee6-846e-459de8c5f810 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:47.556236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:47.557139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:47.557544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:47.557887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:47.558701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:46:47.559107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:47.560934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:47.584239 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2805/5625] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:46:47.588123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2845205-934b-41d2-94d5-8ddfaed7dff6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:47.601288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2845205-934b-41d2-94d5-8ddfaed7dff6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:47.616440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:47.617141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:47.617666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:47.618422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:47.619296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:47.628561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:47.776610 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2821/5626] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:47 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:47.780958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:47.795183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6f4ea-c157-4bb0-958d-45c14536a2bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:47.905405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:47.910534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:47.912653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:47.914420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:47.916378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:47.927355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:48.050288 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2806/5627] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:47 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:48.055239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:48.066545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa73db-a047-4a2b-8c01-b9111511b01d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:48.092592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:48.096633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:48.096633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:48.096633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:48.096633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:48.097005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:48.148449 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2822/5628] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:48.152184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:48.167593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801ffb-555b-4dfd-a22f-1c0885b40964 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:48.182139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee61bd-4a10-42ab-99ea-5097096c6876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:48.182781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee61bd-4a10-42ab-99ea-5097096c6876 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:48.183128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee61bd-4a10-42ab-99ea-5097096c6876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:48.183464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee61bd-4a10-42ab-99ea-5097096c6876 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:48.184197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee61bd-4a10-42ab-99ea-5097096c6876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:48.186267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee61bd-4a10-42ab-99ea-5097096c6876 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:48.244264 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2807/5629] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:48.247848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:48.265022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d08a2-825b-4da4-92a8-aa87368af03f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:48.277790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:48.279503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:48.280269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:48.280922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] PATH_INFO: `/v3/projects/27844c98423f4a6abf6931ea494e8a9a/users/359a23707e6b477b9c6a5b2bf5b58908/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:48.305742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27844c98423f4a6abf6931ea494e8a9a, user_id=359a23707e6b477b9c6a5b2bf5b58908, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:48.333308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:48.536462 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2823/5630] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:48 2022] PUT /identity/v3/projects/27844c98423f4a6abf6931ea494e8a9a/users/359a23707e6b477b9c6a5b2bf5b58908/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:48.554427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aebec5-472d-4bf9-8f31-01be245a9215 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:48.555290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aebec5-472d-4bf9-8f31-01be245a9215 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:48.556275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aebec5-472d-4bf9-8f31-01be245a9215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:48.647764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c7aebec5-472d-4bf9-8f31-01be245a9215 None None] MFA Rules not processed for user `359a23707e6b477b9c6a5b2bf5b58908`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:48.665111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7aebec5-472d-4bf9-8f31-01be245a9215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:48.883131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2808/5631] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:48.900599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:48.904833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:49.100170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4fc91-4be9-4b31-a0c9-26aefd248883 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:49.115814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:49.116461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:49.116680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:49.118426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:49.137336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:49.140254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:49.167555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2824/5632] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:51.784520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0194-3e2a-4a67-8f58-bfb7a51d4960 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:51.785553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0194-3e2a-4a67-8f58-bfb7a51d4960 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:51.786002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0194-3e2a-4a67-8f58-bfb7a51d4960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:51.847530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4cec0194-3e2a-4a67-8f58-bfb7a51d4960 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:51.851744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cec0194-3e2a-4a67-8f58-bfb7a51d4960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:51.929748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:52.031881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:52.036539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:52.059834 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2809/5633] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:52.130413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:52.225541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4a592-6425-4b33-aeaa-d0fb2a2758bb service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:52.233619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ba513-f9d2-4ebc-9dc7-a4dbde73b35b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:52.238528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ba513-f9d2-4ebc-9dc7-a4dbde73b35b service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:52.238528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ba513-f9d2-4ebc-9dc7-a4dbde73b35b service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:52.240712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ba513-f9d2-4ebc-9dc7-a4dbde73b35b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:52.276079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ba513-f9d2-4ebc-9dc7-a4dbde73b35b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:52.277908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ba513-f9d2-4ebc-9dc7-a4dbde73b35b service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:52.286156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0194-3e2a-4a67-8f58-bfb7a51d4960 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:52.297291 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2825/5634] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:46:52.460342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0194-3e2a-4a67-8f58-bfb7a51d4960 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:52.476519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:52.477223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:52.477605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:52.477985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] PATH_INFO: `/v3/users/359a23707e6b477b9c6a5b2bf5b58908` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:52.482574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359a23707e6b477b9c6a5b2bf5b58908)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:52.484647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:52.762562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359a23707e6b477b9c6a5b2bf5b58908'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:52.772239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359a23707e6b477b9c6a5b2bf5b58908'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:52.898526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359a23707e6b477b9c6a5b2bf5b58908'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:52.900296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359a23707e6b477b9c6a5b2bf5b58908'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:52.932020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359a23707e6b477b9c6a5b2bf5b58908'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:53.058197 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2810/5635] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:52 2022] DELETE /identity/v3/users/359a23707e6b477b9c6a5b2bf5b58908 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:53.063288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:53.063926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:53.063926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:53.109072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:53.111778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:53.386928 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2826/5636] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:53.480239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:53.480239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:53.721410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:53.731458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40359b-97d3-4757-87c5-573848d3a828 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:53.755062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91664b6c-9c4d-4e13-ab45-62227ab88da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:53.756391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91664b6c-9c4d-4e13-ab45-62227ab88da8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:53.756391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91664b6c-9c4d-4e13-ab45-62227ab88da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:53.756391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91664b6c-9c4d-4e13-ab45-62227ab88da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:53.788761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91664b6c-9c4d-4e13-ab45-62227ab88da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:53.790246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91664b6c-9c4d-4e13-ab45-62227ab88da8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:53.824742 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2811/5637] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:46:55.799644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:55.806255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:55.840303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fec4e-559d-4eae-b840-e4ae15724196 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:55.854268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:55.855517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:55.855801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:55.856075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] PATH_INFO: `/v3/projects/27844c98423f4a6abf6931ea494e8a9a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:55.859104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27844c98423f4a6abf6931ea494e8a9a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:55.870189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:56.134092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27844c98423f4a6abf6931ea494e8a9a', 'request_id': 'req-6733a389-dcab-4ffd-b34f-a099e4569354'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:56.147333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27844c98423f4a6abf6931ea494e8a9a', 'request_id': 'req-6733a389-dcab-4ffd-b34f-a099e4569354'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:56.316591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27844c98423f4a6abf6931ea494e8a9a', 'request_id': 'req-6733a389-dcab-4ffd-b34f-a099e4569354'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:56.369410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] The token cache is being invalidate because project 27844c98423f4a6abf6931ea494e8a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:46:56.371443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:56.375351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6733a389-dcab-4ffd-b34f-a099e4569354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:56.388258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:56.389350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:56.389808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:56.391969 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2827/5638] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:46:55 2022] DELETE /identity/v3/projects/27844c98423f4a6abf6931ea494e8a9a => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:46:56.476433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:56.481070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:56.783675 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2812/5639] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:46:56.792258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90185a8f-4470-4e3a-bf33-20a86505f627 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:56.794917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90185a8f-4470-4e3a-bf33-20a86505f627 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:56.797210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90185a8f-4470-4e3a-bf33-20a86505f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:56.871043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:56.873141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:56.884750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-90185a8f-4470-4e3a-bf33-20a86505f627 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:56.895280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90185a8f-4470-4e3a-bf33-20a86505f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:56.947092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2828/5640] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:56.949488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90185a8f-4470-4e3a-bf33-20a86505f627 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:56.992732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90185a8f-4470-4e3a-bf33-20a86505f627 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:57.012247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:57.012956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:57.013240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:57.013515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:57.021336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:46:57.021755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:57.037298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:57.095445 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2829/5641] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:46:57.106694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:57.176181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03904a95-c464-43fa-87c7-af32a50f5378 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:57.183006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d7599-d27d-4f90-a43f-5241001f453c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:57.195394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:57.196024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:57.196403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:57.196684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:57.206121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:57.219056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:57.220029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:57.220322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:57.220608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:57.221269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:57.223382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:57.283388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:57.388816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:57.397554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:57.402124 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2830/5642] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:46:57 2022] POST /identity/v3/projects => generated 361 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:57.406376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:57.426428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2813/5643] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:46:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:46:57.728541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5d90-b858-4635-8799-4ce7c6caf94f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:57.744597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:57.745298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:57.745689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:57.746426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:57.747527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:57.759699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:57.974618 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2831/5644] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:46:57 2022] POST /identity/v3/users => generated 281 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:46:57.979265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:58.003250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cded38-c75a-4a82-8f52-83017d72dc66 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:58.035815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:58.036468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:58.036754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:58.037028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:58.037773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:58.042266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:58.080858 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2814/5645] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:46:58.089485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:58.108200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77ab1e-9fcf-4dc8-bb8a-b80fad801cc6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:58.142957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07918db9-cfb8-4003-b8b1-b9406bddf129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:58.143885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918db9-cfb8-4003-b8b1-b9406bddf129 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:58.144166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918db9-cfb8-4003-b8b1-b9406bddf129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:58.144437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918db9-cfb8-4003-b8b1-b9406bddf129 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:58.145340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07918db9-cfb8-4003-b8b1-b9406bddf129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:58.147976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07918db9-cfb8-4003-b8b1-b9406bddf129 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:58.173524 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2832/5646] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:46:58.175980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:58.191827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c73c0-5f47-46c0-8de9-2df817c3491b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:58.198586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:58.199786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:58.200225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:58.200633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] PATH_INFO: `/v3/projects/9508b13821464913a668b7685842ecad/users/240e4a4e81fd44b0b1f4a7d6515ac3aa/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:58.246318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9508b13821464913a668b7685842ecad, user_id=240e4a4e81fd44b0b1f4a7d6515ac3aa, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:58.259563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:58.486989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:58.505621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fd4cf-c54a-48cf-aa23-b52980851966 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:58.506124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fd4cf-c54a-48cf-aa23-b52980851966 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:58.506635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fd4cf-c54a-48cf-aa23-b52980851966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:58.510431 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2815/5647] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:46:58 2022] PUT /identity/v3/projects/9508b13821464913a668b7685842ecad/users/240e4a4e81fd44b0b1f4a7d6515ac3aa/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:58.645785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-926fd4cf-c54a-48cf-aa23-b52980851966 None None] MFA Rules not processed for user `240e4a4e81fd44b0b1f4a7d6515ac3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:58.657863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-926fd4cf-c54a-48cf-aa23-b52980851966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:58.835778 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2833/5648] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:46:58.852350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:46:59.028251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117114e0-fa81-4521-a82b-3a772fd1c407 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:46:59.038348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:46:59.041265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:59.048792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:59.048792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] PATH_INFO: `/v3/users/240e4a4e81fd44b0b1f4a7d6515ac3aa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:59.048792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240e4a4e81fd44b0b1f4a7d6515ac3aa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:46:59.051608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:46:59.495963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240e4a4e81fd44b0b1f4a7d6515ac3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:59.508179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240e4a4e81fd44b0b1f4a7d6515ac3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:59.644027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240e4a4e81fd44b0b1f4a7d6515ac3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:59.651738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240e4a4e81fd44b0b1f4a7d6515ac3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:59.664156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240e4a4e81fd44b0b1f4a7d6515ac3aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:46:59.734521 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2816/5649] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:46:58 2022] DELETE /identity/v3/users/240e4a4e81fd44b0b1f4a7d6515ac3aa => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:46:59.739630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:46:59.740089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:46:59.740178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:46:59.791400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:46:59.792918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:46:59.972212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:59.996052 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2834/5650] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:00.194166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:00.195703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:00.428216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c4ff1-2778-4d32-a4dd-b38f52c3dd24 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:00.443974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8e9cc-de24-4eb4-8d25-77d5066e32a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:00.444706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e9cc-de24-4eb4-8d25-77d5066e32a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:00.445958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e9cc-de24-4eb4-8d25-77d5066e32a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:00.465432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e9cc-de24-4eb4-8d25-77d5066e32a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:00.493404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e9cc-de24-4eb4-8d25-77d5066e32a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:00.495360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e9cc-de24-4eb4-8d25-77d5066e32a7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:00.523024 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2817/5651] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:03.092971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:03.096307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:03.128213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d579ef-489b-4c8c-b497-bfb88bb73a31 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:03.154777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:03.155912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:03.155912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:03.156369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] PATH_INFO: `/v3/projects/9508b13821464913a668b7685842ecad` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:03.167269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9508b13821464913a668b7685842ecad)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:03.169253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:03.452760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9508b13821464913a668b7685842ecad', 'request_id': 'req-2e797e50-05cf-472f-ae5a-191876bd26e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:03.485684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9508b13821464913a668b7685842ecad', 'request_id': 'req-2e797e50-05cf-472f-ae5a-191876bd26e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:03.659950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9508b13821464913a668b7685842ecad', 'request_id': 'req-2e797e50-05cf-472f-ae5a-191876bd26e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:03.678689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] The token cache is being invalidate because project 9508b13821464913a668b7685842ecad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:47:03.679059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:03.680936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e797e50-05cf-472f-ae5a-191876bd26e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:03.688293 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2835/5652] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:47:03 2022] DELETE /identity/v3/projects/9508b13821464913a668b7685842ecad => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:03.690259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec655a75-5451-49d4-8738-bbcd002a8291 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:03.690726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec655a75-5451-49d4-8738-bbcd002a8291 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:03.690837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec655a75-5451-49d4-8738-bbcd002a8291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:03.729460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ec655a75-5451-49d4-8738-bbcd002a8291 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:03.740075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec655a75-5451-49d4-8738-bbcd002a8291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:03.770193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:03.904098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2818/5653] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:03.911736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23318-f3dc-4ad9-9962-45ff685c4464 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:03.912235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23318-f3dc-4ad9-9962-45ff685c4464 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:03.912735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23318-f3dc-4ad9-9962-45ff685c4464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:03.957817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c7a23318-f3dc-4ad9-9962-45ff685c4464 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:03.959833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7a23318-f3dc-4ad9-9962-45ff685c4464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:03.972021 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2836/5654] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:03.986775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec655a75-5451-49d4-8738-bbcd002a8291 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:04.002946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec655a75-5451-49d4-8738-bbcd002a8291 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:04.022093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:04.023495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:04.023805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:04.024878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:04.026838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:47:04.027519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:04.048978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:04.075613 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2819/5655] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:47:04.077007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a23318-f3dc-4ad9-9962-45ff685c4464 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:04.093151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a23318-f3dc-4ad9-9962-45ff685c4464 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:04.105859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:04.106518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:04.106805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:04.107108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:04.107785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:04.111680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:04.305243 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2837/5656] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:47:04 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:47:04.307197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:04.323842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae71c55-d058-45b6-ade0-ba11cf833cd9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:04.493620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:04.494818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:04.496340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:04.497232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:04.499592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:04.503676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:04.680674 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2820/5657] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:47:04 2022] POST /identity/v3/users => generated 288 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:04.682006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:04.699292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2fca2-4ca2-470b-b9b8-2d8c1c3ab985 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:04.711985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:04.712943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:04.713385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:04.713819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:04.715912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:04.719853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:04.779864 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2838/5658] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:04.784508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:04.795498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2b1c-4125-45dd-a953-9ad2ba279e95 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:04.814420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71a3ff-3faf-48a0-b09b-36dd09a2b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:04.815328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71a3ff-3faf-48a0-b09b-36dd09a2b657 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:04.815805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71a3ff-3faf-48a0-b09b-36dd09a2b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:04.816253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71a3ff-3faf-48a0-b09b-36dd09a2b657 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:04.817506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71a3ff-3faf-48a0-b09b-36dd09a2b657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:04.820490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71a3ff-3faf-48a0-b09b-36dd09a2b657 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:04.870313 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2821/5659] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:04.870538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:04.885302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85549869-34ac-40df-9469-9414932926c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:04.916106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:04.916106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:04.916106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:04.916106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] PATH_INFO: `/v3/projects/0c35f3240f8548e08a7d0d42ca522c56/users/3ee0537657be46c9a044f85cb4d2245e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:04.942682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c35f3240f8548e08a7d0d42ca522c56, user_id=3ee0537657be46c9a044f85cb4d2245e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:04.945952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:05.098391 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2839/5660] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:04 2022] PUT /identity/v3/projects/0c35f3240f8548e08a7d0d42ca522c56/users/3ee0537657be46c9a044f85cb4d2245e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:05.105822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe92d-9ebf-408b-a6ec-1b2ff44f7e5e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:05.106428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe92d-9ebf-408b-a6ec-1b2ff44f7e5e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:05.106860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fe92d-9ebf-408b-a6ec-1b2ff44f7e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:05.183784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b3fe92d-9ebf-408b-a6ec-1b2ff44f7e5e None None] MFA Rules not processed for user `3ee0537657be46c9a044f85cb4d2245e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:05.185278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b3fe92d-9ebf-408b-a6ec-1b2ff44f7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:05.365741 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2822/5661] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:05.369965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:05.530320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce92be5-421b-4e47-aace-1b10fa6856dc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:05.549527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:05.550184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:05.550703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:05.551181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:05.552242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:05.557829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:05.740351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe92d-9ebf-408b-a6ec-1b2ff44f7e5e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:05.747028 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2840/5662] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:05.761576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fe92d-9ebf-408b-a6ec-1b2ff44f7e5e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:05.911237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:05.912587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:05.913032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:05.913924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:05.915277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:05.920381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:06.076519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:06.077524 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2823/5663] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:47:05 2022] POST /identity/v3/users => generated 295 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:47:06.088484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:06.115213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea3f5-b2e8-431f-a1e6-77af085f6192 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:06.121360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:06.121987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:06.122365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:06.123017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:06.123781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:06.126230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:06.160961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:06.162497 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2841/5664] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:47:06.192544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe10f0-1ec1-41c8-b26d-985eb74ac91e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:06.210618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:06.213465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:06.213856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:06.214309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] PATH_INFO: `/v3/projects/f481840abb0543629b2610f3ed5aaa8c/users/6a2ad29938534e4e9facb3de9c2df6cb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:06.261450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f481840abb0543629b2610f3ed5aaa8c, user_id=6a2ad29938534e4e9facb3de9c2df6cb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:06.264856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:06.309392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:06.388839 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2824/5665] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:06 2022] PUT /identity/v3/projects/f481840abb0543629b2610f3ed5aaa8c/users/6a2ad29938534e4e9facb3de9c2df6cb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:06.393727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:06.415843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3984-791c-4dc7-b107-1bbfccb5dd5b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:06.665023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b69f28-e5c1-4292-b51f-7384b4e59be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:06.667795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b69f28-e5c1-4292-b51f-7384b4e59be3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:06.671988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b69f28-e5c1-4292-b51f-7384b4e59be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:06.680328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b69f28-e5c1-4292-b51f-7384b4e59be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:06.680328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b69f28-e5c1-4292-b51f-7384b4e59be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:06.680328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b69f28-e5c1-4292-b51f-7384b4e59be3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:06.745925 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2842/5666] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:06.746548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:06.774498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509735f8-78cc-43b7-a43e-3b78ef1e957d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:06.793283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:06.794301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:06.803415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:06.803415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] PATH_INFO: `/v3/projects/f481840abb0543629b2610f3ed5aaa8c/users/6a2ad29938534e4e9facb3de9c2df6cb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:06.803415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f481840abb0543629b2610f3ed5aaa8c, user_id=6a2ad29938534e4e9facb3de9c2df6cb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:06.809957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:06.889792 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2825/5667] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:06 2022] PUT /identity/v3/projects/f481840abb0543629b2610f3ed5aaa8c/users/6a2ad29938534e4e9facb3de9c2df6cb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:06.904107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:06.904773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:06.905536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:07.037558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] MFA Rules not processed for user `6a2ad29938534e4e9facb3de9c2df6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:07.044391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:07.402668 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2843/5668] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:07.509717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:07.513050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:07.759737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb6e4-3551-4ff3-8dca-6f7848791407 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:07.759737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:07.759737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:07.759737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:07.778804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:07.778804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:07.778804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:07.788154 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2826/5669] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:11.273146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:11.273146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:11.491606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda92c1-482e-48de-9a51-47a20e262116 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:11.491606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:11.491606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:11.491606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:11.492547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] PATH_INFO: `/v3/users/636efdb31d874043866bc0bd177acf25` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:11.492547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636efdb31d874043866bc0bd177acf25)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:11.492547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:11.492547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:11.492849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:11.492849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:11.710087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d3a6e-0e4d-4370-a5a1-4bf9f2f3464b service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:11.726137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e7c40-4d36-4d81-b5f7-ee508b2c455d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:11.729559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e7c40-4d36-4d81-b5f7-ee508b2c455d service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:11.730028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e7c40-4d36-4d81-b5f7-ee508b2c455d service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:11.730544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e7c40-4d36-4d81-b5f7-ee508b2c455d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:11.732774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e45e7c40-4d36-4d81-b5f7-ee508b2c455d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:11.759134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e7c40-4d36-4d81-b5f7-ee508b2c455d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:11.760968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e7c40-4d36-4d81-b5f7-ee508b2c455d service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:11.769512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:11.787461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2827/5670] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:47:12.421166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636efdb31d874043866bc0bd177acf25'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:12.472805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636efdb31d874043866bc0bd177acf25'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:12.477104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636efdb31d874043866bc0bd177acf25'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:12.546318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636efdb31d874043866bc0bd177acf25'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:12.666308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636efdb31d874043866bc0bd177acf25'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:12.680820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:12.681777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:12.682859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:12.688714 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2844/5671] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:47:11 2022] DELETE /identity/v3/users/636efdb31d874043866bc0bd177acf25 => generated 0 bytes in 1407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:12.760207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:12.761778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:13.041863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2828/5672] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:13.118548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:13.120245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:13.303761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942ba7-e28b-4dfb-89d1-8b882a9051d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:13.318107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:13.319263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:13.319662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:13.320499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:13.343755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:13.351025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:13.376789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2845/5673] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:15.411206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:15.412325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:15.447325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d0e07-1a60-44c4-bb86-852f657a1eb6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:15.458684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:15.459631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:15.460341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:15.460862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] PATH_INFO: `/v3/projects/cdecaa6d60314a2e8365ab21545ba675` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:15.472270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdecaa6d60314a2e8365ab21545ba675)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:15.473126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:15.707321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdecaa6d60314a2e8365ab21545ba675', 'request_id': 'req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:15.717360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdecaa6d60314a2e8365ab21545ba675', 'request_id': 'req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:15.784346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:15.786730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:15.805530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65a06-c501-4c85-befe-c37ec37729ee service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:15.831275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdecaa6d60314a2e8365ab21545ba675', 'request_id': 'req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:15.853184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] The token cache is being invalidate because project cdecaa6d60314a2e8365ab21545ba675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:47:15.854481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:15.856035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f2570cba-3f8c-4cd3-961e-7a9e293ab2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:15.862151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2829/5674] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:47:15 2022] DELETE /identity/v3/projects/cdecaa6d60314a2e8365ab21545ba675 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:15.867877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4d7a-9fc4-4166-9be5-fa678aba04ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:15.868355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4d7a-9fc4-4166-9be5-fa678aba04ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:15.868925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace4d7a-9fc4-4166-9be5-fa678aba04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:15.962736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7ace4d7a-9fc4-4166-9be5-fa678aba04ca None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:15.962736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7ace4d7a-9fc4-4166-9be5-fa678aba04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:15.987563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:15.987804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:15.988274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:15.988782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] PATH_INFO: `/v3/users/3ee0537657be46c9a044f85cb4d2245e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:15.992260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee0537657be46c9a044f85cb4d2245e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:15.995198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:16.073326 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2830/5675] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:16.084561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135495c3-35ca-4a02-838c-3961dc908f6d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.085318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135495c3-35ca-4a02-838c-3961dc908f6d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.085814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135495c3-35ca-4a02-838c-3961dc908f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.113990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-135495c3-35ca-4a02-838c-3961dc908f6d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:16.115432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-135495c3-35ca-4a02-838c-3961dc908f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:16.127922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2831/5676] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:16.134943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135495c3-35ca-4a02-838c-3961dc908f6d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:16.148175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135495c3-35ca-4a02-838c-3961dc908f6d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:16.160484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:16.161094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.162364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.163846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.165261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:47:16.165683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:16.167516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:16.187178 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2832/5677] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:47:16.194092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:16.205832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:16.222849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb1a63-7ed8-41fb-b24e-d4aecd7c75ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:16.241043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:16.245061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.245061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.245061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.245061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:16.246433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:16.299567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:16.317056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee0537657be46c9a044f85cb4d2245e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:16.334830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee0537657be46c9a044f85cb4d2245e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:16.336938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee0537657be46c9a044f85cb4d2245e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:16.348539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2833/5678] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:47:16 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:16.352909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:16.360321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:16.377453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee0537657be46c9a044f85cb4d2245e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:16.506873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8d8dc5dc-08e9-40c0-b570-a14903e4f37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee0537657be46c9a044f85cb4d2245e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:16.520583 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2846/5679] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:47:15 2022] DELETE /identity/v3/users/3ee0537657be46c9a044f85cb4d2245e => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:47:16.532823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.533182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.533582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.534170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6f2f6-0a2f-4cd2-8b21-53f34840eacf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:16.569328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:16.571935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:16.674314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:16.675897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.676425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.677589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.679002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:16.684539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:16.745631 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2847/5680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:16.758539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:16.760934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:16.833488 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2834/5681] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:47:16 2022] POST /identity/v3/users => generated 287 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:47:16.834881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:16.853221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aebb8a-5605-40d0-a789-9081fdca9b0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:16.876245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:16.877121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.877417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.877697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.879017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:16.880690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:16.906881 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2835/5682] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:16.908708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:16.921245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0ba56-9efd-4eef-b6f2-05bde60637b8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:16.928380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:16.929065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.932292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.932634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.933324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:16.937106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:16.939403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efd56e-dcd3-4657-8a4f-0218dc229295 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:16.946834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640b9b-d068-4f37-bd70-766b4d08f64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:16.947478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640b9b-d068-4f37-bd70-766b4d08f64e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.949746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640b9b-d068-4f37-bd70-766b4d08f64e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.950031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640b9b-d068-4f37-bd70-766b4d08f64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:16.964428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2836/5683] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:16.965780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:16.975205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640b9b-d068-4f37-bd70-766b4d08f64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:16.978232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640b9b-d068-4f37-bd70-766b4d08f64e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:16.980167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ad0c7-f671-4898-9d3d-39a80fdbb6ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:16.986021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:16.990532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:16.993417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:16.993753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] PATH_INFO: `/v3/projects/6cb53c0efe184e22924ac20e3b33934b/users/2c3b398d488848fd83dc89a187f6f393/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:17.002836 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2848/5684] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:17.014631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb53c0efe184e22924ac20e3b33934b, user_id=2c3b398d488848fd83dc89a187f6f393, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:17.018712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:17.141806 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2837/5685] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:16 2022] PUT /identity/v3/projects/6cb53c0efe184e22924ac20e3b33934b/users/2c3b398d488848fd83dc89a187f6f393/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:17.145336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:17.145612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:17.145892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:17.190163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] MFA Rules not processed for user `2c3b398d488848fd83dc89a187f6f393`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:17.191482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:17.321549 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2849/5686] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:17.338900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:17.342816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:17.494082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2e0ee-3acb-408d-a680-7b80d07d58c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:17.499452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:17.499750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:17.499988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:17.500830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:17.510708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:17.512750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:17.530543 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2838/5687] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:17.738044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:18.124738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:18.126253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:18.187229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:18.307184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26652c3a-0487-47f1-a925-968bfa154348 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:18.314835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:18.315735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:18.316205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:18.316645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] PATH_INFO: `/v3/projects/0c35f3240f8548e08a7d0d42ca522c56` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:18.318539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c35f3240f8548e08a7d0d42ca522c56)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:18.321451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:18.532776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c35f3240f8548e08a7d0d42ca522c56', 'request_id': 'req-266e4166-1e53-4261-94fd-e7101a50e138'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:18.555468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c35f3240f8548e08a7d0d42ca522c56', 'request_id': 'req-266e4166-1e53-4261-94fd-e7101a50e138'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:18.649353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c35f3240f8548e08a7d0d42ca522c56', 'request_id': 'req-266e4166-1e53-4261-94fd-e7101a50e138'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:18.682048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] The token cache is being invalidate because project 0c35f3240f8548e08a7d0d42ca522c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:47:18.682591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:18.683537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-266e4166-1e53-4261-94fd-e7101a50e138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:18.689380 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2850/5688] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:47:18 2022] DELETE /identity/v3/projects/0c35f3240f8548e08a7d0d42ca522c56 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:18.693760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:18.720106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0d913-d908-4fef-acdf-73cb159bef46 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:18.851922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:18.853539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:18.854817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:18.855305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] PATH_INFO: `/v3/users/6a2ad29938534e4e9facb3de9c2df6cb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:18.861066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2ad29938534e4e9facb3de9c2df6cb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:18.861066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:19.260132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2ad29938534e4e9facb3de9c2df6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:19.261952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2ad29938534e4e9facb3de9c2df6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:19.483386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2ad29938534e4e9facb3de9c2df6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:19.484439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2ad29938534e4e9facb3de9c2df6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:19.497120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2ad29938534e4e9facb3de9c2df6cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:19.539872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2839/5689] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:47:18 2022] DELETE /identity/v3/users/6a2ad29938534e4e9facb3de9c2df6cb => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:20.503602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423053-7698-4509-a463-14353e8ebe04 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:20.504314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423053-7698-4509-a463-14353e8ebe04 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:20.504314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423053-7698-4509-a463-14353e8ebe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:20.561707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-50423053-7698-4509-a463-14353e8ebe04 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:20.565364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50423053-7698-4509-a463-14353e8ebe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:20.571095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:20.574595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:20.715909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:20.732585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82160-70f0-471f-87c4-368736d23acc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:20.743111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:20.743787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:20.744070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:20.744344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] PATH_INFO: `/v3/projects/f481840abb0543629b2610f3ed5aaa8c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:20.749911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f481840abb0543629b2610f3ed5aaa8c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:20.753541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:20.769941 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2851/5690] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:20.795831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50423053-7698-4509-a463-14353e8ebe04 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:20.800041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-50423053-7698-4509-a463-14353e8ebe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:20.891208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:21.048896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50423053-7698-4509-a463-14353e8ebe04 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:21.064213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f481840abb0543629b2610f3ed5aaa8c', 'request_id': 'req-cf5db4d5-651a-4713-97ab-56af2fc4225d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:21.087880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f481840abb0543629b2610f3ed5aaa8c', 'request_id': 'req-cf5db4d5-651a-4713-97ab-56af2fc4225d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:21.242891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f481840abb0543629b2610f3ed5aaa8c', 'request_id': 'req-cf5db4d5-651a-4713-97ab-56af2fc4225d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:21.269601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] The token cache is being invalidate because project f481840abb0543629b2610f3ed5aaa8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:47:21.270198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:21.271674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cf5db4d5-651a-4713-97ab-56af2fc4225d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:21.272738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20859d07-be90-4bbb-b6c8-831870e8cc4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:21.273392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859d07-be90-4bbb-b6c8-831870e8cc4e service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:21.273676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859d07-be90-4bbb-b6c8-831870e8cc4e service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:21.273952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859d07-be90-4bbb-b6c8-831870e8cc4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:21.278678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20859d07-be90-4bbb-b6c8-831870e8cc4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:21.280263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2840/5691] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:47:20 2022] DELETE /identity/v3/projects/f481840abb0543629b2610f3ed5aaa8c => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:21.291688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79589-5a48-43d9-909c-c217c850b0ba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:21.291688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79589-5a48-43d9-909c-c217c850b0ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:21.291688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c79589-5a48-43d9-909c-c217c850b0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:21.329893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-79c79589-5a48-43d9-909c-c217c850b0ba None None] MFA Rules not processed for user `2c3b398d488848fd83dc89a187f6f393`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:21.337519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-79c79589-5a48-43d9-909c-c217c850b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:21.443567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20859d07-be90-4bbb-b6c8-831870e8cc4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:21.445698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20859d07-be90-4bbb-b6c8-831870e8cc4e service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:21.465949 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2852/5692] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:47:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:21.467331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57ace-8785-480e-962a-3b800390471a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:21.467616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57ace-8785-480e-962a-3b800390471a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:21.467902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57ace-8785-480e-962a-3b800390471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:21.546287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-71f57ace-8785-480e-962a-3b800390471a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:21.550680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71f57ace-8785-480e-962a-3b800390471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:21.566515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2841/5693] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:21.728636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe29f8-07c5-4f3d-9b82-84e97ca76cc8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:21.729517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe29f8-07c5-4f3d-9b82-84e97ca76cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:21.729517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe29f8-07c5-4f3d-9b82-84e97ca76cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:21.801930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f1fe29f8-07c5-4f3d-9b82-84e97ca76cc8 None None] MFA Rules not processed for user `371dc522b1db4365900595d2fb0df7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:21.806551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f1fe29f8-07c5-4f3d-9b82-84e97ca76cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:21.839648 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2853/5694] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:21.844247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93709900-2dc6-4520-a1aa-8284c34a9548 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:21.846554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93709900-2dc6-4520-a1aa-8284c34a9548 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:21.850654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93709900-2dc6-4520-a1aa-8284c34a9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:21.888845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-93709900-2dc6-4520-a1aa-8284c34a9548 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:21.891674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93709900-2dc6-4520-a1aa-8284c34a9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:21.904626 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2854/5695] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:21.909265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93709900-2dc6-4520-a1aa-8284c34a9548 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:21.932250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93709900-2dc6-4520-a1aa-8284c34a9548 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:21.971390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:21.972095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:21.972436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:21.972858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:21.974862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:47:21.975177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:22.006467 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2842/5696] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:22.006646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:22.024149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939391-e7ae-467f-b3fe-57d5e0c40f7b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:22.024529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939391-e7ae-467f-b3fe-57d5e0c40f7b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:22.024836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939391-e7ae-467f-b3fe-57d5e0c40f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:22.032184 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2855/5697] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:47:22.037975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:22.086737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac71a9-897d-44d0-9ea3-53aa66e4cd19 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:22.093556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-60939391-e7ae-467f-b3fe-57d5e0c40f7b None None] MFA Rules not processed for user `371dc522b1db4365900595d2fb0df7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:22.102545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-60939391-e7ae-467f-b3fe-57d5e0c40f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:22.117966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:22.120128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:22.120641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:22.121075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:22.122656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:22.135473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:22.182488 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2843/5698] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:47:22.184992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:22.522821 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2856/5699] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:47:22 2022] POST /identity/v3/projects => generated 397 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:22.527442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939391-e7ae-467f-b3fe-57d5e0c40f7b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:22.547380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939391-e7ae-467f-b3fe-57d5e0c40f7b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:22.635099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:22.712401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:22.713611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:22.714076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:22.714624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:22.715603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:22.720660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:22.880139 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2844/5700] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:47:22 2022] POST /identity/v3/users => generated 299 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:22.883932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:22.909707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f1580-7090-447d-9b43-8c98fe82fc7d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:22.945032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:22.945668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:22.950464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:22.950969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:22.951956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:22.954237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:22.981470 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2857/5701] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:22.985371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:23.008450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c8a4-0072-40ac-b935-0c1d0fb233c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:23.018431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73b2b1-73f9-4e77-a816-8ed2296a14d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:23.019628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b2b1-73f9-4e77-a816-8ed2296a14d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:23.020306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b2b1-73f9-4e77-a816-8ed2296a14d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:23.020884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73b2b1-73f9-4e77-a816-8ed2296a14d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:23.022267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73b2b1-73f9-4e77-a816-8ed2296a14d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:23.024807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73b2b1-73f9-4e77-a816-8ed2296a14d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:23.047887 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2845/5702] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:47:23.055541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:23.069243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1861a-c123-45db-b6ed-dde977facc2b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:23.080710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:23.081409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:23.081697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:23.081975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] PATH_INFO: `/v3/projects/14eefd71318746dfaa73bd8aec22ce4d/users/fdcf9b2e80474636baa24e696753e0bb/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:23.118778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eefd71318746dfaa73bd8aec22ce4d, user_id=fdcf9b2e80474636baa24e696753e0bb, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:23.123837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:23.259104 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2858/5703] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:23 2022] PUT /identity/v3/projects/14eefd71318746dfaa73bd8aec22ce4d/users/fdcf9b2e80474636baa24e696753e0bb/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:23.269683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df74c-115e-466b-aeb0-ff28bec9045c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:23.269960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df74c-115e-466b-aeb0-ff28bec9045c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:23.270267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df74c-115e-466b-aeb0-ff28bec9045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:23.365143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f21df74c-115e-466b-aeb0-ff28bec9045c None None] MFA Rules not processed for user `fdcf9b2e80474636baa24e696753e0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:23.370209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f21df74c-115e-466b-aeb0-ff28bec9045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:23.542685 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2846/5704] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:23.547093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:23.699413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73733f23-ad02-401d-b283-29ed4d8a14a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:23.731042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:23.732046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:23.738629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:23.739169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:23.740329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:23.749821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:23.921109 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2859/5705] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:47:23 2022] POST /identity/v3/projects => generated 397 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:23.925709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21df74c-115e-466b-aeb0-ff28bec9045c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:23.942992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21df74c-115e-466b-aeb0-ff28bec9045c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:24.099393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:24.102484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:24.102767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:24.103039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:24.111117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:24.112986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:24.253159 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2847/5706] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:47:23 2022] POST /identity/v3/users => generated 305 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:24.257480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:24.288650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7400f9a-bded-493d-8c4e-bbe2d136e172 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:24.307154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:24.310984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:24.311515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:24.311954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:24.317125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:24.323988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:24.352960 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2860/5707] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:24.363260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:24.382130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709a4d6-aa94-41fc-bbe0-fc6347a92535 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:24.435133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:24.439668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:24.447183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:24.447183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] PATH_INFO: `/v3/projects/7bb7957def8745689757d2f1d476b5c2/users/1252053db4254a7286a6379d6948b5c0/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:24.489332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb7957def8745689757d2f1d476b5c2, user_id=1252053db4254a7286a6379d6948b5c0, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:24.493407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:24.611316 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2848/5708] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:24 2022] PUT /identity/v3/projects/7bb7957def8745689757d2f1d476b5c2/users/1252053db4254a7286a6379d6948b5c0/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:24.615693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:24.634034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f241596-cb22-4871-aeec-8211a2a7fea3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:24.880945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199524c4-d34a-4871-ba2d-8747b9c3974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:24.881619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199524c4-d34a-4871-ba2d-8747b9c3974c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:24.881952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199524c4-d34a-4871-ba2d-8747b9c3974c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:24.882305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199524c4-d34a-4871-ba2d-8747b9c3974c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:24.883227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199524c4-d34a-4871-ba2d-8747b9c3974c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:24.891720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199524c4-d34a-4871-ba2d-8747b9c3974c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:24.907820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:24.926970 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2861/5709] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:24.927574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:24.933583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:24.952406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f3ff-e63e-4474-ac7b-4ac213b16b78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:24.973356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:24.974232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:24.974573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:24.974914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] PATH_INFO: `/v3/projects/7bb7957def8745689757d2f1d476b5c2/users/1252053db4254a7286a6379d6948b5c0/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:24.981581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb7957def8745689757d2f1d476b5c2, user_id=1252053db4254a7286a6379d6948b5c0, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:24.985711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:25.021434 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2849/5710] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:24 2022] PUT /identity/v3/projects/7bb7957def8745689757d2f1d476b5c2/users/1252053db4254a7286a6379d6948b5c0/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:47:25.037348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:25.037858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:25.038385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:25.118438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] MFA Rules not processed for user `1252053db4254a7286a6379d6948b5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:25.126068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:25.280994 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2862/5711] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:25.321895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:25.321895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:25.441338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b15f4-ca3f-49d7-a878-bfa662a9e8d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:25.446537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:25.447701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:25.448241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:25.448851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:25.601387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:25.603446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:25.658826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:25.662033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:25.697019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2850/5712] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:25.768373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd8548-b7cc-4fa9-8850-a152f8bff9d0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:25.777631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:25.778415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:25.779377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:25.779739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:25.783071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:25.837234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:25.839905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:25.856620 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2863/5713] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:27.499335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:27.501047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:27.671764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554f70-5e15-486b-a7b7-b99f426722a1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:27.684781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:27.690291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:27.690291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:27.690291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:27.695975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:27.698162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:27.710560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2851/5714] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:35.848637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=66 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:37.705007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:48.364249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:48.383048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0880a9-0e6a-4d29-bfac-e8585b3a202d service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:48.389528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2191ea-bc8b-499a-9f22-0b1711820b9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:48.391588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2191ea-bc8b-499a-9f22-0b1711820b9d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:48.391874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2191ea-bc8b-499a-9f22-0b1711820b9d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:48.392244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2191ea-bc8b-499a-9f22-0b1711820b9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:48.397559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f2191ea-bc8b-499a-9f22-0b1711820b9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:48.415541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2191ea-bc8b-499a-9f22-0b1711820b9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:48.417118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2191ea-bc8b-499a-9f22-0b1711820b9d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:48.433422 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2864/5715] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:49.203762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:49.330080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f05c95-82e5-40f4-a169-fb0763b532cb service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:49.337342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:49.338253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:49.339215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:49.339830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] PATH_INFO: `/v3/users/fdcf9b2e80474636baa24e696753e0bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:49.342712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdcf9b2e80474636baa24e696753e0bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:49.346556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:49.646917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdcf9b2e80474636baa24e696753e0bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:49.648575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdcf9b2e80474636baa24e696753e0bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:49.768812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdcf9b2e80474636baa24e696753e0bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:49.775256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdcf9b2e80474636baa24e696753e0bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:49.851153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdcf9b2e80474636baa24e696753e0bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:49.933254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2852/5716] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:47:49 2022] DELETE /identity/v3/users/fdcf9b2e80474636baa24e696753e0bb => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:49.937929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:49.943434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:49.950327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:49.995670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:49.996692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:50.146400 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2865/5717] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:50.157986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:50.160610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:50.346591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b2cf9-57e2-4be6-aee6-edc1f0aeb4ce admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:50.363018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:50.363678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:50.363944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:50.365559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:50.381459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:50.384400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:50.446299 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2853/5718] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:51.130625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:51.133893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:51.220590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ee09a-4eaf-434e-b808-e02bfdcb4381 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:51.243365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:51.244101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:51.244386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:51.244662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] PATH_INFO: `/v3/projects/14eefd71318746dfaa73bd8aec22ce4d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:51.251064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eefd71318746dfaa73bd8aec22ce4d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:51.253072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:51.480995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eefd71318746dfaa73bd8aec22ce4d', 'request_id': 'req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:51.516947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eefd71318746dfaa73bd8aec22ce4d', 'request_id': 'req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:51.687740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eefd71318746dfaa73bd8aec22ce4d', 'request_id': 'req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:51.714206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] The token cache is being invalidate because project 14eefd71318746dfaa73bd8aec22ce4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:47:51.714788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:51.716064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:51.720190 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2866/5719] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:47:51 2022] DELETE /identity/v3/projects/14eefd71318746dfaa73bd8aec22ce4d => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:51.724202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:51.738575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd5ed-c892-42e1-98dd-37e077540fbc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:51.767383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:51.889458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:51.890993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:51.891492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:51.891951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] PATH_INFO: `/v3/users/1252053db4254a7286a6379d6948b5c0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:51.893387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1252053db4254a7286a6379d6948b5c0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:51.896803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:52.184469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1252053db4254a7286a6379d6948b5c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:52.185972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1252053db4254a7286a6379d6948b5c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:52.351979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1252053db4254a7286a6379d6948b5c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:52.353424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1252053db4254a7286a6379d6948b5c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:52.369221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-13f89417-ad76-4806-b166-50fbab8e5e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1252053db4254a7286a6379d6948b5c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:52.441037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2854/5720] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:47:51 2022] DELETE /identity/v3/users/1252053db4254a7286a6379d6948b5c0 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:54.655021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:54.657848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:54.682230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda2c2-f92e-4235-a9e5-eeeae5e330ba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:54.929981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:54.930775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:54.931040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:54.931314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] PATH_INFO: `/v3/projects/7bb7957def8745689757d2f1d476b5c2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:54.934827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb7957def8745689757d2f1d476b5c2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:54.938003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:54.979847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:55.279118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb7957def8745689757d2f1d476b5c2', 'request_id': 'req-61b99ebf-5976-4d98-b77e-c4fdef8a87be'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:55.304484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb7957def8745689757d2f1d476b5c2', 'request_id': 'req-61b99ebf-5976-4d98-b77e-c4fdef8a87be'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:55.413854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb7957def8745689757d2f1d476b5c2', 'request_id': 'req-61b99ebf-5976-4d98-b77e-c4fdef8a87be'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:55.439142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] The token cache is being invalidate because project 7bb7957def8745689757d2f1d476b5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:47:55.439508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:55.441587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b99ebf-5976-4d98-b77e-c4fdef8a87be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:47:55.445811 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2867/5721] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:47:54 2022] DELETE /identity/v3/projects/7bb7957def8745689757d2f1d476b5c2 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:55.450636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995441cc-7ba3-468e-b36e-26877be450e4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:55.451638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995441cc-7ba3-468e-b36e-26877be450e4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:55.452214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995441cc-7ba3-468e-b36e-26877be450e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:55.552900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-995441cc-7ba3-468e-b36e-26877be450e4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:55.585790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-995441cc-7ba3-468e-b36e-26877be450e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:55.807971 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2855/5722] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:55.820221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a74e67-4c9d-4979-a271-a5cd2e467ad4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:55.821221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a74e67-4c9d-4979-a271-a5cd2e467ad4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:55.821728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a74e67-4c9d-4979-a271-a5cd2e467ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:55.863159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-39a74e67-4c9d-4979-a271-a5cd2e467ad4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:55.864551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39a74e67-4c9d-4979-a271-a5cd2e467ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:55.882132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2868/5723] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:55.884730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995441cc-7ba3-468e-b36e-26877be450e4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:55.908054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995441cc-7ba3-468e-b36e-26877be450e4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:55.922805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:55.923594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:55.924002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:55.924383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:55.925155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:47:55.925608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:55.927396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:55.963989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a74e67-4c9d-4979-a271-a5cd2e467ad4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:55.970942 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2856/5724] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:47:55.979103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a74e67-4c9d-4979-a271-a5cd2e467ad4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:55.991439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:55.991439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:55.991439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:55.991439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:55.991966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:56.001236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:56.196393 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2869/5725] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:47:55 2022] POST /identity/v3/projects => generated 397 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:56.200513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:56.217222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507b46a-7828-4f39-942e-73c7233c6913 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:56.295612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:56.343468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ba1e-8546-4047-8b45-50704eff6962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:56.344967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ba1e-8546-4047-8b45-50704eff6962 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:56.348892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ba1e-8546-4047-8b45-50704eff6962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:56.349234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ba1e-8546-4047-8b45-50704eff6962 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:56.349945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63ba1e-8546-4047-8b45-50704eff6962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:56.360247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63ba1e-8546-4047-8b45-50704eff6962 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:56.475166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:56.477061 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2857/5726] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:47:56 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:47:56.490382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410e72-c3c5-4b56-8315-6198fb8c5782 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:56.494327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:56.495003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:56.495467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:56.529562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:56.534954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:56.534954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:56.534954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:56.534954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:56.534954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:56.571099 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2870/5727] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:56.574415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:56.574415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:56.579171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:56.619397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f412ef4-a085-4b75-9f7e-e007a98c7593 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:56.637796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:56.638864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:56.639401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:56.641105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:56.642036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:56.643944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:56.688506 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2871/5728] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:47:56.689653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:56.732878 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2858/5729] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:47:56.733190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c2e10-0384-4a13-97a9-c52715426b6d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:56.748612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:56.750039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f22fe-1ae7-4c07-bf66-4d6526d325c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:56.750667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:56.750971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f22fe-1ae7-4c07-bf66-4d6526d325c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:56.751361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f22fe-1ae7-4c07-bf66-4d6526d325c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:56.751741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f22fe-1ae7-4c07-bf66-4d6526d325c2 admin admin] PATH_INFO: `/v3/projects/b9f488a7ccd34fb4a89fbaf91521a3d5/users/72174dd55da34d0ab1b62fd9f18fecb8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:56.798833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f22fe-1ae7-4c07-bf66-4d6526d325c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f488a7ccd34fb4a89fbaf91521a3d5, user_id=72174dd55da34d0ab1b62fd9f18fecb8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:56.802136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f22fe-1ae7-4c07-bf66-4d6526d325c2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:56.924637 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2872/5730] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:47:56 2022] PUT /identity/v3/projects/b9f488a7ccd34fb4a89fbaf91521a3d5/users/72174dd55da34d0ab1b62fd9f18fecb8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:47:56.926320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898f34e-7f8d-48bf-9ebd-6c2f9e2bbf21 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:56.926682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898f34e-7f8d-48bf-9ebd-6c2f9e2bbf21 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:56.927024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898f34e-7f8d-48bf-9ebd-6c2f9e2bbf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:56.988234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e12a6-387a-4377-9934-6b5135771b19 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:57.075884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3898f34e-7f8d-48bf-9ebd-6c2f9e2bbf21 None None] MFA Rules not processed for user `72174dd55da34d0ab1b62fd9f18fecb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:57.086198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3898f34e-7f8d-48bf-9ebd-6c2f9e2bbf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:57.191194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:57.191871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:57.192215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:57.192658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:57.314738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:57.316535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:57.356654 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2859/5731] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:47:57.589325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2873/5732] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 664 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:57.675943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:57.677570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:57.723706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:57.919714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb8c09-4ece-46a8-a150-68f1d2868072 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:57.939001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:57.941445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:57.949646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:57.950016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:57.973452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:57.974721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:58.001368 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2860/5733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:47:59.100969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b22f77-b8c1-47d5-a55e-8b31993960a8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:59.101510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b22f77-b8c1-47d5-a55e-8b31993960a8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:59.101510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b22f77-b8c1-47d5-a55e-8b31993960a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:59.149286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f7b22f77-b8c1-47d5-a55e-8b31993960a8 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:47:59.153988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f7b22f77-b8c1-47d5-a55e-8b31993960a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:47:59.179378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2874/5734] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:47:59.204633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:47:59.243204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bce86-4373-4c5e-a322-4fd1581d8258 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:47:59.267776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:47:59.268634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:47:59.270460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:47:59.270906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:47:59.305442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:47:59.309477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:47:59.350215 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2861/5735] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:47:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:48:00.665709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732de385-d244-4460-af26-f4d3526655f5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:00.666835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732de385-d244-4460-af26-f4d3526655f5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:00.667671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732de385-d244-4460-af26-f4d3526655f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:00.719823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-732de385-d244-4460-af26-f4d3526655f5 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:00.722684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-732de385-d244-4460-af26-f4d3526655f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:00.767865 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2875/5736] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:00.802145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:00.873761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ca302-c890-47ba-b66a-ccefc24235d9 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:00.894113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:00.894758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:00.895037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:00.895310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:00.949943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:00.953921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:00.991405 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2862/5737] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:48:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:02.052876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:02.053328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:02.053453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:02.065086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:02.097892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:02.100201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:02.118800 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2876/5738] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:48:02.127182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:02.149604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58052-ab45-4aa7-955c-0ccd91c0b274 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:02.165147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e96a3a-0e23-407b-a814-e7279618a501 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:02.167726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e96a3a-0e23-407b-a814-e7279618a501 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:02.168252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e96a3a-0e23-407b-a814-e7279618a501 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:02.168732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e96a3a-0e23-407b-a814-e7279618a501 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:02.193179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e96a3a-0e23-407b-a814-e7279618a501 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:02.195639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e96a3a-0e23-407b-a814-e7279618a501 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:02.224607 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2863/5739] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:11.004918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:11.007317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:11.159192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec740-91b8-4017-bd40-0200c94e5345 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:11.174299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:11.179582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:11.180109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:11.180708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] PATH_INFO: `/v3/users/2c3b398d488848fd83dc89a187f6f393` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:11.181880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3b398d488848fd83dc89a187f6f393)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:11.183866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:11.438657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3b398d488848fd83dc89a187f6f393'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:11.458258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3b398d488848fd83dc89a187f6f393'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:11.459334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3b398d488848fd83dc89a187f6f393'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:11.503107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3b398d488848fd83dc89a187f6f393'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:11.590304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3b398d488848fd83dc89a187f6f393'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:11.598665 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2877/5740] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:11 2022] DELETE /identity/v3/users/2c3b398d488848fd83dc89a187f6f393 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:11.603290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:11.604283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:11.604814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:11.647681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:11.649352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:11.819545 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2864/5741] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:11.930872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:11.932858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:12.061820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:12.063037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:12.063539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67c119-b594-47d5-8cd8-1041b86b0466 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:12.073583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:12.074019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:12.074341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:12.074619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:12.085477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041b81-9d47-4e5a-b35c-9e731b00e7d9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:12.097434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:12.098993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:12.100458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:12.101348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:12.101859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:12.102422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] PATH_INFO: `/v3/users/9622fc7415344c798e80d9259e62c0e5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:12.106108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9622fc7415344c798e80d9259e62c0e5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:12.109795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:12.123513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:12.125274 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2878/5742] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:12.479556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9622fc7415344c798e80d9259e62c0e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:12.480284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9622fc7415344c798e80d9259e62c0e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:12.567069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9622fc7415344c798e80d9259e62c0e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:12.567692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9622fc7415344c798e80d9259e62c0e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:12.579857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d4b1d0e1-c342-47e0-93b3-3c1372862b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9622fc7415344c798e80d9259e62c0e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:12.600745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:12.603310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:12.630862 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2865/5743] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:12 2022] DELETE /identity/v3/users/9622fc7415344c798e80d9259e62c0e5 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:48:12.631965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cd811-4304-4574-88b2-0b6d51596e3e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:12.635651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:12.635939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:12.636212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:12.726500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:12.727725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:12.742113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:12.898492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:12.902461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:12.902768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:12.903053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] PATH_INFO: `/v3/projects/6cb53c0efe184e22924ac20e3b33934b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:12.909308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb53c0efe184e22924ac20e3b33934b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:12.912294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:13.007993 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2866/5744] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:48:13.082812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:13.084746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:13.200562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb53c0efe184e22924ac20e3b33934b', 'request_id': 'req-0c55d554-0bb1-4b20-80b6-e3527296bb42'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:13.218206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb53c0efe184e22924ac20e3b33934b', 'request_id': 'req-0c55d554-0bb1-4b20-80b6-e3527296bb42'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:13.221972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a52331-f7f5-4ef7-b3d3-327a20050d65 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:13.305512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:13.310107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb53c0efe184e22924ac20e3b33934b', 'request_id': 'req-0c55d554-0bb1-4b20-80b6-e3527296bb42'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:13.330098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ebf2-4a46-49b9-90db-7b2e24b2f045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:13.330766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ebf2-4a46-49b9-90db-7b2e24b2f045 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:13.331092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ebf2-4a46-49b9-90db-7b2e24b2f045 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:13.331831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ebf2-4a46-49b9-90db-7b2e24b2f045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:13.335817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] The token cache is being invalidate because project 6cb53c0efe184e22924ac20e3b33934b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:48:13.336473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:13.337529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c55d554-0bb1-4b20-80b6-e3527296bb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:13.346322 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2879/5745] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:48:12 2022] DELETE /identity/v3/projects/6cb53c0efe184e22924ac20e3b33934b => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:13.348080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dd24d-8c35-496d-b194-da0aa17c63e4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:13.348374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dd24d-8c35-496d-b194-da0aa17c63e4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:13.348648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dd24d-8c35-496d-b194-da0aa17c63e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:13.390645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a40dd24d-8c35-496d-b194-da0aa17c63e4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:13.391911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a40dd24d-8c35-496d-b194-da0aa17c63e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:13.486244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ebf2-4a46-49b9-90db-7b2e24b2f045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:13.487597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ebf2-4a46-49b9-90db-7b2e24b2f045 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:13.508999 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2867/5746] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:13.536905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2880/5747] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:13.538591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74807-3dea-47ef-ab49-88e0351cbfd3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:13.538875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74807-3dea-47ef-ab49-88e0351cbfd3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:13.539149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74807-3dea-47ef-ab49-88e0351cbfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:13.565991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c9e74807-3dea-47ef-ab49-88e0351cbfd3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:13.567353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9e74807-3dea-47ef-ab49-88e0351cbfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:13.579358 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2868/5748] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:13.586926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dd24d-8c35-496d-b194-da0aa17c63e4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:13.600277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dd24d-8c35-496d-b194-da0aa17c63e4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:13.617478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:13.618193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:13.618440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:13.618711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:13.619625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:48:13.619884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:13.621737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:13.640167 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2881/5749] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:48:13.641272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74807-3dea-47ef-ab49-88e0351cbfd3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:13.660967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74807-3dea-47ef-ab49-88e0351cbfd3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:13.673449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:13.674249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:13.674924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:13.675227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:13.676125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:13.681017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:14.025442 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2869/5750] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:13 2022] POST /identity/v3/projects => generated 391 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:14.030614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:14.046275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dc9af-9868-40dd-9e30-45e8b5bb16ba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:14.118436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:14.120954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:14.171263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:14.238434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:14.241940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.241940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.241940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.241940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:14.243109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:14.298279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe402b-74ff-4541-ae49-b966bfe42ef3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:14.304526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:14.305588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.306216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.306748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] PATH_INFO: `/v3/projects/e80de6081f5f4cd3bdb5cb04c90b7b1a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.309162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80de6081f5f4cd3bdb5cb04c90b7b1a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:14.312133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:14.420440 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2882/5751] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:14 2022] POST /identity/v3/users => generated 296 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:14.424962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:14.448622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7e536-1636-4c2a-a01c-6cb2729bb177 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:14.465691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:14.468045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.468748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.469242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.470842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:14.480652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:14.511881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80de6081f5f4cd3bdb5cb04c90b7b1a', 'request_id': 'req-eb957abf-343a-4568-874c-dda839efdda2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:14.526645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80de6081f5f4cd3bdb5cb04c90b7b1a', 'request_id': 'req-eb957abf-343a-4568-874c-dda839efdda2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:14.573190 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2883/5752] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:14.578852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:14.607361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80de6081f5f4cd3bdb5cb04c90b7b1a', 'request_id': 'req-eb957abf-343a-4568-874c-dda839efdda2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:14.610482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:14.618949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98b894-dace-4afb-aebf-472ce0a57245 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:14.636549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] The token cache is being invalidate because project e80de6081f5f4cd3bdb5cb04c90b7b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:48:14.636841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:14.638420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eb957abf-343a-4568-874c-dda839efdda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:14.644515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2870/5753] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:48:14 2022] DELETE /identity/v3/projects/e80de6081f5f4cd3bdb5cb04c90b7b1a => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:14.646895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5105b4-8ce4-422f-af42-d6d4dfa9812a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.647180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5105b4-8ce4-422f-af42-d6d4dfa9812a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.647451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5105b4-8ce4-422f-af42-d6d4dfa9812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.711299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f5105b4-8ce4-422f-af42-d6d4dfa9812a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:14.712688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f5105b4-8ce4-422f-af42-d6d4dfa9812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:14.791391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:14.791391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.791391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.791391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.791949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:14.791949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:14.818183 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2884/5754] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:14.818183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:14.826132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:14.831958 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2871/5755] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:14.838826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946236-3c59-4b3b-89e9-a6175dbaf48a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.839628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946236-3c59-4b3b-89e9-a6175dbaf48a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.840414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946236-3c59-4b3b-89e9-a6175dbaf48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.845757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3d52-0d81-46e2-b1b3-82c7af3dcd99 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:14.861467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890da75-9dfd-4ef6-a0d5-7f4457eafd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:14.862484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890da75-9dfd-4ef6-a0d5-7f4457eafd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.862965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890da75-9dfd-4ef6-a0d5-7f4457eafd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.863434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890da75-9dfd-4ef6-a0d5-7f4457eafd57 admin admin] PATH_INFO: `/v3/projects/27b27c47bd7c418f820a0fbdf41b135c/users/b4f4871763074941b7ef40e5a7dfdc91/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.883614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52946236-3c59-4b3b-89e9-a6175dbaf48a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:14.884204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52946236-3c59-4b3b-89e9-a6175dbaf48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:14.900998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890da75-9dfd-4ef6-a0d5-7f4457eafd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b27c47bd7c418f820a0fbdf41b135c, user_id=b4f4871763074941b7ef40e5a7dfdc91, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:14.910688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890da75-9dfd-4ef6-a0d5-7f4457eafd57 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:14.910826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2872/5756] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:14.911465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946236-3c59-4b3b-89e9-a6175dbaf48a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:14.943852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946236-3c59-4b3b-89e9-a6175dbaf48a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:14.959683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:14.960334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:14.960619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:14.960893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:14.961572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:48:14.963781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:14.965790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:15.018869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2873/5757] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:48:15.018869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:15.034556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2b556-f591-408f-9180-ff1efbc8e570 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:15.059429 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2885/5758] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:14 2022] PUT /identity/v3/projects/27b27c47bd7c418f820a0fbdf41b135c/users/b4f4871763074941b7ef40e5a7dfdc91/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:15.073069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:15.073299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:15.073537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:15.075681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:15.079775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:15.080503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:15.081073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:15.082354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:15.089579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:15.139462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] MFA Rules not processed for user `b4f4871763074941b7ef40e5a7dfdc91`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:15.141232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:15.270122 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2874/5759] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:15 2022] POST /identity/v3/projects => generated 361 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:15.276193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:15.293511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2886/5760] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:15.306811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:15.308688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:15.367608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:15.457152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415939-4e6e-4676-802e-ced859b44971 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:15.472661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771b871-3e5e-47ce-9a26-3d2958ee2513 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:15.476466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:15.477222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:15.477571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:15.477935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:15.478707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:15.489221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:15.637028 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2875/5761] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:15 2022] POST /identity/v3/users => generated 281 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:48:15.637028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:15.666011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800e61c-acab-49d3-a9b8-68a7365201ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:15.671142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800e61c-acab-49d3-a9b8-68a7365201ee service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:15.671142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800e61c-acab-49d3-a9b8-68a7365201ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:15.671142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800e61c-acab-49d3-a9b8-68a7365201ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:15.673164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f289b1-297b-4162-8322-c2f9c3d7f431 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:15.683136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:15.683498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:15.683766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:15.684497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:15.685070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:15.687660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:15.704854 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2876/5762] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:15.706949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:15.719740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c38734-ad01-4dcd-8ac9-e1925f3082bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:15.734887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:15.735945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:15.736238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:15.736515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:15.737332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:15.739329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:15.757286 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2877/5763] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:15.762398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:15.794338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7872d-8ffc-4295-9077-0711dffbdc24 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:15.810108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:15.812501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:15.812860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:15.813229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] PATH_INFO: `/v3/projects/6ea7d5f85ab744ff9cf2114412a8782f/users/7c1f0158199b40b0b2cd7621be78f7d1/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:15.818986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800e61c-acab-49d3-a9b8-68a7365201ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:15.823063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800e61c-acab-49d3-a9b8-68a7365201ee service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:15.849244 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2887/5764] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:48:15.854379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea7d5f85ab744ff9cf2114412a8782f, user_id=7c1f0158199b40b0b2cd7621be78f7d1, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:15.857760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:15.861574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:16.006162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2878/5765] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:15 2022] PUT /identity/v3/projects/6ea7d5f85ab744ff9cf2114412a8782f/users/7c1f0158199b40b0b2cd7621be78f7d1/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:16.008196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:16.009098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:16.010018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:16.054178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] MFA Rules not processed for user `7c1f0158199b40b0b2cd7621be78f7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:16.056490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:16.135288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2888/5766] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:16.147512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:16.150259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:16.352787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d04f0-ae49-46f8-91ad-5e71d78b338c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:16.357901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:16.363464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:16.363464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:16.363464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:16.371945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:16.374474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:16.388658 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2879/5767] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:26.744994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:27.893679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:29.224403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:29.226135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:29.330463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b218d0-13a8-47f5-a580-64ddca2c5a2d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:29.339327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:29.340426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:29.341116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:29.341784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] PATH_INFO: `/v3/users/d50c668c2b2f43798ab247029a8386e5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:29.347946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50c668c2b2f43798ab247029a8386e5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:29.355712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:29.631144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50c668c2b2f43798ab247029a8386e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:29.653293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50c668c2b2f43798ab247029a8386e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:29.655170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50c668c2b2f43798ab247029a8386e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:29.682876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50c668c2b2f43798ab247029a8386e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:29.827204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50c668c2b2f43798ab247029a8386e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:29.854607 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2889/5768] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:29 2022] DELETE /identity/v3/users/d50c668c2b2f43798ab247029a8386e5 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:29.912410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:29.940571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376bd7-511d-4962-82b0-95975340f0f4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:30.141820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94497ee-d9cf-4bc8-a00a-298cbcbf9932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:30.142783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94497ee-d9cf-4bc8-a00a-298cbcbf9932 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:30.143498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94497ee-d9cf-4bc8-a00a-298cbcbf9932 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:30.144617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94497ee-d9cf-4bc8-a00a-298cbcbf9932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:30.152186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f94497ee-d9cf-4bc8-a00a-298cbcbf9932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:30.398479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94497ee-d9cf-4bc8-a00a-298cbcbf9932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:30.405403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94497ee-d9cf-4bc8-a00a-298cbcbf9932 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:30.448863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2880/5769] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:31.343541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:31.349452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:31.424812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374c302-0105-4ebb-b5d8-eead43282c4b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:31.495266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:31.496210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:31.502453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:31.502728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] PATH_INFO: `/v3/projects/0afceb9a2a5b41cb8a7e59f036f57422` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:31.509329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0afceb9a2a5b41cb8a7e59f036f57422)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:31.511361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:31.849955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0afceb9a2a5b41cb8a7e59f036f57422', 'request_id': 'req-2c40d954-ef9b-4d01-8748-b01ade1977b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:31.890229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0afceb9a2a5b41cb8a7e59f036f57422', 'request_id': 'req-2c40d954-ef9b-4d01-8748-b01ade1977b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:32.013389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0afceb9a2a5b41cb8a7e59f036f57422', 'request_id': 'req-2c40d954-ef9b-4d01-8748-b01ade1977b2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:32.042561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] The token cache is being invalidate because project 0afceb9a2a5b41cb8a7e59f036f57422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:48:32.043011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:32.045630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2c40d954-ef9b-4d01-8748-b01ade1977b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:32.055348 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2890/5770] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:48:31 2022] DELETE /identity/v3/projects/0afceb9a2a5b41cb8a7e59f036f57422 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:32.061479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a7a3-3ecc-4f71-a3d7-6bc70523257f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:32.061479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a7a3-3ecc-4f71-a3d7-6bc70523257f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:32.061479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0a7a3-3ecc-4f71-a3d7-6bc70523257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:32.104561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7af0a7a3-3ecc-4f71-a3d7-6bc70523257f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:32.108740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7af0a7a3-3ecc-4f71-a3d7-6bc70523257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:32.259946 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2881/5771] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:32.268589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401b285-982b-47da-a247-094ca23be2b9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:32.269052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401b285-982b-47da-a247-094ca23be2b9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:32.269389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401b285-982b-47da-a247-094ca23be2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:32.300818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:32.325883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c401b285-982b-47da-a247-094ca23be2b9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:32.325883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c401b285-982b-47da-a247-094ca23be2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:32.339957 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2891/5772] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:32.341620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0a7a3-3ecc-4f71-a3d7-6bc70523257f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:32.361507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0a7a3-3ecc-4f71-a3d7-6bc70523257f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:32.371204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:32.372353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:32.372353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:32.372565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:32.373708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:48:32.374090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:32.376213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:32.396250 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2882/5773] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:48:32.397159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401b285-982b-47da-a247-094ca23be2b9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:32.408542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401b285-982b-47da-a247-094ca23be2b9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:32.422951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:32.422951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:32.422951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:32.422951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:32.426495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:32.426495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:32.471076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:32.473743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:32.609556 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2892/5774] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:32 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:32.610462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:32.614506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:32.692909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c64ea2-b3c5-4e5e-afee-909f0aed5d1e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:32.749374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd1f0b-a9c7-4e2d-b051-a365df0e14a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:32.755607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:32.756332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:32.756759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:32.757126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:32.757906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:32.761065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:32.877372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:32.878606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:32.879052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:32.880316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:32.883760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:32.908548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:32.910924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:32.911095 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2893/5775] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:32 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:32.915090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:32.939283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3a68d-82b6-4cd3-891b-f764b7beeab0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:32.956690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:32.959844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:32.960261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:32.960642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:32.962650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:32.968150 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2883/5776] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:48:32.976097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:33.007355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:33.012705 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2894/5777] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:48:33.029159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2df6cf-31b9-4826-bb47-aa4353f8ce38 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:33.047501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15543218-c34c-42c7-a817-6a7a85ec154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:33.049085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15543218-c34c-42c7-a817-6a7a85ec154d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:33.050756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15543218-c34c-42c7-a817-6a7a85ec154d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:33.052221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15543218-c34c-42c7-a817-6a7a85ec154d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:33.053448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15543218-c34c-42c7-a817-6a7a85ec154d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:33.061895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15543218-c34c-42c7-a817-6a7a85ec154d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:33.083725 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2884/5778] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:33.093116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:33.106231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1be5-b6ec-4b01-b483-35d4c0e54713 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:33.114734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:33.119352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:33.119352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:33.119352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] PATH_INFO: `/v3/projects/c9be51a8e2d543f8a8ddf5063e485165/users/8cc7f2ab71a4470e9dafb867714ef234/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:33.172831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9be51a8e2d543f8a8ddf5063e485165, user_id=8cc7f2ab71a4470e9dafb867714ef234, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:33.186465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:33.299909 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2895/5779] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:33 2022] PUT /identity/v3/projects/c9be51a8e2d543f8a8ddf5063e485165/users/8cc7f2ab71a4470e9dafb867714ef234/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:33.314531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350fd1-c021-40ae-93e7-4013eaa448eb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:33.314531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350fd1-c021-40ae-93e7-4013eaa448eb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:33.314531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350fd1-c021-40ae-93e7-4013eaa448eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:33.389716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13350fd1-c021-40ae-93e7-4013eaa448eb None None] MFA Rules not processed for user `8cc7f2ab71a4470e9dafb867714ef234`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:33.391722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13350fd1-c021-40ae-93e7-4013eaa448eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:33.604885 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2885/5780] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:33.616710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:33.618703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:33.847486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2a7a-82ec-4b81-a4c2-48d50e04b752 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:33.883202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343601b4-9bde-4ac7-9086-5bf94b764ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:33.884169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343601b4-9bde-4ac7-9086-5bf94b764ec1 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:33.884623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343601b4-9bde-4ac7-9086-5bf94b764ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:33.885066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343601b4-9bde-4ac7-9086-5bf94b764ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:33.914933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343601b4-9bde-4ac7-9086-5bf94b764ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:33.920232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343601b4-9bde-4ac7-9086-5bf94b764ec1 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:33.950602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2896/5781] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:34.002042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350fd1-c021-40ae-93e7-4013eaa448eb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:34.090583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:34.117868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350fd1-c021-40ae-93e7-4013eaa448eb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:34.131454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:34.135594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:34.136511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:34.137032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] PATH_INFO: `/v3/users/8cc7f2ab71a4470e9dafb867714ef234` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:34.138697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc7f2ab71a4470e9dafb867714ef234)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:34.145083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:34.479601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc7f2ab71a4470e9dafb867714ef234'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:34.480383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc7f2ab71a4470e9dafb867714ef234'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:34.550455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc7f2ab71a4470e9dafb867714ef234'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:34.551638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc7f2ab71a4470e9dafb867714ef234'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:34.567020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc7f2ab71a4470e9dafb867714ef234'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:34.616559 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2886/5782] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:33 2022] DELETE /identity/v3/users/8cc7f2ab71a4470e9dafb867714ef234 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:34.620985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:34.621851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:34.622352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:34.665659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:34.666975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:34.679049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:34.751089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2897/5783] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:34.763398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:34.767430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:34.925920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4921e7-22d8-4596-8129-ce95d3a3a73b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:34.930776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad29bfd-e045-42a1-affa-af98041f5030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:34.931555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29bfd-e045-42a1-affa-af98041f5030 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:34.931932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29bfd-e045-42a1-affa-af98041f5030 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:34.932267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29bfd-e045-42a1-affa-af98041f5030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:34.954929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad29bfd-e045-42a1-affa-af98041f5030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:34.959628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad29bfd-e045-42a1-affa-af98041f5030 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:34.973946 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2887/5784] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:35.873625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:35.875762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:35.897829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac41d0-3d22-44c5-bffd-ef127794ee7c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:35.907505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:35.908537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:35.909101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:35.909558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] PATH_INFO: `/v3/projects/c9be51a8e2d543f8a8ddf5063e485165` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:35.912288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9be51a8e2d543f8a8ddf5063e485165)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:35.914689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:36.107139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9be51a8e2d543f8a8ddf5063e485165', 'request_id': 'req-c62d0dd1-495e-4515-aa72-a58da30e1676'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:36.121048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9be51a8e2d543f8a8ddf5063e485165', 'request_id': 'req-c62d0dd1-495e-4515-aa72-a58da30e1676'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:36.265679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9be51a8e2d543f8a8ddf5063e485165', 'request_id': 'req-c62d0dd1-495e-4515-aa72-a58da30e1676'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:36.278815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] The token cache is being invalidate because project c9be51a8e2d543f8a8ddf5063e485165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:48:36.279400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:36.280299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c62d0dd1-495e-4515-aa72-a58da30e1676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:36.286132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2898/5785] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:48:35 2022] DELETE /identity/v3/projects/c9be51a8e2d543f8a8ddf5063e485165 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:36.291072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269545f-1535-44ce-9f9f-0a0789ee12ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:36.291645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269545f-1535-44ce-9f9f-0a0789ee12ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:36.291645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269545f-1535-44ce-9f9f-0a0789ee12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:36.331794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a269545f-1535-44ce-9f9f-0a0789ee12ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:36.334640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a269545f-1535-44ce-9f9f-0a0789ee12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:36.472520 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2888/5786] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:36.479429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece79a-c911-43ec-a0bf-7f0c9d088b91 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:36.479720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece79a-c911-43ec-a0bf-7f0c9d088b91 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:36.479998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece79a-c911-43ec-a0bf-7f0c9d088b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:36.535603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dbece79a-c911-43ec-a0bf-7f0c9d088b91 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:36.537266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dbece79a-c911-43ec-a0bf-7f0c9d088b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:36.549326 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2899/5787] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:36.553816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269545f-1535-44ce-9f9f-0a0789ee12ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:36.569676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269545f-1535-44ce-9f9f-0a0789ee12ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:36.576564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:36.577272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:36.577703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:36.578044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:36.578822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:48:36.579455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:36.580736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:36.591744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:36.596508 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2889/5788] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:48:36.600799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece79a-c911-43ec-a0bf-7f0c9d088b91 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:36.616614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece79a-c911-43ec-a0bf-7f0c9d088b91 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:36.629616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:36.630678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:36.630967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:36.631242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:36.631896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:36.636347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:36.737804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2900/5789] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:36 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:36.742715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:36.760384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab455fb9-511c-4000-a52a-bc86a8485303 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:36.828334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:36.829223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:36.829378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:36.829781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:36.830541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:36.832594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:36.993823 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2890/5790] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:36 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:36.999458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:37.012132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a71d3-a028-4914-ada4-9b4a7f0959cc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:37.018193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:37.019045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:37.019514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:37.019948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:37.020895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:37.022735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:37.042621 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2901/5791] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:37.049096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:37.065316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ac86-7fe8-4b12-ab5c-e0ae10a126f2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:37.072713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04a0d4-2334-464d-ab7d-bd2de6349857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:37.074147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04a0d4-2334-464d-ab7d-bd2de6349857 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:37.074595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04a0d4-2334-464d-ab7d-bd2de6349857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:37.074967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04a0d4-2334-464d-ab7d-bd2de6349857 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:37.077580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04a0d4-2334-464d-ab7d-bd2de6349857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:37.080011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04a0d4-2334-464d-ab7d-bd2de6349857 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:37.098122 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2891/5792] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:37.102656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:37.117211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfebe0-45ce-478a-a43b-7a8918e34687 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:37.130200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:37.130896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:37.131202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:37.137034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] PATH_INFO: `/v3/projects/b9380daa22eb489dbb2b7e27806c8bb3/users/d3ed4523fb1d423abcf98fdb30b37b0a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:37.148927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9380daa22eb489dbb2b7e27806c8bb3, user_id=d3ed4523fb1d423abcf98fdb30b37b0a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:37.151675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:37.294214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2902/5793] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:37 2022] PUT /identity/v3/projects/b9380daa22eb489dbb2b7e27806c8bb3/users/d3ed4523fb1d423abcf98fdb30b37b0a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:48:37.301711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2405d-708e-4e71-a572-87c50d2be69e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:37.303137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2405d-708e-4e71-a572-87c50d2be69e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:37.304072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2405d-708e-4e71-a572-87c50d2be69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:37.334934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c7a2405d-708e-4e71-a572-87c50d2be69e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:37.336444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7a2405d-708e-4e71-a572-87c50d2be69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:37.426416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2892/5794] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:37.466382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:37.468367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:37.588711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:37.669555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868184-764e-4807-b072-eb26e2ce66c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:37.682976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:37.683642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:37.683931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:37.684206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:37.694997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:37.696856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:37.708677 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2903/5795] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:39.595095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:39.595095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:39.595095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:39.629074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] MFA Rules not processed for user `b29dba1f338c4a3ebe1f1b4db9bc45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:39.632522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:39.774262 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2893/5796] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:48:43.371153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:43.372915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:43.452062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd730a-6490-4b1e-be68-2f4f94d07261 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:43.460691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:43.461474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:43.461829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:43.462227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] PATH_INFO: `/v3/users/72174dd55da34d0ab1b62fd9f18fecb8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:43.463824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72174dd55da34d0ab1b62fd9f18fecb8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:43.467183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:43.691431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:43.693749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:43.723234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:43.736710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd130af3-80f4-4ab6-ac48-7ff22c7d494a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:43.745793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:43.751929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:43.752427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:43.752885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] PATH_INFO: `/v3/users/4c2d3742a2f64ada878a9495e44cd701` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:43.755434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2d3742a2f64ada878a9495e44cd701)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:43.757931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:43.787765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72174dd55da34d0ab1b62fd9f18fecb8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:43.807333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72174dd55da34d0ab1b62fd9f18fecb8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:43.807333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72174dd55da34d0ab1b62fd9f18fecb8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:43.826880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72174dd55da34d0ab1b62fd9f18fecb8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:43.948658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-640ba663-af08-4b23-aa20-ac40d055a17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72174dd55da34d0ab1b62fd9f18fecb8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:43.966150 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2904/5797] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:43 2022] DELETE /identity/v3/users/72174dd55da34d0ab1b62fd9f18fecb8 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:43.981332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2d3742a2f64ada878a9495e44cd701'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:43.982875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2d3742a2f64ada878a9495e44cd701'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:43.987045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:43.987369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:43.987654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:44.053396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:44.055456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:44.070336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2d3742a2f64ada878a9495e44cd701'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:44.072087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2d3742a2f64ada878a9495e44cd701'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:44.091963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17680ea-60ad-4799-ba2a-c15595cabb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2d3742a2f64ada878a9495e44cd701'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:44.179722 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2894/5798] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:43 2022] DELETE /identity/v3/users/4c2d3742a2f64ada878a9495e44cd701 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:44.181522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:44.181944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:44.182381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:44.234428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:44.236142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:44.262502 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2905/5799] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:44.284100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:44.308579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:44.415417 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2895/5800] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:44.489071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:44.705554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31a794-bcd4-45fe-a880-368e0e54603b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:44.847009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:44.856113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:44.856113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:44.856113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:44.880677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:44.883707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:44.901296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:44.902711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:44.927215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2ec12-eb7b-46e4-a4e9-6be018f6a357 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:44.938458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff3e6-4157-4fcf-872d-ae701fa84c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:44.943099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff3e6-4157-4fcf-872d-ae701fa84c42 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:44.946200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff3e6-4157-4fcf-872d-ae701fa84c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:44.951728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff3e6-4157-4fcf-872d-ae701fa84c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:44.957390 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2906/5801] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:44.987029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ff3e6-4157-4fcf-872d-ae701fa84c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:44.991348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ff3e6-4157-4fcf-872d-ae701fa84c42 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:45.027548 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2896/5802] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:46.708522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:46.714544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:46.747312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cd9a7-cfb0-4335-852d-9ca19b194877 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:46.761485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:46.764071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:46.764496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:46.764806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] PATH_INFO: `/v3/projects/b9f488a7ccd34fb4a89fbaf91521a3d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:46.767363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f488a7ccd34fb4a89fbaf91521a3d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:46.776844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:46.968904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f488a7ccd34fb4a89fbaf91521a3d5', 'request_id': 'req-4cf16675-8db6-4af5-b739-dc62e3e68889'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:46.983542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f488a7ccd34fb4a89fbaf91521a3d5', 'request_id': 'req-4cf16675-8db6-4af5-b739-dc62e3e68889'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.102987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f488a7ccd34fb4a89fbaf91521a3d5', 'request_id': 'req-4cf16675-8db6-4af5-b739-dc62e3e68889'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.136634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] The token cache is being invalidate because project b9f488a7ccd34fb4a89fbaf91521a3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:48:47.136634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.136634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.145271 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2907/5803] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:48:46 2022] DELETE /identity/v3/projects/b9f488a7ccd34fb4a89fbaf91521a3d5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:47.151777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bdc6e-6912-41cd-9f19-c059f0ac869f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:47.152225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bdc6e-6912-41cd-9f19-c059f0ac869f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:47.152348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bdc6e-6912-41cd-9f19-c059f0ac869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:47.205044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-df3bdc6e-6912-41cd-9f19-c059f0ac869f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:47.205916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df3bdc6e-6912-41cd-9f19-c059f0ac869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:47.207628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:47.210038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:47.433007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf16675-8db6-4af5-b739-dc62e3e68889 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:47.448525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:47.449202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:47.449480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:47.450273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] PATH_INFO: `/v3/projects/48109b15977e4ee6ade3105f08df50d9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:47.454784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48109b15977e4ee6ade3105f08df50d9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:47.456823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:47.469553 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2897/5804] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:47.477436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aaf29-300b-42de-9735-2cf0ce8a856f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:47.478597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aaf29-300b-42de-9735-2cf0ce8a856f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:47.479251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:47.480509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aaf29-300b-42de-9735-2cf0ce8a856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:47.501200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:47.516521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d45aaf29-300b-42de-9735-2cf0ce8a856f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:47.518086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d45aaf29-300b-42de-9735-2cf0ce8a856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:47.531816 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2898/5805] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:47.533236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aaf29-300b-42de-9735-2cf0ce8a856f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:47.550290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aaf29-300b-42de-9735-2cf0ce8a856f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:47.555694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:47.557214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:47.557616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:47.558228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:47.558929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:48:47.559479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:47.561356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:47.588526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2899/5806] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:48:47.591149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:47.611995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1bfaf-6541-4e79-ac93-cca15d8c293f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:47.622947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:47.634170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:47.634170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:47.634170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:47.634170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:47.634170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:47.662610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48109b15977e4ee6ade3105f08df50d9', 'request_id': 'req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.677066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48109b15977e4ee6ade3105f08df50d9', 'request_id': 'req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.824409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48109b15977e4ee6ade3105f08df50d9', 'request_id': 'req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.840095 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2900/5807] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:47 2022] POST /identity/v3/projects => generated 393 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:47.842745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] The token cache is being invalidate because project 48109b15977e4ee6ade3105f08df50d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:48:47.843925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:47.844298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.845193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6b4005f-d02b-4ed7-aec7-62cbb3a00441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:47.862822 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2908/5808] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:48:47 2022] DELETE /identity/v3/projects/48109b15977e4ee6ade3105f08df50d9 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:47.864620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1c07-663d-4087-a4aa-13214f95dd8b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:47.865197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1c07-663d-4087-a4aa-13214f95dd8b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:47.865990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1c07-663d-4087-a4aa-13214f95dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:47.909531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-32db1c07-663d-4087-a4aa-13214f95dd8b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:47.916184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-32db1c07-663d-4087-a4aa-13214f95dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:47.994757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344974e-cd31-438e-a40e-d7d459c7dcef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:48.000677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:48.001355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.001642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.001920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.002652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:48.004654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:48.067607 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2909/5809] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:48.077016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2118dd6-cd26-4ca8-8859-58bc51dce5c3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.077648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2118dd6-cd26-4ca8-8859-58bc51dce5c3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.081575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2118dd6-cd26-4ca8-8859-58bc51dce5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.127458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c2118dd6-cd26-4ca8-8859-58bc51dce5c3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:48.129281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c2118dd6-cd26-4ca8-8859-58bc51dce5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:48.140446 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2910/5810] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:48:48.146157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2118dd6-cd26-4ca8-8859-58bc51dce5c3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.154042 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2901/5811] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:47 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:48.158738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.161632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:48.168855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2118dd6-cd26-4ca8-8859-58bc51dce5c3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:48.177427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177a9d-becf-4b5f-941a-73a4e3747d85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:48.181664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:48.181664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.181664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.181664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.182149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:48:48.182149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:48.182149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:48.184452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:48.185917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.186387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.187103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.188411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:48.191257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:48.212685 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2902/5812] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:48.217242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.229817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb1436-6e6c-4960-8ce8-a2ed471de348 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:48.236982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:48.237753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.238336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.238720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.239646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:48.242020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:48.257338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2911/5813] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:48:48.259583 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2903/5814] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:48.262106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.262415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.274604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e593f-2a54-4730-bdfa-586d802bd253 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:48.296772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:48.296772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.296772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.296772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.297240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:48.297345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850807d-d3bf-4d51-af0b-8fc39d34630d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:48.301570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:48.322201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d90b8e-6cf3-459a-8b60-985136c056c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:48.323647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d90b8e-6cf3-459a-8b60-985136c056c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.324114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d90b8e-6cf3-459a-8b60-985136c056c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.324553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d90b8e-6cf3-459a-8b60-985136c056c4 admin admin] PATH_INFO: `/v3/projects/f371e15059f343ce92c76ea65df8dc22/users/455668a59a524a11b8754cb635636307/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.374238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d90b8e-6cf3-459a-8b60-985136c056c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f371e15059f343ce92c76ea65df8dc22, user_id=455668a59a524a11b8754cb635636307, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:48.377031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d90b8e-6cf3-459a-8b60-985136c056c4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:48.441913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2904/5815] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:48 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:48.447294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.540207 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2912/5816] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:48 2022] PUT /identity/v3/projects/f371e15059f343ce92c76ea65df8dc22/users/455668a59a524a11b8754cb635636307/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:48.550697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.550984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.551369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.601646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] MFA Rules not processed for user `455668a59a524a11b8754cb635636307`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:48.602964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:48.621638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b01f-062d-41b7-959d-5712a29bd176 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:48.793658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2913/5817] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:48:48.799229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:48.800156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:48.800762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:48.801268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:48.802285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:48.804649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:48.852932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.854784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:48.914649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:48.923832 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2905/5818] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:48 2022] POST /identity/v3/users => generated 293 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:48.928240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:48.981650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f4b24-8e8a-42af-9ee3-e2c08799f87c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:49.006612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:49.011383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:49.013572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:49.014493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:49.014961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:49.016007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:49.020105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:49.060966 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2906/5819] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:49.069599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:49.085480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36395a9-3fb3-4015-840b-630f51a86df7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:49.090022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:49.091226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:49.092433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:49.092881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:49.095368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28efe0-eb02-4cbc-8666-06e7a97d9b40 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:49.104064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:49.106796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:49.109218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee4352-9ec5-486d-a3ff-71f6ab82f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:49.113686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee4352-9ec5-486d-a3ff-71f6ab82f0df admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:49.113686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee4352-9ec5-486d-a3ff-71f6ab82f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:49.113686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee4352-9ec5-486d-a3ff-71f6ab82f0df admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:49.114683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee4352-9ec5-486d-a3ff-71f6ab82f0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:49.118252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee4352-9ec5-486d-a3ff-71f6ab82f0df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:49.130951 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2914/5820] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:49.147464 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2907/5821] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:49.151949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:49.169081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229ee16-6add-4da6-ae74-085173cf9cae service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:49.187934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:49.189012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:49.189474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:49.189991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] PATH_INFO: `/v3/projects/f90a8139e89b4a8eac2f36205c9df0ed/users/4ca750827582445ab44f3f633f1bba5b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:49.224013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90a8139e89b4a8eac2f36205c9df0ed, user_id=4ca750827582445ab44f3f633f1bba5b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:49.228385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:49.336221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2915/5822] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:49 2022] PUT /identity/v3/projects/f90a8139e89b4a8eac2f36205c9df0ed/users/4ca750827582445ab44f3f633f1bba5b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:49.346996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:49.348798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:49.350081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:49.431445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] MFA Rules not processed for user `4ca750827582445ab44f3f633f1bba5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:49.437022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:49.580717 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2908/5823] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:49.596442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:49.598622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:49.746384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b6e09-d598-489f-9555-79b8f1e366a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:49.760242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad52123-72e5-4254-92d4-66d2621bb5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:49.762129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad52123-72e5-4254-92d4-66d2621bb5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:49.762655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad52123-72e5-4254-92d4-66d2621bb5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:49.763766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad52123-72e5-4254-92d4-66d2621bb5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:49.793070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad52123-72e5-4254-92d4-66d2621bb5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:49.798259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad52123-72e5-4254-92d4-66d2621bb5d4 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:49.863432 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2916/5824] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:50.900505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:50.900505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:51.040157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f17e3c-9907-4125-87b6-3dabaa9defb5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:51.046339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:51.047096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:51.047434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:51.047784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] PATH_INFO: `/v3/users/b4f4871763074941b7ef40e5a7dfdc91` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:51.049055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f4871763074941b7ef40e5a7dfdc91)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:51.051889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:51.081765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:51.387668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f4871763074941b7ef40e5a7dfdc91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:51.388099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f4871763074941b7ef40e5a7dfdc91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:51.480263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f4871763074941b7ef40e5a7dfdc91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:51.481222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f4871763074941b7ef40e5a7dfdc91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:51.493299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f4871763074941b7ef40e5a7dfdc91'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:51.535451 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2909/5825] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:50 2022] DELETE /identity/v3/users/b4f4871763074941b7ef40e5a7dfdc91 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:51.540072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:51.540678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:51.541189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:51.577274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:51.578637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:51.760937 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2917/5826] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:51.834468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:51.835865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:52.040058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4316a-b876-4f06-aa73-72b27ba6b6bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:52.066296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84081779-30dd-4b0f-99f2-a33fa4ad8df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:52.066473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84081779-30dd-4b0f-99f2-a33fa4ad8df2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:52.066702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84081779-30dd-4b0f-99f2-a33fa4ad8df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:52.067677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84081779-30dd-4b0f-99f2-a33fa4ad8df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:52.120989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84081779-30dd-4b0f-99f2-a33fa4ad8df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:52.133040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84081779-30dd-4b0f-99f2-a33fa4ad8df2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:52.178898 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2910/5827] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:54.171641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:54.174485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:54.231428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:54.243508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c633d-c8a1-42fb-9e92-179ec92b0dd7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:54.256183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:54.257085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:54.257549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:54.257994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] PATH_INFO: `/v3/projects/27b27c47bd7c418f820a0fbdf41b135c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:54.259424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b27c47bd7c418f820a0fbdf41b135c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:54.261829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:54.487450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b27c47bd7c418f820a0fbdf41b135c', 'request_id': 'req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:54.506745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b27c47bd7c418f820a0fbdf41b135c', 'request_id': 'req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:54.600470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b27c47bd7c418f820a0fbdf41b135c', 'request_id': 'req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:54.632068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] The token cache is being invalidate because project 27b27c47bd7c418f820a0fbdf41b135c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:48:54.632428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:54.633125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0479c6de-d0a2-4d8a-b5fd-b2411a7292e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:54.635419 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2918/5828] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:48:54 2022] DELETE /identity/v3/projects/27b27c47bd7c418f820a0fbdf41b135c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:54.643622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7362-edba-44a7-b819-11178f0d00bc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:54.645051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7362-edba-44a7-b819-11178f0d00bc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:54.646375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7362-edba-44a7-b819-11178f0d00bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:54.695659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-642a7362-edba-44a7-b819-11178f0d00bc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:54.698672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-642a7362-edba-44a7-b819-11178f0d00bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:54.853940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568369a-041e-49a2-86b5-ee8a0833cb9a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:54.854366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568369a-041e-49a2-86b5-ee8a0833cb9a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:54.854474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568369a-041e-49a2-86b5-ee8a0833cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:54.877749 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2911/5829] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:54.912393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9568369a-041e-49a2-86b5-ee8a0833cb9a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:54.913985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9568369a-041e-49a2-86b5-ee8a0833cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:54.932897 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2919/5830] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:48:54.937881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7362-edba-44a7-b819-11178f0d00bc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:54.952136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7362-edba-44a7-b819-11178f0d00bc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:54.963087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:54.964287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:54.964561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:54.964833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:54.968438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:48:54.968752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:54.971409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:55.011179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568369a-041e-49a2-86b5-ee8a0833cb9a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:55.017175 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2912/5831] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:48:55.029359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568369a-041e-49a2-86b5-ee8a0833cb9a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:55.043969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:55.045178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:55.045459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:55.045728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:55.046453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:55.048370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:55.226763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:55.232201 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2920/5832] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:55 2022] POST /identity/v3/projects => generated 389 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:55.241994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a105bc8-9b4e-468c-ad44-c048453d657b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:55.317182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:55.438432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:55.443600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:55.443600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:55.443600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:55.443600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:55.446079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:55.488351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:55.491532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:55.577554 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2913/5833] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:55 2022] POST /identity/v3/users => generated 295 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:48:55.579402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:55.614679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc2d9a-c7fd-4576-bb58-575578cbebc7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:55.633242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09718-89d2-445b-bcdb-dd9e66bad25d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:55.638009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:55.639342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:55.639887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:55.641324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a1cf1-86a5-4110-aba3-438d51ff91b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:55.642219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:55.643115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1cf1-86a5-4110-aba3-438d51ff91b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:55.643283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:55.646610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1cf1-86a5-4110-aba3-438d51ff91b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:55.647337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a1cf1-86a5-4110-aba3-438d51ff91b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:55.653280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:55.671868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-636a1cf1-86a5-4110-aba3-438d51ff91b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:55.701371 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2914/5834] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:55.703902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:55.744868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cc9a2-b53c-4006-b433-ba0d8bdce8b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:55.769111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:55.772358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:55.772867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:55.775050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:55.776214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:55.782032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:55.825008 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2915/5835] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:55.835389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:55.868591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a394cd-36ea-4b50-b4d5-d1a1b61ccfeb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:55.876566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a1cf1-86a5-4110-aba3-438d51ff91b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:55.879506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a1cf1-86a5-4110-aba3-438d51ff91b8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:55.889741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:55.892115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:55.901986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:55.901986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:55.901986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] PATH_INFO: `/v3/projects/9c7f9282abf546de97aeefc165b7073d/users/69a2792ee20e450e877d4f016c031768/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:55.908499 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2921/5836] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:48:55.943964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7f9282abf546de97aeefc165b7073d, user_id=69a2792ee20e450e877d4f016c031768, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:55.944555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:56.081098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2916/5837] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:55 2022] PUT /identity/v3/projects/9c7f9282abf546de97aeefc165b7073d/users/69a2792ee20e450e877d4f016c031768/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:56.093530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6778-f135-4c09-a02f-2cf1912d026a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:56.093876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6778-f135-4c09-a02f-2cf1912d026a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:56.094325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6778-f135-4c09-a02f-2cf1912d026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:56.159705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-67ee6778-f135-4c09-a02f-2cf1912d026a None None] MFA Rules not processed for user `69a2792ee20e450e877d4f016c031768`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:56.163398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67ee6778-f135-4c09-a02f-2cf1912d026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:56.338088 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2922/5838] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:56.343408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:56.568279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22587-cf70-48de-afde-7112cabaf4c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:56.577530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:56.578254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:56.578721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:56.579001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:56.579685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:56.581622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:56.792719 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2917/5839] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:48:56 2022] POST /identity/v3/projects => generated 391 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:56.797386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6778-f135-4c09-a02f-2cf1912d026a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:56.852844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6778-f135-4c09-a02f-2cf1912d026a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:57.085429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdc7db-c063-428f-8f4f-bd7ba3c4406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:57.086548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc7db-c063-428f-8f4f-bd7ba3c4406a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:57.088209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc7db-c063-428f-8f4f-bd7ba3c4406a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:57.088704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdc7db-c063-428f-8f4f-bd7ba3c4406a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:57.089754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdc7db-c063-428f-8f4f-bd7ba3c4406a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:57.095554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdc7db-c063-428f-8f4f-bd7ba3c4406a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:57.285900 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2923/5840] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:48:56 2022] POST /identity/v3/users => generated 302 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:48:57.287963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:57.307248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005727b-a9bd-48f2-8833-fa4eb25fefa3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:57.328758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:57.329127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:57.330824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:57.338146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:57.339058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:57.339488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:57.339909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:57.340905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:57.349078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:57.404043 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2918/5841] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:57.408953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:57.458071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e4323-150f-4c1a-845a-20c3e6aa06d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:57.479506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] MFA Rules not processed for user `d3ed4523fb1d423abcf98fdb30b37b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:57.482748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:57.491965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:57.492959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:57.493454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:57.496155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] PATH_INFO: `/v3/projects/2751b46cd5d74e5ea29be04ae823f86f/users/e75b5e687b894134be5eaf009f055a05/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:57.550583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2751b46cd5d74e5ea29be04ae823f86f, user_id=e75b5e687b894134be5eaf009f055a05, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:57.552038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:57.625776 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2924/5842] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:57.633934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:57.647792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:57.676909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2919/5843] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:57 2022] PUT /identity/v3/projects/2751b46cd5d74e5ea29be04ae823f86f/users/e75b5e687b894134be5eaf009f055a05/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:57.678991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:57.680805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:57.775563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:57.848360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388519a6-5519-406c-b86e-320a647cc29a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:57.868856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:57.870041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:57.870956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:57.872453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:57.875203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:57.877346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:57.906262 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2920/5844] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:48:57.913022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:57.941802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d668da5-6d83-4d87-a0a2-c1a0c0af4dd0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:57.953486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2371b-719f-479c-8b7a-9d25eb922f40 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:57.989458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3157e-0ee4-4a62-bc21-3f5f27bb884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:57.990507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3157e-0ee4-4a62-bc21-3f5f27bb884a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:57.990986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3157e-0ee4-4a62-bc21-3f5f27bb884a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:57.993071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3157e-0ee4-4a62-bc21-3f5f27bb884a admin admin] PATH_INFO: `/v3/projects/2751b46cd5d74e5ea29be04ae823f86f/users/e75b5e687b894134be5eaf009f055a05/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:58.005468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3157e-0ee4-4a62-bc21-3f5f27bb884a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2751b46cd5d74e5ea29be04ae823f86f, user_id=e75b5e687b894134be5eaf009f055a05, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:58.008689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3157e-0ee4-4a62-bc21-3f5f27bb884a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:58.053716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2921/5845] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:48:57 2022] PUT /identity/v3/projects/2751b46cd5d74e5ea29be04ae823f86f/users/e75b5e687b894134be5eaf009f055a05/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:48:58.066987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:58.067674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:58.068290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:58.142655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] MFA Rules not processed for user `e75b5e687b894134be5eaf009f055a05`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:58.144376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:58.166565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:58.167503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:58.168226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:58.168380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:58.303775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:58.306167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:58.330429 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2925/5846] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:58.345634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2922/5847] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:58.364274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:58.366224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:58.400297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efba0e-784f-43ff-b1be-d09e4a29f875 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:58.538971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b70bf-1c8e-477e-a8b9-06ee989527df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:58.539653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b70bf-1c8e-477e-a8b9-06ee989527df service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:58.539653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b70bf-1c8e-477e-a8b9-06ee989527df service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:58.539653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b70bf-1c8e-477e-a8b9-06ee989527df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:58.616103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:58.705845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b70bf-1c8e-477e-a8b9-06ee989527df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:58.711102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b70bf-1c8e-477e-a8b9-06ee989527df service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:58.739411 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2926/5848] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:48:58.849291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:58.855355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:59.031817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4dac5-62aa-4086-b3d7-b83ac9245f94 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:48:59.052140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:48:59.053664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:59.068002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:59.068002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] PATH_INFO: `/v3/users/4ca750827582445ab44f3f633f1bba5b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:59.068002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca750827582445ab44f3f633f1bba5b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:48:59.068002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:48:59.213265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:59.376858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca750827582445ab44f3f633f1bba5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:59.377891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca750827582445ab44f3f633f1bba5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:59.478281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca750827582445ab44f3f633f1bba5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:59.479404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca750827582445ab44f3f633f1bba5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:59.491941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca750827582445ab44f3f633f1bba5b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:48:59.523832 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2923/5849] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:48:58 2022] DELETE /identity/v3/users/4ca750827582445ab44f3f633f1bba5b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:48:59.529699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:48:59.532695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:48:59.532695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:48:59.591061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:48:59.600248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:48:59.808639 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2927/5850] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:48:59.861979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:48:59.865147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:00.132487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48508d-75db-4c1c-8962-8e0dbfde608b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:00.143184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca80a48-59ea-4ca6-b1da-f5c5eaf5ed49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:00.147459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca80a48-59ea-4ca6-b1da-f5c5eaf5ed49 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:00.148005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca80a48-59ea-4ca6-b1da-f5c5eaf5ed49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:00.148971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca80a48-59ea-4ca6-b1da-f5c5eaf5ed49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:00.180038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca80a48-59ea-4ca6-b1da-f5c5eaf5ed49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:00.181824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca80a48-59ea-4ca6-b1da-f5c5eaf5ed49 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:00.216805 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2924/5851] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:02.198202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:02.201258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:02.229437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad633dbb-4560-4229-b35a-6ff15887f3d1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:02.241373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:02.244905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:02.245455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:02.246187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] PATH_INFO: `/v3/projects/f90a8139e89b4a8eac2f36205c9df0ed` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:02.255564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90a8139e89b4a8eac2f36205c9df0ed)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:02.263540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:02.497044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90a8139e89b4a8eac2f36205c9df0ed', 'request_id': 'req-fbb0be1e-a97e-44a8-97f3-42086ef2017f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:02.506874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90a8139e89b4a8eac2f36205c9df0ed', 'request_id': 'req-fbb0be1e-a97e-44a8-97f3-42086ef2017f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:02.621743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90a8139e89b4a8eac2f36205c9df0ed', 'request_id': 'req-fbb0be1e-a97e-44a8-97f3-42086ef2017f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:02.704695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] The token cache is being invalidate because project f90a8139e89b4a8eac2f36205c9df0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:49:02.705812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:02.707004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fbb0be1e-a97e-44a8-97f3-42086ef2017f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:02.711714 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2928/5852] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:49:02 2022] DELETE /identity/v3/projects/f90a8139e89b4a8eac2f36205c9df0ed => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:02.717791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340344bd-2807-4d19-82fe-8fa2e44efd14 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:02.719067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340344bd-2807-4d19-82fe-8fa2e44efd14 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:02.719067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340344bd-2807-4d19-82fe-8fa2e44efd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:02.773630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-340344bd-2807-4d19-82fe-8fa2e44efd14 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:02.776371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-340344bd-2807-4d19-82fe-8fa2e44efd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:02.891139 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2925/5853] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:02.900430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0682-b302-4055-863b-7502c92fb449 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:02.900758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0682-b302-4055-863b-7502c92fb449 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:02.900981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0682-b302-4055-863b-7502c92fb449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:02.910473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:02.923458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ea6b0682-b302-4055-863b-7502c92fb449 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:02.924586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ea6b0682-b302-4055-863b-7502c92fb449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:02.937216 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2929/5854] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:02.939433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340344bd-2807-4d19-82fe-8fa2e44efd14 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:02.958646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340344bd-2807-4d19-82fe-8fa2e44efd14 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:02.986258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:02.989120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:02.989412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:02.989699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:02.990436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:49:02.990753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:02.992560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:03.009718 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2926/5855] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:49:03.014592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0682-b302-4055-863b-7502c92fb449 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:03.025009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0682-b302-4055-863b-7502c92fb449 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:03.031879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:03.032616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:03.032976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:03.033302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:03.034127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:03.039176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:03.302630 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2930/5856] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:03 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:49:03.303732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:03.303732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333031d1-14e0-428c-a19c-b4fd249809ae admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:03.383296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:03.478115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:03.483554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:03.484076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:03.484578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:03.485820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:03.489798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:03.673019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2927/5857] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:03 2022] POST /identity/v3/users => generated 294 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:03.678363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:03.692413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e0d7a-7519-4ef2-bcb9-2d3b316b0cbb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:03.710083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:03.711471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:03.711977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:03.712481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:03.713893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:03.724740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:03.750997 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2931/5858] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:03.755177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:03.768493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d032f-5037-4da8-b163-5a9b871f6192 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:03.786592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:03.788851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:03.788851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:03.788851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:03.788851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:03.791020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:03.886257 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2928/5859] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:03.890102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:03.946396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb304d99-0adf-4f89-9818-4d5c862a5358 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:03.960574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fad7c-8389-4538-8a1a-7d3e64226632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:03.962417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fad7c-8389-4538-8a1a-7d3e64226632 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:03.962874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fad7c-8389-4538-8a1a-7d3e64226632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:03.963409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fad7c-8389-4538-8a1a-7d3e64226632 admin admin] PATH_INFO: `/v3/projects/67095bbb7a4647ca994ab52dc948d83b/users/ce62c03899e040bab1f041aba0187227/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:03.989056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fad7c-8389-4538-8a1a-7d3e64226632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67095bbb7a4647ca994ab52dc948d83b, user_id=ce62c03899e040bab1f041aba0187227, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:03.998094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fad7c-8389-4538-8a1a-7d3e64226632 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:04.125668 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2932/5860] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:03 2022] PUT /identity/v3/projects/67095bbb7a4647ca994ab52dc948d83b/users/ce62c03899e040bab1f041aba0187227/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:04.134013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:04.139257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed2e3-4faf-46b9-b40d-ce441653b403 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:04.139590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:04.140290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed2e3-4faf-46b9-b40d-ce441653b403 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:04.140746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed2e3-4faf-46b9-b40d-ce441653b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:04.220519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d09ed2e3-4faf-46b9-b40d-ce441653b403 None None] MFA Rules not processed for user `ce62c03899e040bab1f041aba0187227`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:04.223149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d09ed2e3-4faf-46b9-b40d-ce441653b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:04.350047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2142a-bfae-4a0a-999a-5c39563d92b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:04.417053 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2933/5861] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:04.422840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed2e3-4faf-46b9-b40d-ce441653b403 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:04.499138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:04.501202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:04.502409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:04.504537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:04.511535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:04.640642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed2e3-4faf-46b9-b40d-ce441653b403 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:04.654864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:04.657052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:04.658987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:04.659618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:04.660478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:04.665677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:04.747089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:04.749380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:04.802345 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2929/5862] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:04.816473 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2934/5863] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:04 2022] POST /identity/v3/projects => generated 387 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:49:04.820573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:04.852686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ad0c-1309-4df1-95be-899c609bff8a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:05.042769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:05.047322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:05.047322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:05.047322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:05.047322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:05.047322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:05.055871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:05.241650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2930/5864] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:04 2022] POST /identity/v3/users => generated 294 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:05.250919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:05.264531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b6fcc-348c-4d9b-b840-b96f90461dd8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:05.271134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:05.272855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:05.273473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:05.275786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:05.280049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:05.282474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:05.331617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:05.345331 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2935/5865] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:05.349299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cde4db-8083-4fab-901f-82b15b16fb8c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:05.363958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1a02c-9440-4b52-83c3-b3cfa93118a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:05.364601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1a02c-9440-4b52-83c3-b3cfa93118a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:05.364888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1a02c-9440-4b52-83c3-b3cfa93118a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:05.365171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1a02c-9440-4b52-83c3-b3cfa93118a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:05.365887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1a02c-9440-4b52-83c3-b3cfa93118a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:05.367535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1a02c-9440-4b52-83c3-b3cfa93118a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:05.408577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2931/5866] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:05.409681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:05.418834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:05.432881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78590-ff5a-4bc9-b2f6-cf9991411218 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:05.449414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:05.452831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:05.453345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:05.454170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] PATH_INFO: `/v3/projects/ce1706b91a934d9da192ad1c4a73c5a6/users/37d87f721de548dd81179057d36fe3ae/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:05.512394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1706b91a934d9da192ad1c4a73c5a6, user_id=37d87f721de548dd81179057d36fe3ae, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:05.516815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:05.660521 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2936/5867] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:05 2022] PUT /identity/v3/projects/ce1706b91a934d9da192ad1c4a73c5a6/users/37d87f721de548dd81179057d36fe3ae/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:49:05.678712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fdf1-cb76-422f-bcc0-e6b97cc9be9d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:05.679114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fdf1-cb76-422f-bcc0-e6b97cc9be9d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:05.679473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563fdf1-cb76-422f-bcc0-e6b97cc9be9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:05.730465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c563fdf1-cb76-422f-bcc0-e6b97cc9be9d None None] MFA Rules not processed for user `37d87f721de548dd81179057d36fe3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:05.732926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c563fdf1-cb76-422f-bcc0-e6b97cc9be9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:05.890931 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2932/5868] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:05.895767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:06.056361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc87bea-cf29-4a96-84f9-b4b6c2eaac41 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:06.087757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a39cae-8514-4d06-b552-b80c124c0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:06.090171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39cae-8514-4d06-b552-b80c124c0fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:06.090171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39cae-8514-4d06-b552-b80c124c0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:06.091858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39cae-8514-4d06-b552-b80c124c0fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:06.097431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a39cae-8514-4d06-b552-b80c124c0fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:06.101032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a39cae-8514-4d06-b552-b80c124c0fc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:06.251318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563fdf1-cb76-422f-bcc0-e6b97cc9be9d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:06.276734 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2937/5869] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:05 2022] POST /identity/v3/projects => generated 389 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:49:06.284026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563fdf1-cb76-422f-bcc0-e6b97cc9be9d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:06.316493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482063b0-c269-4e84-9ee0-bf14c20290be None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:06.321462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482063b0-c269-4e84-9ee0-bf14c20290be None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:06.321462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482063b0-c269-4e84-9ee0-bf14c20290be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:06.365622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-482063b0-c269-4e84-9ee0-bf14c20290be None None] MFA Rules not processed for user `d3ed4523fb1d423abcf98fdb30b37b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:06.368345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-482063b0-c269-4e84-9ee0-bf14c20290be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:06.430621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:06.431266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:06.431547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:06.431876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:06.433238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:06.436494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:06.494033 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2938/5870] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:06.553420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2933/5871] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:06 2022] POST /identity/v3/users => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:06.556512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482063b0-c269-4e84-9ee0-bf14c20290be None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:06.599535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482063b0-c269-4e84-9ee0-bf14c20290be None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:06.616978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:06.619006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:06.619673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:06.620233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:06.621643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:06.624952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:06.657591 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2939/5872] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:06.662143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:06.701547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca53d0b-a2d5-4fe9-a501-3a22b7c9b2cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:06.730513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:06.730513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:06.730513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:06.730513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] PATH_INFO: `/v3/projects/5eb31d58ddc143c688a4b834f179f36f/users/d51f8d85f0c54c48a442a5902c3bc36e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:06.738580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:06.788259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb31d58ddc143c688a4b834f179f36f, user_id=d51f8d85f0c54c48a442a5902c3bc36e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:06.809960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:06.943988 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2934/5873] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:06 2022] PUT /identity/v3/projects/5eb31d58ddc143c688a4b834f179f36f/users/d51f8d85f0c54c48a442a5902c3bc36e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:06.953607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:06.966353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4c54a-9cea-44c9-9d14-be727316b49b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:07.121823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83289cd-5a9c-4023-98fc-a094b7c70ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:07.123933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83289cd-5a9c-4023-98fc-a094b7c70ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:07.124384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83289cd-5a9c-4023-98fc-a094b7c70ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:07.125053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83289cd-5a9c-4023-98fc-a094b7c70ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:07.126178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83289cd-5a9c-4023-98fc-a094b7c70ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:07.128708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83289cd-5a9c-4023-98fc-a094b7c70ee8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:07.133192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:07.154003 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2940/5874] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:07.158111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:07.178466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2914-173b-44a9-af87-c4d8a7e080f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:07.189830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:07.191104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:07.192474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:07.192938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] PATH_INFO: `/v3/projects/5eb31d58ddc143c688a4b834f179f36f/users/d51f8d85f0c54c48a442a5902c3bc36e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:07.199423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb31d58ddc143c688a4b834f179f36f, user_id=d51f8d85f0c54c48a442a5902c3bc36e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:07.206305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:07.234548 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2935/5875] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:07 2022] PUT /identity/v3/projects/5eb31d58ddc143c688a4b834f179f36f/users/d51f8d85f0c54c48a442a5902c3bc36e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:07.245487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d7bd1-89cb-49af-9267-92da9d9e7c22 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:07.245878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d7bd1-89cb-49af-9267-92da9d9e7c22 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:07.246088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d7bd1-89cb-49af-9267-92da9d9e7c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:07.281236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b42d7bd1-89cb-49af-9267-92da9d9e7c22 None None] MFA Rules not processed for user `d51f8d85f0c54c48a442a5902c3bc36e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:07.282674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b42d7bd1-89cb-49af-9267-92da9d9e7c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:07.320823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:07.326536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:07.576992 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2941/5876] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:07 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:07.598708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f495-8ac0-4cb5-93cc-8903d53dd922 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:07.606892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:07.608362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:07.608823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:07.609301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] PATH_INFO: `/v3/users/455668a59a524a11b8754cb635636307` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:07.610887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] RBAC: Authorizing `identity:delete_user(user_id=455668a59a524a11b8754cb635636307)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:07.614643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:07.970106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455668a59a524a11b8754cb635636307'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:07.970106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455668a59a524a11b8754cb635636307'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:08.103438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455668a59a524a11b8754cb635636307'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:08.105079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455668a59a524a11b8754cb635636307'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:08.115608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455668a59a524a11b8754cb635636307'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:08.161251 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2936/5877] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:49:07 2022] DELETE /identity/v3/users/455668a59a524a11b8754cb635636307 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:49:08.166098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:08.166702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:08.167179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:08.203768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:08.205013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:08.279476 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2942/5878] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:08.318150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:08.322098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:08.456465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:08.458136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:08.480692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:08.501785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561f0e-1fac-41f5-be31-e8f2d0a6727c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:08.510399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:08.511037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:08.511326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:08.511600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:08.532180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:08.535857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:08.568184 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2937/5879] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:08.626607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a6ab-6705-4859-b8b3-f8a19a02f91d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:08.643759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7693f-1614-4c41-be43-69451f4f2042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:08.644403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7693f-1614-4c41-be43-69451f4f2042 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:08.644686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7693f-1614-4c41-be43-69451f4f2042 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:08.644965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7693f-1614-4c41-be43-69451f4f2042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:08.646826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fcd7693f-1614-4c41-be43-69451f4f2042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:08.694885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:08.805847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7693f-1614-4c41-be43-69451f4f2042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:08.812133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7693f-1614-4c41-be43-69451f4f2042 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:08.853810 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2943/5880] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:09.299658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:09.301318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:09.401724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce5ee5-8d75-4557-a947-c601ca392f73 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:09.413684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:09.414949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:09.416010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:09.416484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] PATH_INFO: `/v3/projects/f371e15059f343ce92c76ea65df8dc22` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:09.418024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f371e15059f343ce92c76ea65df8dc22)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:09.421150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:09.621803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f371e15059f343ce92c76ea65df8dc22', 'request_id': 'req-1c8dbae9-8ba0-4695-9b52-25634445b946'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:09.639113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f371e15059f343ce92c76ea65df8dc22', 'request_id': 'req-1c8dbae9-8ba0-4695-9b52-25634445b946'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:09.732096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f371e15059f343ce92c76ea65df8dc22', 'request_id': 'req-1c8dbae9-8ba0-4695-9b52-25634445b946'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:09.766956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] The token cache is being invalidate because project f371e15059f343ce92c76ea65df8dc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:49:09.770026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:09.775960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c8dbae9-8ba0-4695-9b52-25634445b946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:09.779704 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2938/5881] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:49:09 2022] DELETE /identity/v3/projects/f371e15059f343ce92c76ea65df8dc22 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:09.786084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854ad3-7b4a-4b6e-8603-0f502f45e31e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:09.789116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854ad3-7b4a-4b6e-8603-0f502f45e31e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:09.789431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854ad3-7b4a-4b6e-8603-0f502f45e31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:09.830842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c9854ad3-7b4a-4b6e-8603-0f502f45e31e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:09.832296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9854ad3-7b4a-4b6e-8603-0f502f45e31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:09.921377 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2944/5882] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:09.930736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481614d-2cc2-4434-af17-c2b096a6bc04 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:09.931207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481614d-2cc2-4434-af17-c2b096a6bc04 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:09.932069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481614d-2cc2-4434-af17-c2b096a6bc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:10.019826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9481614d-2cc2-4434-af17-c2b096a6bc04 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:10.021839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9481614d-2cc2-4434-af17-c2b096a6bc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:10.044942 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2939/5883] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:10.050238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9854ad3-7b4a-4b6e-8603-0f502f45e31e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:10.067895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9854ad3-7b4a-4b6e-8603-0f502f45e31e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:10.080525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:10.081579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:10.082300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:10.082945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:10.084028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:49:10.085846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:10.090236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:10.118037 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2945/5884] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:49:10.121876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481614d-2cc2-4434-af17-c2b096a6bc04 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:10.141601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481614d-2cc2-4434-af17-c2b096a6bc04 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:10.148204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:10.148849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:10.149131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:10.149409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:10.150076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:10.152311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:10.297866 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2940/5885] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:10 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:10.300323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:10.329235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e7c6-3fa2-45a3-bc5a-389d3abcbbf6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:10.447539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:10.448597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:10.449758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:10.451440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:10.452261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:10.454645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:10.582879 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2946/5886] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:10 2022] POST /identity/v3/users => generated 280 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:10.586219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:10.609619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3b519-8327-426e-9bd2-0a396a3fab07 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:10.616515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:10.617571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:10.618137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:10.618643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:10.619518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:10.622899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:10.649227 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2941/5887] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:10.653712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:10.672001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce381fa-2632-4a89-9f1b-cfea9811c96c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:10.686047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80db75a-cd01-49ac-a195-719136cec52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:10.687024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80db75a-cd01-49ac-a195-719136cec52e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:10.687358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80db75a-cd01-49ac-a195-719136cec52e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:10.687578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80db75a-cd01-49ac-a195-719136cec52e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:10.688226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80db75a-cd01-49ac-a195-719136cec52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:10.689921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80db75a-cd01-49ac-a195-719136cec52e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:10.751643 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2947/5888] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:49:10.753286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:10.767058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee4f5-120b-4135-b443-04e442cc60de admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:10.772593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:10.773536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:10.774004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:10.774628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] PATH_INFO: `/v3/projects/16c550e0325f49c39ebade8db8ab807b/users/5d807235ac744c368bf199d7f08dfcdc/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:10.834404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c550e0325f49c39ebade8db8ab807b, user_id=5d807235ac744c368bf199d7f08dfcdc, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:10.844581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:10.986443 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2942/5889] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:10 2022] PUT /identity/v3/projects/16c550e0325f49c39ebade8db8ab807b/users/5d807235ac744c368bf199d7f08dfcdc/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:49:11.000062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:11.001410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:11.002241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:11.107799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] MFA Rules not processed for user `5d807235ac744c368bf199d7f08dfcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:11.115570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:11.164017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:11.295082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2948/5890] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:11.368529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:11.371405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:11.540785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0eedc-b9ea-4146-a081-ecdbcfc91034 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:11.547389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:11.548027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:11.548328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:11.549400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:11.558578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:11.579953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:11.582526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:11.608819 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2943/5891] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:15.601059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:15.602651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:15.623757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e95bd-4f57-4767-a76f-3041fccc974e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:15.631244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:15.632277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:15.632832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:15.633590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:15.636628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:15.665010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:15.665010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:15.681781 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2949/5892] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:16.730220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:16.744391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bd8c7-a6c8-45fc-b7ed-440e16a6cf38 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:16.763089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17c448-5ab4-4fe7-8e26-7e4d573eec4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:16.764606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c448-5ab4-4fe7-8e26-7e4d573eec4c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:16.765320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c448-5ab4-4fe7-8e26-7e4d573eec4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:16.765864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c448-5ab4-4fe7-8e26-7e4d573eec4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:16.770610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-df17c448-5ab4-4fe7-8e26-7e4d573eec4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:17.048042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17c448-5ab4-4fe7-8e26-7e4d573eec4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:17.055085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17c448-5ab4-4fe7-8e26-7e4d573eec4c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:17.100345 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2944/5893] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:18.374810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:18.430970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8c53-f469-4569-91f7-11fc2121cbfb service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:18.458145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:18.459245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:18.460010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:18.460680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:18.466399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:18.738417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:18.740810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:18.764940 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2950/5894] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:26.233154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dcbf-2b54-4420-8165-bf7b59e630b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:26.233154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dcbf-2b54-4420-8165-bf7b59e630b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:26.233154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dcbf-2b54-4420-8165-bf7b59e630b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:26.311026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-01a2dcbf-2b54-4420-8165-bf7b59e630b1 None None] MFA Rules not processed for user `69a2792ee20e450e877d4f016c031768`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:26.320047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-01a2dcbf-2b54-4420-8165-bf7b59e630b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:26.534929 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2945/5895] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:28.753274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=61 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:35.555464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:35.569018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c8c1-8a5a-441e-a004-51e985782fbd service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:35.578738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:35.588531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:35.591508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:35.592910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:35.597826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:35.634085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:35.638364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:35.670454 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2951/5896] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:49:36.504107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=58 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:37.667667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:37.671057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:37.672255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:37.737838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] MFA Rules not processed for user `ce62c03899e040bab1f041aba0187227`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:37.739937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:37.887512 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2946/5897] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:43.066925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:43.068520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:43.284867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e35c57-eeec-4587-b022-f30242ebfeff service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:43.294142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:43.294988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:43.295660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:43.296090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:43.298613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:43.325781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:43.328335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:43.679509 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2952/5898] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:49:47.871770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:53.355789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=44 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:54.593505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:54.595371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:54.714393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd294ab-ce07-46b2-ad8b-c979af646e17 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:54.720090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:54.721469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:54.722029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:54.722413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] PATH_INFO: `/v3/users/7c1f0158199b40b0b2cd7621be78f7d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:54.724003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1f0158199b40b0b2cd7621be78f7d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:54.726089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:54.753586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:54.769088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8c534-0621-42b8-9d42-1b0dc4487b78 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:54.773880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:54.774553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:54.774839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:54.775115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] PATH_INFO: `/v3/users/5d807235ac744c368bf199d7f08dfcdc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:54.776304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d807235ac744c368bf199d7f08dfcdc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:54.778969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:54.930635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1f0158199b40b0b2cd7621be78f7d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:54.931995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1f0158199b40b0b2cd7621be78f7d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.027318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1f0158199b40b0b2cd7621be78f7d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.028264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1f0158199b40b0b2cd7621be78f7d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.041675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-14325951-ef5c-4f43-8625-1928f99bb008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1f0158199b40b0b2cd7621be78f7d1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.051604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d807235ac744c368bf199d7f08dfcdc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.065304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d807235ac744c368bf199d7f08dfcdc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.066496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d807235ac744c368bf199d7f08dfcdc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.085663 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2947/5899] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:49:54 2022] DELETE /identity/v3/users/7c1f0158199b40b0b2cd7621be78f7d1 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:55.089723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:55.090259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:55.090715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:55.098461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d807235ac744c368bf199d7f08dfcdc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.117991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:55.119386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:55.146943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2791c734-af46-4b60-9500-c4fd846e2e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d807235ac744c368bf199d7f08dfcdc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:55.153916 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2953/5900] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:49:54 2022] DELETE /identity/v3/users/5d807235ac744c368bf199d7f08dfcdc => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:49:55.158492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:55.158965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:55.159894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:55.201789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:55.203412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:55.216440 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2948/5901] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:55.253614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:55.257743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:55.278437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:55.337750 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2954/5902] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:49:55.360439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:55.364016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:55.391539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d49dab-8950-410e-bc1b-00b6105564c9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:55.511540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:55.512273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:55.512796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:55.513133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:55.517687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee8473-8485-4b6f-bc63-bf4b2cb0f20d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:55.527018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:55.528034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:55.528316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:55.528592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:55.529791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:55.531498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:55.546871 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2949/5903] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:49:55.552223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:55.553947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:55.584304 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2955/5904] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:56.564361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:56.567594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:56.583453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:56.586113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:56.595596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6f547-203f-476c-b1d1-c21a3524b448 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:56.608372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:56.609956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:56.611599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:56.616273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] PATH_INFO: `/v3/projects/16c550e0325f49c39ebade8db8ab807b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:56.618473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c550e0325f49c39ebade8db8ab807b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:56.622036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:56.624803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3481-177f-4164-b4a7-77c4aa4a1e89 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:56.642619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:56.645623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:56.647333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:56.648236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] PATH_INFO: `/v3/projects/6ea7d5f85ab744ff9cf2114412a8782f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:56.651365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea7d5f85ab744ff9cf2114412a8782f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:56.662078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:56.698476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:56.783350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c550e0325f49c39ebade8db8ab807b', 'request_id': 'req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:56.808045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c550e0325f49c39ebade8db8ab807b', 'request_id': 'req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:56.919860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea7d5f85ab744ff9cf2114412a8782f', 'request_id': 'req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:56.925619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c550e0325f49c39ebade8db8ab807b', 'request_id': 'req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:56.931330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea7d5f85ab744ff9cf2114412a8782f', 'request_id': 'req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:56.947912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] The token cache is being invalidate because project 16c550e0325f49c39ebade8db8ab807b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:49:56.948289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:56.950186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:56.962197 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2950/5905] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:49:56 2022] DELETE /identity/v3/projects/16c550e0325f49c39ebade8db8ab807b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:56.965070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:56.969064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:57.045008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea7d5f85ab744ff9cf2114412a8782f', 'request_id': 'req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:57.065046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] The token cache is being invalidate because project 6ea7d5f85ab744ff9cf2114412a8782f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:49:57.065832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:57.068530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:57.069827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc147ad6-535d-45ce-9b29-4ed8fb59ff5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:49:57.079015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2956/5906] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:49:56 2022] DELETE /identity/v3/projects/6ea7d5f85ab744ff9cf2114412a8782f => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:49:57.080793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5305507-cb92-4842-b12c-47a9f972ce12 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.081098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5305507-cb92-4842-b12c-47a9f972ce12 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.081388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5305507-cb92-4842-b12c-47a9f972ce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.133718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c5305507-cb92-4842-b12c-47a9f972ce12 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:57.135002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5305507-cb92-4842-b12c-47a9f972ce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:57.154668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e6f3d-cd73-4f74-8107-ab1b79ac532c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:57.341318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5a3d-d76b-4b92-baab-2357c9682970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:57.342414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5a3d-d76b-4b92-baab-2357c9682970 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.342935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5a3d-d76b-4b92-baab-2357c9682970 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.343309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5a3d-d76b-4b92-baab-2357c9682970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.356442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-227e5a3d-d76b-4b92-baab-2357c9682970 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:57.371771 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2957/5907] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:57.373502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69b1fd-1f9d-4271-a3dc-b5fa0ef525db None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.374214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69b1fd-1f9d-4271-a3dc-b5fa0ef525db None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.374616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69b1fd-1f9d-4271-a3dc-b5fa0ef525db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.397847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e5a3d-d76b-4b92-baab-2357c9682970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:57.399946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e5a3d-d76b-4b92-baab-2357c9682970 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:57.425265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3d69b1fd-1f9d-4271-a3dc-b5fa0ef525db None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:57.426639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d69b1fd-1f9d-4271-a3dc-b5fa0ef525db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:57.437181 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2951/5908] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:49:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:49:57.446981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753732c-d5bd-443c-b18d-b4f72e230965 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.447293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753732c-d5bd-443c-b18d-b4f72e230965 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.460729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753732c-d5bd-443c-b18d-b4f72e230965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.488686 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2958/5909] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:57.490272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128280a-7d39-4213-87e1-99e9d7603380 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.490561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128280a-7d39-4213-87e1-99e9d7603380 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.491094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128280a-7d39-4213-87e1-99e9d7603380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.525372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1753732c-d5bd-443c-b18d-b4f72e230965 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:57.533488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1753732c-d5bd-443c-b18d-b4f72e230965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:57.571046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b128280a-7d39-4213-87e1-99e9d7603380 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:57.572417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b128280a-7d39-4213-87e1-99e9d7603380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:57.579673 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2952/5910] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:57.580778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753732c-d5bd-443c-b18d-b4f72e230965 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:57.593722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753732c-d5bd-443c-b18d-b4f72e230965 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:57.601934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:57.603832 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2959/5911] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:57.604310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.604595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.604880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.607321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:49:57.607950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:57.611791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128280a-7d39-4213-87e1-99e9d7603380 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:57.618138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:57.643379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128280a-7d39-4213-87e1-99e9d7603380 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:57.663570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:57.664793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.665075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.665350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.666172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:49:57.667215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:57.667337 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2953/5912] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:49:57.668895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:57.669988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:57.689565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e21dfa-750a-4764-979f-47fb98a0a021 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:57.695405 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2960/5913] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:49:57.697296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:57.704817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:57.705458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.705732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.706004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.710116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:57.711115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:57.714337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d063ed7-077a-42e0-be91-c5038457714d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:57.720742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:57.722405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.722958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.723477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.724392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:57.726721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:57.835766 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2961/5914] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:57.836988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:57.861000 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2954/5915] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:57.864836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:57.961133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:57.988444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3642a9-2893-44ff-b057-faa3ba98fbfe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:57.989249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fae61-78ac-4991-bdd5-b4c1daa534a5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:57.995740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:57.996630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.996892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:57.997103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.997615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.997723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:57.998123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:57.998410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:57.999356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:57.999524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.001777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.009110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.154666 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2962/5916] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/users => generated 303 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:49:58.159258 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2955/5917] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:57 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:49:58.161169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.166243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.175881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552254-f557-4af3-a20b-080136ea8951 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.183769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.184527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.185640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.186526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.187511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.188698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa0fe1-3cf5-4460-894c-170b34e67ac9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.193812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.195429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.196409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.197180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.197180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.197726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.200284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.213117 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2963/5918] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:58.214504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.224249 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2956/5919] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:58.225659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.243377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75752-c2f1-4d79-bf18-d22346bc4aa7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.251093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.251899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.252287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.252699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.253477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.255325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d392-6428-4b8e-b580-f53588d64e37 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.255769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.267940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.268604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.268889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.269166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.269827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.271793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.286114 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2957/5920] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:58.289468 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2964/5921] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:58.293233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.300322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:58.302516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.306993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630cc1b-5a35-44a2-aa08-c99376f706bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.316141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c30a2a-de9f-470b-9ebb-6c0a5549cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.317330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30a2a-de9f-470b-9ebb-6c0a5549cb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.317330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30a2a-de9f-470b-9ebb-6c0a5549cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.317506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c30a2a-de9f-470b-9ebb-6c0a5549cb9c admin admin] PATH_INFO: `/v3/projects/db15d1d9f44b408ca0dccbc643b96755/users/b4db7104fbbe499ba532747183cc9e37/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.321456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc346b-4220-4252-93ff-f116da88b374 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.327480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c359809-26e4-46d8-88ec-daaaf45bbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.328179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359809-26e4-46d8-88ec-daaaf45bbe04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.328460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359809-26e4-46d8-88ec-daaaf45bbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.328737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359809-26e4-46d8-88ec-daaaf45bbe04 admin admin] PATH_INFO: `/v3/projects/4fd3567560094e17b6a5bee78b364dac/users/a4a1ecab8b16438fa8449200a9c9b2c7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.348247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c30a2a-de9f-470b-9ebb-6c0a5549cb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db15d1d9f44b408ca0dccbc643b96755, user_id=b4db7104fbbe499ba532747183cc9e37, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.351746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c30a2a-de9f-470b-9ebb-6c0a5549cb9c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.352464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359809-26e4-46d8-88ec-daaaf45bbe04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd3567560094e17b6a5bee78b364dac, user_id=a4a1ecab8b16438fa8449200a9c9b2c7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.356641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359809-26e4-46d8-88ec-daaaf45bbe04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.461232 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2958/5922] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:58 2022] PUT /identity/v3/projects/db15d1d9f44b408ca0dccbc643b96755/users/b4db7104fbbe499ba532747183cc9e37/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:49:58.473277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e2771-17a2-4bac-9aba-8230731aec0b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.473562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e2771-17a2-4bac-9aba-8230731aec0b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.473840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e2771-17a2-4bac-9aba-8230731aec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.491208 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2965/5923] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:58 2022] PUT /identity/v3/projects/4fd3567560094e17b6a5bee78b364dac/users/a4a1ecab8b16438fa8449200a9c9b2c7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:58.505453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d179a3-e38f-4996-94bb-b54107428d93 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.505453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d179a3-e38f-4996-94bb-b54107428d93 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.506417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d179a3-e38f-4996-94bb-b54107428d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.523494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c79e2771-17a2-4bac-9aba-8230731aec0b None None] MFA Rules not processed for user `b4db7104fbbe499ba532747183cc9e37`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:58.525630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c79e2771-17a2-4bac-9aba-8230731aec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:58.549517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59d179a3-e38f-4996-94bb-b54107428d93 None None] MFA Rules not processed for user `a4a1ecab8b16438fa8449200a9c9b2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:49:58.551696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59d179a3-e38f-4996-94bb-b54107428d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:49:58.676177 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2959/5924] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:58.680404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e2771-17a2-4bac-9aba-8230731aec0b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.737624 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2966/5925] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:49:58.738907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d179a3-e38f-4996-94bb-b54107428d93 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.793976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e2771-17a2-4bac-9aba-8230731aec0b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.800524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.801212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.801567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.801922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.802618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.804621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.833637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d179a3-e38f-4996-94bb-b54107428d93 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:58.841275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:58.842008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:58.842323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:58.842594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:58.843886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:58.845969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:58.918620 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2960/5926] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:58 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:49:58.923321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:58.976934 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2967/5927] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:49:58 2022] POST /identity/v3/projects => generated 401 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:49:58.990026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.049967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c4372-de33-4287-84a6-bea91f0086f5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.139233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31788f-66f7-44d6-8721-0e209f88ba12 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.145183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.145702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.145985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.146293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.147597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.149705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.169360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.170138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.170425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.170699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.171447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.173688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.186573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:59.246725 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2968/5928] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:58 2022] POST /identity/v3/users => generated 307 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:59.251166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.263527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791573d-7e50-4690-9bb3-4e582969810c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.270206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.271231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.271625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.274465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.274465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.277048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.294696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:59.299183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2961/5929] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:49:58 2022] POST /identity/v3/users => generated 296 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:49:59.303522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.319802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3dcb0-b242-412f-a612-e2af5b1d25c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.322410 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2969/5930] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:59.323693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.328756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.329397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.329747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.330249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.331544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.333237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.351355 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2962/5931] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:49:59.351880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ab23b-d865-4b35-b349-32303f9833de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.357343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.363840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.365054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.365566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.366089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] PATH_INFO: `/v3/projects/cfffe657b5c341c7bca7861f668690d9/users/ec7255ea6e354805a560699e0a3d7ff8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.380499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2df0a-7bdf-4f5a-a396-502796b373ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.391952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.392739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.392955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.393369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] PATH_INFO: `/v3/projects/4ffc43ae29b346b4b5cd5911cccdc1f7/users/a895428a84db4e2ebefd2a863000d053/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.405204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfffe657b5c341c7bca7861f668690d9, user_id=ec7255ea6e354805a560699e0a3d7ff8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.409414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.415450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffc43ae29b346b4b5cd5911cccdc1f7, user_id=a895428a84db4e2ebefd2a863000d053, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.421061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.515966 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2970/5932] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:59 2022] PUT /identity/v3/projects/cfffe657b5c341c7bca7861f668690d9/users/ec7255ea6e354805a560699e0a3d7ff8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:59.517392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.556141 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2963/5933] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:59 2022] PUT /identity/v3/projects/4ffc43ae29b346b4b5cd5911cccdc1f7/users/a895428a84db4e2ebefd2a863000d053/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:59.560299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.617125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af8bf3-c8d7-4f9f-86ba-16311bad8124 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.684353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f7600-4c2a-4525-af83-5548829a200b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.700712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.702024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.702667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.703137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.704017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.715502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.750228 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2964/5934] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:49:59.764282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.783341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.791571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.794360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.794788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.795871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.803216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.846571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba60d-1738-43d5-b2e2-a70e8ced5f4a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.866210 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2971/5935] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:49:59.866210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:49:59.866474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb490278-86a8-4d40-bc1c-d55b40623bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:49:59.866474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb490278-86a8-4d40-bc1c-d55b40623bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.866474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb490278-86a8-4d40-bc1c-d55b40623bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.866474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb490278-86a8-4d40-bc1c-d55b40623bdf admin admin] PATH_INFO: `/v3/projects/4ffc43ae29b346b4b5cd5911cccdc1f7/users/a895428a84db4e2ebefd2a863000d053/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:49:59.870815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb490278-86a8-4d40-bc1c-d55b40623bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffc43ae29b346b4b5cd5911cccdc1f7, user_id=a895428a84db4e2ebefd2a863000d053, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:49:59.882312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb490278-86a8-4d40-bc1c-d55b40623bdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:49:59.895871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a585f84-4e91-4fea-8b3e-bba2ceb5addd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:49:59.912335 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2965/5936] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:59 2022] PUT /identity/v3/projects/4ffc43ae29b346b4b5cd5911cccdc1f7/users/a895428a84db4e2ebefd2a863000d053/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:49:59.925763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:49:59.925763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:49:59.926478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:00.001915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] MFA Rules not processed for user `a895428a84db4e2ebefd2a863000d053`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:00.006117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:00.053242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0244307-daa8-40e0-a4a6-4cb4c86bd33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:00.055191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244307-daa8-40e0-a4a6-4cb4c86bd33a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:00.055770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244307-daa8-40e0-a4a6-4cb4c86bd33a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:00.056200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244307-daa8-40e0-a4a6-4cb4c86bd33a admin admin] PATH_INFO: `/v3/projects/cfffe657b5c341c7bca7861f668690d9/users/ec7255ea6e354805a560699e0a3d7ff8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:00.059709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0244307-daa8-40e0-a4a6-4cb4c86bd33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfffe657b5c341c7bca7861f668690d9, user_id=ec7255ea6e354805a560699e0a3d7ff8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:00.060178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:00.064029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0244307-daa8-40e0-a4a6-4cb4c86bd33a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:00.072784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:00.080793 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2972/5937] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:49:59 2022] PUT /identity/v3/projects/cfffe657b5c341c7bca7861f668690d9/users/ec7255ea6e354805a560699e0a3d7ff8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:00.096513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:00.097045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:00.097330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:00.145252 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2966/5938] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:49:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:00.159464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:00.159880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] MFA Rules not processed for user `ec7255ea6e354805a560699e0a3d7ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:00.161277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:00.161409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:00.238937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c27551-ff34-44fd-95ee-9cac59de9087 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:00.314862 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2973/5939] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:00.327104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:00.328761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:00.357239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:00.359928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:00.360504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:00.361783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:00.431658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2268a-8d65-4de1-9cee-deb4ece9ea1e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:00.435859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:00.436521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:00.436845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:00.437129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:00.451917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:00.451917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:00.488102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:00.503579 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2974/5940] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:00.535729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:00.586909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2967/5941] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:00.696072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:00.851592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c18156-ae5f-4589-a16b-33dc952152e4 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:00.878468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:00.879207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:00.879493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:00.879800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] PATH_INFO: `/v3/users/a4a1ecab8b16438fa8449200a9c9b2c7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:00.881605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a1ecab8b16438fa8449200a9c9b2c7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:00.894907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:00.899934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:00.919872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f9b87-84df-44d3-962d-37a9f5b159e3 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:00.926159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5e9f6-2e0a-4dde-946b-917e969ef6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:00.926907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5e9f6-2e0a-4dde-946b-917e969ef6aa service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:00.927212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5e9f6-2e0a-4dde-946b-917e969ef6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:00.927525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5e9f6-2e0a-4dde-946b-917e969ef6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:01.016033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:01.066487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:01.076082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5e9f6-2e0a-4dde-946b-917e969ef6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:01.078281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5e9f6-2e0a-4dde-946b-917e969ef6aa service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:01.088907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2968/5942] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:01.197879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a1ecab8b16438fa8449200a9c9b2c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:01.208838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a1ecab8b16438fa8449200a9c9b2c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:01.209579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a1ecab8b16438fa8449200a9c9b2c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:01.222720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a1ecab8b16438fa8449200a9c9b2c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:01.376048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a1ecab8b16438fa8449200a9c9b2c7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:01.390256 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2975/5943] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:00 2022] DELETE /identity/v3/users/a4a1ecab8b16438fa8449200a9c9b2c7 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:01.406288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:01.406288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:01.406288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:01.455570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:01.456827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:01.560089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2969/5944] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:01.568008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:01.569474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:01.642479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36180048-7864-441d-8915-5a66103d6fed admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:01.648343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:01.650564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:01.650930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:01.651163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:01.666204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:01.670673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:01.686082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2976/5945] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:02.229388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:02.229388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:02.248182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1e8c4-92dc-4be2-ae45-d0bfad83667c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:02.254754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:02.255629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:02.256084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:02.256494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] PATH_INFO: `/v3/projects/4fd3567560094e17b6a5bee78b364dac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:02.258347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd3567560094e17b6a5bee78b364dac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:02.262858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:02.375190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd3567560094e17b6a5bee78b364dac', 'request_id': 'req-c63bd265-3975-4e7f-aa6b-09048d8bb53e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.382853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd3567560094e17b6a5bee78b364dac', 'request_id': 'req-c63bd265-3975-4e7f-aa6b-09048d8bb53e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.456987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd3567560094e17b6a5bee78b364dac', 'request_id': 'req-c63bd265-3975-4e7f-aa6b-09048d8bb53e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.474624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] The token cache is being invalidate because project 4fd3567560094e17b6a5bee78b364dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:02.474995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.475744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.477461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2970/5946] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:02 2022] DELETE /identity/v3/projects/4fd3567560094e17b6a5bee78b364dac => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:02.481852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:02.495055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bae39-f3aa-4069-b4f7-b2206f06aa58 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:02.557281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:02.570859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:02.571861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:02.572211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:02.572555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] PATH_INFO: `/v3/users/ec7255ea6e354805a560699e0a3d7ff8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:02.574506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec7255ea6e354805a560699e0a3d7ff8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:02.576623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:02.852007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec7255ea6e354805a560699e0a3d7ff8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.869235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec7255ea6e354805a560699e0a3d7ff8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.869795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec7255ea6e354805a560699e0a3d7ff8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.898901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec7255ea6e354805a560699e0a3d7ff8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.983018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b3422f8a-9eff-4eae-9fec-527423d425d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec7255ea6e354805a560699e0a3d7ff8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:02.992000 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2977/5947] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:02 2022] DELETE /identity/v3/users/ec7255ea6e354805a560699e0a3d7ff8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:03.696589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:03.699367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:03.735120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd265-3975-4e7f-aa6b-09048d8bb53e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:03.839996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:03.863834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:03.864441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:03.864725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:03.864998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] PATH_INFO: `/v3/projects/cfffe657b5c341c7bca7861f668690d9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:03.866416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfffe657b5c341c7bca7861f668690d9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:03.868603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:04.034734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfffe657b5c341c7bca7861f668690d9', 'request_id': 'req-e71bd2be-5f25-4666-8585-683ec21c62a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:04.047053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfffe657b5c341c7bca7861f668690d9', 'request_id': 'req-e71bd2be-5f25-4666-8585-683ec21c62a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:04.137178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfffe657b5c341c7bca7861f668690d9', 'request_id': 'req-e71bd2be-5f25-4666-8585-683ec21c62a6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:04.152973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] The token cache is being invalidate because project cfffe657b5c341c7bca7861f668690d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:04.153407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:04.154174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e71bd2be-5f25-4666-8585-683ec21c62a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:04.155729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2971/5948] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:03 2022] DELETE /identity/v3/projects/cfffe657b5c341c7bca7861f668690d9 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:04.161157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394064-24d1-43d9-8d45-9b3bbf5bf294 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:04.161691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394064-24d1-43d9-8d45-9b3bbf5bf294 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:04.161828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394064-24d1-43d9-8d45-9b3bbf5bf294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:04.190926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4f394064-24d1-43d9-8d45-9b3bbf5bf294 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:04.192525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f394064-24d1-43d9-8d45-9b3bbf5bf294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:04.291730 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2978/5949] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:04.299891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a310-5e25-4387-b8b8-6670a8493af7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:04.300182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a310-5e25-4387-b8b8-6670a8493af7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:04.300442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a310-5e25-4387-b8b8-6670a8493af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:04.330451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d273a310-5e25-4387-b8b8-6670a8493af7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:04.332021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d273a310-5e25-4387-b8b8-6670a8493af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:04.341477 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2972/5950] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:04.345659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394064-24d1-43d9-8d45-9b3bbf5bf294 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:04.363688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394064-24d1-43d9-8d45-9b3bbf5bf294 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:04.380862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:04.381518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:04.381808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:04.382131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:04.382792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:50:04.383096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:04.385047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:04.415337 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2979/5951] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:50:04.421034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a310-5e25-4387-b8b8-6670a8493af7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:04.452159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a310-5e25-4387-b8b8-6670a8493af7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:04.485224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:04.486341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:04.486804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:04.487991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:04.489115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:04.500649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:04.632689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:04.633234 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2973/5952] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:04 2022] POST /identity/v3/projects => generated 357 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:04.669815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d38ef8-ef43-46a0-9880-f5a86bb8a8e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:04.789306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:04.797440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:04.798294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:04.798698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:04.799128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:04.800054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:04.802453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:04.919114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2980/5953] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:04 2022] POST /identity/v3/users => generated 279 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:04.919935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:04.952942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f026eb5-dce9-4997-a713-2f7dff4b9b7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:04.970018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:04.970900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:04.971341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:04.971964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:04.972922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:04.975011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:05.001866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:05.002540 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2974/5954] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:05.015302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc70f44-785b-4532-a5bc-a963495ab568 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:05.020969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c43a35-c8c4-4b97-8f04-3f1eeae3d41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:05.021824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43a35-c8c4-4b97-8f04-3f1eeae3d41a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:05.022282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43a35-c8c4-4b97-8f04-3f1eeae3d41a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:05.022803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c43a35-c8c4-4b97-8f04-3f1eeae3d41a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:05.023644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c43a35-c8c4-4b97-8f04-3f1eeae3d41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:05.025452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c43a35-c8c4-4b97-8f04-3f1eeae3d41a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:05.045491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:05.046189 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2981/5955] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:50:05.057869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2759d-98d8-4b97-9f35-6fb36657fe2b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:05.065138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:05.066006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:05.066478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:05.066888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] PATH_INFO: `/v3/projects/6caf1f74f8b34b91b162eaf0261b8831/users/63ed4b9931c04c94886d0d6e599facd8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:05.118309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caf1f74f8b34b91b162eaf0261b8831, user_id=63ed4b9931c04c94886d0d6e599facd8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:05.131118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:05.231269 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2975/5956] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:05 2022] PUT /identity/v3/projects/6caf1f74f8b34b91b162eaf0261b8831/users/63ed4b9931c04c94886d0d6e599facd8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:05.245356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43bb7a-209b-4b2a-b57d-5868115d3701 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:05.246871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43bb7a-209b-4b2a-b57d-5868115d3701 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:05.247325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43bb7a-209b-4b2a-b57d-5868115d3701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:05.291324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc43bb7a-209b-4b2a-b57d-5868115d3701 None None] MFA Rules not processed for user `63ed4b9931c04c94886d0d6e599facd8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:05.293361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc43bb7a-209b-4b2a-b57d-5868115d3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:05.432671 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2982/5957] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:05.433879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:05.579550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510ef1-5153-4ed8-bd01-aadc6b48623c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:05.585266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:05.586311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:05.586597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:05.586876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:05.587850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:05.590554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:05.707310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2976/5958] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:05 2022] POST /identity/v3/projects => generated 353 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:50:05.711670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43bb7a-209b-4b2a-b57d-5868115d3701 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:05.728677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43bb7a-209b-4b2a-b57d-5868115d3701 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:05.837228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:05.837895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:05.838233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:05.843296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:05.843296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:05.843296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:06.006898 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2983/5959] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:05 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:06.013028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:06.025007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:06.044750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded01-7db5-47ed-8e4e-593dbf2603b1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:06.050021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:06.050806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:06.051307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:06.051779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:06.052639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:06.054876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:06.087231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:06.095728 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2977/5960] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:50:06.110619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305f6c5-3aed-4b58-90bf-e8b1f577deb3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:06.123095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:06.126996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:06.126996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:06.127442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] PATH_INFO: `/v3/projects/3bee93d85afb477593e5969d09b21ad9/users/840d5b2817464f029b83971cbb9fecfe/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:06.159791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bee93d85afb477593e5969d09b21ad9, user_id=840d5b2817464f029b83971cbb9fecfe, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:06.162753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:06.310497 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2984/5961] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:06 2022] PUT /identity/v3/projects/3bee93d85afb477593e5969d09b21ad9/users/840d5b2817464f029b83971cbb9fecfe/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:06.314780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:06.333675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780c2f3-face-40f8-a679-739d1638d74e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:06.486760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d8138-e6df-4cc9-a5b2-96820c47c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:06.488047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d8138-e6df-4cc9-a5b2-96820c47c519 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:06.488521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d8138-e6df-4cc9-a5b2-96820c47c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:06.489135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d8138-e6df-4cc9-a5b2-96820c47c519 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:06.490130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d8138-e6df-4cc9-a5b2-96820c47c519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:06.492061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d8138-e6df-4cc9-a5b2-96820c47c519 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:06.514280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:06.525868 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2978/5962] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:50:06.540387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd88d6f-02a0-47db-a237-5a51a3e37ede admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:06.550981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:06.551678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:06.551985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:06.552267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] PATH_INFO: `/v3/projects/3bee93d85afb477593e5969d09b21ad9/users/840d5b2817464f029b83971cbb9fecfe/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:06.566195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bee93d85afb477593e5969d09b21ad9, user_id=840d5b2817464f029b83971cbb9fecfe, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:06.568938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:06.596925 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2985/5963] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:06 2022] PUT /identity/v3/projects/3bee93d85afb477593e5969d09b21ad9/users/840d5b2817464f029b83971cbb9fecfe/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:06.608314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981820-5907-485d-b9dc-f2290dc282f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:06.608701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981820-5907-485d-b9dc-f2290dc282f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:06.609071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981820-5907-485d-b9dc-f2290dc282f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:06.682523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-81981820-5907-485d-b9dc-f2290dc282f3 None None] MFA Rules not processed for user `840d5b2817464f029b83971cbb9fecfe`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:06.683841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-81981820-5907-485d-b9dc-f2290dc282f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:06.799415 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2979/5964] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:07.309938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:07.313324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:07.354595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:07.469836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7510ad-ce0d-4a0f-8e23-b83acac5b803 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:07.512037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:07.512722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:07.513007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:07.513289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:07.550288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:07.553271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:07.599086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2986/5965] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:07.999863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981820-5907-485d-b9dc-f2290dc282f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:08.024798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981820-5907-485d-b9dc-f2290dc282f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:08.039368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:08.040009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:08.040294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:08.040559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:08.131249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:08.133036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:08.145589 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2980/5966] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:16.911125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:16.912822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:17.033533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28c256-5bfc-4d4b-866d-468cae4510cc service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:17.044490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:17.045534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:17.046359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:17.046842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:17.049202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:17.163834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:17.165306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:17.185394 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2987/5967] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:18.139642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:20.581157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:20.583869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:20.669107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:20.670898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:20.732135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd3fe1-0fba-4045-a4cb-0dd10a2a5422 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:20.746674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:20.747540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:20.748007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:20.748424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] PATH_INFO: `/v3/users/a02ed19a63a941d4854c16ca47a122d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:20.750084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a02ed19a63a941d4854c16ca47a122d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:20.756455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:20.785391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463d258-12d7-4abf-9e7c-6220aad37944 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:20.794250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:20.795458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:20.796036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:20.796524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] PATH_INFO: `/v3/users/b4db7104fbbe499ba532747183cc9e37` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:20.798217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4db7104fbbe499ba532747183cc9e37)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:20.801274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:20.830748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:21.089457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a02ed19a63a941d4854c16ca47a122d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.098035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a02ed19a63a941d4854c16ca47a122d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.148372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4db7104fbbe499ba532747183cc9e37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.158395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4db7104fbbe499ba532747183cc9e37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.163380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4db7104fbbe499ba532747183cc9e37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.176778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4db7104fbbe499ba532747183cc9e37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.203538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a02ed19a63a941d4854c16ca47a122d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.208125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a02ed19a63a941d4854c16ca47a122d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.224406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64361fc0-4349-4a94-94b6-789b1b79e2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a02ed19a63a941d4854c16ca47a122d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.281705 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2981/5968] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:20 2022] DELETE /identity/v3/users/a02ed19a63a941d4854c16ca47a122d3 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:21.286756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:21.287163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:21.287718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:21.306190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cd8a2782-a8e5-413b-b76f-91aaaefe4e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4db7104fbbe499ba532747183cc9e37'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:21.313971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:21.313971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:21.316051 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2988/5969] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:20 2022] DELETE /identity/v3/users/b4db7104fbbe499ba532747183cc9e37 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:50:21.322717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:21.323006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:21.324184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:21.352867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:21.354281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:21.424309 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2982/5970] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:50:21.435207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:21.438652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:21.440914 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2989/5971] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:21.452257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:21.459149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:21.470988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:21.528935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5c79-e573-4d93-9b33-eb13dc40f4c3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:21.535468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:21.540411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:21.540411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:21.540411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:21.550801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:21.552573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:21.553067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3949d-cd84-4192-927a-227b670bfa52 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:21.562720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:21.563449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:21.564098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:21.564464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:21.569854 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2983/5972] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:50:21.590325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:21.594483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:21.621426 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2990/5973] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:21.991366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:21.993353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:22.029089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326bdb2-4698-4aca-a07a-a6def30a2401 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:22.035497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:22.046368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:22.046368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:22.046368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] PATH_INFO: `/v3/projects/87e62506bcd44ec0a8c0fb44a3948ee2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:22.046368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e62506bcd44ec0a8c0fb44a3948ee2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:22.046368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:22.251914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:22.256467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:22.325528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12388222-e702-42a0-8659-e052535d8245 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:22.340190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e62506bcd44ec0a8c0fb44a3948ee2', 'request_id': 'req-17688284-dba7-4f2c-9dc6-36af328724c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.367382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e62506bcd44ec0a8c0fb44a3948ee2', 'request_id': 'req-17688284-dba7-4f2c-9dc6-36af328724c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.406610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:22.439662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:22.440755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:22.441251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:22.441685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] PATH_INFO: `/v3/projects/db15d1d9f44b408ca0dccbc643b96755` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:22.443674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db15d1d9f44b408ca0dccbc643b96755)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:22.446135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:22.513128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e62506bcd44ec0a8c0fb44a3948ee2', 'request_id': 'req-17688284-dba7-4f2c-9dc6-36af328724c4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.528165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] The token cache is being invalidate because project 87e62506bcd44ec0a8c0fb44a3948ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:22.528612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.529504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-17688284-dba7-4f2c-9dc6-36af328724c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.531172 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2984/5974] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:21 2022] DELETE /identity/v3/projects/87e62506bcd44ec0a8c0fb44a3948ee2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:22.537005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b8dfe-5120-4939-a933-b37b30f48111 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:22.537458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b8dfe-5120-4939-a933-b37b30f48111 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:22.537837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b8dfe-5120-4939-a933-b37b30f48111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:22.567218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c26b8dfe-5120-4939-a933-b37b30f48111 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:22.568902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c26b8dfe-5120-4939-a933-b37b30f48111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:22.588561 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2985/5975] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:22.600034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731919-ac5d-4866-8a55-e566b02f7f92 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:22.600593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731919-ac5d-4866-8a55-e566b02f7f92 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:22.601031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d731919-ac5d-4866-8a55-e566b02f7f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:22.625671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d731919-ac5d-4866-8a55-e566b02f7f92 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:22.627021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d731919-ac5d-4866-8a55-e566b02f7f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:22.633690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db15d1d9f44b408ca0dccbc643b96755', 'request_id': 'req-bc7fa877-de03-4b91-a110-4609fc597230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.662695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db15d1d9f44b408ca0dccbc643b96755', 'request_id': 'req-bc7fa877-de03-4b91-a110-4609fc597230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.713117 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2986/5976] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:50:22.717144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731919-ac5d-4866-8a55-e566b02f7f92 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:22.728772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d731919-ac5d-4866-8a55-e566b02f7f92 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:22.748492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:22.748492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:22.748492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:22.748492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:22.748850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:50:22.748850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:22.748850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:22.758188 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2987/5977] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:50:22.760267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:22.773980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e06e7-cd22-4adb-97e4-9c317ec5d6bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:22.782995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:22.782995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:22.782995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:22.782995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:22.783348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:22.784237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:22.807274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db15d1d9f44b408ca0dccbc643b96755', 'request_id': 'req-bc7fa877-de03-4b91-a110-4609fc597230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.829777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] The token cache is being invalidate because project db15d1d9f44b408ca0dccbc643b96755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:22.830658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.831493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:22.834476 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2991/5978] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:22 2022] DELETE /identity/v3/projects/db15d1d9f44b408ca0dccbc643b96755 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:22.837559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:22.839413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:22.855202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fa877-de03-4b91-a110-4609fc597230 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:22.860571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:22.861422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:22.861900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:22.862284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] PATH_INFO: `/v3/users/a895428a84db4e2ebefd2a863000d053` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:22.863530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a895428a84db4e2ebefd2a863000d053)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:22.869030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:22.933135 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2988/5979] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:22 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:50:22.943863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:22.943863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:22.952766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:23.028966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff643-90f0-439e-a02f-813f78274b0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:23.035645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:23.036282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:23.036563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:23.036832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:23.037674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:23.040307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:23.097584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a895428a84db4e2ebefd2a863000d053'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:23.109939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a895428a84db4e2ebefd2a863000d053'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:23.110865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a895428a84db4e2ebefd2a863000d053'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:23.125510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a895428a84db4e2ebefd2a863000d053'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:23.161752 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2989/5980] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:22 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:23.163375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:23.165204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:23.180113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2ebae-a989-4d7b-b955-35b03fbf6aa4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:23.186608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:23.187244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:23.187521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:23.187790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:23.188444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:23.190047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:23.201960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2990/5981] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:23.206782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:23.221746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fef66-a483-4b28-8002-daaf592e0399 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:23.227195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:23.227959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:23.228240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:23.228515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:23.229257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:23.231620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:23.242892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2c33a4-f412-4d2e-9440-56915fcb3e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a895428a84db4e2ebefd2a863000d053'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:23.246178 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2991/5982] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:23.250581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:23.261775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d699-2963-4ddb-b72a-ee26563347bc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:23.268191 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2992/5983] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:22 2022] DELETE /identity/v3/users/a895428a84db4e2ebefd2a863000d053 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:23.360321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:23.361496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:23.361783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:23.362083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] PATH_INFO: `/v3/projects/aa53fb9aa3ab4df8a4b6d29d85b0d779/users/6ac44deb1e9d44199888c5b976982a8e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:23.381233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa53fb9aa3ab4df8a4b6d29d85b0d779, user_id=6ac44deb1e9d44199888c5b976982a8e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:23.384509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:23.478941 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2992/5984] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:23 2022] PUT /identity/v3/projects/aa53fb9aa3ab4df8a4b6d29d85b0d779/users/6ac44deb1e9d44199888c5b976982a8e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:23.490486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:23.493423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:23.493423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:23.539701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] MFA Rules not processed for user `6ac44deb1e9d44199888c5b976982a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:23.541176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:23.583375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:23.682187 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2993/5985] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:23.708194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:23.710367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:23.799233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bcd9a-d25b-4ab7-a87b-6e843836cd7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:23.803364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:23.804198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:23.804492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:23.805036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:23.815170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:23.816645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:23.820640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:23.827625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2993/5986] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:50:23.891746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:23.893341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:23.994298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cd1b6-6c37-4c3f-942a-33310ff35e2b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:24.000781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:24.001513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.007436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.007436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] PATH_INFO: `/v3/projects/4ffc43ae29b346b4b5cd5911cccdc1f7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.007436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffc43ae29b346b4b5cd5911cccdc1f7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:24.007436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:24.187743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffc43ae29b346b4b5cd5911cccdc1f7', 'request_id': 'req-ee05e0b0-17ce-4cc8-8f6c-028966014a59'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.196467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffc43ae29b346b4b5cd5911cccdc1f7', 'request_id': 'req-ee05e0b0-17ce-4cc8-8f6c-028966014a59'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.253679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:24.265156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724e2e2-632f-4000-a091-0e5a82f6fcb3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:24.311586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffc43ae29b346b4b5cd5911cccdc1f7', 'request_id': 'req-ee05e0b0-17ce-4cc8-8f6c-028966014a59'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.325789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] The token cache is being invalidate because project 4ffc43ae29b346b4b5cd5911cccdc1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:24.326514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.328677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee05e0b0-17ce-4cc8-8f6c-028966014a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.330926 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2994/5987] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:23 2022] DELETE /identity/v3/projects/4ffc43ae29b346b4b5cd5911cccdc1f7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:24.334706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:24.334706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.334706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.334706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] PATH_INFO: `/v3/users/6ac44deb1e9d44199888c5b976982a8e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.342743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac44deb1e9d44199888c5b976982a8e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:24.342743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:24.343293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fbb01-d266-4d7e-87ec-74ab3802d0ed None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.343293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fbb01-d266-4d7e-87ec-74ab3802d0ed None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.343293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fbb01-d266-4d7e-87ec-74ab3802d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.369167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d97fbb01-d266-4d7e-87ec-74ab3802d0ed None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:24.370950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d97fbb01-d266-4d7e-87ec-74ab3802d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:24.380508 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2995/5988] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:24.389305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361160-38b1-4a77-ab27-536a5eb832a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.389593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361160-38b1-4a77-ab27-536a5eb832a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.390268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361160-38b1-4a77-ab27-536a5eb832a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.412121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7d361160-38b1-4a77-ab27-536a5eb832a4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:24.413454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d361160-38b1-4a77-ab27-536a5eb832a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:24.425931 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2996/5989] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:50:24.427252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361160-38b1-4a77-ab27-536a5eb832a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:24.438169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361160-38b1-4a77-ab27-536a5eb832a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:24.443406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:24.444107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.444389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.444664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.445363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:50:24.445672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:24.447380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:24.474484 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2997/5990] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:50:24.480700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:24.492648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cef98c-7332-4e87-ba26-cbd81eb8e0db admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:24.499631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:24.500045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.500045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.500439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.501035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:24.503121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:24.558767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac44deb1e9d44199888c5b976982a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.559457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac44deb1e9d44199888c5b976982a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.665783 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2998/5991] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:24 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:24.667461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:24.669144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:24.677478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac44deb1e9d44199888c5b976982a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.679233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac44deb1e9d44199888c5b976982a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.687432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f4d32b0e-4541-4a00-a273-cd8230a99531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac44deb1e9d44199888c5b976982a8e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:24.689516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:24.709692 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2994/5992] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:24 2022] DELETE /identity/v3/users/6ac44deb1e9d44199888c5b976982a8e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:50:24.714369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.714797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.715103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.739716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:24.740945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:24.763890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dee60-11fc-4698-b2b8-b08c2e652dc5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:24.810955 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2995/5993] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:24.823489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:24.825698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:24.856239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:24.873011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:24.873639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.873919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.874480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.875122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:24.877067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:24.906168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd098c08-c884-4b21-ac25-0fc169e199ca None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:24.909963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:24.910642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:24.910919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:24.911186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:24.920884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:24.922356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:24.933777 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2996/5994] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:25.008892 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 2999/5995] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:24 2022] POST /identity/v3/users => generated 283 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:50:25.013671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:25.024079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f219d-1da6-409c-8630-cd4274a8965c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:25.030967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:25.031732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.032180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.032505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.033260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:25.035164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:25.050098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2997/5996] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:25.053329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:25.066969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d0ee-b8fb-47ea-b891-9f2ffe3d6074 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:25.103373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf8c47-b9f0-4c6d-a9ab-b73649051cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:25.104619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf8c47-b9f0-4c6d-a9ab-b73649051cee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.105183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf8c47-b9f0-4c6d-a9ab-b73649051cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.105943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf8c47-b9f0-4c6d-a9ab-b73649051cee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.106968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf8c47-b9f0-4c6d-a9ab-b73649051cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:25.110021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf8c47-b9f0-4c6d-a9ab-b73649051cee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:25.123609 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3000/5997] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:50:25.128371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:25.140604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3f79b-baba-4b0b-b06b-3804632399f8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:25.159749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:25.160607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.160799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.162871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] PATH_INFO: `/v3/projects/c7fd718537f740a98bd3d90b7c972a04/users/16accf6392114bd69c4432080dd6124f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.181969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fd718537f740a98bd3d90b7c972a04, user_id=16accf6392114bd69c4432080dd6124f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:25.185465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:25.329529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2998/5998] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:25 2022] PUT /identity/v3/projects/c7fd718537f740a98bd3d90b7c972a04/users/16accf6392114bd69c4432080dd6124f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:25.335620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.336384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.336781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.399705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] MFA Rules not processed for user `16accf6392114bd69c4432080dd6124f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:25.401171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:25.490550 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3001/5999] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:50:25.495124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:25.561096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d624b-339b-4f37-b3a4-777df848dd80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:25.566447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:25.567072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.567358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.567636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.568560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:25.570607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:25.628333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:25.629990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:25.666029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c29f30-b95d-49a7-8d6a-101e3a71888e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:25.670413 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 2999/6000] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:25 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:25.674539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:25.675588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:25.676255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.676571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.676845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] PATH_INFO: `/v3/projects/aa53fb9aa3ab4df8a4b6d29d85b0d779` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.678303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa53fb9aa3ab4df8a4b6d29d85b0d779)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:25.680269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:25.708347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:25.757258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f8c1-1509-4531-93a5-52734c0f17d2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:25.761405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:25.762135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.762491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.762853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.763555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:25.765581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:25.829356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa53fb9aa3ab4df8a4b6d29d85b0d779', 'request_id': 'req-88f45505-1632-4281-9505-e8e97fabd5e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:25.836937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa53fb9aa3ab4df8a4b6d29d85b0d779', 'request_id': 'req-88f45505-1632-4281-9505-e8e97fabd5e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:25.896937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:25.902927 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3000/6001] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:25 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:50:25.907032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:25.917809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d2898-4d13-487d-8333-e387652b26b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:25.982294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:25.982528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa53fb9aa3ab4df8a4b6d29d85b0d779', 'request_id': 'req-88f45505-1632-4281-9505-e8e97fabd5e0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:25.982984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:25.983302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:25.983580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:25.984411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:25.985921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:25.996741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] The token cache is being invalidate because project aa53fb9aa3ab4df8a4b6d29d85b0d779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:25.996998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:25.997771 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3001/6002] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:25.997879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-88f45505-1632-4281-9505-e8e97fabd5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:25.999775 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3002/6003] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:25 2022] DELETE /identity/v3/projects/aa53fb9aa3ab4df8a4b6d29d85b0d779 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:26.002214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.004519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f4c4-1bc3-43a7-84fe-c48594e51890 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.004799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f4c4-1bc3-43a7-84fe-c48594e51890 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.004959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:26.005080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f4c4-1bc3-43a7-84fe-c48594e51890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.018726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87d85-847e-453f-a25b-4dd23199ffeb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.024366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.025044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.026333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5975f4c4-1bc3-43a7-84fe-c48594e51890 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:26.027543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5975f4c4-1bc3-43a7-84fe-c48594e51890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:26.034371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.035333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] PATH_INFO: `/v3/projects/2b89bcdd35c24be18da89e8bbf028062/users/8eee31b7beb34b209fd9ccb9e44d9d7b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.043534 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3003/6004] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:50:26.045188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549ecc-5d09-45fc-8ae7-f2d49dae7c14 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.045478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549ecc-5d09-45fc-8ae7-f2d49dae7c14 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.045758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd549ecc-5d09-45fc-8ae7-f2d49dae7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.072213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd549ecc-5d09-45fc-8ae7-f2d49dae7c14 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:26.073957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd549ecc-5d09-45fc-8ae7-f2d49dae7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:26.087228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3004/6005] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:26.088395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b89bcdd35c24be18da89e8bbf028062, user_id=8eee31b7beb34b209fd9ccb9e44d9d7b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.090702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd549ecc-5d09-45fc-8ae7-f2d49dae7c14 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.091902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.102370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd549ecc-5d09-45fc-8ae7-f2d49dae7c14 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.108541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.109464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.110815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.111281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.121964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:50:26.121964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.121964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.130955 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3005/6006] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:50:26.136241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.149552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0078fe0-df80-4408-8432-741cdd35a95f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.156319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.157670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.158180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.158775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.160709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.162973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.182226 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3002/6007] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:26 2022] PUT /identity/v3/projects/2b89bcdd35c24be18da89e8bbf028062/users/8eee31b7beb34b209fd9ccb9e44d9d7b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:50:26.185708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.260320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792560b-f169-4c25-8cf5-aced90dfd50b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.268170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.268801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.269220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.269434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.270184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.272630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.288350 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3006/6008] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:26 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:26.292456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3003/6009] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:26.292599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.293309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.306829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db8ef6-b254-4926-a0c3-c71d51e60d0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.387095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.388759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.389505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.389943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.390770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.393180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.413756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ee8ac-f3ea-46b7-8802-00376153d669 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.416126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07fad9-9d6e-4c3a-a395-7eaa15eb16d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.417477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07fad9-9d6e-4c3a-a395-7eaa15eb16d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.418330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07fad9-9d6e-4c3a-a395-7eaa15eb16d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.418547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07fad9-9d6e-4c3a-a395-7eaa15eb16d1 admin admin] PATH_INFO: `/v3/projects/2b89bcdd35c24be18da89e8bbf028062/users/8eee31b7beb34b209fd9ccb9e44d9d7b/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.421727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07fad9-9d6e-4c3a-a395-7eaa15eb16d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b89bcdd35c24be18da89e8bbf028062, user_id=8eee31b7beb34b209fd9ccb9e44d9d7b, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.428778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07fad9-9d6e-4c3a-a395-7eaa15eb16d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.450214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3007/6010] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:26 2022] PUT /identity/v3/projects/2b89bcdd35c24be18da89e8bbf028062/users/8eee31b7beb34b209fd9ccb9e44d9d7b/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:50:26.461902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.462223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.462509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.507855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] MFA Rules not processed for user `8eee31b7beb34b209fd9ccb9e44d9d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:26.509085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:26.509210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:26.520576 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3004/6011] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:26 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:26.522048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.533970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985ff79-6183-46a4-8318-3170d7542812 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.582740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:26.614419 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3008/6012] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:26.621198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.621883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.622239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.622512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.623160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.625007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.626398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.627903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:26.639227 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3005/6013] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:26.645129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.656029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46effa47-f3d5-4868-9433-3c49010b8139 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.661438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.662099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.667611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.667611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.667611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.667611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.678389 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3006/6014] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:26.682772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.692866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd431b-5ae9-4d5a-b990-dca69fdd88b7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.693166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a41c-4c1f-4971-b94a-477dcff5da0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:26.697421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2010c5-5caf-4f31-a422-24acc4da43fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.698663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2010c5-5caf-4f31-a422-24acc4da43fe service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.701698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:26.701884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2010c5-5caf-4f31-a422-24acc4da43fe service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.701884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2010c5-5caf-4f31-a422-24acc4da43fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.702169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.702169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.702169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] PATH_INFO: `/v3/projects/7174aebb77f64d5aaa4804eb7aaba3de/users/55429a696dfc4bab825924efd18993d0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.709339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2010c5-5caf-4f31-a422-24acc4da43fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.716417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2010c5-5caf-4f31-a422-24acc4da43fe service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.718791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7174aebb77f64d5aaa4804eb7aaba3de, user_id=55429a696dfc4bab825924efd18993d0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:26.721425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:26.727387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3009/6015] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:50:26.852923 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3007/6016] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:26 2022] PUT /identity/v3/projects/7174aebb77f64d5aaa4804eb7aaba3de/users/55429a696dfc4bab825924efd18993d0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:26.863569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:26.863933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:26.864267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:26.894634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] MFA Rules not processed for user `55429a696dfc4bab825924efd18993d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:26.899328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:26.968132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3010/6017] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:26.968999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.978526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:26.980111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:27.032513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05fde2-39a2-495e-ad5b-c325aa03ae03 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:27.038152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:27.038777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:27.039045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:27.039477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:27.041253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:27.041513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af3d1-06de-4c95-8d45-dbc027051577 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:27.045499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:27.048747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:27.048747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:27.048747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:27.055933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:27.057658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:27.066966 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3011/6018] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:50:27.108940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:27.110472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:27.120576 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3008/6019] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:50:32.722847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:32.725725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:32.765080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:32.925688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aa75e-6a18-40e5-9b1c-7b7da62037ec service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:32.960034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:32.961564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:32.965287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:32.966842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:32.975122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:33.027957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:33.029758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:33.061568 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3012/6020] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:33.899882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:33.914875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188ae30-0b35-4780-847c-e0a7ac0b3f82 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:33.919853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:33.920530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:33.920818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:33.921109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:33.923040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:33.936835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:33.938568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:33.945116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:33.957604 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3009/6021] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:50:34.215625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:34.219070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:34.238746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c091df-a9c2-48f8-9103-6a7a6f94dbca service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:34.253987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97bafd-3012-483f-9799-0f66f30c3585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:34.253987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97bafd-3012-483f-9799-0f66f30c3585 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:34.253987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97bafd-3012-483f-9799-0f66f30c3585 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:34.253987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97bafd-3012-483f-9799-0f66f30c3585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:34.255347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5b97bafd-3012-483f-9799-0f66f30c3585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:34.268197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97bafd-3012-483f-9799-0f66f30c3585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:34.270068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97bafd-3012-483f-9799-0f66f30c3585 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:34.293640 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3013/6022] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:50:34.744518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:34.762535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af878-54b5-4f66-8201-0f3e52b6fed9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:34.769005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:34.772407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:34.772902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:34.773309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:34.779424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:35.031711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:35.033280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:35.048275 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3010/6023] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:38.734732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dc1e1-ff7f-4910-b7ed-fa322507832e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:38.735207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dc1e1-ff7f-4910-b7ed-fa322507832e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:38.735465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dc1e1-ff7f-4910-b7ed-fa322507832e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:38.769753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-683dc1e1-ff7f-4910-b7ed-fa322507832e None None] MFA Rules not processed for user `b29dba1f338c4a3ebe1f1b4db9bc45c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:38.771612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-683dc1e1-ff7f-4910-b7ed-fa322507832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:38.863189 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3014/6024] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:44.062412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:44.068036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:44.246609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cc790-e0bd-45ab-ba32-4f3a5987f107 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:44.255395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:44.256488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:44.256872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:44.257246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] PATH_INFO: `/v3/users/63ed4b9931c04c94886d0d6e599facd8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:44.259353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ed4b9931c04c94886d0d6e599facd8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:44.261726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:44.636712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ed4b9931c04c94886d0d6e599facd8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:44.637582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ed4b9931c04c94886d0d6e599facd8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:44.735004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ed4b9931c04c94886d0d6e599facd8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:44.735861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ed4b9931c04c94886d0d6e599facd8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:44.753619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ed4b9931c04c94886d0d6e599facd8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:44.798302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3011/6025] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:44 2022] DELETE /identity/v3/users/63ed4b9931c04c94886d0d6e599facd8 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:44.803497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:44.809349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:44.809349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:44.833254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:44.834957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:44.935869 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3015/6026] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:44.952967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:44.954944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:44.963413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:45.090977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d27e-8d51-4870-876d-c6b32e979b88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:45.099594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:45.107055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:45.107055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:45.107055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:45.136861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:45.139616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:45.156766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3012/6027] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:46.592688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:46.594851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:46.657525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b8329-9a1f-498d-ac42-e80ea83ac346 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:46.663164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:46.664049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:46.664498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:46.664910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] PATH_INFO: `/v3/projects/6caf1f74f8b34b91b162eaf0261b8831` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:46.666256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6caf1f74f8b34b91b162eaf0261b8831)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:46.668913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:46.698596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:46.864907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caf1f74f8b34b91b162eaf0261b8831', 'request_id': 'req-efa28b71-4996-47b4-92f3-4690350c2de6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:46.879485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caf1f74f8b34b91b162eaf0261b8831', 'request_id': 'req-efa28b71-4996-47b4-92f3-4690350c2de6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.009438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caf1f74f8b34b91b162eaf0261b8831', 'request_id': 'req-efa28b71-4996-47b4-92f3-4690350c2de6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.029867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] The token cache is being invalidate because project 6caf1f74f8b34b91b162eaf0261b8831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:47.030183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.033631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.035464 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3016/6028] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:46 2022] DELETE /identity/v3/projects/6caf1f74f8b34b91b162eaf0261b8831 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:47.039658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:47.058004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadc1a1-f92a-47c7-8683-b803b24ee7fa service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:47.168846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:47.169888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:47.170437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:47.171404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] PATH_INFO: `/v3/users/840d5b2817464f029b83971cbb9fecfe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:47.172972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=840d5b2817464f029b83971cbb9fecfe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:47.175984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:47.557082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840d5b2817464f029b83971cbb9fecfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.558634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840d5b2817464f029b83971cbb9fecfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.814988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840d5b2817464f029b83971cbb9fecfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.816336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840d5b2817464f029b83971cbb9fecfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.832016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a1dd67e3-a2b1-4eae-9854-f525b8f20bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840d5b2817464f029b83971cbb9fecfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:47.877391 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3013/6029] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:47 2022] DELETE /identity/v3/users/840d5b2817464f029b83971cbb9fecfe => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:49.103793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:49.105280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:49.133606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa28b71-4996-47b4-92f3-4690350c2de6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:49.242496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:49.242496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:49.242496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:49.242496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] PATH_INFO: `/v3/projects/3bee93d85afb477593e5969d09b21ad9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:49.243112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bee93d85afb477593e5969d09b21ad9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:49.243112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:49.482374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bee93d85afb477593e5969d09b21ad9', 'request_id': 'req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:49.495394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bee93d85afb477593e5969d09b21ad9', 'request_id': 'req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:49.591405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bee93d85afb477593e5969d09b21ad9', 'request_id': 'req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:49.605452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] The token cache is being invalidate because project 3bee93d85afb477593e5969d09b21ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:49.605801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:49.606762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bc5cc71f-81ab-4bcd-b971-7c06f88f0e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:49.608570 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3017/6030] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:49 2022] DELETE /identity/v3/projects/3bee93d85afb477593e5969d09b21ad9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:49.613238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73a50-e202-4479-bb28-d2da35fe34f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:49.613837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73a50-e202-4479-bb28-d2da35fe34f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:49.613837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d73a50-e202-4479-bb28-d2da35fe34f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:49.637951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0d73a50-e202-4479-bb28-d2da35fe34f3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:49.639553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0d73a50-e202-4479-bb28-d2da35fe34f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:49.662779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:49.706121 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3014/6031] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:49.810953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021967-8058-4a5a-b080-5a9ffbeebc23 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:49.811495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021967-8058-4a5a-b080-5a9ffbeebc23 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:49.811909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021967-8058-4a5a-b080-5a9ffbeebc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:49.853643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-86021967-8058-4a5a-b080-5a9ffbeebc23 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:49.860532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86021967-8058-4a5a-b080-5a9ffbeebc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:49.868888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d73a50-e202-4479-bb28-d2da35fe34f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:49.875433 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3018/6032] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:49.882386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d73a50-e202-4479-bb28-d2da35fe34f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:49.895094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:49.899260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:49.899734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:49.900934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:49.901868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:50:49.903408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:49.905954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:49.937543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86021967-8058-4a5a-b080-5a9ffbeebc23 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:49.943371 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3015/6033] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:50:49.958491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86021967-8058-4a5a-b080-5a9ffbeebc23 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:49.966808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:49.969343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:49.969343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:49.969343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:49.969343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:49.971770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:50.183817 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3019/6034] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:49 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:50.187884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:50.199106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df23dd-b58f-4d46-9480-501657268041 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:50.284781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:50.285714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:50.286273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:50.286713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:50.287776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:50.290306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:50.557465 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3016/6035] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:50 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:50:50.559172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:50.573950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972689d-5971-497b-81ad-a2bf85dd6c01 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:50.585787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:50.586650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:50.587051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:50.587397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:50.588133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:50.591206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:50.608403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3020/6036] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:50:50.609380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:50.624916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c3c34-fafa-4963-824a-c35582a2b032 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:50.632938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5745a-b132-4236-95a5-48db4e6b9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:50.633843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5745a-b132-4236-95a5-48db4e6b9215 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:50.634316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5745a-b132-4236-95a5-48db4e6b9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:50.634765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5745a-b132-4236-95a5-48db4e6b9215 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:50.635605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5745a-b132-4236-95a5-48db4e6b9215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:50.637481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5745a-b132-4236-95a5-48db4e6b9215 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:50.655770 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3017/6037] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:50:50.656344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:50.663275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:50.697375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147bd1e-d99b-41eb-9b3e-7709903a533f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:50.704163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:50.706150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:50.706752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:50.707267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] PATH_INFO: `/v3/projects/5fd6c7edec3b462cb5ef29e445ae175f/users/2e52be24422b4206a0d67f39c831c2e3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:50.764346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd6c7edec3b462cb5ef29e445ae175f, user_id=2e52be24422b4206a0d67f39c831c2e3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:50.780334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:51.041224 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3021/6038] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:50 2022] PUT /identity/v3/projects/5fd6c7edec3b462cb5ef29e445ae175f/users/2e52be24422b4206a0d67f39c831c2e3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:51.060076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7843d-ffa6-4073-a5ef-b7f6050b8e80 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:51.062584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7843d-ffa6-4073-a5ef-b7f6050b8e80 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:51.063123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7843d-ffa6-4073-a5ef-b7f6050b8e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:51.119155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09f7843d-ffa6-4073-a5ef-b7f6050b8e80 None None] MFA Rules not processed for user `2e52be24422b4206a0d67f39c831c2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:51.121122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09f7843d-ffa6-4073-a5ef-b7f6050b8e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:51.271454 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3018/6039] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:51.275650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:51.436438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee10433-1c17-4749-95a2-7c4ea5bf30e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:51.449511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:51.450954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:51.451649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:51.452050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:51.452756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:51.454970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:51.662541 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3022/6040] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:50:51 2022] POST /identity/v3/projects => generated 385 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:50:51.663776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7843d-ffa6-4073-a5ef-b7f6050b8e80 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:51.705222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7843d-ffa6-4073-a5ef-b7f6050b8e80 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:51.830219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:51.831223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:51.831666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:51.832164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:51.832967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:51.835666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:52.033212 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3019/6041] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:50:51 2022] POST /identity/v3/users => generated 299 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:50:52.034637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:52.059288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce968-b527-45e9-924c-e3b9199f44e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:52.070516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:52.072180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:52.074697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:52.075277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:52.077325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:52.079821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:52.122308 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3023/6042] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:50:52.126530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:52.146285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860952-1519-418a-a80e-513b5668d7cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:52.157026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:52.159857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:52.161060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:52.161532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] PATH_INFO: `/v3/projects/942fd8a12b5e4daeb272a57d934c01db/users/3f91afcd82e248f69268c70a1d4551c9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:52.196767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942fd8a12b5e4daeb272a57d934c01db, user_id=3f91afcd82e248f69268c70a1d4551c9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:52.204701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:52.392677 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3020/6043] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:52 2022] PUT /identity/v3/projects/942fd8a12b5e4daeb272a57d934c01db/users/3f91afcd82e248f69268c70a1d4551c9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:52.397236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:52.410238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cebf4-9e82-40c3-86f7-a97e55dda9be admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:52.662361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15190ca-6c23-4a94-ae40-ad8ba37e7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:52.663009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15190ca-6c23-4a94-ae40-ad8ba37e7a2e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:52.663292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15190ca-6c23-4a94-ae40-ad8ba37e7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:52.663568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15190ca-6c23-4a94-ae40-ad8ba37e7a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:52.664246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15190ca-6c23-4a94-ae40-ad8ba37e7a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:52.665904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15190ca-6c23-4a94-ae40-ad8ba37e7a2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:52.696520 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3024/6044] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:50:52.697025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:52.718841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f6c7-829b-470e-8e01-6e5a0f68c222 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:52.734404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:52.735111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:52.735424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:52.735702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] PATH_INFO: `/v3/projects/942fd8a12b5e4daeb272a57d934c01db/users/3f91afcd82e248f69268c70a1d4551c9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:52.737747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942fd8a12b5e4daeb272a57d934c01db, user_id=3f91afcd82e248f69268c70a1d4551c9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:52.740667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:52.782936 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3021/6045] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:50:52 2022] PUT /identity/v3/projects/942fd8a12b5e4daeb272a57d934c01db/users/3f91afcd82e248f69268c70a1d4551c9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:52.785777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4daa-3846-4e41-bd00-8ede967b3b3b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:52.786309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4daa-3846-4e41-bd00-8ede967b3b3b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:52.786806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4daa-3846-4e41-bd00-8ede967b3b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:52.858687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-555b4daa-3846-4e41-bd00-8ede967b3b3b None None] MFA Rules not processed for user `3f91afcd82e248f69268c70a1d4551c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:52.860615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-555b4daa-3846-4e41-bd00-8ede967b3b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:53.052475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:53.054355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:53.061086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3025/6046] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:53.312806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cadaa5-c49c-4793-8792-6c0bf5e5a084 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:53.344412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb4885-fb34-4a77-81c9-f194a4288f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:53.345341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4885-fb34-4a77-81c9-f194a4288f19 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:53.345913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4885-fb34-4a77-81c9-f194a4288f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:53.347344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4885-fb34-4a77-81c9-f194a4288f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:53.365970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb4885-fb34-4a77-81c9-f194a4288f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:53.367594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb4885-fb34-4a77-81c9-f194a4288f19 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:53.451956 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3022/6047] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:53.494636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:53.899366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4daa-3846-4e41-bd00-8ede967b3b3b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:54.029238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:54.086428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4daa-3846-4e41-bd00-8ede967b3b3b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:54.097546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:54.098498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:54.099019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:54.099502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] PATH_INFO: `/v3/users/2e52be24422b4206a0d67f39c831c2e3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:54.100928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e52be24422b4206a0d67f39c831c2e3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:54.103100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:54.403877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e52be24422b4206a0d67f39c831c2e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:54.431548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e52be24422b4206a0d67f39c831c2e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:54.432550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e52be24422b4206a0d67f39c831c2e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:54.455226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e52be24422b4206a0d67f39c831c2e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:54.559507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e52be24422b4206a0d67f39c831c2e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:54.568721 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3026/6048] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:53 2022] DELETE /identity/v3/users/2e52be24422b4206a0d67f39c831c2e3 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:54.574763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:54.575483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:54.575483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:54.622414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:54.623677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:54.800803 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3023/6049] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:54.828322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:54.829870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:55.041461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff4f54-0ac2-4b25-8ecb-fe72998768a9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:55.063185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:55.063967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:55.074995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:55.074995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:55.078981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:55.081780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:55.116566 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3027/6050] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:50:55.346538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:56.966694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:56.967814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:56.988975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9629abf-e9c5-48b6-8c67-b79975a37218 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:57.005228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:57.008895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:57.009807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:57.010326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] PATH_INFO: `/v3/projects/5fd6c7edec3b462cb5ef29e445ae175f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:57.013070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd6c7edec3b462cb5ef29e445ae175f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:57.017326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:57.055719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:57.216297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd6c7edec3b462cb5ef29e445ae175f', 'request_id': 'req-ef048b78-a8c0-4692-b633-3537a6ad6922'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.227911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd6c7edec3b462cb5ef29e445ae175f', 'request_id': 'req-ef048b78-a8c0-4692-b633-3537a6ad6922'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.346247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd6c7edec3b462cb5ef29e445ae175f', 'request_id': 'req-ef048b78-a8c0-4692-b633-3537a6ad6922'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.366510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] The token cache is being invalidate because project 5fd6c7edec3b462cb5ef29e445ae175f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:57.366814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.370929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ef048b78-a8c0-4692-b633-3537a6ad6922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.377548 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3024/6051] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:56 2022] DELETE /identity/v3/projects/5fd6c7edec3b462cb5ef29e445ae175f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:57.382524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:57.404528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cca03-b6a9-4bde-ad3a-83db9685c836 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:57.517822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:57.518552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:57.518828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:57.519097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] PATH_INFO: `/v3/users/3f91afcd82e248f69268c70a1d4551c9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:57.520491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f91afcd82e248f69268c70a1d4551c9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:57.524438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:57.712426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:57.714532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:57.714532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:57.738707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] MFA Rules not processed for user `ce62c03899e040bab1f041aba0187227`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:57.740412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:57.808625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3025/6052] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:50:57.855973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f91afcd82e248f69268c70a1d4551c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.877616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f91afcd82e248f69268c70a1d4551c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.879045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f91afcd82e248f69268c70a1d4551c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:57.920944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f91afcd82e248f69268c70a1d4551c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:58.045548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b9ab1c70-b862-48d7-85d5-8c07f298d8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f91afcd82e248f69268c70a1d4551c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:58.071527 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3028/6053] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:50:57 2022] DELETE /identity/v3/users/3f91afcd82e248f69268c70a1d4551c9 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:59.294481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:50:59.296062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:50:59.322658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7c44c-dc2b-44af-a53e-a91133f37cd3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:50:59.495449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:50:59.495449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:59.495449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:59.495797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] PATH_INFO: `/v3/projects/942fd8a12b5e4daeb272a57d934c01db` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:59.501433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942fd8a12b5e4daeb272a57d934c01db)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:50:59.503529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:50:59.739985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:59.743473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942fd8a12b5e4daeb272a57d934c01db', 'request_id': 'req-3c568926-1b2b-4aac-9232-e81a6df0b818'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:59.765914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942fd8a12b5e4daeb272a57d934c01db', 'request_id': 'req-3c568926-1b2b-4aac-9232-e81a6df0b818'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:59.849290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942fd8a12b5e4daeb272a57d934c01db', 'request_id': 'req-3c568926-1b2b-4aac-9232-e81a6df0b818'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:59.869105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] The token cache is being invalidate because project 942fd8a12b5e4daeb272a57d934c01db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:50:59.869410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:59.875042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3c568926-1b2b-4aac-9232-e81a6df0b818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:50:59.879461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3026/6054] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:50:59 2022] DELETE /identity/v3/projects/942fd8a12b5e4daeb272a57d934c01db => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:50:59.886558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771304-1d4c-4832-8f83-606e305e424f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:50:59.886558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771304-1d4c-4832-8f83-606e305e424f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:50:59.886558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d771304-1d4c-4832-8f83-606e305e424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:50:59.924565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d771304-1d4c-4832-8f83-606e305e424f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:50:59.926106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d771304-1d4c-4832-8f83-606e305e424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:00.077437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e10d-526b-4390-8e49-ebe6652a1548 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.077727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e10d-526b-4390-8e49-ebe6652a1548 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.078049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e10d-526b-4390-8e49-ebe6652a1548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.078185 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3029/6055] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:00.125485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bae1e10d-526b-4390-8e49-ebe6652a1548 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:00.126875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bae1e10d-526b-4390-8e49-ebe6652a1548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:00.150758 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3027/6056] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:00.154368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d771304-1d4c-4832-8f83-606e305e424f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:00.164578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d771304-1d4c-4832-8f83-606e305e424f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:00.186775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:00.187438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.187897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.188338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.189179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:51:00.189636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:00.191490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:00.210043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3030/6057] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:51:00.214885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e10d-526b-4390-8e49-ebe6652a1548 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:00.236413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e10d-526b-4390-8e49-ebe6652a1548 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:00.245812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:00.245812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.245812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.245812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.251565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:00.254278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:00.387639 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3028/6058] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:51:00 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:00.391769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:00.400610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:00.408621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0cff1-293d-4663-bb7f-e1ff9abf13eb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:00.555602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:00.559904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.561439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.566385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.566385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:00.571938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:00.669365 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3031/6059] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:51:00 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:00.673853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:00.690812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4238c0-af34-45db-9aa7-cec58d348ac9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:00.697169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:00.698441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.699399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.699985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.700929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:00.702982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:00.716682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3029/6060] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:00.721084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:00.742386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752187-6617-4b44-90e2-4a5e62e4b8ac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:00.754862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7838e80-d02c-455f-8010-135dbd5da6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:00.755601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7838e80-d02c-455f-8010-135dbd5da6dd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.755885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7838e80-d02c-455f-8010-135dbd5da6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.756160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7838e80-d02c-455f-8010-135dbd5da6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.756928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7838e80-d02c-455f-8010-135dbd5da6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:00.758613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7838e80-d02c-455f-8010-135dbd5da6dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:00.795543 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3032/6061] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:00.799759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:00.813063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f32fec-c164-4537-be03-f1bb55a6cb19 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:00.819569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:00.820251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.820591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.821252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] PATH_INFO: `/v3/projects/cf82709514504448857350c81e7fb045/users/d0df5ff7d5d644579c66704a9a5f6ea1/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.842471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf82709514504448857350c81e7fb045, user_id=d0df5ff7d5d644579c66704a9a5f6ea1, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:00.845907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:00.993965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0fb40-2ac6-4778-ac93-9c993ad5f694 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:00.994458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0fb40-2ac6-4778-ac93-9c993ad5f694 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:00.994583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0fb40-2ac6-4778-ac93-9c993ad5f694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:00.994922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3030/6062] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:00 2022] PUT /identity/v3/projects/cf82709514504448857350c81e7fb045/users/d0df5ff7d5d644579c66704a9a5f6ea1/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:01.115618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f3d0fb40-2ac6-4778-ac93-9c993ad5f694 None None] MFA Rules not processed for user `d0df5ff7d5d644579c66704a9a5f6ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:01.123728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f3d0fb40-2ac6-4778-ac93-9c993ad5f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:01.424811 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3033/6063] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:01.435486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:01.673011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3466c-196d-47e8-99bf-a917d595b3df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:01.683085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:01.683789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:01.684101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:01.684377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:01.685654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:01.687724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:01.871674 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3031/6064] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:51:01 2022] POST /identity/v3/projects => generated 379 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:01.872982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0fb40-2ac6-4778-ac93-9c993ad5f694 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:01.892035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0fb40-2ac6-4778-ac93-9c993ad5f694 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:02.074630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:02.075316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:02.075552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:02.079096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:02.079941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:02.086553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:02.260290 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3034/6065] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:51:01 2022] POST /identity/v3/users => generated 296 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:02.264134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:02.294716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b73c4-6e73-4dcf-bc93-df015ad26267 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:02.299510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c737784-6753-4649-851f-0df371816599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:02.301075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737784-6753-4649-851f-0df371816599 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:02.301300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737784-6753-4649-851f-0df371816599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:02.301576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c737784-6753-4649-851f-0df371816599 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:02.302495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c737784-6753-4649-851f-0df371816599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:02.304776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c737784-6753-4649-851f-0df371816599 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:02.312987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:02.325716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3032/6066] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:02.330019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:02.355374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df31072-9a2c-4466-aadc-aec58c0c7785 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:02.366704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:02.367614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:02.368003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:02.368397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] PATH_INFO: `/v3/projects/38317ad7d8a74074a304e7b8f5e96e44/users/266c5d60789e412e96eccf7fae73f3e3/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:02.426932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38317ad7d8a74074a304e7b8f5e96e44, user_id=266c5d60789e412e96eccf7fae73f3e3, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:02.435740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:02.578940 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3035/6067] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:02 2022] PUT /identity/v3/projects/38317ad7d8a74074a304e7b8f5e96e44/users/266c5d60789e412e96eccf7fae73f3e3/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:02.584504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c737784-6753-4649-851f-0df371816599 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:02.603515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c737784-6753-4649-851f-0df371816599 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:02.847742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:02.869011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8f273-4afc-41e1-84fa-c11960e86266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:02.869565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f273-4afc-41e1-84fa-c11960e86266 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:02.870242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f273-4afc-41e1-84fa-c11960e86266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:02.870487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f273-4afc-41e1-84fa-c11960e86266 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:02.871436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8f273-4afc-41e1-84fa-c11960e86266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:02.873264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8f273-4afc-41e1-84fa-c11960e86266 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:02.905678 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3033/6068] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:02.908773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:02.926621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b7359-20a2-46f2-b77a-dc9ef7918cf9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:02.948738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:02.951108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:02.955661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:02.955661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] PATH_INFO: `/v3/projects/38317ad7d8a74074a304e7b8f5e96e44/users/266c5d60789e412e96eccf7fae73f3e3/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:02.955661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38317ad7d8a74074a304e7b8f5e96e44, user_id=266c5d60789e412e96eccf7fae73f3e3, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:02.957260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:02.999567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3036/6069] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:02 2022] PUT /identity/v3/projects/38317ad7d8a74074a304e7b8f5e96e44/users/266c5d60789e412e96eccf7fae73f3e3/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:03.025094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94edb-f814-411b-b8c2-97970aaac207 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:03.025574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94edb-f814-411b-b8c2-97970aaac207 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:03.025978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94edb-f814-411b-b8c2-97970aaac207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:03.110562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65c94edb-f814-411b-b8c2-97970aaac207 None None] MFA Rules not processed for user `266c5d60789e412e96eccf7fae73f3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:03.112624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65c94edb-f814-411b-b8c2-97970aaac207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:03.270736 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3034/6070] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:03.289404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:03.292029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:03.462937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426f4aa-64c3-4b1d-9052-cc36e3ca6510 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:03.475714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:03.476474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:03.476818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:03.479688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:03.502754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:03.505219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:03.525788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3037/6071] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:51:05.236663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c94edb-f814-411b-b8c2-97970aaac207 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:05.249107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c94edb-f814-411b-b8c2-97970aaac207 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:05.281456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266c5d60789e412e96eccf7fae73f3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38317ad7d8a74074a304e7b8f5e96e44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:05.283500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:05.283791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:05.284071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:05.284824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:51:05.285134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:05.292325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:05.325426 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3035/6072] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:51:05.330140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:05.348954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7563-08bd-4e0c-974a-8018bfdf4c2f service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:05.367225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266c5d60789e412e96eccf7fae73f3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38317ad7d8a74074a304e7b8f5e96e44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:05.367997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:05.368304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:05.368733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:05.369390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:05.372158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:05.458346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:05.474837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:05.595263 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3038/6073] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:51:05 2022] POST /identity/v3/projects => generated 355 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:05.601564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:05.705866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba720db0-096f-4ee1-a75c-3e612d797758 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:05.842378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a02ef-9ee6-429b-834b-f1387286b070 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:05.854702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266c5d60789e412e96eccf7fae73f3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38317ad7d8a74074a304e7b8f5e96e44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:05.855356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:05.855806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:05.856090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:05.857021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:51:05.857500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:05.863518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:05.877839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:05.915699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:05.916410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:05.916703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:05.916979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:05.919031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:05.929267 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3039/6074] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:51:05.939265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:05.953403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:06.017704 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3036/6075] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:51:06.063470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:06.083185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177f1ea-2c1e-471c-8c0f-682431efe462 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:06.100605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266c5d60789e412e96eccf7fae73f3e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38317ad7d8a74074a304e7b8f5e96e44', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:06.101281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:06.101545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:06.102526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] PATH_INFO: `/v3/projects/4a7263015e89405ca5d41a0b8c59a1e4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:06.110356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a7263015e89405ca5d41a0b8c59a1e4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:06.112975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:06.344118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:06.367345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7263015e89405ca5d41a0b8c59a1e4', 'request_id': 'req-5a9930ff-8a9e-4615-858c-72340528dd72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:06.386594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7263015e89405ca5d41a0b8c59a1e4', 'request_id': 'req-5a9930ff-8a9e-4615-858c-72340528dd72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:06.461130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7263015e89405ca5d41a0b8c59a1e4', 'request_id': 'req-5a9930ff-8a9e-4615-858c-72340528dd72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:06.482463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] The token cache is being invalidate because project 4a7263015e89405ca5d41a0b8c59a1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:06.482897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:06.484062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5a9930ff-8a9e-4615-858c-72340528dd72 tempest-VolumeQuotaClassesTest-583981455 tempest-VolumeQuotaClassesTest-583981455-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:06.485995 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3040/6076] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:06 2022] DELETE /identity/v3/projects/4a7263015e89405ca5d41a0b8c59a1e4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:51:07.393428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:07.533426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bf7f-0880-49fb-945b-2acd7cfea499 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:07.661371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:07.662805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:07.663100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:07.663382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] PATH_INFO: `/v3/users/d0df5ff7d5d644579c66704a9a5f6ea1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:07.664965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0df5ff7d5d644579c66704a9a5f6ea1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:07.668629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:07.921885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0df5ff7d5d644579c66704a9a5f6ea1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:07.922903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0df5ff7d5d644579c66704a9a5f6ea1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:08.003223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0df5ff7d5d644579c66704a9a5f6ea1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:08.009133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0df5ff7d5d644579c66704a9a5f6ea1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:08.020379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0df5ff7d5d644579c66704a9a5f6ea1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:08.067180 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3037/6077] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:07 2022] DELETE /identity/v3/users/d0df5ff7d5d644579c66704a9a5f6ea1 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:08.071607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:08.072247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:08.072247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:08.126837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:08.128887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:08.221755 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3041/6078] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:08.230722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:08.232961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:08.241386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:08.313967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f670e01-9db1-430c-a8d7-78027ed2a4bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:08.319587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42f473-250d-44d6-a58e-4e8661f5a950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:08.320674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42f473-250d-44d6-a58e-4e8661f5a950 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:08.321109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42f473-250d-44d6-a58e-4e8661f5a950 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:08.321530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42f473-250d-44d6-a58e-4e8661f5a950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:08.333302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42f473-250d-44d6-a58e-4e8661f5a950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:08.334921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42f473-250d-44d6-a58e-4e8661f5a950 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:08.348953 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3038/6079] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:51:09.431838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:09.434770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:09.453807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8b7d-7306-4812-8ce5-e65d1bdaf3fe None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:09.461004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:09.462128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:09.463164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:09.464402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] PATH_INFO: `/v3/users/16accf6392114bd69c4432080dd6124f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:09.473594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16accf6392114bd69c4432080dd6124f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:09.476054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:09.765537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16accf6392114bd69c4432080dd6124f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:09.779799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16accf6392114bd69c4432080dd6124f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:09.782899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16accf6392114bd69c4432080dd6124f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:09.803924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16accf6392114bd69c4432080dd6124f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:09.936372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16accf6392114bd69c4432080dd6124f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:09.949662 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3042/6080] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:09 2022] DELETE /identity/v3/users/16accf6392114bd69c4432080dd6124f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:09.952335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:09.952836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:09.952932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:09.993299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:09.995548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:10.095000 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3039/6081] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:10.105567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:10.107223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:10.166653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:10.196160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3518a3-bcf0-4a91-920a-321d97c9a5d6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:10.201722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:10.202652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:10.202933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:10.203206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:10.214266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:10.218399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:10.223125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:10.224878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:10.240789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3043/6082] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:51:10.249628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07dc5c-4da9-447f-a8ab-ebd40c89c2f2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:10.265041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:10.270086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:10.270086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:10.270086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] PATH_INFO: `/v3/projects/cf82709514504448857350c81e7fb045` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:10.270086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf82709514504448857350c81e7fb045)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:10.271650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:10.435872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf82709514504448857350c81e7fb045', 'request_id': 'req-0e81b7ee-c54b-4264-94f9-bc70f59041c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:10.442635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf82709514504448857350c81e7fb045', 'request_id': 'req-0e81b7ee-c54b-4264-94f9-bc70f59041c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:10.529495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf82709514504448857350c81e7fb045', 'request_id': 'req-0e81b7ee-c54b-4264-94f9-bc70f59041c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:10.554785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] The token cache is being invalidate because project cf82709514504448857350c81e7fb045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:10.566251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:10.566251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:10.566251 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3040/6083] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:10 2022] DELETE /identity/v3/projects/cf82709514504448857350c81e7fb045 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:51:10.567143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:10.573408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6480b6-c74d-4525-b915-1cad4213f260 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:10.665613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:10.667203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:10.667483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:10.667989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] PATH_INFO: `/v3/users/266c5d60789e412e96eccf7fae73f3e3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:10.669258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266c5d60789e412e96eccf7fae73f3e3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:10.671552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:10.940166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:10.941636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:10.958687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81b7ee-c54b-4264-94f9-bc70f59041c5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:10.964461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:10.965245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:10.965687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:10.965961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] PATH_INFO: `/v3/projects/c7fd718537f740a98bd3d90b7c972a04` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:10.967997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fd718537f740a98bd3d90b7c972a04)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:10.970754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:11.001012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266c5d60789e412e96eccf7fae73f3e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.012910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266c5d60789e412e96eccf7fae73f3e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.014757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266c5d60789e412e96eccf7fae73f3e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.048463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266c5d60789e412e96eccf7fae73f3e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.131550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:11.150940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266c5d60789e412e96eccf7fae73f3e3'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.158256 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3044/6084] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:10 2022] DELETE /identity/v3/users/266c5d60789e412e96eccf7fae73f3e3 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:11.176686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fd718537f740a98bd3d90b7c972a04', 'request_id': 'req-05d40069-b584-4aaa-945e-153e3bf0e1f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.186770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fd718537f740a98bd3d90b7c972a04', 'request_id': 'req-05d40069-b584-4aaa-945e-153e3bf0e1f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.384405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fd718537f740a98bd3d90b7c972a04', 'request_id': 'req-05d40069-b584-4aaa-945e-153e3bf0e1f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.436134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] The token cache is being invalidate because project c7fd718537f740a98bd3d90b7c972a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:11.436134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.436134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.436134 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3041/6085] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:10 2022] DELETE /identity/v3/projects/c7fd718537f740a98bd3d90b7c972a04 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:51:11.436801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:11.436801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:11.531327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c694d3-1993-4ecf-b787-f1e83c193013 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:11.536727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:11.537524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:11.537926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:11.538326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] PATH_INFO: `/v3/users/8eee31b7beb34b209fd9ccb9e44d9d7b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:11.539693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eee31b7beb34b209fd9ccb9e44d9d7b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:11.541896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:11.908413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eee31b7beb34b209fd9ccb9e44d9d7b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.915883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eee31b7beb34b209fd9ccb9e44d9d7b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.917238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eee31b7beb34b209fd9ccb9e44d9d7b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.934375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eee31b7beb34b209fd9ccb9e44d9d7b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:11.962555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:11.965095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:12.031350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-08a87fdf-39ff-4c2d-9aa1-25f465bba275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eee31b7beb34b209fd9ccb9e44d9d7b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.043286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3045/6086] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:11 2022] DELETE /identity/v3/users/8eee31b7beb34b209fd9ccb9e44d9d7b => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:12.086989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40069-b584-4aaa-945e-153e3bf0e1f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:12.191435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:12.192135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:12.192416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:12.193021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] PATH_INFO: `/v3/projects/38317ad7d8a74074a304e7b8f5e96e44` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:12.194048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=38317ad7d8a74074a304e7b8f5e96e44)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:12.196194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:12.382191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38317ad7d8a74074a304e7b8f5e96e44', 'request_id': 'req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.397465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38317ad7d8a74074a304e7b8f5e96e44', 'request_id': 'req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.505831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38317ad7d8a74074a304e7b8f5e96e44', 'request_id': 'req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.530197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] The token cache is being invalidate because project 38317ad7d8a74074a304e7b8f5e96e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:12.530593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.531507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a3d6953a-0236-43c9-b09b-37a4a3bf2bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.534415 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3042/6087] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:11 2022] DELETE /identity/v3/projects/38317ad7d8a74074a304e7b8f5e96e44 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:12.542295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:12.544084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:12.544084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:12.567809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:12.569172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:12.643808 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3046/6088] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:12.652166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842990ad-043b-47b4-b68a-07d2b3a723fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:12.652545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842990ad-043b-47b4-b68a-07d2b3a723fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:12.652709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842990ad-043b-47b4-b68a-07d2b3a723fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:12.659247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:12.673214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:12.683564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-842990ad-043b-47b4-b68a-07d2b3a723fd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:12.684905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-842990ad-043b-47b4-b68a-07d2b3a723fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:12.699165 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3043/6089] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:12.700238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842990ad-043b-47b4-b68a-07d2b3a723fd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:12.707091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620f50d-59f3-4d8f-9ddb-70ca16ae5fde None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:12.713677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842990ad-043b-47b4-b68a-07d2b3a723fd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:12.714076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:12.716834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:12.718329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:12.718627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] PATH_INFO: `/v3/projects/2b89bcdd35c24be18da89e8bbf028062` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:12.719909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:12.720062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b89bcdd35c24be18da89e8bbf028062)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:12.721219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:12.721576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:12.721924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:12.722112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:12.722773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:51:12.723148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:12.725217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:12.738824 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3044/6090] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:51:12.744235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:12.757931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f46f2-90c4-44e5-bc5b-789fa0fc865d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:12.763020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:12.763646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:12.763932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:12.764214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:12.764853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:12.766882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:12.873915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b89bcdd35c24be18da89e8bbf028062', 'request_id': 'req-a1bd4f05-1c10-4388-acb7-e326f455b933'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.881324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b89bcdd35c24be18da89e8bbf028062', 'request_id': 'req-a1bd4f05-1c10-4388-acb7-e326f455b933'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.905065 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3045/6091] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:51:12 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:12.906101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:12.950898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b89bcdd35c24be18da89e8bbf028062', 'request_id': 'req-a1bd4f05-1c10-4388-acb7-e326f455b933'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.978795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f392f62-d01c-4287-adf0-7482ecd23149 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:12.986202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:12.987131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:12.987461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] The token cache is being invalidate because project 2b89bcdd35c24be18da89e8bbf028062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:12.987706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:12.988041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:12.988778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:12.989319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.990788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:12.990951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a1bd4f05-1c10-4388-acb7-e326f455b933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:12.993537 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3047/6092] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:12 2022] DELETE /identity/v3/projects/2b89bcdd35c24be18da89e8bbf028062 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:13.001614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de9f5-5e73-4e1f-be85-85669a17a54e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.002187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de9f5-5e73-4e1f-be85-85669a17a54e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.003324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de9f5-5e73-4e1f-be85-85669a17a54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.004921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:13.033754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c63de9f5-5e73-4e1f-be85-85669a17a54e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:13.035023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c63de9f5-5e73-4e1f-be85-85669a17a54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:13.044380 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3048/6093] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:13.053375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448ee4-6cf1-4b17-a8c1-db222d627125 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.053663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448ee4-6cf1-4b17-a8c1-db222d627125 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.054131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448ee4-6cf1-4b17-a8c1-db222d627125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.075638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-18448ee4-6cf1-4b17-a8c1-db222d627125 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:13.076857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-18448ee4-6cf1-4b17-a8c1-db222d627125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:13.085132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3049/6094] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:51:13.091123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18448ee4-6cf1-4b17-a8c1-db222d627125 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.102207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18448ee4-6cf1-4b17-a8c1-db222d627125 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.109860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.111618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.111618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.111618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.112180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:51:13.113349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.114436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.124927 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3046/6095] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:51:12 2022] POST /identity/v3/users => generated 282 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:51:13.129551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.131935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:13.139796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3050/6096] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:51:13.147807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.154573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8879ce-94f5-4ce6-8a8f-d328fd10a279 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.159565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9c1f5-b83a-4376-98cc-d04c5f56fca2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.161118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.161734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.162144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.163095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.163215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.165284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.167177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.167287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.167287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.167287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.167994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.170223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.183600 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3047/6097] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:13.187513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.200080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d92b9-11b9-4522-9573-8ffb041dfb83 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.205067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.205716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.205992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.206301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.206995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.208592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.227500 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3048/6098] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:51:13.227500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.239019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909d62d-fdcc-429a-9c58-459e364113ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.244123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af114b3-7687-45bb-96fb-97251be56c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.244863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af114b3-7687-45bb-96fb-97251be56c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.245143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af114b3-7687-45bb-96fb-97251be56c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.245419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af114b3-7687-45bb-96fb-97251be56c03 admin admin] PATH_INFO: `/v3/projects/96f3aa7c1cb04bbf9c17cdd6ef661c7b/users/ed057cd103544e81997bc7a4542cbec7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.264180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af114b3-7687-45bb-96fb-97251be56c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f3aa7c1cb04bbf9c17cdd6ef661c7b, user_id=ed057cd103544e81997bc7a4542cbec7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.269423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af114b3-7687-45bb-96fb-97251be56c03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.296286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3051/6099] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:51:13 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:51:13.300257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.375553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164ff2f-0270-4424-a9b8-6682ce69bcc6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.375653 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3049/6100] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:13 2022] PUT /identity/v3/projects/96f3aa7c1cb04bbf9c17cdd6ef661c7b/users/ed057cd103544e81997bc7a4542cbec7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:51:13.377109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.377402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.377704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.403637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:13.404951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:13.458010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.458318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.458705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.459076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.459959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.462216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.563406 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3050/6101] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:13.572061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.573767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:13.647555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3052/6102] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:51:13 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:51:13.651575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.666001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa33aac-ef08-47b4-b383-3d636f972ea9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.667214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ead0aa-90be-43df-85e2-3876520dadfb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.671361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.671860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.672143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.672406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.680408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.681104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.681388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.681698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.682772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.685514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.689638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.691855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.705289 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3051/6103] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:51:13.718127 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3053/6104] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:13.722774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.740188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe56ae5-5734-4ca3-a9e4-dbba0a4c14f2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.746594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495712e-c9ab-4d84-aaf9-3087d1781517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.747460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495712e-c9ab-4d84-aaf9-3087d1781517 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.747847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495712e-c9ab-4d84-aaf9-3087d1781517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.748231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495712e-c9ab-4d84-aaf9-3087d1781517 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.749522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495712e-c9ab-4d84-aaf9-3087d1781517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.752100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495712e-c9ab-4d84-aaf9-3087d1781517 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:13.772852 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3052/6105] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:13.774918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:13.787606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9b40a-57a3-44e2-8e9d-32adce48a8de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:13.794386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:13.795145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:13.795503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:13.795874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] PATH_INFO: `/v3/projects/9ff58b6872294d2bb7d9aacabbaacd52/users/7ffd222f07e04971954e587d4ab0bab2/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:13.815276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff58b6872294d2bb7d9aacabbaacd52, user_id=7ffd222f07e04971954e587d4ab0bab2, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:13.818652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:14.005945 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3054/6106] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:13 2022] PUT /identity/v3/projects/9ff58b6872294d2bb7d9aacabbaacd52/users/7ffd222f07e04971954e587d4ab0bab2/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:14.018310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8e94d-4e00-48d6-9cea-fe28308bd8b0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:14.019091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8e94d-4e00-48d6-9cea-fe28308bd8b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:14.020418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8e94d-4e00-48d6-9cea-fe28308bd8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:14.083605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0c8e94d-4e00-48d6-9cea-fe28308bd8b0 None None] MFA Rules not processed for user `7ffd222f07e04971954e587d4ab0bab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:14.089609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0c8e94d-4e00-48d6-9cea-fe28308bd8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:14.213109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3053/6107] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:14.218387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:14.316854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473716-da03-461f-9789-8da8c9381031 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:14.326002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:14.332981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:14.332981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:14.332981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:14.332981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:14.332981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:14.478181 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3055/6108] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:51:14 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:51:14.483099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8e94d-4e00-48d6-9cea-fe28308bd8b0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:14.506525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8e94d-4e00-48d6-9cea-fe28308bd8b0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:14.528062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:14.621348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:14.623026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:14.625154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:14.625651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:14.626601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:14.635316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:14.754508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:14.755117 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3054/6109] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:51:14 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:14.777152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292fd3-1377-4822-9fd8-39afa0c11cd1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:14.795474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:14.796162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:14.796447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:14.796727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:14.797392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:14.799536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:14.832602 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3056/6110] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:14.836067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:14.853543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034b660-59bd-4860-aeff-9cb0f022b375 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:14.859635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:14.860329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:14.860610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:14.860884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] PATH_INFO: `/v3/projects/cd6b2b0776694b52af04a312a2014d76/users/d6e8327f82d04bc39fd82877dec794ab/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:14.880579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6b2b0776694b52af04a312a2014d76, user_id=d6e8327f82d04bc39fd82877dec794ab, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:14.883905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:14.974019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3055/6111] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:14 2022] PUT /identity/v3/projects/cd6b2b0776694b52af04a312a2014d76/users/d6e8327f82d04bc39fd82877dec794ab/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:51:14.978017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:14.993245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242839d6-8aeb-44a7-a21a-0c0c5bb64c65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:15.076418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292c38c-82d8-4ad4-a8d9-235008702816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:15.076418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c38c-82d8-4ad4-a8d9-235008702816 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:15.077071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c38c-82d8-4ad4-a8d9-235008702816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:15.077071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292c38c-82d8-4ad4-a8d9-235008702816 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:15.077837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c38c-82d8-4ad4-a8d9-235008702816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:15.079945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292c38c-82d8-4ad4-a8d9-235008702816 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:15.090807 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3057/6112] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:51:15.095130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:15.106638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30f25-31a7-4732-9139-39d4f23b51ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:15.111152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:15.112034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:15.112153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:15.112426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] PATH_INFO: `/v3/projects/cd6b2b0776694b52af04a312a2014d76/users/d6e8327f82d04bc39fd82877dec794ab/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:15.114459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6b2b0776694b52af04a312a2014d76, user_id=d6e8327f82d04bc39fd82877dec794ab, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:15.117158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:15.128974 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3056/6113] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:15 2022] PUT /identity/v3/projects/cd6b2b0776694b52af04a312a2014d76/users/d6e8327f82d04bc39fd82877dec794ab/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:51:15.239756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db5da5-5e46-4297-9115-47c29a295d3a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:15.240052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db5da5-5e46-4297-9115-47c29a295d3a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:15.240239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db5da5-5e46-4297-9115-47c29a295d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:15.292679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-89db5da5-5e46-4297-9115-47c29a295d3a None None] MFA Rules not processed for user `d6e8327f82d04bc39fd82877dec794ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:15.293362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89db5da5-5e46-4297-9115-47c29a295d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:15.400007 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3058/6114] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:15.414900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:15.417281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:15.520744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb6fb-b717-4ae8-84ae-f01486071d05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:15.524943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5372d-c826-4936-86ff-2bbc1c14c654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:15.526512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5372d-c826-4936-86ff-2bbc1c14c654 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:15.527081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5372d-c826-4936-86ff-2bbc1c14c654 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:15.527525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5372d-c826-4936-86ff-2bbc1c14c654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:15.541108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5372d-c826-4936-86ff-2bbc1c14c654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:15.542658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5372d-c826-4936-86ff-2bbc1c14c654 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:15.558266 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3057/6115] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:51:15.842975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:16.257776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db5da5-5e46-4297-9115-47c29a295d3a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:16.343696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db5da5-5e46-4297-9115-47c29a295d3a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:16.359210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:16.360238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:16.360599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:16.360839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] PATH_INFO: `/v3/users/7ffd222f07e04971954e587d4ab0bab2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:16.363394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffd222f07e04971954e587d4ab0bab2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:16.367969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:16.592201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffd222f07e04971954e587d4ab0bab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:16.605754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffd222f07e04971954e587d4ab0bab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:16.605754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffd222f07e04971954e587d4ab0bab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:16.621401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffd222f07e04971954e587d4ab0bab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:16.767909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffd222f07e04971954e587d4ab0bab2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:16.785445 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3059/6116] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:16 2022] DELETE /identity/v3/users/7ffd222f07e04971954e587d4ab0bab2 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:16.789892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:16.790407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:16.790592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:16.822305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:16.825761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:16.848248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:16.942583 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3058/6117] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:16.981154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:16.982675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:17.078034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b77303-425a-4813-a8c9-fbbd329ddecd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:17.082337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:17.083748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:17.084312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:17.084495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:17.098188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:17.100104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:17.113247 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3060/6118] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:51:17.942099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:18.454414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:18.457018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:18.500836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d58ff-84d7-4d7d-82f1-7837f0dc2214 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:18.515908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:18.516879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:18.517281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:18.517655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] PATH_INFO: `/v3/projects/9ff58b6872294d2bb7d9aacabbaacd52` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:18.519288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff58b6872294d2bb7d9aacabbaacd52)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:18.521375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:18.688577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff58b6872294d2bb7d9aacabbaacd52', 'request_id': 'req-0b35387f-04d0-4b9a-abac-68db7df12781'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:18.696087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff58b6872294d2bb7d9aacabbaacd52', 'request_id': 'req-0b35387f-04d0-4b9a-abac-68db7df12781'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:18.785844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff58b6872294d2bb7d9aacabbaacd52', 'request_id': 'req-0b35387f-04d0-4b9a-abac-68db7df12781'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:18.804007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] The token cache is being invalidate because project 9ff58b6872294d2bb7d9aacabbaacd52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:18.804620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:18.808267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:18.811846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3059/6119] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:18 2022] DELETE /identity/v3/projects/9ff58b6872294d2bb7d9aacabbaacd52 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:18.816329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:18.818943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:18.832750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc903e-a11c-441c-8573-f11e2866fd1b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:18.939860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:18.941943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:18.941943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:18.941943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] PATH_INFO: `/v3/users/d6e8327f82d04bc39fd82877dec794ab` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:18.942837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e8327f82d04bc39fd82877dec794ab)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:18.945244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:19.201856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e8327f82d04bc39fd82877dec794ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:19.221853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e8327f82d04bc39fd82877dec794ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:19.228216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e8327f82d04bc39fd82877dec794ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:19.279457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e8327f82d04bc39fd82877dec794ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:19.597847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b6e44d5-0089-4759-ac05-b7536493c7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e8327f82d04bc39fd82877dec794ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:19.610839 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3061/6120] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:18 2022] DELETE /identity/v3/users/d6e8327f82d04bc39fd82877dec794ab => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:19.739648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:20.629532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:20.704628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:20.706220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:20.737944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35387f-04d0-4b9a-abac-68db7df12781 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:20.814293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:20.815282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:20.815719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:20.816292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] PATH_INFO: `/v3/projects/cd6b2b0776694b52af04a312a2014d76` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:20.817717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6b2b0776694b52af04a312a2014d76)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:20.820701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:20.954903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6b2b0776694b52af04a312a2014d76', 'request_id': 'req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:20.966979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6b2b0776694b52af04a312a2014d76', 'request_id': 'req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:21.003473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:21.093723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6b2b0776694b52af04a312a2014d76', 'request_id': 'req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:21.116358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] The token cache is being invalidate because project cd6b2b0776694b52af04a312a2014d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:21.117723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:21.118177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b5b8fe1c-49aa-4a01-b27c-1e5d10bc5960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:21.121790 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3060/6121] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:20 2022] DELETE /identity/v3/projects/cd6b2b0776694b52af04a312a2014d76 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:21.130803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851be72-6cc1-46bf-a03f-53af4aeb3682 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:21.131151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851be72-6cc1-46bf-a03f-53af4aeb3682 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:21.131401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851be72-6cc1-46bf-a03f-53af4aeb3682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:21.168818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a851be72-6cc1-46bf-a03f-53af4aeb3682 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:21.170344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a851be72-6cc1-46bf-a03f-53af4aeb3682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:21.281888 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3062/6122] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:21.291358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935c57-8dd4-4e0d-be77-97a88ee74a13 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:21.293347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935c57-8dd4-4e0d-be77-97a88ee74a13 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:21.293626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935c57-8dd4-4e0d-be77-97a88ee74a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:21.320256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6b935c57-8dd4-4e0d-be77-97a88ee74a13 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:21.323165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6b935c57-8dd4-4e0d-be77-97a88ee74a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:21.337787 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3061/6123] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:21.343508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851be72-6cc1-46bf-a03f-53af4aeb3682 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:21.389348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851be72-6cc1-46bf-a03f-53af4aeb3682 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:21.409747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:21.410600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:21.410898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:21.411188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:21.412651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:51:21.413036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:21.415086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:21.458450 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3063/6124] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:51:21.458539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935c57-8dd4-4e0d-be77-97a88ee74a13 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:21.463942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935c57-8dd4-4e0d-be77-97a88ee74a13 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:21.476601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:21.483727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:21.483727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:21.483727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:21.483727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:21.492884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:21.628033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:21.629014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3062/6125] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:51:21 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:21.649949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125f2a-4a29-4ac0-81de-366fd0df227e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:21.863098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:21.863098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:21.863098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:21.863408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:21.864047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:21.866038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:22.017174 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3064/6126] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:51:21 2022] POST /identity/v3/users => generated 286 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:22.021082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:22.041036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbd1eb-8a53-4df0-a8fb-785168087e4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:22.047727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:22.049545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:22.049545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:22.049545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:22.049974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:22.053379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:22.069092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3063/6127] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:22.078353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:22.090165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365bc47-3e23-4e98-93b4-16e1fdbf1000 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:22.107208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce737260-ac66-44f9-804c-64e4b65e6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:22.107844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737260-ac66-44f9-804c-64e4b65e6f4f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:22.108405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737260-ac66-44f9-804c-64e4b65e6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:22.108553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce737260-ac66-44f9-804c-64e4b65e6f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:22.109237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce737260-ac66-44f9-804c-64e4b65e6f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:22.111065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce737260-ac66-44f9-804c-64e4b65e6f4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:22.156141 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3065/6128] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:22.160328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:22.171413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51866e-e0a5-46e8-ace6-e6aca063da66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:22.202136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:22.203067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:22.203633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:22.204217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] PATH_INFO: `/v3/projects/2da00e8c79804846a4c913cce8015690/users/b01b6239b8a94b2791b537d9fb6a0085/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:22.247700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da00e8c79804846a4c913cce8015690, user_id=b01b6239b8a94b2791b537d9fb6a0085, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:22.253023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:22.382750 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3064/6129] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:51:22 2022] PUT /identity/v3/projects/2da00e8c79804846a4c913cce8015690/users/b01b6239b8a94b2791b537d9fb6a0085/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:22.387362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:22.387771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:22.388151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:22.496593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] MFA Rules not processed for user `b01b6239b8a94b2791b537d9fb6a0085`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:22.498949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:22.529793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:22.531598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:22.591760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:22.746635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3066/6130] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:22.755561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85aa2f-2d4f-4e2c-a754-4413d0df6fa0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:22.763309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:22.765055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:22.765182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33262cf6-892b-4ccc-a3e2-e34a0edaf4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:22.765865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262cf6-892b-4ccc-a3e2-e34a0edaf4e9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:22.766257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262cf6-892b-4ccc-a3e2-e34a0edaf4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:22.766614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33262cf6-892b-4ccc-a3e2-e34a0edaf4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:22.768509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-33262cf6-892b-4ccc-a3e2-e34a0edaf4e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:22.881424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:22.882273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262cf6-892b-4ccc-a3e2-e34a0edaf4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:22.883977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33262cf6-892b-4ccc-a3e2-e34a0edaf4e9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:22.895606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3065/6131] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:51:22.896915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51d775-262e-4831-8664-27a235dc696a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:22.897298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51d775-262e-4831-8664-27a235dc696a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:22.897610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51d775-262e-4831-8664-27a235dc696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:22.909214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7f69-1c46-47b2-ad41-71f75842cc95 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:22.913599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:22.914664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:22.914944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:22.915219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:22.933124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:22.935868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:22.938451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a51d775-262e-4831-8664-27a235dc696a None None] MFA Rules not processed for user `ed057cd103544e81997bc7a4542cbec7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:22.938451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a51d775-262e-4831-8664-27a235dc696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:22.967342 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3067/6132] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:51:23.098480 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3066/6133] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:23.103390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:23.106440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:23.270305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce199837-2cb8-4db0-ac1c-9bac93b055b3 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:23.276890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:23.278093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:23.278728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:23.279220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:23.280137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:23.282464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:23.439379 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3068/6134] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:51:23 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:51:23.440153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51d775-262e-4831-8664-27a235dc696a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:23.463622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51d775-262e-4831-8664-27a235dc696a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:23.468386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edebc2-60fb-42aa-bd7c-b204a72d9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:23.469309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edebc2-60fb-42aa-bd7c-b204a72d9157 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:23.469780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edebc2-60fb-42aa-bd7c-b204a72d9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:23.470250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edebc2-60fb-42aa-bd7c-b204a72d9157 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:23.471078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edebc2-60fb-42aa-bd7c-b204a72d9157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:23.478209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edebc2-60fb-42aa-bd7c-b204a72d9157 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:23.496757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3067/6135] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:23.502359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:23.520460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f46afe-d6ae-4445-b0da-dc12fd29e23c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:23.530618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:23.533790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:23.536974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:23.537577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] PATH_INFO: `/v3/system/users/b8b9e8acda9b4ef7910ea4ebf169fc74/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:23.560667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b8b9e8acda9b4ef7910ea4ebf169fc74, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:23.562008 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:51:23.562008 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:51:23.562008 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:51:23.563621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:23.689504 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3069/6136] 10.222.0.27 () {60 vars in 1378 bytes} [Tue Oct 18 13:51:23 2022] PUT /identity/v3/system/users/b8b9e8acda9b4ef7910ea4ebf169fc74/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:23.701180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1f56-0e1f-47fa-b57d-4a63469bb65f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:23.701467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1f56-0e1f-47fa-b57d-4a63469bb65f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:23.701743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1f56-0e1f-47fa-b57d-4a63469bb65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:23.740281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a18e1f56-0e1f-47fa-b57d-4a63469bb65f None None] MFA Rules not processed for user `b8b9e8acda9b4ef7910ea4ebf169fc74`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:23.742177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a18e1f56-0e1f-47fa-b57d-4a63469bb65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:23.842829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3068/6137] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:23 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 13:51:23.847220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:24.089980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d7f1b-580e-4198-b176-9c049f206921 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:24.156174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b9e8acda9b4ef7910ea4ebf169fc74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:24.157679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:24.158195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:24.159080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:24.159852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:24.163338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:24.181429 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3070/6138] 10.222.0.27 () {58 vars in 1110 bytes} [Tue Oct 18 13:51:23 2022] GET /identity/v3/services => generated 2191 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:51:24.184697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e1f56-0e1f-47fa-b57d-4a63469bb65f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:24.393309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e1f56-0e1f-47fa-b57d-4a63469bb65f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:24.506176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b9e8acda9b4ef7910ea4ebf169fc74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:24.507335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:24.508032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:24.508407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] PATH_INFO: `/v3/limits` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:24.509261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:24.512430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 18 13:51:24.628653 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 18 13:51:24.630090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:51:24.630895 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3069/6139] 10.222.0.27 () {60 vars in 1126 bytes} [Tue Oct 18 13:51:24 2022] POST /identity/v3/limits => generated 124 bytes in 448 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:51:24.643377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:24.722561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:24.976265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebd793-1201-408c-a80c-f8b7c0979df7 None tempest-ImageQuotaTest-1555319709-system-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:25.099912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f11ffd-915f-443b-89a1-155a59ce387a None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b9e8acda9b4ef7910ea4ebf169fc74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:25.101054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f11ffd-915f-443b-89a1-155a59ce387a None tempest-ImageQuotaTest-1555319709-system-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:25.101365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f11ffd-915f-443b-89a1-155a59ce387a None tempest-ImageQuotaTest-1555319709-system-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:25.101703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f11ffd-915f-443b-89a1-155a59ce387a None tempest-ImageQuotaTest-1555319709-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:25.104611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f11ffd-915f-443b-89a1-155a59ce387a None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:25.109737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f11ffd-915f-443b-89a1-155a59ce387a None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:25.124312 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3071/6140] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:51:24 2022] GET /identity/v3/registered_limits => generated 129 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:51:25.140629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:25.145961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:25.373620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:25.390936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6984-0903-42c2-93cc-df995cca621c None tempest-ImageQuotaTest-1555319709-system-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:25.477672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ad76-4446-46c8-b799-5740a3e3da12 None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b9e8acda9b4ef7910ea4ebf169fc74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:25.479066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ad76-4446-46c8-b799-5740a3e3da12 None tempest-ImageQuotaTest-1555319709-system-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:25.480442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ad76-4446-46c8-b799-5740a3e3da12 None tempest-ImageQuotaTest-1555319709-system-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:25.481295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ad76-4446-46c8-b799-5740a3e3da12 None tempest-ImageQuotaTest-1555319709-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:25.482218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ad76-4446-46c8-b799-5740a3e3da12 None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:25.483555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ad76-4446-46c8-b799-5740a3e3da12 None tempest-ImageQuotaTest-1555319709-system-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:25.491641 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3070/6141] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 18 13:51:25 2022] GET /identity/v3/registered_limits => generated 129 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:51:26.137286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16856aa9-c2ce-4413-af4c-0a6e878aaa87 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:26.137856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16856aa9-c2ce-4413-af4c-0a6e878aaa87 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:26.138227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16856aa9-c2ce-4413-af4c-0a6e878aaa87 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:26.140036 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3072/6142] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 13:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:51:26.146419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e0685-0466-4c7d-b442-221290c3b3a6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:26.146865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e0685-0466-4c7d-b442-221290c3b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:26.147239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e0685-0466-4c7d-b442-221290c3b3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:26.259168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-064e0685-0466-4c7d-b442-221290c3b3a6 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:26.261369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-064e0685-0466-4c7d-b442-221290c3b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:26.402786 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3071/6143] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:51:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:26.431210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16856aa9-c2ce-4413-af4c-0a6e878aaa87 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:26.434171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-16856aa9-c2ce-4413-af4c-0a6e878aaa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:26.461669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16856aa9-c2ce-4413-af4c-0a6e878aaa87 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:26.473638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:26.474566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:26.475131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:26.475562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:26.501679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:26.505516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:26.537796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3073/6144] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:51:26.856625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:27.781918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d7f0-2c36-43a3-9da2-95c037e45b66 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:27.782932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d7f0-2c36-43a3-9da2-95c037e45b66 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:27.784440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d7f0-2c36-43a3-9da2-95c037e45b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:27.839151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9b99d7f0-2c36-43a3-9da2-95c037e45b66 None None] MFA Rules not processed for user `b01b6239b8a94b2791b537d9fb6a0085`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:27.844489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b99d7f0-2c36-43a3-9da2-95c037e45b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:27.863534 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3072/6145] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:51:30.145794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:30.148016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:30.179665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d89e-c563-48fb-b486-a9e7a82d1098 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:30.193327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:30.193963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:30.194264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:30.194749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:30.196783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:30.371566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:30.374130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:30.388760 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3074/6146] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:51:37.822626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:39.872297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d7f0-2c36-43a3-9da2-95c037e45b66 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:39.893067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d7f0-2c36-43a3-9da2-95c037e45b66 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:39.898264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:39.898919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:39.899199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:39.899468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] PATH_INFO: `/v3/users/ed057cd103544e81997bc7a4542cbec7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:39.906510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed057cd103544e81997bc7a4542cbec7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:39.908691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:40.231096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed057cd103544e81997bc7a4542cbec7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:40.240705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed057cd103544e81997bc7a4542cbec7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:40.381139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:40.391148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed057cd103544e81997bc7a4542cbec7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:40.392254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed057cd103544e81997bc7a4542cbec7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:40.409763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed057cd103544e81997bc7a4542cbec7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:40.458783 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3073/6147] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:39 2022] DELETE /identity/v3/users/ed057cd103544e81997bc7a4542cbec7 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:41.490516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:41.508339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7147254-fc74-46c4-acd5-3e6092b34b9e service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:41.625017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:41.626238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:41.626665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:41.627084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] PATH_INFO: `/v3/projects/96f3aa7c1cb04bbf9c17cdd6ef661c7b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:41.628552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f3aa7c1cb04bbf9c17cdd6ef661c7b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:41.631682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:41.818668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f3aa7c1cb04bbf9c17cdd6ef661c7b', 'request_id': 'req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:41.834263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f3aa7c1cb04bbf9c17cdd6ef661c7b', 'request_id': 'req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:41.932055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f3aa7c1cb04bbf9c17cdd6ef661c7b', 'request_id': 'req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:41.973406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] The token cache is being invalidate because project 96f3aa7c1cb04bbf9c17cdd6ef661c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:41.973965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:41.975438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:41.977544 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3075/6148] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:41 2022] DELETE /identity/v3/projects/96f3aa7c1cb04bbf9c17cdd6ef661c7b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:41.984263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:41.984263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:42.034099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5ada-0ae3-41b8-b6d0-47630f0f0b62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:42.162610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:42.163549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:42.164005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:42.164436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] PATH_INFO: `/v3/users/b8b9e8acda9b4ef7910ea4ebf169fc74` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:42.166112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b9e8acda9b4ef7910ea4ebf169fc74)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:42.168260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:42.481189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b9e8acda9b4ef7910ea4ebf169fc74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:42.488346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b9e8acda9b4ef7910ea4ebf169fc74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:42.579554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b9e8acda9b4ef7910ea4ebf169fc74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:42.580362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b9e8acda9b4ef7910ea4ebf169fc74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:42.583340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:42.590878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c403d479-9d8c-47db-b361-ef6542cc0f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b9e8acda9b4ef7910ea4ebf169fc74'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:42.613686 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3074/6149] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:41 2022] DELETE /identity/v3/users/b8b9e8acda9b4ef7910ea4ebf169fc74 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:51.944447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:52.865071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:56.589305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:56.590902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:56.607205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3d1cc-dc3a-47bf-8fa3-582ee5860848 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:56.712965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:56.713925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:56.714377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:56.714811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] PATH_INFO: `/v3/users/ce62c03899e040bab1f041aba0187227` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:56.716392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce62c03899e040bab1f041aba0187227)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:56.718775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:57.023469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce62c03899e040bab1f041aba0187227'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:57.037371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce62c03899e040bab1f041aba0187227'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:57.038830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce62c03899e040bab1f041aba0187227'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:57.098048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce62c03899e040bab1f041aba0187227'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:57.349520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce62c03899e040bab1f041aba0187227'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:57.357784 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3076/6150] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:56 2022] DELETE /identity/v3/users/ce62c03899e040bab1f041aba0187227 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:57.362266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:57.362808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:57.362808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:57.385843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:51:57.387140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:57.494359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3075/6151] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:51:57.504586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:57.506162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:57.725815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da1b96-95ed-48d3-8ed2-cc739886af53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:57.731582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:57.732526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:57.733824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:57.734372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:57.747735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:57.750911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:57.782265 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3077/6152] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:51:58.365156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:58.373066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:51:58.388739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ea606-0f41-48aa-931a-e7ce6d3f6fa4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:58.396837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:58.397787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:58.398259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:58.398761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] PATH_INFO: `/v3/projects/67095bbb7a4647ca994ab52dc948d83b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:58.400456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67095bbb7a4647ca994ab52dc948d83b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:58.403886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:58.552697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67095bbb7a4647ca994ab52dc948d83b', 'request_id': 'req-9b3013ed-f0bf-4e04-845c-262888605206'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:58.561883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67095bbb7a4647ca994ab52dc948d83b', 'request_id': 'req-9b3013ed-f0bf-4e04-845c-262888605206'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:58.678694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67095bbb7a4647ca994ab52dc948d83b', 'request_id': 'req-9b3013ed-f0bf-4e04-845c-262888605206'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:58.695796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] The token cache is being invalidate because project 67095bbb7a4647ca994ab52dc948d83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:51:58.696560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:58.697539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:58.700007 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3076/6153] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:51:58 2022] DELETE /identity/v3/projects/67095bbb7a4647ca994ab52dc948d83b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:51:58.704030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:51:58.724802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758396-a2d5-4963-a7d4-5123e35464e3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:51:58.730158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:58.823780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:51:58.824493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:51:58.824778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:51:58.825111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] PATH_INFO: `/v3/users/37d87f721de548dd81179057d36fe3ae` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:51:58.826710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d87f721de548dd81179057d36fe3ae)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:51:58.828837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:51:59.095609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d87f721de548dd81179057d36fe3ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:59.115292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d87f721de548dd81179057d36fe3ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:59.116057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d87f721de548dd81179057d36fe3ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:59.140644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d87f721de548dd81179057d36fe3ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:59.213270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d87f721de548dd81179057d36fe3ae'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:51:59.220426 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3078/6154] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:51:58 2022] DELETE /identity/v3/users/37d87f721de548dd81179057d36fe3ae => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:02.307888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:02.309510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:02.333571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3013ed-f0bf-4e04-845c-262888605206 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:02.475461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:02.476130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:02.476415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:02.476693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] PATH_INFO: `/v3/projects/ce1706b91a934d9da192ad1c4a73c5a6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:02.479153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1706b91a934d9da192ad1c4a73c5a6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:02.481132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:02.645883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:02.684379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1706b91a934d9da192ad1c4a73c5a6', 'request_id': 'req-127733ab-c8be-4d07-8ea0-eb80de5d34af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:02.695086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1706b91a934d9da192ad1c4a73c5a6', 'request_id': 'req-127733ab-c8be-4d07-8ea0-eb80de5d34af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:02.845846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1706b91a934d9da192ad1c4a73c5a6', 'request_id': 'req-127733ab-c8be-4d07-8ea0-eb80de5d34af'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:02.874106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] The token cache is being invalidate because project ce1706b91a934d9da192ad1c4a73c5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:02.875434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:02.876335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:02.885620 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3077/6155] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:02 2022] DELETE /identity/v3/projects/ce1706b91a934d9da192ad1c4a73c5a6 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:02.885865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:02.888088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:02.913172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78bbbe-c556-4321-bd3a-ed9f89c439a2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:03.014964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:03.015771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:03.016060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:03.016348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] PATH_INFO: `/v3/users/d51f8d85f0c54c48a442a5902c3bc36e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:03.017587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51f8d85f0c54c48a442a5902c3bc36e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:03.019718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:03.164756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:03.276442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51f8d85f0c54c48a442a5902c3bc36e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:03.291186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51f8d85f0c54c48a442a5902c3bc36e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:03.292224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51f8d85f0c54c48a442a5902c3bc36e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:03.332617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51f8d85f0c54c48a442a5902c3bc36e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:03.447297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51f8d85f0c54c48a442a5902c3bc36e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:03.455643 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3079/6156] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:02 2022] DELETE /identity/v3/users/d51f8d85f0c54c48a442a5902c3bc36e => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:04.003808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:04.007455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:04.030568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127733ab-c8be-4d07-8ea0-eb80de5d34af admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:04.142376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:04.142376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:04.142376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:04.142376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] PATH_INFO: `/v3/projects/5eb31d58ddc143c688a4b834f179f36f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:04.142664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb31d58ddc143c688a4b834f179f36f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:04.144156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:04.182762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:04.184414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:04.302623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffca21-0134-4f3f-a0f5-62376c50cbaa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:04.308212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8547e-5242-4700-b116-d520980066ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:04.309584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8547e-5242-4700-b116-d520980066ba service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:04.310540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8547e-5242-4700-b116-d520980066ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:04.317674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8547e-5242-4700-b116-d520980066ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:04.317674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0e8547e-5242-4700-b116-d520980066ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:04.333910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8547e-5242-4700-b116-d520980066ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:04.337600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8547e-5242-4700-b116-d520980066ba service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:04.353808 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3080/6157] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:04.354957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb31d58ddc143c688a4b834f179f36f', 'request_id': 'req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:04.367629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb31d58ddc143c688a4b834f179f36f', 'request_id': 'req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:04.487586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb31d58ddc143c688a4b834f179f36f', 'request_id': 'req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:04.511273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] The token cache is being invalidate because project 5eb31d58ddc143c688a4b834f179f36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:04.511590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:04.515513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75a65c14-a281-4ea3-b3d7-6cd4d81b735c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:04.517816 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3078/6158] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:04 2022] DELETE /identity/v3/projects/5eb31d58ddc143c688a4b834f179f36f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:04.524350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941d9f9-304a-42db-9f76-19cf5eb762a8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:04.525070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941d9f9-304a-42db-9f76-19cf5eb762a8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:04.525693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941d9f9-304a-42db-9f76-19cf5eb762a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:04.578607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9941d9f9-304a-42db-9f76-19cf5eb762a8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:04.580148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9941d9f9-304a-42db-9f76-19cf5eb762a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:04.663699 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3081/6159] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:04.671877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf85f9-a763-4563-a28c-889ac6a7cb54 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:04.672221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf85f9-a763-4563-a28c-889ac6a7cb54 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:04.672525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf85f9-a763-4563-a28c-889ac6a7cb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:04.697367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c2bf85f9-a763-4563-a28c-889ac6a7cb54 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:04.700007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c2bf85f9-a763-4563-a28c-889ac6a7cb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:04.710869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3079/6160] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:04.715840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941d9f9-304a-42db-9f76-19cf5eb762a8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:04.728452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941d9f9-304a-42db-9f76-19cf5eb762a8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:04.736936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:04.737710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:04.738078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:04.738443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:04.739890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:04.740276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:04.742046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:04.763221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf85f9-a763-4563-a28c-889ac6a7cb54 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:04.772325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3082/6161] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:04.777631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf85f9-a763-4563-a28c-889ac6a7cb54 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:04.785946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:04.787070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:04.787445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:04.787800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:04.788522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:04.791366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:04.897284 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3080/6162] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:04 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:04.902467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:04.920827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ab415-69e7-471f-97ac-8dbb958a8e48 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:04.966453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:05.046272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:05.048948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:05.049487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:05.050260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:05.053260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:05.057073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:05.198038 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3083/6163] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:04 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:05.203882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:05.240667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaddf3e-6242-49d3-9ff9-2c5e787086d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:05.249040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:05.250574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:05.251139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:05.251623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:05.254217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:05.256464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:05.272819 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3081/6164] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:05.277308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:05.290680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c82d5c-f676-46a6-a6f0-09e75a86f23f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:05.318414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e535c-82b3-4620-8a65-1e08eb8a2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:05.318414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e535c-82b3-4620-8a65-1e08eb8a2c40 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:05.318414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e535c-82b3-4620-8a65-1e08eb8a2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:05.318414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e535c-82b3-4620-8a65-1e08eb8a2c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:05.318889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e535c-82b3-4620-8a65-1e08eb8a2c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:05.318889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e535c-82b3-4620-8a65-1e08eb8a2c40 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:05.350401 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3084/6165] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:52:05.350645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:05.358883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:05.368717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f9ae-ab59-471a-b7b6-cca0305bedeb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:05.383063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:05.384947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:05.385717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:05.386846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] PATH_INFO: `/v3/projects/a9ded6cc2bc84dea980ab12eb532e0c2/users/76a7e384b7514d4aa79cbe2154747ee9/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:05.439963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ded6cc2bc84dea980ab12eb532e0c2, user_id=76a7e384b7514d4aa79cbe2154747ee9, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:05.442866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:05.537452 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3082/6166] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:05 2022] PUT /identity/v3/projects/a9ded6cc2bc84dea980ab12eb532e0c2/users/76a7e384b7514d4aa79cbe2154747ee9/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:05.543984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ea11-ae71-431f-b169-796726e97c8e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:05.544284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ea11-ae71-431f-b169-796726e97c8e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:05.544604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ea11-ae71-431f-b169-796726e97c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:05.573280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c4d4ea11-ae71-431f-b169-796726e97c8e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:05.574638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4d4ea11-ae71-431f-b169-796726e97c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:05.687323 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3085/6167] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:05.761127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:05.764998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:05.936723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bd672-46cb-43df-8891-ba383f062f30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:05.946184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:05.947347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:05.947635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:05.950250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:05.971226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:05.972695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:06.000587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3083/6168] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:10.620039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:10.620563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:10.620734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:10.642266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] MFA Rules not processed for user `69a2792ee20e450e877d4f016c031768`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:10.643589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:10.744384 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3086/6169] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:11.649080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:11.650904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:11.676106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54420f-e4dc-4ce9-822c-d3225b5f8a7e service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:11.683710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:11.684671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:11.685106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:11.685479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:11.691332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:11.715021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:11.717001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:11.765045 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3084/6170] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:13.431487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:13.433651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:13.583003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:13.648672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9393-4c46-48a0-b390-f589c6239265 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:13.661637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:13.662305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:13.662585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:13.662862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:13.669098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:13.683764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:13.685453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:13.700693 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3087/6171] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:14.144621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:14.146707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:14.192932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6a91b-f5e3-4155-8742-26fdb7cdc2ec service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:14.209760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:14.210753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:14.211347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:14.212306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] PATH_INFO: `/v3/users/b29dba1f338c4a3ebe1f1b4db9bc45c5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:14.214094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29dba1f338c4a3ebe1f1b4db9bc45c5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:14.219039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:14.650393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29dba1f338c4a3ebe1f1b4db9bc45c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:14.651108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29dba1f338c4a3ebe1f1b4db9bc45c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:14.744121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29dba1f338c4a3ebe1f1b4db9bc45c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:14.744764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29dba1f338c4a3ebe1f1b4db9bc45c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:14.761084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-373e8ff0-5964-4d12-84e5-4916290e29f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29dba1f338c4a3ebe1f1b4db9bc45c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:14.887688 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3085/6172] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:14 2022] DELETE /identity/v3/users/b29dba1f338c4a3ebe1f1b4db9bc45c5 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:15.837057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:15.860051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941894f-7675-4355-9822-cd242d0513b2 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:16.107409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:16.108391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:16.109413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:16.110086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] PATH_INFO: `/v3/projects/6742e113ada149739d921ce92ff153ec` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:16.121720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6742e113ada149739d921ce92ff153ec)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:16.130080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:16.409431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6742e113ada149739d921ce92ff153ec', 'request_id': 'req-52d8cf68-5862-41d1-98df-f490e68f956f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:16.424986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6742e113ada149739d921ce92ff153ec', 'request_id': 'req-52d8cf68-5862-41d1-98df-f490e68f956f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:16.521238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6742e113ada149739d921ce92ff153ec', 'request_id': 'req-52d8cf68-5862-41d1-98df-f490e68f956f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:16.546782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] The token cache is being invalidate because project 6742e113ada149739d921ce92ff153ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:16.548358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:16.549586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d8cf68-5862-41d1-98df-f490e68f956f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:16.554603 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3088/6173] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:15 2022] DELETE /identity/v3/projects/6742e113ada149739d921ce92ff153ec => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:16.560313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b565b-3754-46f6-a0e8-e02fda0d0982 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:16.560831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b565b-3754-46f6-a0e8-e02fda0d0982 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:16.560910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b565b-3754-46f6-a0e8-e02fda0d0982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:16.628244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c51b565b-3754-46f6-a0e8-e02fda0d0982 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:16.632777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c51b565b-3754-46f6-a0e8-e02fda0d0982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:16.806025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:16.910160 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3086/6174] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:16.910612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5004-f75d-4b44-887b-f5b4db83ce21 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:16.911396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5004-f75d-4b44-887b-f5b4db83ce21 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:16.911826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d5004-f75d-4b44-887b-f5b4db83ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:16.963297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4d3d5004-f75d-4b44-887b-f5b4db83ce21 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:16.979908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4d3d5004-f75d-4b44-887b-f5b4db83ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:17.015350 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3089/6175] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:17.017311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b565b-3754-46f6-a0e8-e02fda0d0982 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:17.030926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b565b-3754-46f6-a0e8-e02fda0d0982 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:17.049681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:17.050361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:17.050643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:17.050914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:17.051592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:17.051898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:17.053557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:17.099590 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3087/6176] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:17.105783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5004-f75d-4b44-887b-f5b4db83ce21 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:17.125761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d5004-f75d-4b44-887b-f5b4db83ce21 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:17.140221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:17.141146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:17.141659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:17.143043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:17.144399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:17.149356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:17.353810 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3090/6177] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:17 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:17.359126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:17.376684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f37aa-cbe1-4a9c-9239-8e1e1ed5f164 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:17.655994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:17.656709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:17.671132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:17.671422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:17.672272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:17.676766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:17.795361 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3088/6178] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:17 2022] POST /identity/v3/users => generated 302 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:17.802621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:17.827493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5583b-5417-4070-864a-f6d6664ee954 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:17.836006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:17.839184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:17.839745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:17.840292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:17.841273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:17.844862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:17.936230 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3091/6179] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:17.938909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:17.958512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6158c58-98ea-4c5a-bcf1-fa81fd1a1b4f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:17.970584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65f63-4d63-4a0f-afb2-4e6bf090a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:17.971221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65f63-4d63-4a0f-afb2-4e6bf090a479 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:17.971671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65f63-4d63-4a0f-afb2-4e6bf090a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:17.972148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65f63-4d63-4a0f-afb2-4e6bf090a479 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:17.973176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65f63-4d63-4a0f-afb2-4e6bf090a479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:17.975004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65f63-4d63-4a0f-afb2-4e6bf090a479 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:18.009931 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3089/6180] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:18.013983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:18.029896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167128a4-1e19-4968-a6c2-a24a53f588c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:18.042626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:18.043566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:18.043993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:18.044432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] PATH_INFO: `/v3/projects/a09575782c0a430bbb005207f853d1bf/users/5ac9ee0ff0ff485bb1506a5c87394b85/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:18.097182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09575782c0a430bbb005207f853d1bf, user_id=5ac9ee0ff0ff485bb1506a5c87394b85, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:18.097182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:18.111929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:18.225009 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3092/6181] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:18 2022] PUT /identity/v3/projects/a09575782c0a430bbb005207f853d1bf/users/5ac9ee0ff0ff485bb1506a5c87394b85/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:18.235808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:18.236327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:18.237540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:18.283568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] MFA Rules not processed for user `5ac9ee0ff0ff485bb1506a5c87394b85`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:18.291506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:18.483560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:18.490019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3090/6182] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:18.688945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58101e-de70-4b40-9974-ff5c8ea0431f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:18.690037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:18.699984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:18.700285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:18.700572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] PATH_INFO: `/v3/users/5ac9ee0ff0ff485bb1506a5c87394b85` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:18.701983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac9ee0ff0ff485bb1506a5c87394b85)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:18.704066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:18.969519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:18.971149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:18.988498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac9ee0ff0ff485bb1506a5c87394b85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:19.016544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac9ee0ff0ff485bb1506a5c87394b85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:19.019138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac9ee0ff0ff485bb1506a5c87394b85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:19.082193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac9ee0ff0ff485bb1506a5c87394b85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:19.104189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:19.155761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-abc8402e-87b1-4044-80bb-05d23a36c4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac9ee0ff0ff485bb1506a5c87394b85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:19.164212 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3093/6183] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:18 2022] DELETE /identity/v3/users/5ac9ee0ff0ff485bb1506a5c87394b85 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:19.169147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:19.169761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:19.170292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:19.180730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c694-77b3-4e5d-9592-da26607a5a4c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:19.239846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:19.250281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:19.342264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:19.351952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:19.351952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:19.351952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:19.351952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:19.375392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:19.381422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:19.427414 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3094/6184] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:19.443640 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3091/6185] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:19.545280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:19.547084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:19.619254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:19.740941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530d27a-9cfe-4250-896f-68307dd89dcf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:19.752223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca233aa-da2a-4262-9961-964a9b581082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:19.753893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca233aa-da2a-4262-9961-964a9b581082 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:19.754957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca233aa-da2a-4262-9961-964a9b581082 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:19.755734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca233aa-da2a-4262-9961-964a9b581082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:19.801606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca233aa-da2a-4262-9961-964a9b581082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:19.803724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca233aa-da2a-4262-9961-964a9b581082 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:19.828553 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3095/6186] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:21.675085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:21.684055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:21.721710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5247f-a07c-4cb4-99f9-6c5b80a553ed service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:21.750760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:21.753761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:21.753761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:21.753761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] PATH_INFO: `/v3/projects/a09575782c0a430bbb005207f853d1bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:21.754961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09575782c0a430bbb005207f853d1bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:21.763820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:22.010473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09575782c0a430bbb005207f853d1bf', 'request_id': 'req-25b3e9e5-df35-4b64-a25d-667eec5528cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:22.029558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09575782c0a430bbb005207f853d1bf', 'request_id': 'req-25b3e9e5-df35-4b64-a25d-667eec5528cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:22.183960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09575782c0a430bbb005207f853d1bf', 'request_id': 'req-25b3e9e5-df35-4b64-a25d-667eec5528cd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:22.208276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] The token cache is being invalidate because project a09575782c0a430bbb005207f853d1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:22.209694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:22.211056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-25b3e9e5-df35-4b64-a25d-667eec5528cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:22.213808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3092/6187] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:21 2022] DELETE /identity/v3/projects/a09575782c0a430bbb005207f853d1bf => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:22.223716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9dde6-96e7-488f-b178-818ec5d62439 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:22.236389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9dde6-96e7-488f-b178-818ec5d62439 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:22.236389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9dde6-96e7-488f-b178-818ec5d62439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:22.347527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a9d9dde6-96e7-488f-b178-818ec5d62439 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:22.349178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a9d9dde6-96e7-488f-b178-818ec5d62439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:22.572143 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3096/6188] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:22.581625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a158-5304-4324-9dc8-817844d0fd2f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:22.582411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a158-5304-4324-9dc8-817844d0fd2f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:22.583219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a158-5304-4324-9dc8-817844d0fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:22.665432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9648a158-5304-4324-9dc8-817844d0fd2f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:22.668796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9648a158-5304-4324-9dc8-817844d0fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:22.700677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9dde6-96e7-488f-b178-818ec5d62439 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:22.717438 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3093/6189] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:22.728435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:22.733255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:22.734118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:22.764286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9dde6-96e7-488f-b178-818ec5d62439 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:22.779629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:22.781422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:22.781861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:22.782231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:22.782924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:22.790991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:22.790991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:22.833327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3097/6190] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:22.838455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:22.849259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] MFA Rules not processed for user `76a7e384b7514d4aa79cbe2154747ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:22.854396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:22.859817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78b35-8ebb-447a-ab23-33b460814b38 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:22.868634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:22.869302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:22.869302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:22.869302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:22.869302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:22.873004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:22.918688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:23.017664 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3094/6191] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:23.018912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.020360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:23.026443 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3098/6192] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:22 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:52:23.028004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.039143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaa8bb-384c-4de8-ae1a-51a5b8d947b0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.137925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.138764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.139195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.139551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.140341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.153243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.216633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209001b8-75e4-42d4-b191-e62b323d05a8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.225233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.225980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.230451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.230451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.230451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.238405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.349996 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3095/6193] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:23 2022] POST /identity/v3/projects => generated 373 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:23.360492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.407252 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3099/6194] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:23 2022] POST /identity/v3/users => generated 287 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:52:23.416774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.445352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5892e-6c90-4c3c-b8f0-ddcb717f7f5e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.461675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:23.521802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef9651-1af1-4432-933e-494beea5248a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.530555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.542241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.542241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.542241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.542241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.542241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.632216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.632216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.632216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.632216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.632619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.633580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.664866 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3100/6195] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:23.666711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.687247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640713b-2aca-41c8-870f-558a37183a99 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.697528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.698344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.698771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.699060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.700277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.703131 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3096/6196] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:23 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:23.705562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.707495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.739336 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3101/6197] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:23.745123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.745275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12a146-af23-4959-ba41-455f5ea76825 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.763348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.763993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.764279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.765093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a586a5-0566-4b7e-93df-8a18dee2629f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.765225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.765856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.767566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.781136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca663e0-a8a6-4204-8bde-5d28697e4110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.783290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca663e0-a8a6-4204-8bde-5d28697e4110 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.783290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca663e0-a8a6-4204-8bde-5d28697e4110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.783290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca663e0-a8a6-4204-8bde-5d28697e4110 admin admin] PATH_INFO: `/v3/projects/d6b0aa2f20c34d52885928fe8de06c7a/users/a59b7673423f4cf0865574170d12c33f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.800815 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3097/6198] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:52:23.802415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:23.817257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb08a6-7e20-434d-9754-155bbc0332c2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:23.821393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca663e0-a8a6-4204-8bde-5d28697e4110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b0aa2f20c34d52885928fe8de06c7a, user_id=a59b7673423f4cf0865574170d12c33f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.824527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca663e0-a8a6-4204-8bde-5d28697e4110 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.831868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:23.832554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.832853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.833096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] PATH_INFO: `/v3/projects/cfddc60d5b974578a119f6602f7556f8/users/61faf6ad6e7848799bf63a6fe0697f97/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.854294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfddc60d5b974578a119f6602f7556f8, user_id=61faf6ad6e7848799bf63a6fe0697f97, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:23.858264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:23.922118 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3102/6199] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:23 2022] PUT /identity/v3/projects/d6b0aa2f20c34d52885928fe8de06c7a/users/a59b7673423f4cf0865574170d12c33f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:23.931818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7d57d-e805-440e-ac17-f66cf450029d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:23.931951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7d57d-e805-440e-ac17-f66cf450029d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:23.932356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7d57d-e805-440e-ac17-f66cf450029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:23.958911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3098/6200] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:23 2022] PUT /identity/v3/projects/cfddc60d5b974578a119f6602f7556f8/users/61faf6ad6e7848799bf63a6fe0697f97/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:23.967427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:24.014235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-47f7d57d-e805-440e-ac17-f66cf450029d None None] MFA Rules not processed for user `a59b7673423f4cf0865574170d12c33f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:24.015470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47f7d57d-e805-440e-ac17-f66cf450029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:24.030782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:24.161146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4338f7c-9eb8-4de2-96e1-1f9958d7dad0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:24.169390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:24.170541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:24.171059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:24.171558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:24.172637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:24.174658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:24.177535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3103/6201] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:24.182606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7d57d-e805-440e-ac17-f66cf450029d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:24.197125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3099/6202] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:24.201103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:24.210544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7d57d-e805-440e-ac17-f66cf450029d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:24.218718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:24.219362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:24.219645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:24.219984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:24.220837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390d0ab-13d9-4e0e-b628-f23c7e4b3045 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:24.221422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:24.223839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:24.235375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:24.237581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:24.238690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:24.239851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] PATH_INFO: `/v3/projects/cfddc60d5b974578a119f6602f7556f8/users/61faf6ad6e7848799bf63a6fe0697f97/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:24.246666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfddc60d5b974578a119f6602f7556f8, user_id=61faf6ad6e7848799bf63a6fe0697f97, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:24.250019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:24.280180 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3100/6203] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:24 2022] PUT /identity/v3/projects/cfddc60d5b974578a119f6602f7556f8/users/61faf6ad6e7848799bf63a6fe0697f97/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:24.359421 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3104/6204] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:24.363762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:24.591634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510d4c3-d119-4974-a7df-22b06bf885b9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:24.760966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:24.762577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:24.762577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:24.762577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:24.763273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:24.771077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:24.942443 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3101/6205] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:24 2022] POST /identity/v3/users => generated 293 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:24.952324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:24.975816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb29a16-92f2-4cac-a9d0-609a93bd09c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:25.001772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:25.003761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:25.010286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:25.015806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:25.015806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:25.024999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:25.067136 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3105/6206] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:25.068793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:25.090616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9064bad-1452-42d6-bac8-7387f6d09426 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:25.102785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d541c-15bf-419c-8def-509751748654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:25.103488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d541c-15bf-419c-8def-509751748654 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:25.103769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d541c-15bf-419c-8def-509751748654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:25.104050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d541c-15bf-419c-8def-509751748654 admin admin] PATH_INFO: `/v3/projects/4f7bdac2bce3450a99144708fa082ba9/users/c8f6030d91d441fca7f510ff932ed29a/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:25.141489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d541c-15bf-419c-8def-509751748654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7bdac2bce3450a99144708fa082ba9, user_id=c8f6030d91d441fca7f510ff932ed29a, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:25.144300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d541c-15bf-419c-8def-509751748654 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:25.262893 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3102/6207] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:25 2022] PUT /identity/v3/projects/4f7bdac2bce3450a99144708fa082ba9/users/c8f6030d91d441fca7f510ff932ed29a/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:25.267087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:25.285107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2442b7-0193-4705-8ef1-f0d09fb26997 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:25.390534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:25.511332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb8db6-935d-4a16-bf3b-1984e0a41144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:25.512300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb8db6-935d-4a16-bf3b-1984e0a41144 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:25.512753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb8db6-935d-4a16-bf3b-1984e0a41144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:25.513202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb8db6-935d-4a16-bf3b-1984e0a41144 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:25.514158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb8db6-935d-4a16-bf3b-1984e0a41144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:25.516017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb8db6-935d-4a16-bf3b-1984e0a41144 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:25.536758 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3106/6208] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:25.542846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d541c-15bf-419c-8def-509751748654 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:25.565248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d541c-15bf-419c-8def-509751748654 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:25.583714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:25.583714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:25.583714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:25.583714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] PATH_INFO: `/v3/projects/4f7bdac2bce3450a99144708fa082ba9/users/c8f6030d91d441fca7f510ff932ed29a/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:25.592501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7bdac2bce3450a99144708fa082ba9, user_id=c8f6030d91d441fca7f510ff932ed29a, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:25.603130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:25.624507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:25.634351 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3103/6209] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:25 2022] PUT /identity/v3/projects/4f7bdac2bce3450a99144708fa082ba9/users/c8f6030d91d441fca7f510ff932ed29a/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:25.654042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be380-862a-4680-acb4-62d46bee4ac5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:25.665089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be380-862a-4680-acb4-62d46bee4ac5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:25.665089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be380-862a-4680-acb4-62d46bee4ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:25.768563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2f8be380-862a-4680-acb4-62d46bee4ac5 None None] MFA Rules not processed for user `c8f6030d91d441fca7f510ff932ed29a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:25.769839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f8be380-862a-4680-acb4-62d46bee4ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:26.004695 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3107/6210] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:26.009856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:26.030844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0cfca-60dc-469c-abfd-8a699709c8d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:26.040933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:26.041943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:26.042775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:26.043304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:26.044234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:26.046922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:26.178420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3104/6211] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:52:26 2022] POST /identity/v3/domains => generated 277 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:26.183852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be380-862a-4680-acb4-62d46bee4ac5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:26.204103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be380-862a-4680-acb4-62d46bee4ac5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:26.456108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:26.456108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:26.456108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:26.456955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:26.456955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:26.478480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:26.650221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3108/6212] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:26 2022] POST /identity/v3/projects => generated 401 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:26.654754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:26.667770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bfbbf-f418-46e0-b17c-983ccd204df3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:26.780037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:26.780764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:26.781132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:26.781470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:26.783308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:26.785633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:26.865694 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3105/6213] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 13:52:26 2022] POST /identity/v3/groups => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:26.881277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:26.886933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a65df-3583-4196-a76a-2fc29176731d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:26.898151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:26.899044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:26.899440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:26.899729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:26.900450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:26.902388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:27.011546 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3109/6214] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:26 2022] POST /identity/v3/users => generated 445 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:27.015480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:27.030490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369f39-9442-49ee-9023-e128e79ea79d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:27.038412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:27.039616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:27.040096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:27.040633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:27.041825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:27.043862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:27.175471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3106/6215] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:52:27 2022] POST /identity/v3/roles => generated 240 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:27.177000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:27.185212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:27.190207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12cd1f-7635-4a82-a32b-83148bf9d2dd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:27.202557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:27.204082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:27.205038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:27.205628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/groups/91f02958ed6045a081f63da864bbec02/roles/432b91e495d04546a93d752811e4bf84/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:27.219078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, group_id=91f02958ed6045a081f63da864bbec02, role_id=432b91e495d04546a93d752811e4bf84)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:27.221987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:27.378302 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3110/6216] 10.222.0.27 () {60 vars in 1585 bytes} [Tue Oct 18 13:52:27 2022] PUT /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/groups/91f02958ed6045a081f63da864bbec02/roles/432b91e495d04546a93d752811e4bf84/inherited_to_projects => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:27.384640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:27.395214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128333df-f262-422a-b915-2714a670b7ed tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:27.488994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:27.489919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:27.490329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:27.490905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/groups/91f02958ed6045a081f63da864bbec02/roles/432b91e495d04546a93d752811e4bf84/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:27.494375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, group_id=91f02958ed6045a081f63da864bbec02, role_id=432b91e495d04546a93d752811e4bf84)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:27.495536 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:52:27.495536 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:52:27.495536 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:52:27.498329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:27.511993 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3107/6217] 10.222.0.27 () {58 vars in 1567 bytes} [Tue Oct 18 13:52:27 2022] HEAD /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/groups/91f02958ed6045a081f63da864bbec02/roles/432b91e495d04546a93d752811e4bf84/inherited_to_projects => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:27.515926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:27.527718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0323187-a3cf-45c3-a338-660a2b63e266 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:27.532694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:27.533626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:27.534092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:27.534547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/groups/91f02958ed6045a081f63da864bbec02/roles/432b91e495d04546a93d752811e4bf84/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:27.537099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, group_id=91f02958ed6045a081f63da864bbec02, role_id=432b91e495d04546a93d752811e4bf84)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:27.540566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:27.548497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role 432b91e495d04546a93d752811e4bf84 was removed from group 91f02958ed6045a081f63da864bbec02 on project cc5fc2e454c34f67a1dd1f11288074cf. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:27.548855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:27.549944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:27.667291 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3111/6218] 10.222.0.27 () {58 vars in 1569 bytes} [Tue Oct 18 13:52:27 2022] DELETE /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/groups/91f02958ed6045a081f63da864bbec02/roles/432b91e495d04546a93d752811e4bf84/inherited_to_projects => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:27.669319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:27.672240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:27.688241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5048b3-a033-453b-975d-ee15d9149b50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:27.898361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:27.900268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:27.900736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:27.901202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles/432b91e495d04546a93d752811e4bf84` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:27.919045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_role(role_id=432b91e495d04546a93d752811e4bf84)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:27.921700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:27.994547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:28.222122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role 432b91e495d04546a93d752811e4bf84 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:28.222749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:28.223158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:28.225839 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3108/6219] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:27 2022] DELETE /identity/v3/roles/432b91e495d04546a93d752811e4bf84 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:28.231421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:28.252132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ed90-76ac-488f-9c43-c2797495ca35 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:28.446274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:28.447250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:28.450502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:28.451441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:28.454305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:28.467256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:28.629628 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3112/6220] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:52:28 2022] POST /identity/v3/roles => generated 240 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:28.634475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:28.636765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:28.676095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717b4a-386f-41d0-84ce-7f056b2a66d6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:28.698643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:28.699826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:28.706043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:28.706043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/8b9de948b962485194b3b28a4083724d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:28.759163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=8b9de948b962485194b3b28a4083724d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:28.762237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:28.902956 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3109/6221] 10.222.0.27 () {60 vars in 1582 bytes} [Tue Oct 18 13:52:28 2022] PUT /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/8b9de948b962485194b3b28a4083724d/inherited_to_projects => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:28.907251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:28.918180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88ca51-8014-4a40-9cce-ed6bd6d94431 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:29.029273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:29.030498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:29.030996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:29.031548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/8b9de948b962485194b3b28a4083724d/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:29.035258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=8b9de948b962485194b3b28a4083724d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:29.040434 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:52:29.040434 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:52:29.040434 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:52:29.040434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:29.049246 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3113/6222] 10.222.0.27 () {58 vars in 1564 bytes} [Tue Oct 18 13:52:28 2022] HEAD /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/8b9de948b962485194b3b28a4083724d/inherited_to_projects => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:29.053883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:29.075081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa17406-e196-4962-9df5-10b3306ffa7e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:29.088908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:29.090040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:29.090578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:29.091080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/8b9de948b962485194b3b28a4083724d/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:29.101490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=8b9de948b962485194b3b28a4083724d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:29.106327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:29.119832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role 8b9de948b962485194b3b28a4083724d was removed from user 2109300bb5fa45ed9f8c0edc6f364f5d on project cc5fc2e454c34f67a1dd1f11288074cf. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:29.122340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:29.123518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:29.302121 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3110/6223] 10.222.0.27 () {58 vars in 1566 bytes} [Tue Oct 18 13:52:29 2022] DELETE /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/8b9de948b962485194b3b28a4083724d/inherited_to_projects => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:29.306212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:29.309301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:29.342251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952603b4-0043-4a09-89a2-582dc4c7be46 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:29.545496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:29.546631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:29.547129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:29.547635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles/8b9de948b962485194b3b28a4083724d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:29.550500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8b9de948b962485194b3b28a4083724d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:29.556386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:29.566240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:29.809827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role 8b9de948b962485194b3b28a4083724d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:29.809827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:29.809827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:29.811637 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3114/6224] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:29 2022] DELETE /identity/v3/roles/8b9de948b962485194b3b28a4083724d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:29.816660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:29.841071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e510d-fd08-4e5c-a2a3-94f5d7114c9e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:30.010184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:30.012584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:30.013109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:30.013656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:30.015897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:30.020386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:30.210195 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3111/6225] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:52:29 2022] POST /identity/v3/roles => generated 240 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:30.212359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:30.215992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:30.237931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e0604-643f-479f-9af6-4a880a0915aa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:30.253618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:30.254431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:30.254785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:30.255132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/a119a8b2505241dea83e088e4f405612/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:30.265977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, group_id=91f02958ed6045a081f63da864bbec02, role_id=a119a8b2505241dea83e088e4f405612)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:30.270649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:30.432940 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3115/6226] 10.222.0.27 () {60 vars in 1582 bytes} [Tue Oct 18 13:52:30 2022] PUT /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/a119a8b2505241dea83e088e4f405612/inherited_to_projects => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:30.442928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:30.479138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e74af-6837-4862-9a60-fe1d8490e1d3 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:30.650678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:30.652108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:30.653520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:30.654135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:30.656995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=7ff4ee207a764128a5b31706c143aa61, group_id=91f02958ed6045a081f63da864bbec02)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:30.659948 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:52:30.659948 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:52:30.659948 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:52:30.669239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:30.686535 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3112/6227] 10.222.0.27 () {58 vars in 1464 bytes} [Tue Oct 18 13:52:30 2022] GET /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/inherited_to_projects => generated 448 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:30.693513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:30.707572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfb856-4048-4c24-ba6e-08b029e72c77 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:30.719377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:30.721211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:30.727142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:30.728348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/a119a8b2505241dea83e088e4f405612/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:30.742719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, group_id=91f02958ed6045a081f63da864bbec02, role_id=a119a8b2505241dea83e088e4f405612)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:30.742719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:30.757373 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3116/6228] 10.222.0.27 () {58 vars in 1564 bytes} [Tue Oct 18 13:52:30 2022] HEAD /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/a119a8b2505241dea83e088e4f405612/inherited_to_projects => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:30.762555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:30.789840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f45ca-0d8e-43ac-ade2-3c6adf5c98fb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:30.803767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:30.808699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:30.809113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:30.821898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/a119a8b2505241dea83e088e4f405612/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:30.821898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, group_id=91f02958ed6045a081f63da864bbec02, role_id=a119a8b2505241dea83e088e4f405612)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:30.821898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:30.831172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role a119a8b2505241dea83e088e4f405612 was removed from group 91f02958ed6045a081f63da864bbec02 on domain 7ff4ee207a764128a5b31706c143aa61. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:30.832379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:30.834139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:30.847907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:31.043915 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3113/6229] 10.222.0.27 () {58 vars in 1566 bytes} [Tue Oct 18 13:52:30 2022] DELETE /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/groups/91f02958ed6045a081f63da864bbec02/roles/a119a8b2505241dea83e088e4f405612/inherited_to_projects => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:31.048061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:31.050181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:31.074982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce535754-e1df-40bb-80b6-38dab7f9f645 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:31.199294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:31.200232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:31.200712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:31.201152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles/a119a8b2505241dea83e088e4f405612` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:31.203386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a119a8b2505241dea83e088e4f405612)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:31.205421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:31.390008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role a119a8b2505241dea83e088e4f405612 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:31.390705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:31.391860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:31.403576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3117/6230] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:31 2022] DELETE /identity/v3/roles/a119a8b2505241dea83e088e4f405612 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:31.404227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:31.425793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862df40-79a9-4ea0-81f1-b74b081444d5 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:31.555442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:31.555442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:31.555442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:31.556254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:31.556254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:31.556254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:31.647997 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3114/6231] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:52:31 2022] POST /identity/v3/roles => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:52:31.658777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:31.673204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:31.745667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecc9a5-3d16-490a-bed4-dc59824bbb96 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:31.764104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:31.767243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:31.768878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:31.769366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/402942857035415fa8322e3d8d1d4e84/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:31.782139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=402942857035415fa8322e3d8d1d4e84)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:31.787711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:31.899938 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3118/6232] 10.222.0.27 () {60 vars in 1579 bytes} [Tue Oct 18 13:52:31 2022] PUT /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/402942857035415fa8322e3d8d1d4e84/inherited_to_projects => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:31.904256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:31.931639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e507b9-f0fe-45e3-bb93-b6102a4ef763 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:32.115051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:32.116144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:32.116464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:32.116798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:32.119845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=7ff4ee207a764128a5b31706c143aa61, user_id=2109300bb5fa45ed9f8c0edc6f364f5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:32.126911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:32.146774 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3115/6233] 10.222.0.27 () {58 vars in 1461 bytes} [Tue Oct 18 13:52:31 2022] GET /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/inherited_to_projects => generated 447 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:32.150711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:32.170048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfbecd-9fc3-4845-a2ec-357cd67ebd80 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:32.173211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:32.174492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:32.174952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:32.175430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/402942857035415fa8322e3d8d1d4e84/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:32.178418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=402942857035415fa8322e3d8d1d4e84)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:32.182025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:32.193045 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3119/6234] 10.222.0.27 () {58 vars in 1561 bytes} [Tue Oct 18 13:52:32 2022] HEAD /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/402942857035415fa8322e3d8d1d4e84/inherited_to_projects => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:32.197852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:32.216678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a593-3030-4b3f-ae5a-d8385ab2f0c9 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:32.223201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:32.224194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:32.224732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:32.225258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/402942857035415fa8322e3d8d1d4e84/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:32.229077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=402942857035415fa8322e3d8d1d4e84)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:32.236458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:32.258289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role 402942857035415fa8322e3d8d1d4e84 was removed from user 2109300bb5fa45ed9f8c0edc6f364f5d on domain 7ff4ee207a764128a5b31706c143aa61. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:32.263809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:32.265329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:32.351447 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3116/6235] 10.222.0.27 () {58 vars in 1563 bytes} [Tue Oct 18 13:52:32 2022] DELETE /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/402942857035415fa8322e3d8d1d4e84/inherited_to_projects => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:32.364307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:32.367198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:32.392396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d1714-243e-4518-aeb3-13c9537fe600 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:32.531486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:32.584502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:32.587795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:32.588126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:32.588402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles/402942857035415fa8322e3d8d1d4e84` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:32.590243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_role(role_id=402942857035415fa8322e3d8d1d4e84)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:32.592240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:32.803884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role 402942857035415fa8322e3d8d1d4e84 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:32.808094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:32.808094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:32.816335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3120/6236] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:32 2022] DELETE /identity/v3/roles/402942857035415fa8322e3d8d1d4e84 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:32.823946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:32.864178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cf4a8-2020-466a-bde7-ecda6dc327ea tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:33.044265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:33.058531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:33.058870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:33.061189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:33.061189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:33.061565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:33.217988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:33.266359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3117/6237] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:52:32 2022] POST /identity/v3/roles => generated 239 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:33.268509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:33.271078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:33.303700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06212ab5-36bc-4742-9a92-d618d8f55a3d tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:33.317902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:33.325850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:33.326359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:33.327534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:33.328376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:33.354666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:33.632923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3121/6238] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:33 2022] POST /identity/v3/projects => generated 409 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:33.633753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:33.653366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9593d8-3286-4376-9582-bb3d237a173a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:33.889783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:33.892576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:33.893084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:33.894098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/d6aa627fc49142089934caba37a3fc53/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:33.896860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=d6aa627fc49142089934caba37a3fc53)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:33.904347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:34.037179 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3118/6239] 10.222.0.27 () {60 vars in 1579 bytes} [Tue Oct 18 13:52:33 2022] PUT /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/d6aa627fc49142089934caba37a3fc53/inherited_to_projects => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:34.042833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:34.061072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53a91-cdcb-4591-bcd3-61f844f138de tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:34.162375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:34.163291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:34.163728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:34.164777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:34.165895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Adding query filter params (scope.project.id=cc5fc2e454c34f67a1dd1f11288074cf, user.id=2109300bb5fa45ed9f8c0edc6f364f5d) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:34.166449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:34.167698 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:52:34.167698 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 13:52:34.167698 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:52:34.169383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:34.274669 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3122/6240] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 13:52:34 2022] GET /identity/v3/role_assignments?scope.project.id=cc5fc2e454c34f67a1dd1f11288074cf&user.id=2109300bb5fa45ed9f8c0edc6f364f5d&effective => generated 648 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:34.278962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:34.292728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6360e7-91ab-4064-a3fe-934262c45060 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:34.304049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:34.307409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:34.307409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:34.307409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:34.307409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Adding query filter params (scope.project.id=b9e1e41e0e4f4c0abaaf0b17c61addf5, user.id=2109300bb5fa45ed9f8c0edc6f364f5d) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:34.307917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:34.309219 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:52:34.309219 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:52:34.309219 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:52:34.310839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:34.417484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3119/6241] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 13:52:34 2022] GET /identity/v3/role_assignments?scope.project.id=b9e1e41e0e4f4c0abaaf0b17c61addf5&user.id=2109300bb5fa45ed9f8c0edc6f364f5d&effective => generated 648 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:52:34.422227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:34.440000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eaacc-463a-4db9-a8c9-cb6fbdd0b36a tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:34.449925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:34.449925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:34.449925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:34.450292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/d6aa627fc49142089934caba37a3fc53/inherited_to_projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:34.457249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7ff4ee207a764128a5b31706c143aa61, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=d6aa627fc49142089934caba37a3fc53)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:34.460347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:34.468134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role d6aa627fc49142089934caba37a3fc53 was removed from user 2109300bb5fa45ed9f8c0edc6f364f5d on domain 7ff4ee207a764128a5b31706c143aa61. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:34.468689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:34.469726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:34.574530 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3123/6242] 10.222.0.27 () {58 vars in 1563 bytes} [Tue Oct 18 13:52:34 2022] DELETE /identity/v3/OS-INHERIT/domains/7ff4ee207a764128a5b31706c143aa61/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/d6aa627fc49142089934caba37a3fc53/inherited_to_projects => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:34.579781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:34.581956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:34.608783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ffd6f-97c2-46cd-bc0d-b24c50e05f04 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:34.767602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:34.768326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:34.773986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:34.782473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:34.782473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Adding query filter params (scope.project.id=cc5fc2e454c34f67a1dd1f11288074cf, user.id=2109300bb5fa45ed9f8c0edc6f364f5d) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:34.782473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:34.782473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:34.868298 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3120/6243] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 13:52:34 2022] GET /identity/v3/role_assignments?scope.project.id=cc5fc2e454c34f67a1dd1f11288074cf&user.id=2109300bb5fa45ed9f8c0edc6f364f5d&effective => generated 228 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:34.872337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:34.890619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ee18a-806c-491b-93aa-5e8b1c0e77e1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:34.910147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:34.910942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:34.911232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:34.911520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:34.912271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Adding query filter params (scope.project.id=b9e1e41e0e4f4c0abaaf0b17c61addf5, user.id=2109300bb5fa45ed9f8c0edc6f364f5d) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:34.912585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:34.915471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:34.994714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:35.036100 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3124/6244] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 13:52:34 2022] GET /identity/v3/role_assignments?scope.project.id=b9e1e41e0e4f4c0abaaf0b17c61addf5&user.id=2109300bb5fa45ed9f8c0edc6f364f5d&effective => generated 228 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:35.040018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:35.057650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db716e-e570-404d-aa09-804af7842d8e tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:35.068051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:35.069065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:35.069514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:35.071290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/projects/b9e1e41e0e4f4c0abaaf0b17c61addf5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:35.072755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9e1e41e0e4f4c0abaaf0b17c61addf5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:35.075324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:35.302820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e1e41e0e4f4c0abaaf0b17c61addf5', 'request_id': 'req-319e0f71-d307-4942-878a-3abebea63a02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:35.322298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e1e41e0e4f4c0abaaf0b17c61addf5', 'request_id': 'req-319e0f71-d307-4942-878a-3abebea63a02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:35.446121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:35.504300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e1e41e0e4f4c0abaaf0b17c61addf5', 'request_id': 'req-319e0f71-d307-4942-878a-3abebea63a02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:35.528616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] The token cache is being invalidate because project b9e1e41e0e4f4c0abaaf0b17c61addf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:35.529178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:35.530487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:35.534504 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3121/6245] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:35 2022] DELETE /identity/v3/projects/b9e1e41e0e4f4c0abaaf0b17c61addf5 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:35.540764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:35.548463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:35.574790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84eb8d-eeaf-42fb-b73d-0d5d5b5bf767 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:35.720490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:35.722559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:35.722990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:35.723568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles/d6aa627fc49142089934caba37a3fc53` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:35.731096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d6aa627fc49142089934caba37a3fc53)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:35.733014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:35.892513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role d6aa627fc49142089934caba37a3fc53 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:35.892513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:35.892513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:35.893457 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3125/6246] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:35 2022] DELETE /identity/v3/roles/d6aa627fc49142089934caba37a3fc53 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:35.898229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:35.912834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0f71-d307-4942-878a-3abebea63a02 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:36.034820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:36.035326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:36.035983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:36.036486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:36.037384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:36.042119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:36.176061 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3122/6247] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:52:35 2022] POST /identity/v3/roles => generated 239 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:36.181767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:36.183505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:36.213953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6799e-1775-419d-a53b-cd827b6bc0a6 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:36.219805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:36.220566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:36.220955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:36.221413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:36.222240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:36.224494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:36.439918 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3126/6248] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:36 2022] POST /identity/v3/projects => generated 410 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:36.444023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:36.456197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fd6d-8931-4e67-91a5-1ffcc6713687 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:36.575805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:36.576774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:36.577242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:36.577672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/c1688c75256d425a97af74ca527c49cc/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:36.580762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=c1688c75256d425a97af74ca527c49cc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:36.585390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:36.752296 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3123/6249] 10.222.0.27 () {60 vars in 1582 bytes} [Tue Oct 18 13:52:36 2022] PUT /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/c1688c75256d425a97af74ca527c49cc/inherited_to_projects => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:36.755231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:36.773973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725f690-0b3d-4ddf-8470-b093181f42b2 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:36.877705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:36.878763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:36.879558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:36.880482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:36.881250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Adding query filter params (scope.project.id=ec1a50a4284245d7b6a653301016c573, user.id=2109300bb5fa45ed9f8c0edc6f364f5d) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:36.881562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:36.884121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:36.959871 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3127/6250] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 13:52:36 2022] GET /identity/v3/role_assignments?scope.project.id=ec1a50a4284245d7b6a653301016c573&user.id=2109300bb5fa45ed9f8c0edc6f364f5d&effective => generated 649 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:36.964516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:36.983659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcd569-f0a9-4dd9-bc08-b92732780104 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:36.994352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:36.995062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:36.995348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:36.995672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/c1688c75256d425a97af74ca527c49cc/inherited_to_projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:36.999093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cc5fc2e454c34f67a1dd1f11288074cf, user_id=2109300bb5fa45ed9f8c0edc6f364f5d, role_id=c1688c75256d425a97af74ca527c49cc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:37.002109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:37.012975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role c1688c75256d425a97af74ca527c49cc was removed from user 2109300bb5fa45ed9f8c0edc6f364f5d on project cc5fc2e454c34f67a1dd1f11288074cf. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:37.013370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:37.014388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:37.137707 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3124/6251] 10.222.0.27 () {58 vars in 1566 bytes} [Tue Oct 18 13:52:36 2022] DELETE /identity/v3/OS-INHERIT/projects/cc5fc2e454c34f67a1dd1f11288074cf/users/2109300bb5fa45ed9f8c0edc6f364f5d/roles/c1688c75256d425a97af74ca527c49cc/inherited_to_projects => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:37.141831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:37.145360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:37.159737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a36b5-6564-4528-ab85-2f000afa2ac4 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:37.232129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:37.232847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:37.233157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:37.233399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:37.234171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Adding query filter params (scope.project.id=ec1a50a4284245d7b6a653301016c573, user.id=2109300bb5fa45ed9f8c0edc6f364f5d) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:37.234511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:37.236969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:37.311221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3128/6252] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 13:52:37 2022] GET /identity/v3/role_assignments?scope.project.id=ec1a50a4284245d7b6a653301016c573&user.id=2109300bb5fa45ed9f8c0edc6f364f5d&effective => generated 228 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:37.315537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:37.330154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37a272-03e2-4afe-b3ed-62ae757b9f0b tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:37.339815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:37.340921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:37.341365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:37.341813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/projects/ec1a50a4284245d7b6a653301016c573` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:37.343209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec1a50a4284245d7b6a653301016c573)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:37.345146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:37.501504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:37.528465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1a50a4284245d7b6a653301016c573', 'request_id': 'req-798f2351-4820-4271-85aa-be64fa887e23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:37.537135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1a50a4284245d7b6a653301016c573', 'request_id': 'req-798f2351-4820-4271-85aa-be64fa887e23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:37.678970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1a50a4284245d7b6a653301016c573', 'request_id': 'req-798f2351-4820-4271-85aa-be64fa887e23'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:37.697442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] The token cache is being invalidate because project ec1a50a4284245d7b6a653301016c573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:37.697912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:37.699698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:37.704073 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3125/6253] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:37 2022] DELETE /identity/v3/projects/ec1a50a4284245d7b6a653301016c573 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:37.708032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:37.709963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:37.737026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092bc4c-498c-4103-a1ed-b1feb93f4c59 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:37.866483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:37.869889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:37.870941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:37.870941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:37.871218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/roles/c1688c75256d425a97af74ca527c49cc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:37.874311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c1688c75256d425a97af74ca527c49cc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:37.876290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:38.074608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invalidating the token cache because role c1688c75256d425a97af74ca527c49cc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:38.075277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:38.076193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a1001da-372a-42fd-ab6a-ee0674fcfb50 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:38.082802 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3129/6254] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:37 2022] DELETE /identity/v3/roles/c1688c75256d425a97af74ca527c49cc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:38.084024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:38.101240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f2351-4820-4271-85aa-be64fa887e23 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:38.219789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:38.220768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:38.221061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:38.221342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/users/2109300bb5fa45ed9f8c0edc6f364f5d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:38.223410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2109300bb5fa45ed9f8c0edc6f364f5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:38.225567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:38.360683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:38.360683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:38.360683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:38.428544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2109300bb5fa45ed9f8c0edc6f364f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:38.431960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2109300bb5fa45ed9f8c0edc6f364f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:38.465265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] MFA Rules not processed for user `61faf6ad6e7848799bf63a6fe0697f97`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:38.474132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:38.629927 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3130/6255] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:38.636773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:38.643518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:38.646557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2109300bb5fa45ed9f8c0edc6f364f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:38.647188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2109300bb5fa45ed9f8c0edc6f364f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:38.657924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2109300bb5fa45ed9f8c0edc6f364f5d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:38.691937 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3126/6256] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:38 2022] DELETE /identity/v3/users/2109300bb5fa45ed9f8c0edc6f364f5d => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:38.708485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:38.708485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:38.819838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf2621-7c58-4d3a-bd74-2215ee835ce1 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:38.832629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:38.835406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:38.836226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:38.846709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/groups/91f02958ed6045a081f63da864bbec02` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:38.850866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_group(group_id=91f02958ed6045a081f63da864bbec02)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:38.858181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:38.887645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56568dba-d6ef-4bf3-9b11-e749a9add5b1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:39.048993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531fa7f-dfa8-43e5-b534-61f4fbc754d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:39.050277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531fa7f-dfa8-43e5-b534-61f4fbc754d8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:39.050277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531fa7f-dfa8-43e5-b534-61f4fbc754d8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:39.050277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531fa7f-dfa8-43e5-b534-61f4fbc754d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:39.126592 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3127/6257] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 13:52:38 2022] DELETE /identity/v3/groups/91f02958ed6045a081f63da864bbec02 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:39.133998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:39.251694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531fa7f-dfa8-43e5-b534-61f4fbc754d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:39.253656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531fa7f-dfa8-43e5-b534-61f4fbc754d8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:39.273405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73afea3-e9f0-42cd-8fde-f931f4e499eb tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:39.275646 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3131/6258] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:39.299587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:39.300485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:39.303814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:39.305433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/projects/cc5fc2e454c34f67a1dd1f11288074cf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:39.308841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc5fc2e454c34f67a1dd1f11288074cf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:39.316512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:39.375850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3b5e0-2ffa-4bf5-b9b2-5d565e191c65 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:39.376270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3b5e0-2ffa-4bf5-b9b2-5d565e191c65 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:39.376650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3b5e0-2ffa-4bf5-b9b2-5d565e191c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:39.411080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-21a3b5e0-2ffa-4bf5-b9b2-5d565e191c65 None None] MFA Rules not processed for user `76a7e384b7514d4aa79cbe2154747ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:39.412391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-21a3b5e0-2ffa-4bf5-b9b2-5d565e191c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:39.515398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5fc2e454c34f67a1dd1f11288074cf', 'request_id': 'req-aacbf3ab-930b-4396-becf-81d6157deecd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:39.533531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5fc2e454c34f67a1dd1f11288074cf', 'request_id': 'req-aacbf3ab-930b-4396-becf-81d6157deecd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:39.580219 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3132/6259] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:39.652596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5fc2e454c34f67a1dd1f11288074cf', 'request_id': 'req-aacbf3ab-930b-4396-becf-81d6157deecd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:39.671605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] The token cache is being invalidate because project cc5fc2e454c34f67a1dd1f11288074cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:39.671908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:39.674632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:39.677889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3128/6260] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:39 2022] DELETE /identity/v3/projects/cc5fc2e454c34f67a1dd1f11288074cf => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:39.682012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3b5e0-2ffa-4bf5-b9b2-5d565e191c65 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:39.688627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:39.709323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3b5e0-2ffa-4bf5-b9b2-5d565e191c65 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:39.839838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:39.840518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:39.840802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:39.842828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/domains/7ff4ee207a764128a5b31706c143aa61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:39.844169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7ff4ee207a764128a5b31706c143aa61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:39.845809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:39.916976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7ff4ee207a764128a5b31706c143aa61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:39.919118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7ff4ee207a764128a5b31706c143aa61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.067713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7ff4ee207a764128a5b31706c143aa61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.068958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7ff4ee207a764128a5b31706c143aa61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.077707 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3133/6261] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:52:39 2022] PATCH /identity/v3/domains/7ff4ee207a764128a5b31706c143aa61 => generated 278 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:40.079298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:40.081708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:40.102132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf3ab-930b-4396-becf-81d6157deecd tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:40.206861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:40.226139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f6030d91d441fca7f510ff932ed29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7bdac2bce3450a99144708fa082ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:40.227610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:40.228081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:40.228541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] PATH_INFO: `/v3/domains/7ff4ee207a764128a5b31706c143aa61` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:40.263447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7ff4ee207a764128a5b31706c143aa61)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:40.268788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:40.310479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7ff4ee207a764128a5b31706c143aa61'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.336642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7ff4ee207a764128a5b31706c143aa61'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.404800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:40.407825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:40.539615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff4ee207a764128a5b31706c143aa61', 'request_id': 'req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.559946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff4ee207a764128a5b31706c143aa61', 'request_id': 'req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.604767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05fb81-c805-4f81-b8bf-373dfbc41891 tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:40.669953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:40.670928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:40.671353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:40.671749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:40.674227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:40.704516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff4ee207a764128a5b31706c143aa61', 'request_id': 'req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.715553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:40.718368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:40.737316 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3134/6262] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:52:40.780115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] The token cache is being invalidate because project 7ff4ee207a764128a5b31706c143aa61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:40.780546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.781286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.802721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7ff4ee207a764128a5b31706c143aa61', 'request_id': 'req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.806327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7ff4ee207a764128a5b31706c143aa61', 'request_id': 'req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.806327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa tempest-InheritsV3TestJSON-1569788070 tempest-InheritsV3TestJSON-1569788070-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7ff4ee207a764128a5b31706c143aa61', 'request_id': 'req-f17e0c62-2dfc-4165-b8b9-3f2381ad74fa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:40.832061 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3129/6263] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:52:40 2022] DELETE /identity/v3/domains/7ff4ee207a764128a5b31706c143aa61 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:40.832418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:40.835585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:40.990200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765eba5-5fbd-44f7-9a82-60185967f3ed service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:40.999417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:40.999417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:40.999417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:41.000241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] PATH_INFO: `/v3/users/a59b7673423f4cf0865574170d12c33f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:41.001755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59b7673423f4cf0865574170d12c33f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:41.004033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:41.329506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59b7673423f4cf0865574170d12c33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:41.348834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59b7673423f4cf0865574170d12c33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:41.352288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59b7673423f4cf0865574170d12c33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:41.400173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59b7673423f4cf0865574170d12c33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:41.579834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59b7673423f4cf0865574170d12c33f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:41.604480 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3135/6264] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:40 2022] DELETE /identity/v3/users/a59b7673423f4cf0865574170d12c33f => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:41.607266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:41.608508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:41.609013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:41.656178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:41.658152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:41.732721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:41.825915 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3130/6265] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:41.847439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:41.849308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:41.990712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c65705-b6d8-4149-932b-08f20795ded3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:41.999582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9dfee-d391-4758-8026-251fd2531f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:42.008924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9dfee-d391-4758-8026-251fd2531f0f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:42.008924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9dfee-d391-4758-8026-251fd2531f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:42.008924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9dfee-d391-4758-8026-251fd2531f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:42.046133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9dfee-d391-4758-8026-251fd2531f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:42.047976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9dfee-d391-4758-8026-251fd2531f0f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:42.068843 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3136/6266] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:42.304008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:42.890253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:42.893854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:42.954606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ab5da-a55d-4113-80a2-9dbbed918d8b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:42.963669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:42.964344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:42.964678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:42.964956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] PATH_INFO: `/v3/projects/d6b0aa2f20c34d52885928fe8de06c7a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:42.967322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b0aa2f20c34d52885928fe8de06c7a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:42.978744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:43.067888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04025a-9be3-4e3f-aff4-d4d88ecd2153 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:43.068821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04025a-9be3-4e3f-aff4-d4d88ecd2153 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:43.069408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04025a-9be3-4e3f-aff4-d4d88ecd2153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:43.111122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fa04025a-9be3-4e3f-aff4-d4d88ecd2153 None None] MFA Rules not processed for user `d3ed4523fb1d423abcf98fdb30b37b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:43.112635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa04025a-9be3-4e3f-aff4-d4d88ecd2153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:43.238784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b0aa2f20c34d52885928fe8de06c7a', 'request_id': 'req-50adebc8-a719-49cd-a004-b8dc4c0ac78e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.245392 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3137/6267] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:43.259651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b0aa2f20c34d52885928fe8de06c7a', 'request_id': 'req-50adebc8-a719-49cd-a004-b8dc4c0ac78e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.332785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b0aa2f20c34d52885928fe8de06c7a', 'request_id': 'req-50adebc8-a719-49cd-a004-b8dc4c0ac78e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.360338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] The token cache is being invalidate because project d6b0aa2f20c34d52885928fe8de06c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:43.361025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.362721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.364935 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3131/6268] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:42 2022] DELETE /identity/v3/projects/d6b0aa2f20c34d52885928fe8de06c7a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:43.369737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04025a-9be3-4e3f-aff4-d4d88ecd2153 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:43.411289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04025a-9be3-4e3f-aff4-d4d88ecd2153 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:43.564088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:43.565176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:43.566839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:43.569715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] PATH_INFO: `/v3/users/c8f6030d91d441fca7f510ff932ed29a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:43.574362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f6030d91d441fca7f510ff932ed29a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:43.579468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:43.631735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:43.907797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f6030d91d441fca7f510ff932ed29a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.925337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f6030d91d441fca7f510ff932ed29a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.926523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f6030d91d441fca7f510ff932ed29a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:43.957199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f6030d91d441fca7f510ff932ed29a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:44.166723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f6030d91d441fca7f510ff932ed29a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:44.178200 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3138/6269] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:43 2022] DELETE /identity/v3/users/c8f6030d91d441fca7f510ff932ed29a => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:44.323440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:44.325166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:44.460307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adebc8-a719-49cd-a004-b8dc4c0ac78e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:44.637253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e934c-d103-450c-97e5-1a0ef388050c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:44.640337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e934c-d103-450c-97e5-1a0ef388050c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:44.640337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e934c-d103-450c-97e5-1a0ef388050c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:44.640337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e934c-d103-450c-97e5-1a0ef388050c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:44.641041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-947e934c-d103-450c-97e5-1a0ef388050c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:44.679214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e934c-d103-450c-97e5-1a0ef388050c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:44.681257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e934c-d103-450c-97e5-1a0ef388050c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:44.698037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3132/6270] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:44.717341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:44.926021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:45.424541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:45.426954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:45.591376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b19991-d6ef-42cb-90cf-3222afa76c2e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:45.611946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:45.612626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:45.612908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:45.613183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] PATH_INFO: `/v3/projects/4f7bdac2bce3450a99144708fa082ba9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:45.615384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7bdac2bce3450a99144708fa082ba9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:45.617487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:45.827040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7bdac2bce3450a99144708fa082ba9', 'request_id': 'req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:45.839378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7bdac2bce3450a99144708fa082ba9', 'request_id': 'req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:46.018542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7bdac2bce3450a99144708fa082ba9', 'request_id': 'req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:46.041447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] The token cache is being invalidate because project 4f7bdac2bce3450a99144708fa082ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:46.042221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:46.044503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0964b812-1aa6-4fe7-a946-1d1f3b67f6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:46.054188 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3139/6271] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:45 2022] DELETE /identity/v3/projects/4f7bdac2bce3450a99144708fa082ba9 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:46.065011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977675-515d-4bc0-8ee6-c9e9ab41ddcb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:46.066843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977675-515d-4bc0-8ee6-c9e9ab41ddcb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:46.068953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977675-515d-4bc0-8ee6-c9e9ab41ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:46.078797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:46.228059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d977675-515d-4bc0-8ee6-c9e9ab41ddcb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:46.230046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d977675-515d-4bc0-8ee6-c9e9ab41ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:46.347381 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3133/6272] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:46.356391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288199-63a1-4d60-9c4f-b0430f66fcac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:46.356772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288199-63a1-4d60-9c4f-b0430f66fcac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:46.357124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a288199-63a1-4d60-9c4f-b0430f66fcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:46.398759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9a288199-63a1-4d60-9c4f-b0430f66fcac None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:46.400414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a288199-63a1-4d60-9c4f-b0430f66fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:46.432512 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3140/6273] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:46.434394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977675-515d-4bc0-8ee6-c9e9ab41ddcb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:46.446283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977675-515d-4bc0-8ee6-c9e9ab41ddcb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:46.458898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:46.459790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:46.460318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:46.461363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:46.465406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:46.465406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:46.465406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:46.487625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3134/6274] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:46.488822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a288199-63a1-4d60-9c4f-b0430f66fcac None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:46.500492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a288199-63a1-4d60-9c4f-b0430f66fcac None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:46.517978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:46.518756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:46.519080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:46.519391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:46.520160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:46.522696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:46.599556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:46.653311 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3141/6275] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:46 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:46.657312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:46.688746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b50d-193e-465d-be44-6f0b4256b8f4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:46.807407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:46.816196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:46.816196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:46.816196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:46.816196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:46.816196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:46.928472 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3135/6276] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:46 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:46.936704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:46.980273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d519dbf-8941-499b-9f77-85142be2712c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:47.008178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:47.008931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:47.011055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:47.012339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:47.014976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:47.018502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:47.035975 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3142/6277] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:47.041145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:47.052845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02983f-43e0-446c-b09a-a8b08cdf8f50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:47.059046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d0cd9-a4be-462b-990b-9c4bb690d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:47.059852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d0cd9-a4be-462b-990b-9c4bb690d406 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:47.060190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d0cd9-a4be-462b-990b-9c4bb690d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:47.060567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d0cd9-a4be-462b-990b-9c4bb690d406 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:47.061417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d0cd9-a4be-462b-990b-9c4bb690d406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:47.063334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d0cd9-a4be-462b-990b-9c4bb690d406 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:47.079877 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3136/6278] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:47.081450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:47.094224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32e4f7-931c-4d46-b04d-0641ff867cfb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:47.099418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:47.100113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:47.100397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:47.100677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] PATH_INFO: `/v3/projects/54f8ade651bd44bf9f2d31ba1b32b76f/users/068d38e007b94c85bf1ae01bcb1dcf75/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:47.118494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f8ade651bd44bf9f2d31ba1b32b76f, user_id=068d38e007b94c85bf1ae01bcb1dcf75, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:47.121274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:47.253062 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3143/6279] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:47 2022] PUT /identity/v3/projects/54f8ade651bd44bf9f2d31ba1b32b76f/users/068d38e007b94c85bf1ae01bcb1dcf75/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:47.275072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30095-332a-45b8-82e5-1b53d2e7ade7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:47.275368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30095-332a-45b8-82e5-1b53d2e7ade7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:47.275649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30095-332a-45b8-82e5-1b53d2e7ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:47.310493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ab30095-332a-45b8-82e5-1b53d2e7ade7 None None] MFA Rules not processed for user `068d38e007b94c85bf1ae01bcb1dcf75`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:47.313202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ab30095-332a-45b8-82e5-1b53d2e7ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:47.434834 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3137/6280] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:47.438520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:47.544776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1752-b723-4606-ae84-295f123b8c70 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:47.551042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:47.551765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:47.552051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:47.552328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:47.552989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:47.556764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:47.674789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3144/6281] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:47 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:47.678477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab30095-332a-45b8-82e5-1b53d2e7ade7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:47.694307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab30095-332a-45b8-82e5-1b53d2e7ade7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:47.777559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:47.778567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:47.779333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:47.780041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:47.780897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:47.783568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:47.915410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3138/6282] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:47 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:47.915638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:47.931912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fdcac-e50c-4787-bc94-cfd998cdb353 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:47.945692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:47.946853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:47.947330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:47.947866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:47.948852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:47.951345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:47.972264 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3145/6283] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:47.972457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:48.003443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b5bab-2926-444b-bb19-35c78ee8e354 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:48.021588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814a8f4-a7e2-4938-bb88-b54cccaabcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:48.022798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a8f4-a7e2-4938-bb88-b54cccaabcaa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:48.023167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a8f4-a7e2-4938-bb88-b54cccaabcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:48.023770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a8f4-a7e2-4938-bb88-b54cccaabcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:48.024951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814a8f4-a7e2-4938-bb88-b54cccaabcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:48.038511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814a8f4-a7e2-4938-bb88-b54cccaabcaa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:48.075766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3139/6284] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:48.078909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:48.096586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025de8-82b2-4a51-9b40-63f5574821aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:48.113688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:48.113688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:48.113688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:48.113688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] PATH_INFO: `/v3/projects/d12f5f2c7f674336b9cba132bfd5816e/users/523f54a8da5d451fb0bb0148fc8428bd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:48.146047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12f5f2c7f674336b9cba132bfd5816e, user_id=523f54a8da5d451fb0bb0148fc8428bd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:48.147704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:48.290967 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3146/6285] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:48 2022] PUT /identity/v3/projects/d12f5f2c7f674336b9cba132bfd5816e/users/523f54a8da5d451fb0bb0148fc8428bd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:48.308860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0d27-918e-4590-8975-2a99939f5824 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:48.309623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0d27-918e-4590-8975-2a99939f5824 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:48.310237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b0d27-918e-4590-8975-2a99939f5824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:48.447237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:48.505398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1b4b0d27-918e-4590-8975-2a99939f5824 None None] MFA Rules not processed for user `523f54a8da5d451fb0bb0148fc8428bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:48.508002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b4b0d27-918e-4590-8975-2a99939f5824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:48.686560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3140/6286] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:48.687846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:48.780108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1b07-9671-4bfa-becf-e65bb360407f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:48.786070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf26d92-f991-4e07-8ead-7f9d1947207d tempest-IdentityV3ProjectsTest-1643620537 tempest-IdentityV3ProjectsTest-1643620537-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068d38e007b94c85bf1ae01bcb1dcf75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54f8ade651bd44bf9f2d31ba1b32b76f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:48.787727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf26d92-f991-4e07-8ead-7f9d1947207d tempest-IdentityV3ProjectsTest-1643620537 tempest-IdentityV3ProjectsTest-1643620537-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:48.788134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf26d92-f991-4e07-8ead-7f9d1947207d tempest-IdentityV3ProjectsTest-1643620537 tempest-IdentityV3ProjectsTest-1643620537-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:48.788634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf26d92-f991-4e07-8ead-7f9d1947207d tempest-IdentityV3ProjectsTest-1643620537 tempest-IdentityV3ProjectsTest-1643620537-project] PATH_INFO: `/v3/users/068d38e007b94c85bf1ae01bcb1dcf75/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:48.792576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf26d92-f991-4e07-8ead-7f9d1947207d tempest-IdentityV3ProjectsTest-1643620537 tempest-IdentityV3ProjectsTest-1643620537-project] RBAC: Authorizing `identity:list_user_projects(user_id=068d38e007b94c85bf1ae01bcb1dcf75)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:48.795021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf26d92-f991-4e07-8ead-7f9d1947207d tempest-IdentityV3ProjectsTest-1643620537 tempest-IdentityV3ProjectsTest-1643620537-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:48.869561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:48.881010 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3147/6287] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 18 13:52:48 2022] GET /identity/v3/users/068d38e007b94c85bf1ae01bcb1dcf75/projects => generated 517 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:48.882281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6bad-18a2-46bc-ba98-6239533d490b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:48.883196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6bad-18a2-46bc-ba98-6239533d490b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:48.883475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f6bad-18a2-46bc-ba98-6239533d490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:48.930127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-181f6bad-18a2-46bc-ba98-6239533d490b None None] MFA Rules not processed for user `068d38e007b94c85bf1ae01bcb1dcf75`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:48.931407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-181f6bad-18a2-46bc-ba98-6239533d490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:48.953515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3141/6288] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:48.967594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84faf90-9b94-41a7-b31e-45c20cdfd9ca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:48.967890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84faf90-9b94-41a7-b31e-45c20cdfd9ca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:48.968263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84faf90-9b94-41a7-b31e-45c20cdfd9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:49.000378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f84faf90-9b94-41a7-b31e-45c20cdfd9ca None None] MFA Rules not processed for user `068d38e007b94c85bf1ae01bcb1dcf75`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:49.000378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f84faf90-9b94-41a7-b31e-45c20cdfd9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:49.067022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.models.token_model [None req-f84faf90-9b94-41a7-b31e-45c20cdfd9ca None None] User 068d38e007b94c85bf1ae01bcb1dcf75 has no access to project d12f5f2c7f674336b9cba132bfd5816e {{(pid=82160) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 18 13:52:49.071544 n-d-858383-13 devstack@keystone.service[82160]: WARNING keystone.server.flask.application [None req-f84faf90-9b94-41a7-b31e-45c20cdfd9ca None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 13:52:49.073706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3148/6289] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:48 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 107 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 18 13:52:49.080390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6bad-18a2-46bc-ba98-6239533d490b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:49.215269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f6bad-18a2-46bc-ba98-6239533d490b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:49.220698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:49.221373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:49.221659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:49.224121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] PATH_INFO: `/v3/users/068d38e007b94c85bf1ae01bcb1dcf75` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:49.225825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068d38e007b94c85bf1ae01bcb1dcf75)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:49.229021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:49.586206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068d38e007b94c85bf1ae01bcb1dcf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:49.587974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068d38e007b94c85bf1ae01bcb1dcf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:49.732651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068d38e007b94c85bf1ae01bcb1dcf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:49.734760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068d38e007b94c85bf1ae01bcb1dcf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:49.746944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068d38e007b94c85bf1ae01bcb1dcf75'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:49.810846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3142/6290] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:49 2022] DELETE /identity/v3/users/068d38e007b94c85bf1ae01bcb1dcf75 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:49.815554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:49.816599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:49.816975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:49.845874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:49.847919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:49.963263 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3149/6291] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:49.983126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:49.984887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:50.046879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:50.069400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f019-9559-40c7-9d26-690a0f650f87 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:50.073602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:50.074435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:50.074722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:50.075000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:50.086456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:50.087928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:50.100972 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3143/6292] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:50.224592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:50.977563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:50.979744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:51.001033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d11ac7-4099-4b00-bd11-7e34e9b57172 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:51.009420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:51.010836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:51.011489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:51.011870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] PATH_INFO: `/v3/projects/54f8ade651bd44bf9f2d31ba1b32b76f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:51.013999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f8ade651bd44bf9f2d31ba1b32b76f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:51.016192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:51.193222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f8ade651bd44bf9f2d31ba1b32b76f', 'request_id': 'req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.202213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f8ade651bd44bf9f2d31ba1b32b76f', 'request_id': 'req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.320844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f8ade651bd44bf9f2d31ba1b32b76f', 'request_id': 'req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.339686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] The token cache is being invalidate because project 54f8ade651bd44bf9f2d31ba1b32b76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:51.341408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.342892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.346270 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3150/6293] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:50 2022] DELETE /identity/v3/projects/54f8ade651bd44bf9f2d31ba1b32b76f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:51.350940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:51.364108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbe996-bb12-4228-be9e-97f1607b43a7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:51.452177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:51.453167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:51.453601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:51.454018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] PATH_INFO: `/v3/users/523f54a8da5d451fb0bb0148fc8428bd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:51.455624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523f54a8da5d451fb0bb0148fc8428bd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:51.458881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:51.816047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523f54a8da5d451fb0bb0148fc8428bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.816882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523f54a8da5d451fb0bb0148fc8428bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.892667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:51.961746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523f54a8da5d451fb0bb0148fc8428bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.971080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523f54a8da5d451fb0bb0148fc8428bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:51.981279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523f54a8da5d451fb0bb0148fc8428bd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:52.027282 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3144/6294] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:51 2022] DELETE /identity/v3/users/523f54a8da5d451fb0bb0148fc8428bd => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:53.337411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:53.337411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:53.365450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50619f-d8ed-4b8d-87e0-0e11904e6b61 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:53.389524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:53.542862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:53.543619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:53.543971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:53.544317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] PATH_INFO: `/v3/projects/d12f5f2c7f674336b9cba132bfd5816e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:53.546600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12f5f2c7f674336b9cba132bfd5816e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:53.548974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:53.682542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12f5f2c7f674336b9cba132bfd5816e', 'request_id': 'req-8a456555-e77f-451c-aa88-8ed2f271b172'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:53.691521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12f5f2c7f674336b9cba132bfd5816e', 'request_id': 'req-8a456555-e77f-451c-aa88-8ed2f271b172'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:53.703096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:53.703550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:53.718997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741c257-9a84-4bcb-8b95-3db5c27804d5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:53.785307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:53.785992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:53.786545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:53.786827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] PATH_INFO: `/v3/users/55429a696dfc4bab825924efd18993d0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:53.788035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55429a696dfc4bab825924efd18993d0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:53.790737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:53.817324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12f5f2c7f674336b9cba132bfd5816e', 'request_id': 'req-8a456555-e77f-451c-aa88-8ed2f271b172'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:53.831531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] The token cache is being invalidate because project d12f5f2c7f674336b9cba132bfd5816e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:53.831919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:53.832579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8a456555-e77f-451c-aa88-8ed2f271b172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:53.834209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3151/6295] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:53 2022] DELETE /identity/v3/projects/d12f5f2c7f674336b9cba132bfd5816e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:53.839514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f48338-895e-46dc-b3ef-49eae28fdb78 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:53.846581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f48338-895e-46dc-b3ef-49eae28fdb78 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:53.846581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f48338-895e-46dc-b3ef-49eae28fdb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:53.868644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d3f48338-895e-46dc-b3ef-49eae28fdb78 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:53.869967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3f48338-895e-46dc-b3ef-49eae28fdb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:53.881121 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3152/6296] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:53.889099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91114b4-04b3-4641-99f5-6d1ab4c1fd9b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:53.891507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91114b4-04b3-4641-99f5-6d1ab4c1fd9b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:53.891507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91114b4-04b3-4641-99f5-6d1ab4c1fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:53.939144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e91114b4-04b3-4641-99f5-6d1ab4c1fd9b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:53.941678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e91114b4-04b3-4641-99f5-6d1ab4c1fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:53.955834 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3153/6297] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:53.963222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91114b4-04b3-4641-99f5-6d1ab4c1fd9b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:53.980206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91114b4-04b3-4641-99f5-6d1ab4c1fd9b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:53.988691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:53.993239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:53.993239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:53.993239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:53.993239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:53.993239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:53.996061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:54.010119 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3154/6298] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:54.014688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:54.040676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b909a-93ac-4c51-99e2-22394705f512 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:54.052277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55429a696dfc4bab825924efd18993d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:54.053063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55429a696dfc4bab825924efd18993d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:54.055817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:54.056482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.056947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.057108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.057827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:54.060132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:54.160783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55429a696dfc4bab825924efd18993d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:54.161416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55429a696dfc4bab825924efd18993d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:54.173138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-63c0ce2c-a270-49c5-a0da-2000a9243b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55429a696dfc4bab825924efd18993d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:54.175706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3155/6299] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:54 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:52:54.180800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:54.182650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:54.195678 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3145/6300] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:52:53 2022] DELETE /identity/v3/users/55429a696dfc4bab825924efd18993d0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:54.200992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.201976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.202707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.240563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:54.250257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:54.305389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d8bbc-f7e5-42c1-98f6-47b7475be1e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:54.411904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:54.413334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.414391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.414927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.415767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:54.417933 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3146/6301] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:54.418522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:54.435364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:54.437788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:54.545015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3156/6302] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:54 2022] POST /identity/v3/users => generated 288 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:52:54.553474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:54.574450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc675ab-269a-419b-860f-ccb87071229b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:54.588632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:54.590783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.591895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.592718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.594159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:54.598307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:54.632754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2b5aa-9144-4889-8171-de539b2d7270 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:54.633975 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3157/6303] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:52:54.635728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:54.659188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:54.659827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.660111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.660382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.681974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62050-9909-4f4b-b288-b5f4adacfd13 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:54.682331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:54.682331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:54.689714 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3147/6304] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:52:54.696464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78553c3a-5d5d-4caa-ba57-df3b2e260015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:54.697223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78553c3a-5d5d-4caa-ba57-df3b2e260015 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.697614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78553c3a-5d5d-4caa-ba57-df3b2e260015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.697982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78553c3a-5d5d-4caa-ba57-df3b2e260015 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.698790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78553c3a-5d5d-4caa-ba57-df3b2e260015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:54.700756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78553c3a-5d5d-4caa-ba57-df3b2e260015 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:54.714535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3158/6305] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:54.718496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:54.729616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44291f41-6a93-40d6-9c2e-35550fd43073 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:54.744708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:54.745524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.745906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.746492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] PATH_INFO: `/v3/projects/9b098cda0b5441289e48d0b46e23d347/users/83b4253ae6a2435a918108d022b0d078/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.768372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b098cda0b5441289e48d0b46e23d347, user_id=83b4253ae6a2435a918108d022b0d078, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:54.771807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:54.867716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3148/6306] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:54 2022] PUT /identity/v3/projects/9b098cda0b5441289e48d0b46e23d347/users/83b4253ae6a2435a918108d022b0d078/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:54.881040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:54.889645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:54.890393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:54.890933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:54.925893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:54.927072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:55.015959 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3159/6307] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:55.021422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:55.035331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43982c-b63b-473f-b088-cb57dc4b4df3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:55.041711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7a0e1-76b3-471a-901e-f969c7e5c934 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:55.042030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:55.042476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7a0e1-76b3-471a-901e-f969c7e5c934 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.042772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7a0e1-76b3-471a-901e-f969c7e5c934 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.043058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7a0e1-76b3-471a-901e-f969c7e5c934 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.044874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:55.145031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c277c-6819-425f-bf83-074fc9140b81 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:55.149972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:55.150651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.150936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.151216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] PATH_INFO: `/v3/projects/7174aebb77f64d5aaa4804eb7aaba3de` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.152358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7174aebb77f64d5aaa4804eb7aaba3de)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:55.154365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:55.165375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-56b7a0e1-76b3-471a-901e-f969c7e5c934 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:55.263026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3149/6308] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:52:55 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:55.309614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7174aebb77f64d5aaa4804eb7aaba3de', 'request_id': 'req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:55.316155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7174aebb77f64d5aaa4804eb7aaba3de', 'request_id': 'req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:55.410457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7174aebb77f64d5aaa4804eb7aaba3de', 'request_id': 'req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:55.422493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] The token cache is being invalidate because project 7174aebb77f64d5aaa4804eb7aaba3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:52:55.429122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:55.429122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f6218f5a-f65c-4696-9b80-5c3d79d2b9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:55.429122 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3160/6309] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:52:55 2022] DELETE /identity/v3/projects/7174aebb77f64d5aaa4804eb7aaba3de => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:55.430332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467828e1-11ef-4676-b5d0-1811304f275a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.430641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467828e1-11ef-4676-b5d0-1811304f275a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.430917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467828e1-11ef-4676-b5d0-1811304f275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.451004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-467828e1-11ef-4676-b5d0-1811304f275a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:55.452227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-467828e1-11ef-4676-b5d0-1811304f275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:55.522355 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3150/6310] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:55.529904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfc6de-a1c8-4802-946c-0b2e4beb0db3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.533287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfc6de-a1c8-4802-946c-0b2e4beb0db3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.533287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfc6de-a1c8-4802-946c-0b2e4beb0db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.551741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-81cfc6de-a1c8-4802-946c-0b2e4beb0db3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:55.552971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81cfc6de-a1c8-4802-946c-0b2e4beb0db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:55.565483 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3161/6311] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:55.570613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467828e1-11ef-4676-b5d0-1811304f275a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:55.583387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467828e1-11ef-4676-b5d0-1811304f275a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:55.590601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:55.591551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.591898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.592290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.593018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:52:55.593527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:55.595800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:55.610760 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3151/6312] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:52:55.615292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfc6de-a1c8-4802-946c-0b2e4beb0db3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:55.628402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfc6de-a1c8-4802-946c-0b2e4beb0db3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:55.634833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:55.635618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.642512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.642512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.642512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:55.642512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:55.743799 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3162/6313] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:52:55 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:52:55.754300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:55.757842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:55.769371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b210-d342-4586-acd0-654d85badbfd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:55.830912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:55.831421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.831698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.831967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.832608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:55.834851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:55.949482 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3152/6314] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:52:55 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:52:55.953357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:55.963760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea766b-e7bc-4ae4-a79e-e1439bbf7f58 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:55.968780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:55.969397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:55.969675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:55.969944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:55.970633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:55.972309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:55.984570 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3163/6315] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:55.987682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:55.998792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045bd13-aa0b-45a9-849f-481d6e888466 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:56.004021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d668bf-730c-4480-8dda-cde20c4f6d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:56.004672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d668bf-730c-4480-8dda-cde20c4f6d84 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.004952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d668bf-730c-4480-8dda-cde20c4f6d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.005224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d668bf-730c-4480-8dda-cde20c4f6d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.005883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d668bf-730c-4480-8dda-cde20c4f6d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:56.008994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d668bf-730c-4480-8dda-cde20c4f6d84 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:56.021501 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3153/6316] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:52:56.025598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:56.036840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06569d7-e14f-4365-9225-479edce6de98 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:56.044732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a52f2-b98e-4178-81c9-0620a1ebfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:56.046775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a52f2-b98e-4178-81c9-0620a1ebfc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.046775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a52f2-b98e-4178-81c9-0620a1ebfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.046775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a52f2-b98e-4178-81c9-0620a1ebfc8f admin admin] PATH_INFO: `/v3/projects/7079287d9a3c490a80fa1e932e0a45f6/users/30404f61542a4f3881ac822b70e2d7f9/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.065510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a52f2-b98e-4178-81c9-0620a1ebfc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7079287d9a3c490a80fa1e932e0a45f6, user_id=30404f61542a4f3881ac822b70e2d7f9, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:56.068694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a52f2-b98e-4178-81c9-0620a1ebfc8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:56.184673 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3164/6317] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:52:56 2022] PUT /identity/v3/projects/7079287d9a3c490a80fa1e932e0a45f6/users/30404f61542a4f3881ac822b70e2d7f9/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:56.195068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.195405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.195676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.243569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] MFA Rules not processed for user `30404f61542a4f3881ac822b70e2d7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:56.244871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:56.269028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645dfa-2f68-4a46-9657-1ba5d1505cbf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.269375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645dfa-2f68-4a46-9657-1ba5d1505cbf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.269605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645dfa-2f68-4a46-9657-1ba5d1505cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.294082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5d645dfa-2f68-4a46-9657-1ba5d1505cbf None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:56.295785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d645dfa-2f68-4a46-9657-1ba5d1505cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:56.299552 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3165/6318] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:56 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:52:56.304737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5e0ad-26ea-4533-929c-98e8d3618b54 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.305022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5e0ad-26ea-4533-929c-98e8d3618b54 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.305580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5e0ad-26ea-4533-929c-98e8d3618b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.332675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bdc5e0ad-26ea-4533-929c-98e8d3618b54 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:56.334669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bdc5e0ad-26ea-4533-929c-98e8d3618b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:56.336936 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3154/6319] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:56.350266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:56.351858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:56.419334 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3166/6320] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:56.423875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5e0ad-26ea-4533-929c-98e8d3618b54 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:56.434516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5e0ad-26ea-4533-929c-98e8d3618b54 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:56.438619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fe3eb-658f-4dda-b2b9-5a13879082ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:56.442464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:56.442464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.442464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.442934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.443031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:56.443133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.443405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.443704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.459406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:56.461016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:56.471528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3155/6321] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:52:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:52:56.490770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:52:56.498485 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 13:52:56.505665 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:52:56.506767 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3167/6322] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:52:56 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 188 bytes in 76 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:52:56.508561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:56.518532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d4165-e71a-429e-8fa0-187e81c1eacb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:56.522758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0ab91-6dcc-41ac-b5e7-d49174996e46 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:56.523907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ab91-6dcc-41ac-b5e7-d49174996e46 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.524193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ab91-6dcc-41ac-b5e7-d49174996e46 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.524469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0ab91-6dcc-41ac-b5e7-d49174996e46 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.562400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:56.564423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-5cc0ab91-6dcc-41ac-b5e7-d49174996e46 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:52:56.566856 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 13:52:56.575372 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:52:56.576644 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3156/6323] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:52:56 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 188 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:52:56.576644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0ab91-6dcc-41ac-b5e7-d49174996e46 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:56.583597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0ab91-6dcc-41ac-b5e7-d49174996e46 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:56.588966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703eaf6-8cdc-438b-b180-5d332b649f8f tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:56.589745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703eaf6-8cdc-438b-b180-5d332b649f8f tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.590031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703eaf6-8cdc-438b-b180-5d332b649f8f tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.590342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703eaf6-8cdc-438b-b180-5d332b649f8f tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.687643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade85cd5-3a20-4b85-9b31-a68e2437a05e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:56.698782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15eee7-19fb-4730-bd91-20069e27f55b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:56.699980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15eee7-19fb-4730-bd91-20069e27f55b service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:56.699980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15eee7-19fb-4730-bd91-20069e27f55b service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:56.700144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15eee7-19fb-4730-bd91-20069e27f55b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:56.704289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb15eee7-19fb-4730-bd91-20069e27f55b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:56.729342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2703eaf6-8cdc-438b-b180-5d332b649f8f tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:56.779107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15eee7-19fb-4730-bd91-20069e27f55b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:52:56.780776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15eee7-19fb-4730-bd91-20069e27f55b service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:52:56.790086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3168/6324] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:52:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:52:56.908349 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3157/6325] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:52:56 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:52:57.321167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:57.385055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb8eb-b271-49e0-963e-90d4c8eba99f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:57.385334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb8eb-b271-49e0-963e-90d4c8eba99f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:57.385644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb8eb-b271-49e0-963e-90d4c8eba99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:57.404903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ab9eb8eb-b271-49e0-963e-90d4c8eba99f None None] MFA Rules not processed for user `76a7e384b7514d4aa79cbe2154747ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:57.406239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ab9eb8eb-b271-49e0-963e-90d4c8eba99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:57.469482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3169/6326] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:57.912251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ec82-6715-41f2-a842-595e07e0f681 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:57.912807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ec82-6715-41f2-a842-595e07e0f681 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:57.912807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ec82-6715-41f2-a842-595e07e0f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:57.954752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0852ec82-6715-41f2-a842-595e07e0f681 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:57.956153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0852ec82-6715-41f2-a842-595e07e0f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:57.961332 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3158/6327] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:52:57.965879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee770dc9-14b7-4d99-88b9-ba12674c1982 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:57.967030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee770dc9-14b7-4d99-88b9-ba12674c1982 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:57.967030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee770dc9-14b7-4d99-88b9-ba12674c1982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:57.988419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ee770dc9-14b7-4d99-88b9-ba12674c1982 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:57.989675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee770dc9-14b7-4d99-88b9-ba12674c1982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:57.997145 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3170/6328] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:52:58.001736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ec82-6715-41f2-a842-595e07e0f681 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:58.014161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ec82-6715-41f2-a842-595e07e0f681 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:58.019653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a853c7-764e-4623-b791-e004f63592eb tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:58.020305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a853c7-764e-4623-b791-e004f63592eb tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:58.020845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a853c7-764e-4623-b791-e004f63592eb tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:58.020845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a853c7-764e-4623-b791-e004f63592eb tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:58.187395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-50a853c7-764e-4623-b791-e004f63592eb tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:58.271580 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3159/6329] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:52:58 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:59.183646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:59.280844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02360-9eb8-48af-b4a3-160a981a6b05 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:59.280844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02360-9eb8-48af-b4a3-160a981a6b05 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:59.280844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02360-9eb8-48af-b4a3-160a981a6b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:59.307872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-10d02360-9eb8-48af-b4a3-160a981a6b05 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:59.310422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-10d02360-9eb8-48af-b4a3-160a981a6b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:59.320206 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3171/6330] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:52:59.322302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cba7e-e88d-4143-b68b-b3c759bbd445 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:59.322969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cba7e-e88d-4143-b68b-b3c759bbd445 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:59.323101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cba7e-e88d-4143-b68b-b3c759bbd445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:59.365870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ef5cba7e-e88d-4143-b68b-b3c759bbd445 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:52:59.368667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef5cba7e-e88d-4143-b68b-b3c759bbd445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:52:59.401605 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3160/6331] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:52:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:52:59.408066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02360-9eb8-48af-b4a3-160a981a6b05 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:52:59.433610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02360-9eb8-48af-b4a3-160a981a6b05 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:52:59.439707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d24d2f-a26e-4b8b-9428-bcd891d961fc tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:52:59.440801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d24d2f-a26e-4b8b-9428-bcd891d961fc tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:52:59.441313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d24d2f-a26e-4b8b-9428-bcd891d961fc tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:52:59.441758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d24d2f-a26e-4b8b-9428-bcd891d961fc tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:52:59.651407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a1d24d2f-a26e-4b8b-9428-bcd891d961fc tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:52:59.787020 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3172/6332] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:52:59 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:52:59.914464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:00.794035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197a50e-a2f3-4b08-88b5-09851e5c46b4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:00.794889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197a50e-a2f3-4b08-88b5-09851e5c46b4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:00.794889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197a50e-a2f3-4b08-88b5-09851e5c46b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:00.813825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b197a50e-a2f3-4b08-88b5-09851e5c46b4 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:00.815264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b197a50e-a2f3-4b08-88b5-09851e5c46b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:00.821151 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3161/6333] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:00 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:53:00.826455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967cc7-490c-41f6-8628-814c5e022abb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:00.828593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967cc7-490c-41f6-8628-814c5e022abb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:00.829015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967cc7-490c-41f6-8628-814c5e022abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:00.859908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e1967cc7-490c-41f6-8628-814c5e022abb None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:00.861201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1967cc7-490c-41f6-8628-814c5e022abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:00.871755 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3173/6334] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:00.874220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197a50e-a2f3-4b08-88b5-09851e5c46b4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:00.888416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197a50e-a2f3-4b08-88b5-09851e5c46b4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:00.892615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade01e6c-e446-4679-98c6-84369f6e9a31 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:00.893327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade01e6c-e446-4679-98c6-84369f6e9a31 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:00.893612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade01e6c-e446-4679-98c6-84369f6e9a31 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:00.893903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade01e6c-e446-4679-98c6-84369f6e9a31 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:01.033516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ade01e6c-e446-4679-98c6-84369f6e9a31 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:01.142942 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3162/6335] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:53:00 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:01.304650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:02.146231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567564a-2927-4065-a5ca-b54a171bbee2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:02.146878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567564a-2927-4065-a5ca-b54a171bbee2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:02.147242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567564a-2927-4065-a5ca-b54a171bbee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:02.173423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d567564a-2927-4065-a5ca-b54a171bbee2 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:02.174971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d567564a-2927-4065-a5ca-b54a171bbee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:02.178174 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3174/6336] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:53:03.184730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc5d4-fdaa-49aa-8d79-72cd39274dfa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:03.185615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc5d4-fdaa-49aa-8d79-72cd39274dfa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:03.186221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bc5d4-fdaa-49aa-8d79-72cd39274dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:03.216166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e8bc5d4-fdaa-49aa-8d79-72cd39274dfa None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:03.217976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e8bc5d4-fdaa-49aa-8d79-72cd39274dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:03.234404 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3163/6337] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:03.236323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a587e-c303-4179-aff8-48cafeb03653 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:03.236793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a587e-c303-4179-aff8-48cafeb03653 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:03.237058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a587e-c303-4179-aff8-48cafeb03653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:03.266131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0c8a587e-c303-4179-aff8-48cafeb03653 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:03.267608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c8a587e-c303-4179-aff8-48cafeb03653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:03.271573 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3175/6338] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:53:03.276162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2473-0c47-49e4-a957-dee734eba590 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:03.281551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2473-0c47-49e4-a957-dee734eba590 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:03.281551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2473-0c47-49e4-a957-dee734eba590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:03.407817 n-d-858383-13 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-93cb2473-0c47-49e4-a957-dee734eba590 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 13:53:03.411106 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3164/6339] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:03 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 136 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 18 13:53:03.416205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe17cf-fd4a-4590-8b94-2b9ce73cadc2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:03.416446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe17cf-fd4a-4590-8b94-2b9ce73cadc2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:03.416980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe17cf-fd4a-4590-8b94-2b9ce73cadc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:03.615256 n-d-858383-13 devstack@keystone.service[82160]: WARNING keystone.server.flask.application [None req-83fe17cf-fd4a-4590-8b94-2b9ce73cadc2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 13:53:03.618977 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3176/6340] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:03 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 204 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 18 13:53:03.623531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c154-eb77-4b78-97a3-06eb98c18e5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:03.624025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c154-eb77-4b78-97a3-06eb98c18e5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:03.624452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686c154-eb77-4b78-97a3-06eb98c18e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:03.649242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:UPDATE=4,keystone:INSERT=6,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:03.663935 n-d-858383-13 devstack@keystone.service[82161]: WARNING keystone.server.flask.application [None req-d686c154-eb77-4b78-97a3-06eb98c18e5f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 13:53:03.665883 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3165/6341] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:03 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 43 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 18 13:53:13.606010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=19,keystone:INSERT=1,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:13.852205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe17cf-fd4a-4590-8b94-2b9ce73cadc2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:13.855528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-83fe17cf-fd4a-4590-8b94-2b9ce73cadc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:14.020674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe17cf-fd4a-4590-8b94-2b9ce73cadc2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:14.027465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416063d-5bef-473d-9aaf-3be0a08ced0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:14.028277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416063d-5bef-473d-9aaf-3be0a08ced0b service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:14.028619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416063d-5bef-473d-9aaf-3be0a08ced0b service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:14.029221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416063d-5bef-473d-9aaf-3be0a08ced0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:14.031802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f416063d-5bef-473d-9aaf-3be0a08ced0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:14.049756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416063d-5bef-473d-9aaf-3be0a08ced0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:14.055915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416063d-5bef-473d-9aaf-3be0a08ced0b service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:14.075732 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3177/6342] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:14.659340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c154-eb77-4b78-97a3-06eb98c18e5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:14.661984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d686c154-eb77-4b78-97a3-06eb98c18e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:14.678098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686c154-eb77-4b78-97a3-06eb98c18e5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:14.682984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638efba-b110-4183-9f66-fca2a4ab88e3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:14.682984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638efba-b110-4183-9f66-fca2a4ab88e3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:14.682984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638efba-b110-4183-9f66-fca2a4ab88e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:14.683653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:14.683769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:14.684103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:14.684388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:14.686407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:14.701124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:14.703364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:14.739392 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3166/6343] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:53:14.832111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7638efba-b110-4183-9f66-fca2a4ab88e3 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:14.833331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7638efba-b110-4183-9f66-fca2a4ab88e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:14.837227 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3178/6344] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:14 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:53:14.842851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:14.854592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44d601-85a5-4f34-8620-6e770f4b7c58 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:14.859149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3efe1-a368-4f9f-ba89-435088b7ea37 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:14.860004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3efe1-a368-4f9f-ba89-435088b7ea37 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:14.860283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3efe1-a368-4f9f-ba89-435088b7ea37 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:14.866188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3efe1-a368-4f9f-ba89-435088b7ea37 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:14.984334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38b3efe1-a368-4f9f-ba89-435088b7ea37 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:15.070336 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3167/6345] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:53:14 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:15.483568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638efba-b110-4183-9f66-fca2a4ab88e3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:15.498140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638efba-b110-4183-9f66-fca2a4ab88e3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:15.503158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd462762-3902-41cc-9514-1704b76ecf69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:15.503779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462762-3902-41cc-9514-1704b76ecf69 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:15.504287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462762-3902-41cc-9514-1704b76ecf69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:15.504564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd462762-3902-41cc-9514-1704b76ecf69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:15.506427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd462762-3902-41cc-9514-1704b76ecf69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:15.591225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd462762-3902-41cc-9514-1704b76ecf69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:15.592722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd462762-3902-41cc-9514-1704b76ecf69 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:15.610270 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3179/6346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:15.946413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3efe1-a368-4f9f-ba89-435088b7ea37 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:16.027706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3efe1-a368-4f9f-ba89-435088b7ea37 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:16.032502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:16.033142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.033424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.033703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] PATH_INFO: `/v3/users/30404f61542a4f3881ac822b70e2d7f9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.034884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=30404f61542a4f3881ac822b70e2d7f9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:16.036915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:16.075351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15a1b-4640-47f8-81a5-bbdab7868559 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.075863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15a1b-4640-47f8-81a5-bbdab7868559 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.075985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15a1b-4640-47f8-81a5-bbdab7868559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.096992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c9e15a1b-4640-47f8-81a5-bbdab7868559 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:16.098130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9e15a1b-4640-47f8-81a5-bbdab7868559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:16.101255 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3180/6347] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:16 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:53:16.105638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f289a6-2816-4e44-b4bd-6e22a86c457c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.105926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f289a6-2816-4e44-b4bd-6e22a86c457c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.106256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f289a6-2816-4e44-b4bd-6e22a86c457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-18f289a6-2816-4e44-b4bd-6e22a86c457c None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 18 13:53:16.131219 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:53:16.133034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:53:16.134262 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3181/6348] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:16 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:53:16.138633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21935-f319-402c-bbeb-a0a47b035028 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.139101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21935-f319-402c-bbeb-a0a47b035028 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.141090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21935-f319-402c-bbeb-a0a47b035028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.302524 n-d-858383-13 devstack@keystone.service[82160]: WARNING keystone.server.flask.application [None req-a3c21935-f319-402c-bbeb-a0a47b035028 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.27: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 13:53:16.305615 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3182/6349] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:16 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 168 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 18 13:53:16.310263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0421-f60d-4bd9-8d83-29154b27d120 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.310972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0421-f60d-4bd9-8d83-29154b27d120 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.311261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c0421-f60d-4bd9-8d83-29154b27d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.318922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30404f61542a4f3881ac822b70e2d7f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:16.321495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30404f61542a4f3881ac822b70e2d7f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:16.411561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30404f61542a4f3881ac822b70e2d7f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:16.412191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30404f61542a4f3881ac822b70e2d7f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:16.421753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-32d31ee8-99de-4de3-b4ed-b9696c5fa6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30404f61542a4f3881ac822b70e2d7f9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:16.446539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3168/6350] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:15 2022] DELETE /identity/v3/users/30404f61542a4f3881ac822b70e2d7f9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:16.452455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.452890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.453285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.482820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:16.484159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:16.486736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-500c0421-f60d-4bd9-8d83-29154b27d120 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:16.487916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-500c0421-f60d-4bd9-8d83-29154b27d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:16.498797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:UPDATE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:16.508293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:16.578791 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3169/6351] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:16.589397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:16.589397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:16.595794 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3183/6352] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:16.600440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c0421-f60d-4bd9-8d83-29154b27d120 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:16.610817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c0421-f60d-4bd9-8d83-29154b27d120 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:16.616069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc436e-9879-45c3-b588-0f02be73ce80 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:16.616783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc436e-9879-45c3-b588-0f02be73ce80 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.618496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc436e-9879-45c3-b588-0f02be73ce80 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.618912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc436e-9879-45c3-b588-0f02be73ce80 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.656214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe6d0a-b249-46e1-833a-c86e0460f710 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:16.660421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:16.661286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:16.661746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:16.662329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:16.674840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:16.676310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:16.687851 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3170/6353] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:53:16.761218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5fc436e-9879-45c3-b588-0f02be73ce80 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:16.873280 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3184/6354] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:53:16 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:16.965209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:16.968103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:17.015570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d837-c79d-4f02-b6ad-e517ea77b3b1 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:17.030839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:17.031727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.032141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.032511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] PATH_INFO: `/v3/projects/7079287d9a3c490a80fa1e932e0a45f6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.033894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7079287d9a3c490a80fa1e932e0a45f6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:17.036750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:17.172302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7079287d9a3c490a80fa1e932e0a45f6', 'request_id': 'req-6b86f3f9-930d-4517-b6f2-10ad3e44902c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:17.180018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7079287d9a3c490a80fa1e932e0a45f6', 'request_id': 'req-6b86f3f9-930d-4517-b6f2-10ad3e44902c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:17.291394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7079287d9a3c490a80fa1e932e0a45f6', 'request_id': 'req-6b86f3f9-930d-4517-b6f2-10ad3e44902c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:17.303174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] The token cache is being invalidate because project 7079287d9a3c490a80fa1e932e0a45f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:17.303673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:17.304298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6b86f3f9-930d-4517-b6f2-10ad3e44902c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:17.305864 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3171/6355] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:16 2022] DELETE /identity/v3/projects/7079287d9a3c490a80fa1e932e0a45f6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:17.310815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917edbe-a05c-41e0-8f89-caf7662dab28 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.311309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917edbe-a05c-41e0-8f89-caf7662dab28 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.311442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917edbe-a05c-41e0-8f89-caf7662dab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.332977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d917edbe-a05c-41e0-8f89-caf7662dab28 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:17.334246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d917edbe-a05c-41e0-8f89-caf7662dab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:17.404864 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3185/6356] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:17.414701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620991c-8e2c-4beb-8e64-fc0ff1a539b2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.415025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620991c-8e2c-4beb-8e64-fc0ff1a539b2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.415286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620991c-8e2c-4beb-8e64-fc0ff1a539b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.445425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8620991c-8e2c-4beb-8e64-fc0ff1a539b2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:17.446823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8620991c-8e2c-4beb-8e64-fc0ff1a539b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:17.460416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3172/6357] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:17.460932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917edbe-a05c-41e0-8f89-caf7662dab28 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:17.483170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917edbe-a05c-41e0-8f89-caf7662dab28 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:17.495965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:17.497026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.498238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.498735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.499840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:53:17.501034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:17.503671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:17.531936 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3186/6358] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:53:17.533358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620991c-8e2c-4beb-8e64-fc0ff1a539b2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:17.545802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620991c-8e2c-4beb-8e64-fc0ff1a539b2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:17.550446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:17.551080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.551361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.551648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.552272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:17.554982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:17.670168 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3173/6359] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:17 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:17.674017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:17.685307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c5abd-d692-42f9-9765-413f6449a5cf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:17.745635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f04cb-fb94-4bd5-8a7c-9e64b4f2a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:17.746204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f04cb-fb94-4bd5-8a7c-9e64b4f2a0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.746984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f04cb-fb94-4bd5-8a7c-9e64b4f2a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.747807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f04cb-fb94-4bd5-8a7c-9e64b4f2a0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.747963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f04cb-fb94-4bd5-8a7c-9e64b4f2a0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:17.749978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f04cb-fb94-4bd5-8a7c-9e64b4f2a0f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:17.850988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:17.859931 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3187/6360] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:17 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:17.864184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:17.880083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76857ced-7335-48f0-9791-8f480ec0baf3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.880700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76857ced-7335-48f0-9791-8f480ec0baf3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.887935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76857ced-7335-48f0-9791-8f480ec0baf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.888110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e9bae-89c5-45ed-b3e4-da9fbae37c12 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:17.914637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:17.915342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.915691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.916027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.916751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:17.920725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:17.927441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-76857ced-7335-48f0-9791-8f480ec0baf3 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:17.929804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76857ced-7335-48f0-9791-8f480ec0baf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:17.935534 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3188/6361] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:17 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 13:53:17.940016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf15c3-28ff-4fef-95b6-9173feebd176 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.940480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf15c3-28ff-4fef-95b6-9173feebd176 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.941644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf15c3-28ff-4fef-95b6-9173feebd176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.942932 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3174/6362] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:17.947610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:17.968419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab27e-dbef-44cc-81ba-308335899e56 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:17.976196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-26cf15c3-28ff-4fef-95b6-9173feebd176 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:17.977781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-26cf15c3-28ff-4fef-95b6-9173feebd176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:17.982516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:17.984692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:17.985576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:17.986492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:17.988425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:17.990115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:18.021287 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3175/6363] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:18.023986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:18.040305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:18.050475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254c791-e762-4a9e-850e-e92d8127922b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:18.058040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92117e-6e2b-4811-9da0-8a215cc8da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:18.058879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92117e-6e2b-4811-9da0-8a215cc8da8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:18.059321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92117e-6e2b-4811-9da0-8a215cc8da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:18.059841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92117e-6e2b-4811-9da0-8a215cc8da8e admin admin] PATH_INFO: `/v3/projects/43447a94f3e643048fab617578cef499/users/5b88ed9e06b149d2a98b1fe7181ef488/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:18.083538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92117e-6e2b-4811-9da0-8a215cc8da8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43447a94f3e643048fab617578cef499, user_id=5b88ed9e06b149d2a98b1fe7181ef488, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:18.086992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92117e-6e2b-4811-9da0-8a215cc8da8e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:18.097394 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3189/6364] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:18.102426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf15c3-28ff-4fef-95b6-9173feebd176 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:18.112742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf15c3-28ff-4fef-95b6-9173feebd176 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:18.118198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:18.130142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:18.130801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:18.131245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:18.225993 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3176/6365] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:18 2022] PUT /identity/v3/projects/43447a94f3e643048fab617578cef499/users/5b88ed9e06b149d2a98b1fe7181ef488/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:18.237592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672083e9-92ed-4c57-adcc-5e0fe2113f1c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:18.238527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672083e9-92ed-4c57-adcc-5e0fe2113f1c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:18.239483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672083e9-92ed-4c57-adcc-5e0fe2113f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:18.273783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:18.315232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-672083e9-92ed-4c57-adcc-5e0fe2113f1c None None] MFA Rules not processed for user `5b88ed9e06b149d2a98b1fe7181ef488`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:18.316714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-672083e9-92ed-4c57-adcc-5e0fe2113f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:18.377309 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3190/6366] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:53:18 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:18.478019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3177/6367] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:18.488775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:18.491335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:18.568512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad6b1d-c3fd-4ed7-9476-4e4795d27e82 tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:18.639262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f0b6-ad0a-4c56-8569-fa16a9ec6449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:18.639893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f0b6-ad0a-4c56-8569-fa16a9ec6449 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:18.640415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f0b6-ad0a-4c56-8569-fa16a9ec6449 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:18.640696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f0b6-ad0a-4c56-8569-fa16a9ec6449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:18.657210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f0b6-ad0a-4c56-8569-fa16a9ec6449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:18.659527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f0b6-ad0a-4c56-8569-fa16a9ec6449 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:18.675955 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3191/6368] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:18.695531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672083e9-92ed-4c57-adcc-5e0fe2113f1c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:18.793308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672083e9-92ed-4c57-adcc-5e0fe2113f1c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:18.798140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:18.798807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:18.799085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:18.799356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] PATH_INFO: `/v3/users/5b88ed9e06b149d2a98b1fe7181ef488` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:18.800524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b88ed9e06b149d2a98b1fe7181ef488)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:18.802532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:19.063217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b88ed9e06b149d2a98b1fe7181ef488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:19.064007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b88ed9e06b149d2a98b1fe7181ef488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:19.132714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b88ed9e06b149d2a98b1fe7181ef488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:19.134567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b88ed9e06b149d2a98b1fe7181ef488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:19.144416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b88ed9e06b149d2a98b1fe7181ef488'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:19.150776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:19.164621 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3178/6369] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:18 2022] DELETE /identity/v3/users/5b88ed9e06b149d2a98b1fe7181ef488 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:19.170555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825e03-bc7f-4f08-9874-b9cb7eb0dd5e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:19.171059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825e03-bc7f-4f08-9874-b9cb7eb0dd5e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:19.171593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5825e03-bc7f-4f08-9874-b9cb7eb0dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:19.194889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a5825e03-bc7f-4f08-9874-b9cb7eb0dd5e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:19.196178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a5825e03-bc7f-4f08-9874-b9cb7eb0dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:19.215874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:19.268891 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3192/6370] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:19.278650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:19.280162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:19.349775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ddebf-2f29-446b-8ce8-87d3cdc772d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:19.353819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662caad-f8c0-40d2-8816-59083def8f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:19.354720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662caad-f8c0-40d2-8816-59083def8f63 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:19.355005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662caad-f8c0-40d2-8816-59083def8f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:19.355369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662caad-f8c0-40d2-8816-59083def8f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:19.366663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662caad-f8c0-40d2-8816-59083def8f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:19.368274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662caad-f8c0-40d2-8816-59083def8f63 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:19.379658 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3179/6371] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:19.383567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373bc12-e256-4df8-a258-2ba01fb7921c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:19.386789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373bc12-e256-4df8-a258-2ba01fb7921c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:19.386789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373bc12-e256-4df8-a258-2ba01fb7921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:19.405770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a373bc12-e256-4df8-a258-2ba01fb7921c None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:19.410107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a373bc12-e256-4df8-a258-2ba01fb7921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:19.414703 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3193/6372] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:19 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:53:19.416262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:19.416573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:19.416848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:19.439088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:19.440325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:19.547600 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3180/6373] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:19.551785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373bc12-e256-4df8-a258-2ba01fb7921c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:19.572681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373bc12-e256-4df8-a258-2ba01fb7921c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:19.577601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdc063-35ca-4697-ad6d-09a273f9963e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83b4253ae6a2435a918108d022b0d078', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b098cda0b5441289e48d0b46e23d347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:19.582377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc063-35ca-4697-ad6d-09a273f9963e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:19.582377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc063-35ca-4697-ad6d-09a273f9963e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:19.582377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdc063-35ca-4697-ad6d-09a273f9963e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078/password` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:19.713865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-65bdc063-35ca-4697-ad6d-09a273f9963e tempest-IdentityV3UsersTest-1774981333 tempest-IdentityV3UsersTest-1774981333-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:19.797004 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3194/6374] 10.222.0.27 () {60 vars in 1269 bytes} [Tue Oct 18 13:53:19 2022] POST /identity/v3/users/83b4253ae6a2435a918108d022b0d078/password => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:20.056268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:20.058868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:20.086195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec1723-7630-475a-a568-fc4ea2d04d58 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:20.091893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:20.092620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:20.092903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:20.093182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] PATH_INFO: `/v3/projects/43447a94f3e643048fab617578cef499` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:20.094440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43447a94f3e643048fab617578cef499)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:20.096623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:20.226268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43447a94f3e643048fab617578cef499', 'request_id': 'req-2027def9-b786-4555-bd92-2a8d8482664b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:20.235235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43447a94f3e643048fab617578cef499', 'request_id': 'req-2027def9-b786-4555-bd92-2a8d8482664b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:20.388668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43447a94f3e643048fab617578cef499', 'request_id': 'req-2027def9-b786-4555-bd92-2a8d8482664b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:20.400560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] The token cache is being invalidate because project 43447a94f3e643048fab617578cef499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:20.400864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:20.401537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2027def9-b786-4555-bd92-2a8d8482664b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:20.407306 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3181/6375] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:20 2022] DELETE /identity/v3/projects/43447a94f3e643048fab617578cef499 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:20.408193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f916-2e41-4a1c-8fcf-346bcf4f77cf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:20.408646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f916-2e41-4a1c-8fcf-346bcf4f77cf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:20.408872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f916-2e41-4a1c-8fcf-346bcf4f77cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:20.446394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c555f916-2e41-4a1c-8fcf-346bcf4f77cf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:20.452555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c555f916-2e41-4a1c-8fcf-346bcf4f77cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:20.556045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5b99-1254-4ee4-a334-5ec8668a2e73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:20.556416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5b99-1254-4ee4-a334-5ec8668a2e73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:20.556621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5b99-1254-4ee4-a334-5ec8668a2e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:20.559686 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3195/6376] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:20.582850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c52c5b99-1254-4ee4-a334-5ec8668a2e73 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:20.584193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c52c5b99-1254-4ee4-a334-5ec8668a2e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:20.595696 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3182/6377] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:20.607529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f916-2e41-4a1c-8fcf-346bcf4f77cf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:20.617981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f916-2e41-4a1c-8fcf-346bcf4f77cf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:20.622816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:20.623458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:20.623744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:20.624024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:20.624694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:53:20.625001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:20.626989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:20.642090 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3196/6378] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:53:20.644510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c5b99-1254-4ee4-a334-5ec8668a2e73 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:20.656802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c5b99-1254-4ee4-a334-5ec8668a2e73 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:20.662325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32abe0d-2f89-4b67-bae7-3f070673320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:20.663923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32abe0d-2f89-4b67-bae7-3f070673320a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:20.664190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32abe0d-2f89-4b67-bae7-3f070673320a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:20.664276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32abe0d-2f89-4b67-bae7-3f070673320a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:20.664961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32abe0d-2f89-4b67-bae7-3f070673320a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:20.666907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32abe0d-2f89-4b67-bae7-3f070673320a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:20.677638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:20.784592 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3183/6379] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:20 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:20.789375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:20.815312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbcc1d-6c67-4a95-a366-730d72371fce None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:20.818002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbcc1d-6c67-4a95-a366-730d72371fce None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:20.820207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c11bd5-a437-4904-a20a-74d8b44eb88d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:20.820485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbcc1d-6c67-4a95-a366-730d72371fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:20.869035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cefbcc1d-6c67-4a95-a366-730d72371fce None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:20.871868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cefbcc1d-6c67-4a95-a366-730d72371fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:20.893132 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3184/6380] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:20 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 13:53:20.961676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:20.962540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:20.962908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:20.963269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:20.964009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:20.966583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:21.068014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:21.082336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbcc1d-6c67-4a95-a366-730d72371fce None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:21.086709 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3197/6381] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:20 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:21.096939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbcc1d-6c67-4a95-a366-730d72371fce None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:21.106223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:21.106963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:21.107261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:21.107646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:21.108283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:21.109912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:21.123204 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3185/6382] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:21.127417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:21.148339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb282a7-c309-4764-971a-49a743e24a99 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:21.154175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe00b-f38a-416c-9eb3-63c7f7a9a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:21.154822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe00b-f38a-416c-9eb3-63c7f7a9a73a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:21.155102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe00b-f38a-416c-9eb3-63c7f7a9a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:21.155377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe00b-f38a-416c-9eb3-63c7f7a9a73a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:21.156035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffe00b-f38a-416c-9eb3-63c7f7a9a73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:21.160007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffe00b-f38a-416c-9eb3-63c7f7a9a73a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:21.175635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3198/6383] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:21.177188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:21.188513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f2662-d9c8-41e0-9e09-39b4fa36c632 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:21.195851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:21.196554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:21.196845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:21.199157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] PATH_INFO: `/v3/projects/9fa5b71dffe04987ba03ade40ecaa19e/users/95f56adb596d49b2abbfb8961d55aaf7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:21.215872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa5b71dffe04987ba03ade40ecaa19e, user_id=95f56adb596d49b2abbfb8961d55aaf7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:21.218668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:21.340041 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3186/6384] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:21 2022] PUT /identity/v3/projects/9fa5b71dffe04987ba03ade40ecaa19e/users/95f56adb596d49b2abbfb8961d55aaf7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:21.352104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcdb7c-c0db-4487-a375-a5a899bd2588 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:21.352403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcdb7c-c0db-4487-a375-a5a899bd2588 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:21.353167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcdb7c-c0db-4487-a375-a5a899bd2588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:21.400989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e4fcdb7c-c0db-4487-a375-a5a899bd2588 None None] MFA Rules not processed for user `95f56adb596d49b2abbfb8961d55aaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:21.402521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e4fcdb7c-c0db-4487-a375-a5a899bd2588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:21.514702 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3199/6385] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:21.535080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:21.542689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:21.631836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420af9-2b1e-451a-93a4-6ff9ef59d542 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:21.641547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7fca9-05ff-49a2-bfdb-bcbbee30adf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:21.643049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fca9-05ff-49a2-bfdb-bcbbee30adf2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:21.643049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fca9-05ff-49a2-bfdb-bcbbee30adf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:21.643049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fca9-05ff-49a2-bfdb-bcbbee30adf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:21.662582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7fca9-05ff-49a2-bfdb-bcbbee30adf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:21.664954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7fca9-05ff-49a2-bfdb-bcbbee30adf2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:21.676241 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3187/6386] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:53:21.695840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcdb7c-c0db-4487-a375-a5a899bd2588 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:21.838631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcdb7c-c0db-4487-a375-a5a899bd2588 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:21.847160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:21.848720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:21.849222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:21.849700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] PATH_INFO: `/v3/users/95f56adb596d49b2abbfb8961d55aaf7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:21.851746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f56adb596d49b2abbfb8961d55aaf7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:21.854108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:21.893886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:21.894858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:21.896185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:21.940369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] MFA Rules not processed for user `83b4253ae6a2435a918108d022b0d078`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:21.941770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:22.041430 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3188/6387] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:22.050530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:22.052392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:22.076376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa087b-b0aa-482b-9aa4-e3b4fb92c5cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:22.082099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f56adb596d49b2abbfb8961d55aaf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.087764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:22.088764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:22.089255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:22.089692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] PATH_INFO: `/v3/users/83b4253ae6a2435a918108d022b0d078` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:22.091807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b4253ae6a2435a918108d022b0d078)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:22.104649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f56adb596d49b2abbfb8961d55aaf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.105995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f56adb596d49b2abbfb8961d55aaf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.115047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:22.146170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f56adb596d49b2abbfb8961d55aaf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.157605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:22.248436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3487a143-7370-4fee-b743-10fb91e6e850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f56adb596d49b2abbfb8961d55aaf7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.256055 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3200/6388] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:21 2022] DELETE /identity/v3/users/95f56adb596d49b2abbfb8961d55aaf7 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:22.261851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:22.262344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:22.262502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:22.312326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:22.317040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:22.436452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.438168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.442526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:22.481946 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3201/6389] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:22.496920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:22.498490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:22.535894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.537302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.556649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c6a940a-36b3-4a7c-93db-8d72986fb67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b4253ae6a2435a918108d022b0d078'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:22.596452 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3189/6390] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:22 2022] DELETE /identity/v3/users/83b4253ae6a2435a918108d022b0d078 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:22.598737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb30de-a96c-4862-8033-f06f607ad0e1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:22.598737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb30de-a96c-4862-8033-f06f607ad0e1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:22.599186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb30de-a96c-4862-8033-f06f607ad0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:22.667554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bceb30de-a96c-4862-8033-f06f607ad0e1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:22.668195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bceb30de-a96c-4862-8033-f06f607ad0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:22.680152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a93ae-7226-4ffb-9f09-4599831dcf60 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:22.805554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:22.806782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:22.807131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:22.807468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:22.860863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3190/6391] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:22.871882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb30de-a96c-4862-8033-f06f607ad0e1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:22.893664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb30de-a96c-4862-8033-f06f607ad0e1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:22.906673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:22.907944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:22.909000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:22.909464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:22.931541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:23.042033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:23.043471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:23.043471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:23.043888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3191/6392] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:53:23.044109 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3202/6393] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:53:23.762688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:23.764195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:23.777874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56ad8e-6c5e-4247-adc5-f5fc9c62afd2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:23.799451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:23.800116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:23.800395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:23.800673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] PATH_INFO: `/v3/projects/9fa5b71dffe04987ba03ade40ecaa19e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:23.803075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa5b71dffe04987ba03ade40ecaa19e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:23.804352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:23.806422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:23.807158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:23.822785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:23.828373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88423262-9a31-4989-ad20-90bd8107e9a9 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:23.835538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:23.836597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:23.838282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:23.838726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] PATH_INFO: `/v3/projects/9b098cda0b5441289e48d0b46e23d347` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:23.840648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b098cda0b5441289e48d0b46e23d347)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:23.843764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:23.955036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa5b71dffe04987ba03ade40ecaa19e', 'request_id': 'req-f9351766-e62f-49cd-ad6a-421f518fcfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:23.977466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa5b71dffe04987ba03ade40ecaa19e', 'request_id': 'req-f9351766-e62f-49cd-ad6a-421f518fcfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:23.989238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b098cda0b5441289e48d0b46e23d347', 'request_id': 'req-5979a9de-869e-47e1-8843-56c91946b1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:23.996955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b098cda0b5441289e48d0b46e23d347', 'request_id': 'req-5979a9de-869e-47e1-8843-56c91946b1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:24.069496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa5b71dffe04987ba03ade40ecaa19e', 'request_id': 'req-f9351766-e62f-49cd-ad6a-421f518fcfe0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:24.081943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] The token cache is being invalidate because project 9fa5b71dffe04987ba03ade40ecaa19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:24.082291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:24.082986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9351766-e62f-49cd-ad6a-421f518fcfe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:24.085720 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3192/6394] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:23 2022] DELETE /identity/v3/projects/9fa5b71dffe04987ba03ade40ecaa19e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:24.091768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfe7ff-60e2-4de1-9bc5-80d1d77bcb0f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.092179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfe7ff-60e2-4de1-9bc5-80d1d77bcb0f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.092688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfe7ff-60e2-4de1-9bc5-80d1d77bcb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.125358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ccfe7ff-60e2-4de1-9bc5-80d1d77bcb0f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:24.126865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ccfe7ff-60e2-4de1-9bc5-80d1d77bcb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:24.176489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:24.200385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b098cda0b5441289e48d0b46e23d347', 'request_id': 'req-5979a9de-869e-47e1-8843-56c91946b1b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:24.215573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] The token cache is being invalidate because project 9b098cda0b5441289e48d0b46e23d347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:24.217092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:24.217092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5979a9de-869e-47e1-8843-56c91946b1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:24.219096 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3203/6395] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:23 2022] DELETE /identity/v3/projects/9b098cda0b5441289e48d0b46e23d347 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:24.224772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a312d-810d-4bd2-8df7-ba9f05dc0934 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.225063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a312d-810d-4bd2-8df7-ba9f05dc0934 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.225935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a312d-810d-4bd2-8df7-ba9f05dc0934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.227683 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3193/6396] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:24.235429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae6596-cd4c-4918-bcfd-7c0c9553bfe6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.235721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae6596-cd4c-4918-bcfd-7c0c9553bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.236002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae6596-cd4c-4918-bcfd-7c0c9553bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.264576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-637a312d-810d-4bd2-8df7-ba9f05dc0934 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:24.265128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-637a312d-810d-4bd2-8df7-ba9f05dc0934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:24.272825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-75ae6596-cd4c-4918-bcfd-7c0c9553bfe6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:24.274747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75ae6596-cd4c-4918-bcfd-7c0c9553bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:24.274891 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3204/6397] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:24.282735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3e20-0fe0-4e06-b03e-8c19a66a19ad None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.283110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3e20-0fe0-4e06-b03e-8c19a66a19ad None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.283835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3e20-0fe0-4e06-b03e-8c19a66a19ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.300135 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3194/6398] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:24.302824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae6596-cd4c-4918-bcfd-7c0c9553bfe6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.315130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae6596-cd4c-4918-bcfd-7c0c9553bfe6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.325057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.325824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.328021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.328407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.329177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:53:24.329586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.332899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.335290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-75dd3e20-0fe0-4e06-b03e-8c19a66a19ad None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:24.338442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75dd3e20-0fe0-4e06-b03e-8c19a66a19ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:24.361192 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3205/6399] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:24.365461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3e20-0fe0-4e06-b03e-8c19a66a19ad None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.370305 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3195/6400] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:53:24.371839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.390432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3e20-0fe0-4e06-b03e-8c19a66a19ad None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.391194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9b462-b861-4915-9192-6fa19fd7dda8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.396824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.397113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.398523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.398913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.399226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.399687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.400165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.400556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.401186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.402450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.402898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:53:24.403236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.407189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.426330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3206/6401] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:53:24.430961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.443575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256567c4-9ad5-4ac3-84bd-437ff133ee37 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.459268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.460708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.461337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.461775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.462596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.471595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.512709 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3196/6402] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:24.517222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.606285 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3207/6403] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:53:24.607587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40f0e2-5beb-4b5f-bd8b-7f9c2852edaa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.610697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.691936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.692943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.693401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.694808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.695964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.697974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e06fa-f175-4b79-824d-6e162a4400ac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.698364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.703166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.703790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.704074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.704346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.705045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.707150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.811060 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3197/6404] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:24.819722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.826845 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3208/6405] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:24 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:24.836945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.846713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c797635-b486-40d1-8828-1682fbf8585a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.848615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cfe6d-3fe7-4b4d-9190-03794a180b72 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.853130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.858184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.858184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.858406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.858520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.858621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.858709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.858831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.858831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.858831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.859060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.859152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.870691 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3198/6406] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:24.872146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.874347 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3209/6407] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:24.875332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:24.877552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:24.888203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996ab25-703a-4ded-a088-6847ac9b58bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.894441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.895412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.895778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.896276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] PATH_INFO: `/v3/projects/8e813de331c54c999386f0be12d0838b/users/c39e084f4532408eac63bdf84bada24f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.913908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:24.920864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e813de331c54c999386f0be12d0838b, user_id=c39e084f4532408eac63bdf84bada24f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:24.921483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:24.923924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:24.974227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc4a01-2187-4ead-97d6-ac5040239259 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:24.980604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:24.981793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:24.982162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:24.982385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:24.984266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:24.999017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.000884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.012900 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3199/6408] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:25.013686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.024941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac126807-9805-471d-a4c8-401328ee4045 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.030008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.032801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.032801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.032801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.032801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.033760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.047536 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3200/6409] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:25.048522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.059166 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3210/6410] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:24 2022] PUT /identity/v3/projects/8e813de331c54c999386f0be12d0838b/users/c39e084f4532408eac63bdf84bada24f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:25.064160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0677ec-3926-4e51-9e68-f0cf44e624fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.064659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.134983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397db7-c9d2-4720-9d08-9da486251496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.135788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397db7-c9d2-4720-9d08-9da486251496 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.136155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397db7-c9d2-4720-9d08-9da486251496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.136543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397db7-c9d2-4720-9d08-9da486251496 admin admin] PATH_INFO: `/v3/projects/bcb6b990bd8a4a62be62d7e9d4aaf431/users/c767ae6dddad482a87ad07055de4daf8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.164456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397db7-c9d2-4720-9d08-9da486251496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb6b990bd8a4a62be62d7e9d4aaf431, user_id=c767ae6dddad482a87ad07055de4daf8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.167427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397db7-c9d2-4720-9d08-9da486251496 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.174616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cc97d-3a38-4704-9ec1-6e0fa2f81efa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.181227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.181865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.182180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.182468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.183114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.184910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.210360 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3211/6411] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:25.210360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.223664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508088f-80e9-4c53-a64d-234d20481c73 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.230380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b89e92-767b-47ca-8e2f-c9478b181193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.232185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89e92-767b-47ca-8e2f-c9478b181193 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.232623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89e92-767b-47ca-8e2f-c9478b181193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.233248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b89e92-767b-47ca-8e2f-c9478b181193 admin admin] PATH_INFO: `/v3/projects/8e813de331c54c999386f0be12d0838b/users/c39e084f4532408eac63bdf84bada24f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.235544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b89e92-767b-47ca-8e2f-c9478b181193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e813de331c54c999386f0be12d0838b, user_id=c39e084f4532408eac63bdf84bada24f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.238758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b89e92-767b-47ca-8e2f-c9478b181193 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.252594 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3212/6412] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:25 2022] PUT /identity/v3/projects/8e813de331c54c999386f0be12d0838b/users/c39e084f4532408eac63bdf84bada24f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:25.264451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e5b19-a08a-472e-8f64-bec7fa5002d3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.265730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e5b19-a08a-472e-8f64-bec7fa5002d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.266271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e5b19-a08a-472e-8f64-bec7fa5002d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.274109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3201/6413] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:25 2022] PUT /identity/v3/projects/bcb6b990bd8a4a62be62d7e9d4aaf431/users/c767ae6dddad482a87ad07055de4daf8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:25.284895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cd82-350f-4557-9ce8-13fd8f7dddad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.286919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cd82-350f-4557-9ce8-13fd8f7dddad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.286919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cd82-350f-4557-9ce8-13fd8f7dddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.315178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bb15cd82-350f-4557-9ce8-13fd8f7dddad None None] MFA Rules not processed for user `c767ae6dddad482a87ad07055de4daf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:25.315590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d9e5b19-a08a-472e-8f64-bec7fa5002d3 None None] MFA Rules not processed for user `c39e084f4532408eac63bdf84bada24f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:25.316412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb15cd82-350f-4557-9ce8-13fd8f7dddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:25.317146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d9e5b19-a08a-472e-8f64-bec7fa5002d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:25.402869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3202/6414] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:25.410131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15cd82-350f-4557-9ce8-13fd8f7dddad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.418619 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3213/6415] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:25.427664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:25.427898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e5b19-a08a-472e-8f64-bec7fa5002d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.508486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15cd82-350f-4557-9ce8-13fd8f7dddad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.521949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.523274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.523604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.523846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.524496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.527305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.532833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e5b19-a08a-472e-8f64-bec7fa5002d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.538540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.547250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.547250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.547250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.547250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.547250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.548154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:25.645273 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3203/6416] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:25 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:25.650883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.684864 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3214/6417] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:25 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:53:25.687493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.736801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9358a-2470-4211-a5a3-2b8fca4043d7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.791495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52064cdc-4444-4408-bd6d-6b4b20cc594a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.805067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.805711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.806000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.806336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.809367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.811430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.825813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.826499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.827280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.827280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.827752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.829705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.939683 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3215/6418] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:25 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:25.941164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.953139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf1e3c-c7d7-4294-a0ef-64dbd424cc79 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.962289 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3204/6419] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:25 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:25.967726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:25.968419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:25.968764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:25.969100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:25.969823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:25.970891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:25.972661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:25.991347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f196-51db-488a-8b8b-9e7e40504f80 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:25.994913 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3216/6420] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:53:25.999280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:26.003310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.004381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.004381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.004570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.012696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.014365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e80b9-f688-4521-aad8-85d50b4806d3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:26.014993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.023247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.023998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.024445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.024767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.025711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.027515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.034666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3205/6421] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:26.042225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:26.049346 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3217/6422] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:53:26.050897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:26.074348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c415b-2df2-4f06-9e38-7d1cd74906cc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:26.074995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528a7f-6227-4d1e-8e0c-e397070eb16b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:26.080081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f46ca1-d2e1-493a-9f64-1faf2e6d8105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.080594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.081304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46ca1-d2e1-493a-9f64-1faf2e6d8105 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.081420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.081588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.081806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46ca1-d2e1-493a-9f64-1faf2e6d8105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.081916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] PATH_INFO: `/v3/projects/ea554b86bd0f4a7cb2de5a852b91b387/users/f273ab86def04b30b7b1aa9ba55c7d12/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.082484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f46ca1-d2e1-493a-9f64-1faf2e6d8105 admin admin] PATH_INFO: `/v3/projects/be5f24ac5bfb47238272a2cb1ac334d6/users/5aea073edbaf494b9fc0a20cf42b6325/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.104841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea554b86bd0f4a7cb2de5a852b91b387, user_id=f273ab86def04b30b7b1aa9ba55c7d12, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.105336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f46ca1-d2e1-493a-9f64-1faf2e6d8105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5f24ac5bfb47238272a2cb1ac334d6, user_id=5aea073edbaf494b9fc0a20cf42b6325, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.110484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f46ca1-d2e1-493a-9f64-1faf2e6d8105 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.110608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.214624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:26.223879 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3206/6423] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:26 2022] PUT /identity/v3/projects/ea554b86bd0f4a7cb2de5a852b91b387/users/f273ab86def04b30b7b1aa9ba55c7d12/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:26.225433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:26.254338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3218/6424] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:26 2022] PUT /identity/v3/projects/be5f24ac5bfb47238272a2cb1ac334d6/users/5aea073edbaf494b9fc0a20cf42b6325/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:26.265190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.265482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.265761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.297626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] MFA Rules not processed for user `5aea073edbaf494b9fc0a20cf42b6325`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:26.298952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:26.317011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082c62f-bba1-4e2c-9755-51174a23cc7b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:26.402760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.403973 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3219/6425] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:26.404410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.408204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.408483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.409826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.410808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.421033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:26.423117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:26.435873 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3207/6426] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:53:26.442459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:26.469633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9eca2-9974-4a1a-b1ff-0e05e907f252 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:26.475795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c55e2-e461-47d4-bcff-cbf739df1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.476644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c55e2-e461-47d4-bcff-cbf739df1514 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.478034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c55e2-e461-47d4-bcff-cbf739df1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.478034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c55e2-e461-47d4-bcff-cbf739df1514 admin admin] PATH_INFO: `/v3/projects/ea554b86bd0f4a7cb2de5a852b91b387/users/f273ab86def04b30b7b1aa9ba55c7d12/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.482942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c55e2-e461-47d4-bcff-cbf739df1514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea554b86bd0f4a7cb2de5a852b91b387, user_id=f273ab86def04b30b7b1aa9ba55c7d12, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.484502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:26.486161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c55e2-e461-47d4-bcff-cbf739df1514 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.513743 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3208/6427] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:26 2022] PUT /identity/v3/projects/ea554b86bd0f4a7cb2de5a852b91b387/users/f273ab86def04b30b7b1aa9ba55c7d12/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:26.531719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.532051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.532240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.566429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] MFA Rules not processed for user `f273ab86def04b30b7b1aa9ba55c7d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:26.567714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:26.625856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d18c7-86be-47c6-ae7b-f9836c29980f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:26.659294 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3209/6428] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:26.673046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:26.675057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:26.701128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:26.705709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.706901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.707696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.708269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.796562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.799330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.821199 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3220/6429] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:26.829084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549765a-2999-4b2e-b85c-4a180887e850 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:26.834088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:26.835292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:26.835584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:26.837340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:26.863944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:26.868672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:26.883792 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3210/6430] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:27.210507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:27.230835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7596e86-b7d1-4d15-a391-0d10a2461c6f service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:27.239823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ceb7fa-6a94-429c-8b1d-6e9c5dcfe7ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:27.241283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb7fa-6a94-429c-8b1d-6e9c5dcfe7ed service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:27.242028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb7fa-6a94-429c-8b1d-6e9c5dcfe7ed service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:27.242521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ceb7fa-6a94-429c-8b1d-6e9c5dcfe7ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:27.362206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceb7fa-6a94-429c-8b1d-6e9c5dcfe7ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:27.363837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ceb7fa-6a94-429c-8b1d-6e9c5dcfe7ed service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:27.375719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3221/6431] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:28.898386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:29.010846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980af0-6eaa-4966-ac6b-b1d15ee70717 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:29.015898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:29.016817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:29.017342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:29.017824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] PATH_INFO: `/v3/users/c39e084f4532408eac63bdf84bada24f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:29.019246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39e084f4532408eac63bdf84bada24f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:29.021364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:29.267901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39e084f4532408eac63bdf84bada24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:29.268826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39e084f4532408eac63bdf84bada24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:29.367316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39e084f4532408eac63bdf84bada24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:29.368174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39e084f4532408eac63bdf84bada24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:29.386328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39e084f4532408eac63bdf84bada24f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:29.409833 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3211/6432] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:28 2022] DELETE /identity/v3/users/c39e084f4532408eac63bdf84bada24f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:29.415690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:29.416214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:29.416214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:29.447227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:29.448766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:29.475136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:29.546035 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3222/6433] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:29.557795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:29.559414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:29.584158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:29.750651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11933b3-fe4a-44e6-a76b-1bbf07e3bde4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:29.758554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:29.759688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:29.760186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:29.760669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:29.778024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:29.780999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:29.800337 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3212/6434] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:30.283157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:30.284578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:30.300227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314465f7-f912-46af-8f1a-df53a2683fec None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:30.307292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:30.307971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:30.312887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:30.316427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] PATH_INFO: `/v3/users/76a7e384b7514d4aa79cbe2154747ee9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:30.316427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a7e384b7514d4aa79cbe2154747ee9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:30.316956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:30.485227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:30.488627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:30.514535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fe187-774f-4e3a-841a-b73afeeb0ab7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:30.526381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:30.527037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:30.527319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:30.527640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] PATH_INFO: `/v3/projects/8e813de331c54c999386f0be12d0838b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:30.528916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e813de331c54c999386f0be12d0838b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:30.531106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:30.560370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a7e384b7514d4aa79cbe2154747ee9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.568956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a7e384b7514d4aa79cbe2154747ee9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.569672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a7e384b7514d4aa79cbe2154747ee9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.583365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a7e384b7514d4aa79cbe2154747ee9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.672321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a7e384b7514d4aa79cbe2154747ee9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.675599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e813de331c54c999386f0be12d0838b', 'request_id': 'req-ed2602f0-35d5-438d-ae42-216973136d7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.686774 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3223/6435] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:30 2022] DELETE /identity/v3/users/76a7e384b7514d4aa79cbe2154747ee9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:30.695191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e813de331c54c999386f0be12d0838b', 'request_id': 'req-ed2602f0-35d5-438d-ae42-216973136d7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.781785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e813de331c54c999386f0be12d0838b', 'request_id': 'req-ed2602f0-35d5-438d-ae42-216973136d7b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.802139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] The token cache is being invalidate because project 8e813de331c54c999386f0be12d0838b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:30.802439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.804106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:30.807374 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3213/6436] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:30 2022] DELETE /identity/v3/projects/8e813de331c54c999386f0be12d0838b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:30.811593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:30.813307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:30.915380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c98c-ed8e-4fcc-82f2-47fc60053317 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:30.921411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:30.922091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:30.922388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:30.922671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] PATH_INFO: `/v3/users/5aea073edbaf494b9fc0a20cf42b6325` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:30.930883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aea073edbaf494b9fc0a20cf42b6325)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:30.930883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:31.032187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:31.075152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:31.081286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:31.181597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2602f0-35d5-438d-ae42-216973136d7b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:31.187919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:31.188632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:31.188945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:31.189226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] PATH_INFO: `/v3/projects/a9ded6cc2bc84dea980ab12eb532e0c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:31.190618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ded6cc2bc84dea980ab12eb532e0c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:31.193159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:31.285269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aea073edbaf494b9fc0a20cf42b6325'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.293413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aea073edbaf494b9fc0a20cf42b6325'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.294277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aea073edbaf494b9fc0a20cf42b6325'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.309894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aea073edbaf494b9fc0a20cf42b6325'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.370468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:31.377566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ded6cc2bc84dea980ab12eb532e0c2', 'request_id': 'req-a04618db-59fd-44e3-be4c-f04d78cd9350'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.385888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ded6cc2bc84dea980ab12eb532e0c2', 'request_id': 'req-a04618db-59fd-44e3-be4c-f04d78cd9350'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.403789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aea073edbaf494b9fc0a20cf42b6325'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.410707 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3224/6437] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:30 2022] DELETE /identity/v3/users/5aea073edbaf494b9fc0a20cf42b6325 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:31.537917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ded6cc2bc84dea980ab12eb532e0c2', 'request_id': 'req-a04618db-59fd-44e3-be4c-f04d78cd9350'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.552629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] The token cache is being invalidate because project a9ded6cc2bc84dea980ab12eb532e0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:31.552940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.554288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.556163 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3214/6438] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:31 2022] DELETE /identity/v3/projects/a9ded6cc2bc84dea980ab12eb532e0c2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:31.560268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:31.561883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:31.640262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac74a72-b5e8-4d43-8387-91e3a6996c6b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:31.645310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:31.645959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:31.652257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:31.652257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] PATH_INFO: `/v3/users/61faf6ad6e7848799bf63a6fe0697f97` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:31.652257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61faf6ad6e7848799bf63a6fe0697f97)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:31.652257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:31.871326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61faf6ad6e7848799bf63a6fe0697f97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.879138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61faf6ad6e7848799bf63a6fe0697f97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.879907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61faf6ad6e7848799bf63a6fe0697f97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.886642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:31.888206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:31.897307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61faf6ad6e7848799bf63a6fe0697f97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.977852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9931e9-63d7-4fbb-92d7-4eba7a19b575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61faf6ad6e7848799bf63a6fe0697f97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:31.987360 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3225/6439] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:31 2022] DELETE /identity/v3/users/61faf6ad6e7848799bf63a6fe0697f97 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:31.988482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04618db-59fd-44e3-be4c-f04d78cd9350 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:32.073266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:32.074009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:32.074984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:32.075472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] PATH_INFO: `/v3/projects/be5f24ac5bfb47238272a2cb1ac334d6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:32.077389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5f24ac5bfb47238272a2cb1ac334d6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:32.080290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:32.210010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5f24ac5bfb47238272a2cb1ac334d6', 'request_id': 'req-c9ed5372-5728-46cd-8364-c5ee305512ef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.217417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5f24ac5bfb47238272a2cb1ac334d6', 'request_id': 'req-c9ed5372-5728-46cd-8364-c5ee305512ef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.315463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5f24ac5bfb47238272a2cb1ac334d6', 'request_id': 'req-c9ed5372-5728-46cd-8364-c5ee305512ef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.338108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] The token cache is being invalidate because project be5f24ac5bfb47238272a2cb1ac334d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:32.338108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.338108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.338108 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3215/6440] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:31 2022] DELETE /identity/v3/projects/be5f24ac5bfb47238272a2cb1ac334d6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:32.347245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5576f9-50c1-41a8-8b07-2b858edc02ac None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:32.347245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5576f9-50c1-41a8-8b07-2b858edc02ac None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:32.347245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5576f9-50c1-41a8-8b07-2b858edc02ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:32.383797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1f5576f9-50c1-41a8-8b07-2b858edc02ac None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:32.385519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1f5576f9-50c1-41a8-8b07-2b858edc02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:32.408519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:32.419774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:32.435638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:32.461721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:32.510461 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3226/6441] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:32.510461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681f0c-187a-4520-9bf3-9c8a35dde70c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:32.510461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681f0c-187a-4520-9bf3-9c8a35dde70c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:32.510461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e681f0c-187a-4520-9bf3-9c8a35dde70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:32.535383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed5372-5728-46cd-8364-c5ee305512ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:32.541275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:32.542181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:32.542475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:32.542755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] PATH_INFO: `/v3/projects/cfddc60d5b974578a119f6602f7556f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:32.544109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfddc60d5b974578a119f6602f7556f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:32.546127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:32.550227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7e681f0c-187a-4520-9bf3-9c8a35dde70c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:32.551792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e681f0c-187a-4520-9bf3-9c8a35dde70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:32.578395 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3227/6442] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:32.579102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681f0c-187a-4520-9bf3-9c8a35dde70c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:32.590227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e681f0c-187a-4520-9bf3-9c8a35dde70c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:32.596109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:32.596778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:32.597056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:32.597327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:32.598005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:53:32.598339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:32.600681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:32.617081 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3228/6443] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:53:32.617940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:32.628696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f135a-072e-4759-aed3-b2b935feef4a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:32.634858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:32.635471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:32.635747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:32.636015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:32.636641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:32.638571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:32.687282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfddc60d5b974578a119f6602f7556f8', 'request_id': 'req-ce3c2c39-4d0e-429b-9970-a48d5a447085'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.695187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfddc60d5b974578a119f6602f7556f8', 'request_id': 'req-ce3c2c39-4d0e-429b-9970-a48d5a447085'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.728126 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3229/6444] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:32 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:32.732395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:32.798103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d72ea-3bf3-4ce4-a0f9-e224b82bbc41 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:32.803736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:32.804359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:32.804649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:32.804930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:32.805561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:32.807648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:32.817330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfddc60d5b974578a119f6602f7556f8', 'request_id': 'req-ce3c2c39-4d0e-429b-9970-a48d5a447085'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.839471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] The token cache is being invalidate because project cfddc60d5b974578a119f6602f7556f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:32.839842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.841365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:32.850527 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3216/6445] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:32 2022] DELETE /identity/v3/projects/cfddc60d5b974578a119f6602f7556f8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:32.966413 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3230/6446] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:32 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:53:32.967921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:32.969661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:33.139721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c2c39-4d0e-429b-9970-a48d5a447085 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:33.148471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:33.148471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:33.148471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:33.148471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:33.149855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:33.151822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:33.166134 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3217/6447] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:33.169754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:33.184504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a8f4-b6a3-4513-8b54-ce00a02c9b84 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:33.191345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8a78f-77c7-434d-a249-958add29b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:33.192331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a78f-77c7-434d-a249-958add29b563 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:33.193030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a78f-77c7-434d-a249-958add29b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:33.194122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a78f-77c7-434d-a249-958add29b563 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:33.195306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a78f-77c7-434d-a249-958add29b563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:33.197557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8a78f-77c7-434d-a249-958add29b563 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:33.214859 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3231/6448] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:53:33.215846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:33.232174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38a72-9aaf-4c65-ae93-4be2ae229da3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:33.253294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:33.257726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:33.259275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:33.259701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] PATH_INFO: `/v3/projects/530b9c0b7eb344cfb692ccbb10c1f61b/users/e29c2abe8eb8440592264b7073407b21/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:33.335836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=530b9c0b7eb344cfb692ccbb10c1f61b, user_id=e29c2abe8eb8440592264b7073407b21, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:33.338832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:33.510577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3218/6449] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:33 2022] PUT /identity/v3/projects/530b9c0b7eb344cfb692ccbb10c1f61b/users/e29c2abe8eb8440592264b7073407b21/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:33.513772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5415ef-bf47-4126-b4e3-045927f81b17 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:33.514232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5415ef-bf47-4126-b4e3-045927f81b17 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:33.514612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5415ef-bf47-4126-b4e3-045927f81b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:33.583546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4f5415ef-bf47-4126-b4e3-045927f81b17 None None] MFA Rules not processed for user `e29c2abe8eb8440592264b7073407b21`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:33.587269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4f5415ef-bf47-4126-b4e3-045927f81b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:33.709136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:33.747074 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3232/6450] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:33.748501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:33.782218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:33.989752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93406c1-cc92-4a51-bd73-cc7edc9c6c2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:34.014282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:34.015110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:34.015475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:34.015888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:34.016568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:34.022519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:34.112187 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3219/6451] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:33 2022] POST /identity/v3/projects => generated 369 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:34.113298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5415ef-bf47-4126-b4e3-045927f81b17 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:34.125846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5415ef-bf47-4126-b4e3-045927f81b17 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:34.221965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:34.222777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:34.223312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:34.224388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:34.226007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:34.229314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:34.315072 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3233/6452] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:34 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:34.319349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:34.330426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2fe1-2a08-4bc9-aad7-e4f4ce56cc5b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:34.335990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:34.336759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:34.337115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:34.337475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:34.338225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:34.339928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:34.353283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3220/6453] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:34.357394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:34.369212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb161743-2f2c-4506-8280-a54cc31c246e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:34.375030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c823146-0507-45c8-b21e-22416131148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:34.375879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c823146-0507-45c8-b21e-22416131148f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:34.376339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c823146-0507-45c8-b21e-22416131148f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:34.377122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c823146-0507-45c8-b21e-22416131148f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:34.377923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c823146-0507-45c8-b21e-22416131148f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:34.379929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c823146-0507-45c8-b21e-22416131148f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:34.401464 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3234/6454] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:34.402439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:34.425732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ed1f-5158-421a-a0f8-cf364fe0012e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:34.432423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:34.433937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:34.434365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:34.434592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] PATH_INFO: `/v3/projects/f37afcf482574aaab54e6e4ccadc88a6/users/2eef5846f8444867b32173f4d097b275/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:34.466629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37afcf482574aaab54e6e4ccadc88a6, user_id=2eef5846f8444867b32173f4d097b275, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:34.470359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:34.584787 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3221/6455] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:34 2022] PUT /identity/v3/projects/f37afcf482574aaab54e6e4ccadc88a6/users/2eef5846f8444867b32173f4d097b275/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:34.586591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038ff7e-c23c-4a44-8350-2cc94eba12ea None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:34.587036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038ff7e-c23c-4a44-8350-2cc94eba12ea None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:34.587231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038ff7e-c23c-4a44-8350-2cc94eba12ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:34.626780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4038ff7e-c23c-4a44-8350-2cc94eba12ea None None] MFA Rules not processed for user `2eef5846f8444867b32173f4d097b275`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:34.628347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4038ff7e-c23c-4a44-8350-2cc94eba12ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:34.706214 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3235/6456] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:34.719978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:34.722354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:34.797851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db2621-7806-4e7b-958c-26c3a110a439 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:34.802045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:34.802449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:34.802729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:34.803235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:34.884013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:34.885407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:34.901892 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3222/6457] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:35.376079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038ff7e-c23c-4a44-8350-2cc94eba12ea None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:35.391399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038ff7e-c23c-4a44-8350-2cc94eba12ea None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:35.396056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6631b99-88a5-4111-9c88-739af7789040 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:35.397377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631b99-88a5-4111-9c88-739af7789040 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:35.397834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631b99-88a5-4111-9c88-739af7789040 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:35.398373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6631b99-88a5-4111-9c88-739af7789040 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:35.415247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631b99-88a5-4111-9c88-739af7789040 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:35.416837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6631b99-88a5-4111-9c88-739af7789040 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:35.427810 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3236/6458] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:39.122680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:39.171344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:39.305908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf55fb9-26ae-4031-a149-c9d6ff370140 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:39.315249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:39.322032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:39.322032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:39.322032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] PATH_INFO: `/v3/users/e29c2abe8eb8440592264b7073407b21` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:39.322032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29c2abe8eb8440592264b7073407b21)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:39.323004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:39.612257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29c2abe8eb8440592264b7073407b21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:39.614155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29c2abe8eb8440592264b7073407b21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:39.698531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29c2abe8eb8440592264b7073407b21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:39.699368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29c2abe8eb8440592264b7073407b21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:39.730240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29c2abe8eb8440592264b7073407b21'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:39.784832 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3223/6459] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:39 2022] DELETE /identity/v3/users/e29c2abe8eb8440592264b7073407b21 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:39.789437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:39.790497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:39.790928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:39.832850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:39.834914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:39.929942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:39.969136 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3237/6460] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:39.992735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:39.995571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:40.198742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69647c7d-72ce-4ce8-ad1c-62d34272bc66 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:40.213132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:40.219327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:40.221190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:40.221190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:40.251198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:40.257371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:40.325375 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3224/6461] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:41.546408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:41.548485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:41.573918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ac7c-bba8-4eee-ac62-369f1ae973d6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:41.591112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:41.591112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:41.591112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:41.591112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] PATH_INFO: `/v3/projects/530b9c0b7eb344cfb692ccbb10c1f61b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:41.591551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=530b9c0b7eb344cfb692ccbb10c1f61b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:41.595202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:41.791019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530b9c0b7eb344cfb692ccbb10c1f61b', 'request_id': 'req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:41.813575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530b9c0b7eb344cfb692ccbb10c1f61b', 'request_id': 'req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:41.957819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530b9c0b7eb344cfb692ccbb10c1f61b', 'request_id': 'req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:41.981022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] The token cache is being invalidate because project 530b9c0b7eb344cfb692ccbb10c1f61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:41.981498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:41.982225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:41.987503 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3238/6462] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:41 2022] DELETE /identity/v3/projects/530b9c0b7eb344cfb692ccbb10c1f61b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:53:41.994334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:42.038924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43d2aa-17f0-4653-89f2-29567509dc9f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:42.202008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:42.343637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:42.344752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:42.345249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:42.345730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] PATH_INFO: `/v3/users/2eef5846f8444867b32173f4d097b275` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:42.373123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eef5846f8444867b32173f4d097b275)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:42.376766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:42.744105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eef5846f8444867b32173f4d097b275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:42.746032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eef5846f8444867b32173f4d097b275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:42.842885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eef5846f8444867b32173f4d097b275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:42.844073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eef5846f8444867b32173f4d097b275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:42.873164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9debdcb-5996-4ba7-ba82-55a52f7982f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eef5846f8444867b32173f4d097b275'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:43.011946 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3225/6463] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:41 2022] DELETE /identity/v3/users/2eef5846f8444867b32173f4d097b275 => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:43.888002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:43.890392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:43.911999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaafab6-70ab-4cf5-bb06-eec6c98e9eda admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:44.038681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:44.039626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:44.040378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:44.040855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] PATH_INFO: `/v3/projects/f37afcf482574aaab54e6e4ccadc88a6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:44.047062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37afcf482574aaab54e6e4ccadc88a6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:44.049515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:44.210400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37afcf482574aaab54e6e4ccadc88a6', 'request_id': 'req-8092fdea-6245-455a-a841-107b12ace576'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:44.217900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37afcf482574aaab54e6e4ccadc88a6', 'request_id': 'req-8092fdea-6245-455a-a841-107b12ace576'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:44.327697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37afcf482574aaab54e6e4ccadc88a6', 'request_id': 'req-8092fdea-6245-455a-a841-107b12ace576'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:44.353471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:44.359035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] The token cache is being invalidate because project f37afcf482574aaab54e6e4ccadc88a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:44.359270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:44.362191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8092fdea-6245-455a-a841-107b12ace576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:44.368211 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3239/6464] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:43 2022] DELETE /identity/v3/projects/f37afcf482574aaab54e6e4ccadc88a6 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:44.374022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a6f2-072e-46a9-9c0c-8af2925f1aa4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:44.390289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a6f2-072e-46a9-9c0c-8af2925f1aa4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:44.390289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a6f2-072e-46a9-9c0c-8af2925f1aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:44.398537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5b15a6f2-072e-46a9-9c0c-8af2925f1aa4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:44.399805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b15a6f2-072e-46a9-9c0c-8af2925f1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:44.666346 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3226/6465] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:53:44.668158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7f38-7ce4-40d5-bda4-c86c36da810b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:44.668828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7f38-7ce4-40d5-bda4-c86c36da810b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:44.669321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c7f38-7ce4-40d5-bda4-c86c36da810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:44.692776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0c9c7f38-7ce4-40d5-bda4-c86c36da810b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:44.696878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c9c7f38-7ce4-40d5-bda4-c86c36da810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:44.718699 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3240/6466] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:44.719516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15a6f2-072e-46a9-9c0c-8af2925f1aa4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:44.754306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15a6f2-072e-46a9-9c0c-8af2925f1aa4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:44.764791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:44.767497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:44.767859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:44.768143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:44.769824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:53:44.770169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:44.776665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:44.813338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7f38-7ce4-40d5-bda4-c86c36da810b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:44.815961 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3227/6467] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:53:44.824888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c7f38-7ce4-40d5-bda4-c86c36da810b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:44.839349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:44.839998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:44.840292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:44.840556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:44.841209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:44.843374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:44.992908 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3241/6468] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:44 2022] POST /identity/v3/projects => generated 407 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:44.997242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:45.022299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeae03f-2e7a-41ae-a3bb-9a138407ee5b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:45.254800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:45.298927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:45.300658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:45.300658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:45.300658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:45.300948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:45.317578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:45.477060 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3228/6469] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:44 2022] POST /identity/v3/users => generated 304 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:53:45.480017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:45.497829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ec98-ce40-4391-b3f0-901e6bdfe21b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:45.513083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:45.518902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:45.525202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:45.526191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:45.531627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:45.552610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:45.589720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:45.589950 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3242/6470] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:45.605120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848773b0-a9f5-4826-b947-b368d02dc402 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:45.627278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9b84a-5ea4-4465-9c02-49f9a890fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:45.627278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b84a-5ea4-4465-9c02-49f9a890fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:45.627278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b84a-5ea4-4465-9c02-49f9a890fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:45.627278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b84a-5ea4-4465-9c02-49f9a890fd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:45.627762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9b84a-5ea4-4465-9c02-49f9a890fd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:45.627762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9b84a-5ea4-4465-9c02-49f9a890fd53 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:45.649596 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3229/6471] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:45.655888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:45.679254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3fa75-60b2-432c-9a1b-48e9ff3992d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:45.697767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:45.698476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:45.698906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:45.699050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] PATH_INFO: `/v3/projects/2f9649e4950c439da7bba493f2a8f885/users/eb5b265968834671b0575f668bce05e4/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:45.733307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9649e4950c439da7bba493f2a8f885, user_id=eb5b265968834671b0575f668bce05e4, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:45.736355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:45.895371 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3243/6472] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:45 2022] PUT /identity/v3/projects/2f9649e4950c439da7bba493f2a8f885/users/eb5b265968834671b0575f668bce05e4/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:46.011483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e990-2c51-47da-896c-22367025f3ef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:46.012160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e990-2c51-47da-896c-22367025f3ef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:46.012718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878e990-2c51-47da-896c-22367025f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:46.088877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7878e990-2c51-47da-896c-22367025f3ef None None] MFA Rules not processed for user `eb5b265968834671b0575f668bce05e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:46.090344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7878e990-2c51-47da-896c-22367025f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:46.265112 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3230/6473] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:46.266376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:46.402836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b845e6b-0177-4a92-a948-1aa7005d895b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:46.418037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:46.419012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:46.419489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:46.419919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:46.420763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:46.423129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:46.663351 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3244/6474] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:53:46 2022] POST /identity/v3/projects => generated 407 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:53:46.664171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e990-2c51-47da-896c-22367025f3ef None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:46.689032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878e990-2c51-47da-896c-22367025f3ef None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:46.833561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:46.834381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:46.834823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:46.835204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:46.835974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:46.838259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:46.963372 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3231/6475] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:53:46 2022] POST /identity/v3/users => generated 310 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:53:46.968224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:46.998109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0b4e7-e26d-407f-94d9-5e9b481611f8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:47.024239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:47.024884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:47.025169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:47.026229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:47.026974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:47.032536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:47.048683 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3245/6476] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:47.054135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:47.074916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96af0a-830e-4cb8-a24f-dd9ebe65af71 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:47.104606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:47.105362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:47.105659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:47.105914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] PATH_INFO: `/v3/projects/37dd700c5cf0431faec83f1b7ecb96a3/users/539bb39a8d0e4f8c9960d7c71864cc2e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:47.148201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dd700c5cf0431faec83f1b7ecb96a3, user_id=539bb39a8d0e4f8c9960d7c71864cc2e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:47.151161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:47.245356 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3232/6477] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:47 2022] PUT /identity/v3/projects/37dd700c5cf0431faec83f1b7ecb96a3/users/539bb39a8d0e4f8c9960d7c71864cc2e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:47.259335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:47.283315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacaf45-eef3-467c-a875-451cb383d9d7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:47.405734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4636b4b-7370-4b03-be70-f726ba38ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:47.410789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4636b4b-7370-4b03-be70-f726ba38ad75 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:47.410789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4636b4b-7370-4b03-be70-f726ba38ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:47.410789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4636b4b-7370-4b03-be70-f726ba38ad75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:47.410789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4636b4b-7370-4b03-be70-f726ba38ad75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:47.410789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4636b4b-7370-4b03-be70-f726ba38ad75 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:47.443868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3246/6478] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:53:47.447927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:47.462649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aaf8d-0dd2-4333-a0f3-f97adc298656 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:47.484093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:47.487295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:47.487295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:47.487295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] PATH_INFO: `/v3/projects/37dd700c5cf0431faec83f1b7ecb96a3/users/539bb39a8d0e4f8c9960d7c71864cc2e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:47.487567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dd700c5cf0431faec83f1b7ecb96a3, user_id=539bb39a8d0e4f8c9960d7c71864cc2e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:47.490288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:47.512503 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3233/6479] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:53:47 2022] PUT /identity/v3/projects/37dd700c5cf0431faec83f1b7ecb96a3/users/539bb39a8d0e4f8c9960d7c71864cc2e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:47.514667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:47.515127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:47.515412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:47.531285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:47.567308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] MFA Rules not processed for user `539bb39a8d0e4f8c9960d7c71864cc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:47.568849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:47.666176 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3247/6480] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:47.675631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:47.682896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:47.715816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:47.838856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefa3ac-7220-4dae-b5d9-27af5f408390 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:47.863149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:47.863793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:47.864079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:47.871478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:48.053473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:48.054980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:48.090459 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3234/6481] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:47 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:49.025360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:49.029435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:49.205250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf060e-4b58-4b7f-ba1e-67db4a42390f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:49.212145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:49.212592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:49.212904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:49.216049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:49.223339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:49.225525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:49.235509 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3248/6482] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:49 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:55.931931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:55.945462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9099be-4821-4f65-9413-3a6f6d17d558 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:55.952374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:55.954658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:55.955128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:55.955575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:55.962883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:55.995007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:55.998597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:56.026925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3235/6483] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:57.936350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:57.939188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:58.018163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb2ebb-2e54-4f12-90e2-5ff13fd8a71c service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:58.024913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0030ebe-6451-4b26-84ae-53a7fcda14fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:58.025570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030ebe-6451-4b26-84ae-53a7fcda14fb service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:58.025853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030ebe-6451-4b26-84ae-53a7fcda14fb service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:58.026320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0030ebe-6451-4b26-84ae-53a7fcda14fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:58.028566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0030ebe-6451-4b26-84ae-53a7fcda14fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:58.043037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0030ebe-6451-4b26-84ae-53a7fcda14fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:58.044675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0030ebe-6451-4b26-84ae-53a7fcda14fb service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:58.057723 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3249/6484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:58.106651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:58.177133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a93bf2-ded7-4492-bab9-3b57047520fb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:58.181728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:58.182468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:58.182747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:58.183017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] PATH_INFO: `/v3/users/eb5b265968834671b0575f668bce05e4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:58.184141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5b265968834671b0575f668bce05e4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:58.186094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:58.393252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5b265968834671b0575f668bce05e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:58.394311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5b265968834671b0575f668bce05e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:58.397435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:58.474858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5b265968834671b0575f668bce05e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:58.475564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5b265968834671b0575f668bce05e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:58.487105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5b265968834671b0575f668bce05e4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:58.515791 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3236/6485] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:58 2022] DELETE /identity/v3/users/eb5b265968834671b0575f668bce05e4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:58.526867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:58.527222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:58.527562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:58.547375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:58.554788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:53:58.556103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:58.663250 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3250/6486] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:53:58.669762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:58.671337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:58.741991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bdae8-ef4b-47c8-adba-0ddc191be51d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:58.746880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:58.747634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:58.747991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:58.748378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:58.782372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:58.784428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:58.806416 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3237/6487] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:53:59.106374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:59.108379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:59.128173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73dac2-1eb3-4c3a-9e48-a3138fe2e5ae None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:59.156728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:59.156728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:59.156728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:59.156728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] PATH_INFO: `/v3/projects/2f9649e4950c439da7bba493f2a8f885` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:59.165485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9649e4950c439da7bba493f2a8f885)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:59.167535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:59.323056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9649e4950c439da7bba493f2a8f885', 'request_id': 'req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.337089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9649e4950c439da7bba493f2a8f885', 'request_id': 'req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.396879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:59.398459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:59.401586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9649e4950c439da7bba493f2a8f885', 'request_id': 'req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.422217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] The token cache is being invalidate because project 2f9649e4950c439da7bba493f2a8f885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:53:59.422513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.424109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.425988 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3251/6488] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:53:59 2022] DELETE /identity/v3/projects/2f9649e4950c439da7bba493f2a8f885 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:53:59.430467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:53:59.432047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:59.568183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c87a9-47b5-4cf8-ab81-df4568949adf service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:59.637240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307922-bfa2-43ea-bb9a-896c0d2d1cc2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:53:59.664630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:59.665536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:59.665831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:59.666150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] PATH_INFO: `/v3/users/539bb39a8d0e4f8c9960d7c71864cc2e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:59.668547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539bb39a8d0e4f8c9960d7c71864cc2e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:59.670552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:59.747509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:53:59.756325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:53:59.756325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:53:59.756325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:53:59.756325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:53:59.801427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:59.851064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:53:59.854771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:53:59.878230 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3238/6489] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:53:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:53:59.905589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:59.933347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539bb39a8d0e4f8c9960d7c71864cc2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.952503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539bb39a8d0e4f8c9960d7c71864cc2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.954048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539bb39a8d0e4f8c9960d7c71864cc2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:53:59.987219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539bb39a8d0e4f8c9960d7c71864cc2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:00.066004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c2fb5e-50c1-480f-b79e-046ffad4bef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539bb39a8d0e4f8c9960d7c71864cc2e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:00.074894 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3252/6490] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:53:59 2022] DELETE /identity/v3/users/539bb39a8d0e4f8c9960d7c71864cc2e => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:00.480053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:00.644748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c66c0-bf6b-4f7f-b05c-1edc1c0c5acc service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:00.644748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:00.644748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:00.644748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:00.647970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] PATH_INFO: `/v3/projects/37dd700c5cf0431faec83f1b7ecb96a3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:00.647970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dd700c5cf0431faec83f1b7ecb96a3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:00.647970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:00.816971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dd700c5cf0431faec83f1b7ecb96a3', 'request_id': 'req-0cb1f7f3-6caa-403e-b937-1c239dfde77f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:00.836606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dd700c5cf0431faec83f1b7ecb96a3', 'request_id': 'req-0cb1f7f3-6caa-403e-b937-1c239dfde77f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:00.914293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dd700c5cf0431faec83f1b7ecb96a3', 'request_id': 'req-0cb1f7f3-6caa-403e-b937-1c239dfde77f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:00.928006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] The token cache is being invalidate because project 37dd700c5cf0431faec83f1b7ecb96a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:54:00.928582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:00.929530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0cb1f7f3-6caa-403e-b937-1c239dfde77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:00.934780 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3239/6491] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:54:00 2022] DELETE /identity/v3/projects/37dd700c5cf0431faec83f1b7ecb96a3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:00.936644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725380f-0dc0-41f8-b581-9eebfb7da2ab None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:00.937156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725380f-0dc0-41f8-b581-9eebfb7da2ab None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:00.937324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725380f-0dc0-41f8-b581-9eebfb7da2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.007483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4725380f-0dc0-41f8-b581-9eebfb7da2ab None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:01.007483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4725380f-0dc0-41f8-b581-9eebfb7da2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:01.148022 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3253/6492] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:01.157859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377cb23-a188-464d-acdd-7edba582e030 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.161539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377cb23-a188-464d-acdd-7edba582e030 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.161857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377cb23-a188-464d-acdd-7edba582e030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.190770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1377cb23-a188-464d-acdd-7edba582e030 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:01.192603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1377cb23-a188-464d-acdd-7edba582e030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:01.205611 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3240/6493] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:01.206759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725380f-0dc0-41f8-b581-9eebfb7da2ab None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:01.220191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725380f-0dc0-41f8-b581-9eebfb7da2ab None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:01.225728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:01.227052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.227337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.227622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.228275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:54:01.228582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:01.230319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:01.244902 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3254/6494] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:54:01.248490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377cb23-a188-464d-acdd-7edba582e030 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:01.273474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377cb23-a188-464d-acdd-7edba582e030 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:01.284694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:01.285436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.285785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.286368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.287067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:01.289412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:01.423282 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3241/6495] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:54:01 2022] POST /identity/v3/projects => generated 357 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:54:01.428255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:01.450549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ccd6a-27b0-4293-b8ba-05dd6f3a08e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:01.530644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:01.531900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.531900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.532225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.533159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:01.535405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:01.624359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3255/6496] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:54:01 2022] POST /identity/v3/users => generated 279 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:54:01.628964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:01.640406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60361875-67e2-4e8f-8836-f60cc066b81e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:01.645193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:01.645807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.646116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.646418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.652863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:01.656019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:01.671682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3242/6497] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:54:01.676512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:01.688385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153c722-1af5-4f80-9d28-c2acd431f98c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:01.693255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17d470-b695-40e6-9142-5d709873def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:01.693972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d470-b695-40e6-9142-5d709873def6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.694163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d470-b695-40e6-9142-5d709873def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.694507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d470-b695-40e6-9142-5d709873def6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.695162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17d470-b695-40e6-9142-5d709873def6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:01.696765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17d470-b695-40e6-9142-5d709873def6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:01.708518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3256/6498] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:54:01.716749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:01.727689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466b8a4-1a55-4b78-9472-61ae8448c718 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:01.732305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:01.732964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.733277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.733584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] PATH_INFO: `/v3/projects/d4e86177d8384c989420175e0cc271cf/users/ce9a2f4fc54e43f487523803a285830c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.749824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e86177d8384c989420175e0cc271cf, user_id=ce9a2f4fc54e43f487523803a285830c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:01.752777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:01.864345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:01.873038 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3243/6499] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:54:01 2022] PUT /identity/v3/projects/d4e86177d8384c989420175e0cc271cf/users/ce9a2f4fc54e43f487523803a285830c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:54:01.884464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99901531-29d2-4ff6-a440-8544ea79339d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:01.884835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99901531-29d2-4ff6-a440-8544ea79339d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:01.885181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99901531-29d2-4ff6-a440-8544ea79339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:01.932811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-99901531-29d2-4ff6-a440-8544ea79339d None None] MFA Rules not processed for user `ce9a2f4fc54e43f487523803a285830c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:01.934382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99901531-29d2-4ff6-a440-8544ea79339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:01.940436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:02.038259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3257/6500] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:54:02.043366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:02.162904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0542ae4-4098-45ad-ae8e-44fddea2bf43 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:02.172810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:02.173862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:02.174335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:02.174973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:02.176827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:02.181175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:02.336287 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3244/6501] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:54:02 2022] POST /identity/v3/projects => generated 355 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:54:02.340039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99901531-29d2-4ff6-a440-8544ea79339d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:02.359682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99901531-29d2-4ff6-a440-8544ea79339d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:02.462745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:02.463380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:02.463666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:02.463945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:02.464592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:02.466624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:02.591604 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3258/6502] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:54:02 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:54:02.595946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:02.612289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796803fd-7a9e-4005-bbd3-9be38643b636 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:02.629160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:02.629160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:02.629160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:02.629160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:02.630246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:02.630246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:02.651226 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3245/6503] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:54:02.652600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:02.665987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28355c3-749c-4d55-8afc-a2d53b44953a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:02.671941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:02.672628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:02.672902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:02.673362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] PATH_INFO: `/v3/projects/77b4b551d961492082ae4800ba9e6c2d/users/ee9cb3ec18f34c198b80ef2939798b24/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:02.720359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b4b551d961492082ae4800ba9e6c2d, user_id=ee9cb3ec18f34c198b80ef2939798b24, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:02.723275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:02.853020 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3259/6504] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:54:02 2022] PUT /identity/v3/projects/77b4b551d961492082ae4800ba9e6c2d/users/ee9cb3ec18f34c198b80ef2939798b24/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:02.857515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:02.868577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c8d8d-7917-4d3a-860f-9e55c85451ab admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:02.940859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad78e-9c3b-44e3-8f16-0c832c79b9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:02.941485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad78e-9c3b-44e3-8f16-0c832c79b9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:02.941766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad78e-9c3b-44e3-8f16-0c832c79b9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:02.942040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad78e-9c3b-44e3-8f16-0c832c79b9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:02.942775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad78e-9c3b-44e3-8f16-0c832c79b9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:02.944387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad78e-9c3b-44e3-8f16-0c832c79b9a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:02.956441 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3246/6505] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:54:02.961329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:02.973016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed29201-319d-4f43-9857-0c086b1f4f1a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:02.979113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:02.979971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:02.980727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:02.981153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] PATH_INFO: `/v3/projects/77b4b551d961492082ae4800ba9e6c2d/users/ee9cb3ec18f34c198b80ef2939798b24/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:02.983555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b4b551d961492082ae4800ba9e6c2d, user_id=ee9cb3ec18f34c198b80ef2939798b24, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:02.986559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:02.999596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3260/6506] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:54:02 2022] PUT /identity/v3/projects/77b4b551d961492082ae4800ba9e6c2d/users/ee9cb3ec18f34c198b80ef2939798b24/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:54:03.010843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4475e-0fdd-46a3-81c1-162270366444 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:03.011822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4475e-0fdd-46a3-81c1-162270366444 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:03.012493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4475e-0fdd-46a3-81c1-162270366444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:03.060026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3db4475e-0fdd-46a3-81c1-162270366444 None None] MFA Rules not processed for user `ee9cb3ec18f34c198b80ef2939798b24`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:03.061311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3db4475e-0fdd-46a3-81c1-162270366444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:03.197714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:03.218331 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3247/6507] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:03.223386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:03.252235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a7c7e-c799-480f-89b0-596548bd8d6e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:03.258608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9cb3ec18f34c198b80ef2939798b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77b4b551d961492082ae4800ba9e6c2d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:03.260178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:03.260178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:03.260673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:03.262743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:54:03.263485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:03.265494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:03.301418 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3261/6508] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:54:03.306754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4475e-0fdd-46a3-81c1-162270366444 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:03.325822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4475e-0fdd-46a3-81c1-162270366444 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:03.334788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9cb3ec18f34c198b80ef2939798b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77b4b551d961492082ae4800ba9e6c2d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:03.335447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:03.335738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:03.336125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:03.337169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:03.340053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:03.539456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3248/6509] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:54:03 2022] POST /identity/v3/projects => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:54:03.544159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:03.564131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dc282-d21d-4f61-8ec5-90641f3ad4c5 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:03.673906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:03.690602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9cb3ec18f34c198b80ef2939798b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77b4b551d961492082ae4800ba9e6c2d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:03.692248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:03.693923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:03.701925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:03.701925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:54:03.701925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:03.701925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:03.731966 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3262/6510] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:54:03.746395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:03.749021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:03.924111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b76359-deab-44e0-874b-5dc7720f579d tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:03.936664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:03.937888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:03.939101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:03.940643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:03.964472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:03.968504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:03.982984 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3249/6511] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:54:04.483870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:04.504395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca11d-36ef-4a1a-a22e-1708f5f2a146 tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:04.512750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9cb3ec18f34c198b80ef2939798b24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '77b4b551d961492082ae4800ba9e6c2d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:04.513676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:04.514138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:04.514564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] PATH_INFO: `/v3/projects/e71f433bac8f48a69c75254195df8ffc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:04.515958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e71f433bac8f48a69c75254195df8ffc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:04.518294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:04.539290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:04.541014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:04.631870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ab152-d3b1-4e1d-956c-5b67d72667a3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:04.650710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71f433bac8f48a69c75254195df8ffc', 'request_id': 'req-38c432a4-35f2-419e-bdb0-3573d8d44c2f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:04.672452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71f433bac8f48a69c75254195df8ffc', 'request_id': 'req-38c432a4-35f2-419e-bdb0-3573d8d44c2f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:04.712971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:04.713589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:04.714015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:04.714322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:04.716426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:04.772007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:04.809192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71f433bac8f48a69c75254195df8ffc', 'request_id': 'req-38c432a4-35f2-419e-bdb0-3573d8d44c2f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:04.809343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:04.810704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:04.824784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] The token cache is being invalidate because project e71f433bac8f48a69c75254195df8ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:54:04.825367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:04.826304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-38c432a4-35f2-419e-bdb0-3573d8d44c2f tempest-QuotasTest-373750774 tempest-QuotasTest-373750774-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:04.826983 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3250/6512] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:54:04.833459 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3263/6513] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:54:04 2022] DELETE /identity/v3/projects/e71f433bac8f48a69c75254195df8ffc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:04.991217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:05.112308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565adf0-6d5f-4d31-a758-79ca434efb8e service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:05.120446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:05.121210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:05.121595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:05.122159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] PATH_INFO: `/v3/users/ce9a2f4fc54e43f487523803a285830c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:05.123493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9a2f4fc54e43f487523803a285830c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:05.125962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:05.410246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9a2f4fc54e43f487523803a285830c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:05.413760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9a2f4fc54e43f487523803a285830c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:05.508426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9a2f4fc54e43f487523803a285830c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:05.509445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9a2f4fc54e43f487523803a285830c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:05.519883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9a2f4fc54e43f487523803a285830c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:05.552075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3251/6514] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:54:04 2022] DELETE /identity/v3/users/ce9a2f4fc54e43f487523803a285830c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:05.556994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:05.557679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:05.557679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:05.632497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:05.633771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:05.725482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3264/6515] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:05.732081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:05.733539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:05.801550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34c63b-c3d7-4763-b404-527788c0edc8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:05.807020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:05.807892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:05.808391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:05.809395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:05.820397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:05.838991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:05.843236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:05.859431 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3252/6516] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:54:06.419757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:06.421520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:06.439924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a353a5-fe23-4d24-85fd-ffc464b49bb8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:06.461402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:06.462543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:06.463083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:06.463623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] PATH_INFO: `/v3/projects/d4e86177d8384c989420175e0cc271cf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:06.465327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e86177d8384c989420175e0cc271cf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:06.468895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:06.637016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e86177d8384c989420175e0cc271cf', 'request_id': 'req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:06.654953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e86177d8384c989420175e0cc271cf', 'request_id': 'req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:06.661216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:06.725243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e86177d8384c989420175e0cc271cf', 'request_id': 'req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:06.747108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] The token cache is being invalidate because project d4e86177d8384c989420175e0cc271cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:54:06.747562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:06.748370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:06.750305 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3265/6517] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:54:06 2022] DELETE /identity/v3/projects/d4e86177d8384c989420175e0cc271cf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:06.754625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:06.771474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3626c1-96f9-4a4b-9165-eb32f6f53da3 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:06.898557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:06.899407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:06.899795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:06.900176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] PATH_INFO: `/v3/users/ee9cb3ec18f34c198b80ef2939798b24` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:06.902988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9cb3ec18f34c198b80ef2939798b24)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:06.905113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:07.216096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9cb3ec18f34c198b80ef2939798b24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:07.216780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9cb3ec18f34c198b80ef2939798b24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:07.288655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9cb3ec18f34c198b80ef2939798b24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:07.293371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9cb3ec18f34c198b80ef2939798b24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:07.299876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6ed39026-dbc4-483c-bb7d-10385853e7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9cb3ec18f34c198b80ef2939798b24'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:07.338863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3253/6518] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:54:06 2022] DELETE /identity/v3/users/ee9cb3ec18f34c198b80ef2939798b24 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:07.851136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:07.853593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:07.894358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592fc7b-3e34-42d5-bdef-7be4ef1d216e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:07.991465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:07.992379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:07.992818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:07.993271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] PATH_INFO: `/v3/projects/77b4b551d961492082ae4800ba9e6c2d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:07.994618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b4b551d961492082ae4800ba9e6c2d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:07.996705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:08.127326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b4b551d961492082ae4800ba9e6c2d', 'request_id': 'req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:08.135952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b4b551d961492082ae4800ba9e6c2d', 'request_id': 'req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:08.223716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b4b551d961492082ae4800ba9e6c2d', 'request_id': 'req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:08.241261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] The token cache is being invalidate because project 77b4b551d961492082ae4800ba9e6c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:54:08.241557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:08.243004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e4ef3dfd-eb33-41f4-8fd0-c9af89c6de62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:08.245605 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3266/6519] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:54:07 2022] DELETE /identity/v3/projects/77b4b551d961492082ae4800ba9e6c2d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:08.251608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27017a59-2385-4859-83c2-c4fc40e7ec73 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.252083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27017a59-2385-4859-83c2-c4fc40e7ec73 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.252200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27017a59-2385-4859-83c2-c4fc40e7ec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.274812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-27017a59-2385-4859-83c2-c4fc40e7ec73 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:08.276326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-27017a59-2385-4859-83c2-c4fc40e7ec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:08.340368 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3254/6520] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:08.348750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03c842-81d9-4971-b850-dbe1c7364593 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.349662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03c842-81d9-4971-b850-dbe1c7364593 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.349992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03c842-81d9-4971-b850-dbe1c7364593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.373035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3b03c842-81d9-4971-b850-dbe1c7364593 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:08.374297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3b03c842-81d9-4971-b850-dbe1c7364593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:08.383496 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3267/6521] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:08.387836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27017a59-2385-4859-83c2-c4fc40e7ec73 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:08.399720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27017a59-2385-4859-83c2-c4fc40e7ec73 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:08.404606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:08.405275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.405556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.405830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.406758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:54:08.407071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:08.408740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:08.420799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:08.424845 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3255/6522] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:54:08.432813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03c842-81d9-4971-b850-dbe1c7364593 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:08.441227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03c842-81d9-4971-b850-dbe1c7364593 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:08.446892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:08.447525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.449468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.449468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.449468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:08.454562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:08.569377 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3268/6523] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:54:08 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:54:08.573116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:08.586981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf23c-d762-4d03-904e-1e2a89708519 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:08.698472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:08.699511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.699795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.700070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.701012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:08.703144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:08.811213 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3256/6524] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:54:08 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:54:08.815490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:08.833205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d00c9-228f-475e-bcec-b9a32968a37b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:08.834642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:08.835271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.835555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.835830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.836515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:08.838220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:08.850412 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3269/6525] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:54:08.855106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:08.866148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca8b9e-eab7-4036-91ab-72f814bd87ea admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:08.878115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348c1a-f81f-4df9-9113-b6d3503d7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:08.878891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348c1a-f81f-4df9-9113-b6d3503d7018 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.879198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348c1a-f81f-4df9-9113-b6d3503d7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.879483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348c1a-f81f-4df9-9113-b6d3503d7018 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.880358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348c1a-f81f-4df9-9113-b6d3503d7018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:08.881987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348c1a-f81f-4df9-9113-b6d3503d7018 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:08.896306 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3257/6526] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:54:08.905291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:08.917674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57632fb1-a759-4a32-9106-e50a11d582c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:08.931571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:08.931571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:08.931571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:08.931571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] PATH_INFO: `/v3/projects/101d652545464e8395bd9e119360da64/users/5b4d0f6fad684ec58010bbf95fed74fc/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:08.952678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=101d652545464e8395bd9e119360da64, user_id=5b4d0f6fad684ec58010bbf95fed74fc, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:08.956011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:09.051518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3270/6527] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:54:08 2022] PUT /identity/v3/projects/101d652545464e8395bd9e119360da64/users/5b4d0f6fad684ec58010bbf95fed74fc/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:54:09.062798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32c23-2999-47c9-a5cd-009dfc9c8cae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:09.063075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32c23-2999-47c9-a5cd-009dfc9c8cae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:09.063558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32c23-2999-47c9-a5cd-009dfc9c8cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:09.096881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00b32c23-2999-47c9-a5cd-009dfc9c8cae None None] MFA Rules not processed for user `5b4d0f6fad684ec58010bbf95fed74fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:09.098175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00b32c23-2999-47c9-a5cd-009dfc9c8cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:09.254215 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3258/6528] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:09.261077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:09.284133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:09.351135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4afb-aedc-4fda-bb69-4838b93fc99a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:09.355814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:09.356434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:09.356868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:09.357142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:09.357773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:09.359745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:09.475501 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3271/6529] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:54:09 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:54:09.479204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32c23-2999-47c9-a5cd-009dfc9c8cae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:09.491424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32c23-2999-47c9-a5cd-009dfc9c8cae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:09.638116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:09.639578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:09.640483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:09.649240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:09.652856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:09.656671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:09.789791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:09.794427 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3259/6530] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:54:09 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:54:09.799002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:09.816053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266409d4-c69b-4da6-94dd-bfd3485c29d9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:09.824152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:09.824931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:09.825371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:09.825665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:09.826540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:09.829187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:09.842089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3272/6531] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:54:09.846369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:09.857244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc287e8-ff11-479a-b15b-2784eec49c85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:09.862105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:09.862801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:09.863084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:09.863362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] PATH_INFO: `/v3/projects/7b5ccd12e7d6447f9a0e3f4979d69f2a/users/910ade33f88341b3b0388ef8a82d8986/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:09.887071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5ccd12e7d6447f9a0e3f4979d69f2a, user_id=910ade33f88341b3b0388ef8a82d8986, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:09.890146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:09.985857 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3260/6532] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:54:09 2022] PUT /identity/v3/projects/7b5ccd12e7d6447f9a0e3f4979d69f2a/users/910ade33f88341b3b0388ef8a82d8986/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:54:09.997486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:10.001891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b2ae-70bf-448f-bbd5-ef0165f23d17 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:10.069566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfe640-252e-4598-a751-fac9decd2ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:10.070228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfe640-252e-4598-a751-fac9decd2ceb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:10.070517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfe640-252e-4598-a751-fac9decd2ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:10.070795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfe640-252e-4598-a751-fac9decd2ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:10.071445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfe640-252e-4598-a751-fac9decd2ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:10.074833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfe640-252e-4598-a751-fac9decd2ceb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:10.092518 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3273/6533] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:54:10.093915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:10.113919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73762794-902b-48d0-9500-ed981309cd7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:10.119533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:10.120236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:10.120520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:10.120795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] PATH_INFO: `/v3/projects/7b5ccd12e7d6447f9a0e3f4979d69f2a/users/910ade33f88341b3b0388ef8a82d8986/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:10.122869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5ccd12e7d6447f9a0e3f4979d69f2a, user_id=910ade33f88341b3b0388ef8a82d8986, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:10.126921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:10.140280 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3261/6534] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:54:10 2022] PUT /identity/v3/projects/7b5ccd12e7d6447f9a0e3f4979d69f2a/users/910ade33f88341b3b0388ef8a82d8986/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:54:10.156392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6351d7-d4b5-4ea0-8d32-9ed34f763176 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:10.156392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6351d7-d4b5-4ea0-8d32-9ed34f763176 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:10.156392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6351d7-d4b5-4ea0-8d32-9ed34f763176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:10.186464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0d6351d7-d4b5-4ea0-8d32-9ed34f763176 None None] MFA Rules not processed for user `910ade33f88341b3b0388ef8a82d8986`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:10.187702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d6351d7-d4b5-4ea0-8d32-9ed34f763176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:10.271487 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3274/6535] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:10.297642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:10.297642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:10.380030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302606c-f13b-4757-ba34-38101136e5d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:10.381547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:10.382602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:10.383293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:10.383746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:10.401062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:10.402827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:10.419850 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3262/6536] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:54:19.180095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6351d7-d4b5-4ea0-8d32-9ed34f763176 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:19.191728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6351d7-d4b5-4ea0-8d32-9ed34f763176 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:19.204407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910ade33f88341b3b0388ef8a82d8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5ccd12e7d6447f9a0e3f4979d69f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:19.207240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:19.207783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:19.208327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:19.209233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:54:19.209756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:19.212159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:19.218200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:19.232292 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3275/6537] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:54:19.237068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:19.248140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc26f-8228-46d2-91af-ea6a73926ece service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:19.253718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910ade33f88341b3b0388ef8a82d8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5ccd12e7d6447f9a0e3f4979d69f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:19.254386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:19.254671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:19.254971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:19.255830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:19.257960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:19.396281 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3263/6538] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:54:19 2022] POST /identity/v3/projects => generated 348 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:54:19.398686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:19.409824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8afb44-98ca-4025-ae26-5dae507472a7 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:19.479300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910ade33f88341b3b0388ef8a82d8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5ccd12e7d6447f9a0e3f4979d69f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:19.480042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:19.480334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:19.480607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:19.481309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:54:19.481621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:19.483253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:19.495097 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3276/6539] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:54:20.202969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:20.216856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b06b4-3b77-44a1-941e-8393278aada2 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:20.221591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '910ade33f88341b3b0388ef8a82d8986', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5ccd12e7d6447f9a0e3f4979d69f2a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:20.222266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:20.222557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:20.222837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] PATH_INFO: `/v3/projects/0bddc8f2b41b4006ba20469d910c484c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:20.223989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0bddc8f2b41b4006ba20469d910c484c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:20.225898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:20.368061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bddc8f2b41b4006ba20469d910c484c', 'request_id': 'req-2035e806-7f0f-4135-86a6-12d3bffae840'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:20.375975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bddc8f2b41b4006ba20469d910c484c', 'request_id': 'req-2035e806-7f0f-4135-86a6-12d3bffae840'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:20.429248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:20.431120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:20.491095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bddc8f2b41b4006ba20469d910c484c', 'request_id': 'req-2035e806-7f0f-4135-86a6-12d3bffae840'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:20.503826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] The token cache is being invalidate because project 0bddc8f2b41b4006ba20469d910c484c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:54:20.504119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:20.505531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:20.517310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3264/6540] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:54:20 2022] DELETE /identity/v3/projects/0bddc8f2b41b4006ba20469d910c484c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:20.519717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:20.522131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:20.525164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81b22-c6c3-4b51-be93-894497a25742 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:20.558726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:20.597631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035e806-7f0f-4135-86a6-12d3bffae840 tempest-RoutersIpV6AdminTest-698571041 tempest-RoutersIpV6AdminTest-698571041-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:20.603182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:20.603800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:20.604951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:20.604951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:20.604951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:20.605326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:20.605326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:20.605326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:20.606947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:20.607081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:20.630974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:20.674555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:20.676168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:20.681298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:20.682903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:20.688558 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3277/6541] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:54:20.697367 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3265/6542] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:54:27.189259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:27.190770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:27.221495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d89ce-fe84-45c1-bdb4-6c49c8275fc9 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:27.236385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:27.237010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:27.237494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:27.237930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:27.242539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:27.414601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:27.416237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:27.428052 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3278/6543] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:54:30.691808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=37 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:35.204058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:35.232831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f9109-9653-428f-bb87-f5520b206177 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:35.232831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:35.232831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:35.232831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:35.233314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:35.233314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:35.366810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:35.368666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:35.419162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3266/6544] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:54:37.422483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=47 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:45.390442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=30 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:45.810605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:45.812361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:45.854344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada48c0a-29fb-4b53-b4ec-4fe5e90c264a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:45.887505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:45.888170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:45.892722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:45.893049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:45.901861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:45.953693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:45.955713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:45.987947 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3279/6545] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:54:53.749183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:53.760494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:53.804471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62f75-c745-4dda-9347-8dc245b1e325 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:53.820286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:53.823239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:53.823936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:53.824369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] PATH_INFO: `/v3/users/371dc522b1db4365900595d2fb0df7b8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:53.828687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371dc522b1db4365900595d2fb0df7b8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:53.840582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:54.116034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371dc522b1db4365900595d2fb0df7b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:54.116923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371dc522b1db4365900595d2fb0df7b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:54.232681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371dc522b1db4365900595d2fb0df7b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:54.233318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371dc522b1db4365900595d2fb0df7b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:54.243890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371dc522b1db4365900595d2fb0df7b8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:54.287922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3267/6546] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:54:53 2022] DELETE /identity/v3/users/371dc522b1db4365900595d2fb0df7b8 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:55.014535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:55.028572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263b49b-1d71-43ad-910d-b559f6082361 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:55.177449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:55.178558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:55.179114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:55.180217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] PATH_INFO: `/v3/projects/3da657bc46794b2c84e755ed48250a86` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:55.183839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da657bc46794b2c84e755ed48250a86)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:55.188474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:55.691836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da657bc46794b2c84e755ed48250a86', 'request_id': 'req-72889907-6c72-4931-a0c4-033b65981747'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:55.699139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da657bc46794b2c84e755ed48250a86', 'request_id': 'req-72889907-6c72-4931-a0c4-033b65981747'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:55.842008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da657bc46794b2c84e755ed48250a86', 'request_id': 'req-72889907-6c72-4931-a0c4-033b65981747'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:55.863733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] The token cache is being invalidate because project 3da657bc46794b2c84e755ed48250a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:54:55.864036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:55.866044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:55.869512 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3280/6547] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:54:55 2022] DELETE /identity/v3/projects/3da657bc46794b2c84e755ed48250a86 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:55.873697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:55.880336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:55.919937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93ed1f-2781-4d66-8443-3677a69a6ed5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:56.037577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:56.038420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:56.038704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:56.038981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] PATH_INFO: `/v3/users/9db4fb751a8a47139dede519c8b7481c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:56.044050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db4fb751a8a47139dede519c8b7481c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:56.048561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:56.329221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db4fb751a8a47139dede519c8b7481c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:56.333274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db4fb751a8a47139dede519c8b7481c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:56.455495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db4fb751a8a47139dede519c8b7481c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:56.456289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db4fb751a8a47139dede519c8b7481c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:56.468286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-96f49cb4-baf7-4956-88bf-c1d61eb9c17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db4fb751a8a47139dede519c8b7481c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:56.484207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:56.509436 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3268/6548] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:54:55 2022] DELETE /identity/v3/users/9db4fb751a8a47139dede519c8b7481c => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:56.883173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:56.885498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:56.915104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889907-6c72-4931-a0c4-033b65981747 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:57.040938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:57.043136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:57.043781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:57.044238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] PATH_INFO: `/v3/projects/261a21adc58343c2919f1e029317f3ea` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:57.046511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261a21adc58343c2919f1e029317f3ea)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:57.049413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:57.157593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:57.343599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261a21adc58343c2919f1e029317f3ea', 'request_id': 'req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:57.360327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261a21adc58343c2919f1e029317f3ea', 'request_id': 'req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:57.444489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261a21adc58343c2919f1e029317f3ea', 'request_id': 'req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:57.469723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] The token cache is being invalidate because project 261a21adc58343c2919f1e029317f3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:54:57.469723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:57.469723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-32c3dc84-613b-4173-b4d9-40a6a2d08ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:54:57.475611 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3281/6549] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:54:56 2022] DELETE /identity/v3/projects/261a21adc58343c2919f1e029317f3ea => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:57.480467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd39de-cf11-430a-98e0-0198f369aeb8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:57.481430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd39de-cf11-430a-98e0-0198f369aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:57.481917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd39de-cf11-430a-98e0-0198f369aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:57.538733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f0bd39de-cf11-430a-98e0-0198f369aeb8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:57.553172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f0bd39de-cf11-430a-98e0-0198f369aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:57.736401 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3269/6550] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:57.745165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581332-1c66-4a9b-9194-9ba674fbbb8e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:57.745928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581332-1c66-4a9b-9194-9ba674fbbb8e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:57.746398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a581332-1c66-4a9b-9194-9ba674fbbb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:57.786586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6a581332-1c66-4a9b-9194-9ba674fbbb8e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:57.787704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6a581332-1c66-4a9b-9194-9ba674fbbb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:57.811284 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3282/6551] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:57.815760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd39de-cf11-430a-98e0-0198f369aeb8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:57.830798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd39de-cf11-430a-98e0-0198f369aeb8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:57.836520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:57.837489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:57.838418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:57.838575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:57.839287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:54:57.839644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:57.841580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:57.857631 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3270/6552] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:54:57.861996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581332-1c66-4a9b-9194-9ba674fbbb8e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:57.876628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a581332-1c66-4a9b-9194-9ba674fbbb8e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:57.883271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:57.893098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:57.893098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:57.893098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:57.893098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:57.893098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:58.029387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3283/6553] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:54:57 2022] POST /identity/v3/projects => generated 391 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:54:58.033305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:58.048733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcedd2-eac7-410a-8f98-d1c47e4ce092 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:58.180776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:58.181674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:58.181961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:58.182854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:58.183378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:58.189983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:58.329142 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3271/6554] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:54:58 2022] POST /identity/v3/users => generated 296 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:54:58.333015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:58.357671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee0464-cccc-49ae-ac22-ae3810e6b2e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:58.363244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:58.364405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:58.364985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:58.365341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:58.366107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:58.368487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:58.381581 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3284/6555] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:54:58.385640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:58.397904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e977ed-4628-49db-876a-a62efd14428e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:58.410831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ba9ea-7bf9-4fc0-8e42-06bf7fd029ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:58.414239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba9ea-7bf9-4fc0-8e42-06bf7fd029ff admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:58.414239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba9ea-7bf9-4fc0-8e42-06bf7fd029ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:58.414239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ba9ea-7bf9-4fc0-8e42-06bf7fd029ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:58.414239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ba9ea-7bf9-4fc0-8e42-06bf7fd029ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:58.416330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ba9ea-7bf9-4fc0-8e42-06bf7fd029ff admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:58.468099 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3272/6556] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:54:58.474824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:58.489049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d690f4-0172-499d-86ef-65e4ddfd3607 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:58.496732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:58.500275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:58.500275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:58.500275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] PATH_INFO: `/v3/projects/e7caeabfa27f4070843694f55f857581/users/b58627a63ea04c6a8a7a62c0f28208c2/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:58.547292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7caeabfa27f4070843694f55f857581, user_id=b58627a63ea04c6a8a7a62c0f28208c2, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:58.554140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:58.673645 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3285/6557] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:54:58 2022] PUT /identity/v3/projects/e7caeabfa27f4070843694f55f857581/users/b58627a63ea04c6a8a7a62c0f28208c2/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:54:58.680963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:58.681510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:58.681628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:58.710202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:54:58.710202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:58.786603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:58.797552 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3273/6558] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:54:58.813185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:54:58.815120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:54:58.919874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffb9f-3f4a-449b-9638-1d6848961813 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:54:58.930359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc541c-4830-4b55-a78e-ba089ebb4fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:54:58.931558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc541c-4830-4b55-a78e-ba089ebb4fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:54:58.932174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc541c-4830-4b55-a78e-ba089ebb4fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:54:58.932743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc541c-4830-4b55-a78e-ba089ebb4fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:54:58.945002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc541c-4830-4b55-a78e-ba089ebb4fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:54:58.947690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc541c-4830-4b55-a78e-ba089ebb4fa4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:54:58.961380 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3286/6559] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:08.154135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:08.156196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:08.174758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c0146-8ede-4d15-8ce7-83012cfe9f3b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:08.192921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:08.193959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:08.194462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:08.194923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] PATH_INFO: `/v3/users/c767ae6dddad482a87ad07055de4daf8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:08.201475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c767ae6dddad482a87ad07055de4daf8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:08.206260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:08.483389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c767ae6dddad482a87ad07055de4daf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:08.484234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c767ae6dddad482a87ad07055de4daf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:08.606692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c767ae6dddad482a87ad07055de4daf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:08.610335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c767ae6dddad482a87ad07055de4daf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:08.625616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c767ae6dddad482a87ad07055de4daf8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:08.676664 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3274/6560] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:08 2022] DELETE /identity/v3/users/c767ae6dddad482a87ad07055de4daf8 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:08.679348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb4cc-0cc6-4131-8c0d-ba323b656ef3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:08.679348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb4cc-0cc6-4131-8c0d-ba323b656ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:08.679348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb4cc-0cc6-4131-8c0d-ba323b656ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:08.725816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cdcdb4cc-0cc6-4131-8c0d-ba323b656ef3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:08.727120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cdcdb4cc-0cc6-4131-8c0d-ba323b656ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:08.847726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:08.902944 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3287/6561] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:08.918930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:08.920989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:09.143920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1701-2df5-42c6-a21d-5519a88051d2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:09.149861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35121f-1e2f-4c86-9e1f-dd287addf846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:09.150533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35121f-1e2f-4c86-9e1f-dd287addf846 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:09.150813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35121f-1e2f-4c86-9e1f-dd287addf846 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:09.151085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35121f-1e2f-4c86-9e1f-dd287addf846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:09.156245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb4cc-0cc6-4131-8c0d-ba323b656ef3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:09.173526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb4cc-0cc6-4131-8c0d-ba323b656ef3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:09.183013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:09.183655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:09.183935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:09.184203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:09.187728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:09.191143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35121f-1e2f-4c86-9e1f-dd287addf846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:09.192600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35121f-1e2f-4c86-9e1f-dd287addf846 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:09.247430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:09.248958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:09.250158 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3275/6562] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:09.252011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7544-4845-43b0-b6fd-fa8030ebb99e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:09.252296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7544-4845-43b0-b6fd-fa8030ebb99e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:09.252566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a7544-4845-43b0-b6fd-fa8030ebb99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:09.279548 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3288/6563] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:55:09.305971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-427a7544-4845-43b0-b6fd-fa8030ebb99e None None] MFA Rules not processed for user `69a2792ee20e450e877d4f016c031768`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:09.307541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-427a7544-4845-43b0-b6fd-fa8030ebb99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:09.454048 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3276/6564] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:12.003691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:12.006553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:12.071825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d22071-38d3-4248-bcc3-c43e5444ce3f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:12.100468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:12.106968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:12.107900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:12.112774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] PATH_INFO: `/v3/projects/bcb6b990bd8a4a62be62d7e9d4aaf431` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:12.119703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb6b990bd8a4a62be62d7e9d4aaf431)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:12.124520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:12.341273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb6b990bd8a4a62be62d7e9d4aaf431', 'request_id': 'req-49911855-f8cc-4d76-a908-a058bccdc27e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:12.355799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb6b990bd8a4a62be62d7e9d4aaf431', 'request_id': 'req-49911855-f8cc-4d76-a908-a058bccdc27e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:12.490633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb6b990bd8a4a62be62d7e9d4aaf431', 'request_id': 'req-49911855-f8cc-4d76-a908-a058bccdc27e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:12.518839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] The token cache is being invalidate because project bcb6b990bd8a4a62be62d7e9d4aaf431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:12.520146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:12.524939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:12.537159 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3289/6565] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:12 2022] DELETE /identity/v3/projects/bcb6b990bd8a4a62be62d7e9d4aaf431 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:12.541908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a7544-4845-43b0-b6fd-fa8030ebb99e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:12.553983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a7544-4845-43b0-b6fd-fa8030ebb99e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:12.587820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:12.687107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:12.687992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:12.688292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:12.688609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] PATH_INFO: `/v3/users/f273ab86def04b30b7b1aa9ba55c7d12` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:12.692186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f273ab86def04b30b7b1aa9ba55c7d12)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:12.694191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:13.020221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f273ab86def04b30b7b1aa9ba55c7d12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:13.020952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f273ab86def04b30b7b1aa9ba55c7d12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:13.114166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f273ab86def04b30b7b1aa9ba55c7d12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:13.116229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f273ab86def04b30b7b1aa9ba55c7d12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:13.140253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a7c2fa85-a0ea-47f9-a375-adee949e8008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f273ab86def04b30b7b1aa9ba55c7d12'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:13.181738 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3277/6566] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:12 2022] DELETE /identity/v3/users/f273ab86def04b30b7b1aa9ba55c7d12 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:15.067736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:15.071972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:15.138116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49911855-f8cc-4d76-a908-a058bccdc27e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:15.354887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:15.355748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:15.357773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:15.359112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] PATH_INFO: `/v3/projects/ea554b86bd0f4a7cb2de5a852b91b387` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:15.361114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea554b86bd0f4a7cb2de5a852b91b387)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:15.365698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:15.621770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea554b86bd0f4a7cb2de5a852b91b387', 'request_id': 'req-2254c1df-44fa-4841-9d16-c0b0c440cb56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:15.645067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea554b86bd0f4a7cb2de5a852b91b387', 'request_id': 'req-2254c1df-44fa-4841-9d16-c0b0c440cb56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:15.653869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:15.829471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea554b86bd0f4a7cb2de5a852b91b387', 'request_id': 'req-2254c1df-44fa-4841-9d16-c0b0c440cb56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:15.870110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] The token cache is being invalidate because project ea554b86bd0f4a7cb2de5a852b91b387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:15.870110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:15.870794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2254c1df-44fa-4841-9d16-c0b0c440cb56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:15.878675 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3290/6567] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:15 2022] DELETE /identity/v3/projects/ea554b86bd0f4a7cb2de5a852b91b387 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:15.879375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb6b40-910f-4539-9f92-432bbb5a711f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:15.879819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb6b40-910f-4539-9f92-432bbb5a711f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:15.879915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb6b40-910f-4539-9f92-432bbb5a711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:15.929705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6acb6b40-910f-4539-9f92-432bbb5a711f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:15.929705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6acb6b40-910f-4539-9f92-432bbb5a711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:16.054546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3278/6568] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:16.055325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443948f4-0fe6-4e58-bb60-fb0f0e1e1b6e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:16.055617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443948f4-0fe6-4e58-bb60-fb0f0e1e1b6e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:16.055935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443948f4-0fe6-4e58-bb60-fb0f0e1e1b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:16.095710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-443948f4-0fe6-4e58-bb60-fb0f0e1e1b6e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:16.098766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-443948f4-0fe6-4e58-bb60-fb0f0e1e1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:16.119545 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3291/6569] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:16.122984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb6b40-910f-4539-9f92-432bbb5a711f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:16.158999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb6b40-910f-4539-9f92-432bbb5a711f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:16.171597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:16.172463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:16.172960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:16.173421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:16.175037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:16.175559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:16.177405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:16.197388 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3279/6570] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:16.201689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443948f4-0fe6-4e58-bb60-fb0f0e1e1b6e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:16.222635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443948f4-0fe6-4e58-bb60-fb0f0e1e1b6e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:16.233548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:16.234783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:16.235285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:16.235715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:16.236527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:16.240461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:16.521309 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3292/6571] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:16 2022] POST /identity/v3/projects => generated 365 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:16.525800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:16.569012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ca94c-219c-4fbe-ab49-a48098971ee2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:16.632574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:16.734558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:16.735864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:16.736431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:16.736951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:16.739822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:16.742475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:16.912910 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3280/6572] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:16 2022] POST /identity/v3/users => generated 283 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:16.917189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:16.930380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccba32-f5c9-41ee-b6d7-6d195b7a3911 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:16.942494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:16.943413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:16.943852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:16.944280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:16.955284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:16.958285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:16.976706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3293/6573] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:16.981042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:17.017285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6980aa-add3-4fd7-84e8-394ab6de917b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:17.030448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed88da-ffc4-41b4-a78f-298e6d414ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:17.031288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed88da-ffc4-41b4-a78f-298e6d414ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:17.031958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed88da-ffc4-41b4-a78f-298e6d414ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:17.032249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed88da-ffc4-41b4-a78f-298e6d414ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:17.033315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed88da-ffc4-41b4-a78f-298e6d414ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:17.037158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed88da-ffc4-41b4-a78f-298e6d414ea4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:17.058625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3281/6574] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:17.063805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:17.102271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656a9be-4cf4-4bb0-b848-024c8bf23974 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:17.117890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42474b7e-b9dd-4422-b8f8-3a66e3b56428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:17.119547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42474b7e-b9dd-4422-b8f8-3a66e3b56428 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:17.131735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e079-d5c4-4f1a-b375-e615d4308de1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:17.132244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e079-d5c4-4f1a-b375-e615d4308de1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:17.132731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e079-d5c4-4f1a-b375-e615d4308de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:17.138141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42474b7e-b9dd-4422-b8f8-3a66e3b56428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:17.138438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42474b7e-b9dd-4422-b8f8-3a66e3b56428 admin admin] PATH_INFO: `/v3/projects/22bff938fc154dbd99890ae00f819091/users/12a88d6684f846ac862330c35a5a2a03/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:17.178020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42474b7e-b9dd-4422-b8f8-3a66e3b56428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bff938fc154dbd99890ae00f819091, user_id=12a88d6684f846ac862330c35a5a2a03, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:17.178575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4848e079-d5c4-4f1a-b375-e615d4308de1 None None] MFA Rules not processed for user `b58627a63ea04c6a8a7a62c0f28208c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:17.180238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4848e079-d5c4-4f1a-b375-e615d4308de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:17.180782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42474b7e-b9dd-4422-b8f8-3a66e3b56428 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:17.315559 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3282/6575] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:17.326577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:17.328327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:17.328920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:17.372070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] MFA Rules not processed for user `b58627a63ea04c6a8a7a62c0f28208c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:17.372293 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3294/6576] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:17 2022] PUT /identity/v3/projects/22bff938fc154dbd99890ae00f819091/users/12a88d6684f846ac862330c35a5a2a03/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:17.372394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:17.380968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473fb0d-d83c-49f3-8e87-4014ba80b4d7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:17.381253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473fb0d-d83c-49f3-8e87-4014ba80b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:17.381532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473fb0d-d83c-49f3-8e87-4014ba80b4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:17.445299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1473fb0d-d83c-49f3-8e87-4014ba80b4d7 None None] MFA Rules not processed for user `12a88d6684f846ac862330c35a5a2a03`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:17.446688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1473fb0d-d83c-49f3-8e87-4014ba80b4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:17.481964 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3283/6577] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:17.492479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:17.494042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:17.601069 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3295/6578] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:55:17.607400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473fb0d-d83c-49f3-8e87-4014ba80b4d7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:17.650236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ef38e-3e8b-48dd-8ad9-96bb1b76d840 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:17.686857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:17.686857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:17.686857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:17.686857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:17.692587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:17.706253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:17.727320 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3284/6579] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:17.749998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473fb0d-d83c-49f3-8e87-4014ba80b4d7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:17.757825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:17.758980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:17.759413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:17.759847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:17.760682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:17.763776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:17.968576 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3296/6580] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:17 2022] POST /identity/v3/projects => generated 363 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:17.976127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:18.008840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546be84-5685-4ef2-8367-37f5ec1567a0 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:18.128032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:18.129692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:18.131243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:18.132540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:18.133472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:18.140422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:18.194339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:18.329877 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3285/6581] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:17 2022] POST /identity/v3/users => generated 288 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:18.330559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:18.349223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9952d3-1813-4d1a-b2b4-d92907e80862 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:18.363021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:18.363874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:18.364171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:18.364498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:18.365178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:18.376432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:18.419038 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3297/6582] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:18.422975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:18.436887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd0f1-f89c-4033-a93b-e88b4fa1fa07 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:18.446736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:18.447891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:18.448022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:18.449548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] PATH_INFO: `/v3/projects/a612cc924660470e86bf8be26951cec9/users/d19a5f35b57143c7b4da43ece9809c97/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:18.481313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a612cc924660470e86bf8be26951cec9, user_id=d19a5f35b57143c7b4da43ece9809c97, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:18.485001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:18.655082 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3286/6583] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:18 2022] PUT /identity/v3/projects/a612cc924660470e86bf8be26951cec9/users/d19a5f35b57143c7b4da43ece9809c97/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:18.656584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:18.670403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8537aba-1eb6-4ade-ae1b-6561fc3af603 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:18.780920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6079c8-19bb-4330-a419-640ab2d68702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:18.781677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6079c8-19bb-4330-a419-640ab2d68702 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:18.782023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6079c8-19bb-4330-a419-640ab2d68702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:18.785369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6079c8-19bb-4330-a419-640ab2d68702 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:18.785369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6079c8-19bb-4330-a419-640ab2d68702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:18.786239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6079c8-19bb-4330-a419-640ab2d68702 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:18.801262 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3298/6584] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:18.805497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:18.823401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5d331-8f46-482e-9b56-3512c19238c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:18.831041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:18.831041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:18.831041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:18.832065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] PATH_INFO: `/v3/projects/a612cc924660470e86bf8be26951cec9/users/d19a5f35b57143c7b4da43ece9809c97/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:18.834622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a612cc924660470e86bf8be26951cec9, user_id=d19a5f35b57143c7b4da43ece9809c97, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:18.840122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:18.869455 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3287/6585] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:18 2022] PUT /identity/v3/projects/a612cc924660470e86bf8be26951cec9/users/d19a5f35b57143c7b4da43ece9809c97/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:18.870490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:18.870781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:18.871058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:18.903639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:18.938250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] MFA Rules not processed for user `d19a5f35b57143c7b4da43ece9809c97`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:18.939994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:19.076817 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3299/6586] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:55:19.089435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:19.092462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:19.198516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:19.204481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:19.222252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687731d-6896-4771-bc4a-7c52e65411c4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:19.239589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:19.240174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:19.240527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:19.240870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:19.296200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:19.298571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:19.343603 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3288/6587] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:19.424777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9442928-d7c5-455b-96e9-ef122bb1862b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:19.431059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:19.432945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:19.485793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:19.486500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:19.488059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:19.488352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] PATH_INFO: `/v3/users/d3ed4523fb1d423abcf98fdb30b37b0a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:19.489590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ed4523fb1d423abcf98fdb30b37b0a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:19.492313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:19.635309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111ac9b-0136-449c-b0ee-98aff55b54c8 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:19.670803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:19.671467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:19.671808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:19.672091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:19.674049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:19.694375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:19.707676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:19.739346 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3289/6588] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:55:19.791806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:19.832154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c82ba-a56f-497a-bc0f-5642e0365ed9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:19.848897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:19.850842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:19.851134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:19.851415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:19.878579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ed4523fb1d423abcf98fdb30b37b0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:19.890916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ed4523fb1d423abcf98fdb30b37b0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:19.892095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ed4523fb1d423abcf98fdb30b37b0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:19.912000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ed4523fb1d423abcf98fdb30b37b0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:20.017932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:20.023045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:20.049798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a50918e3-c586-41d1-822a-e66b265637c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ed4523fb1d423abcf98fdb30b37b0a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:20.053428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3290/6589] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:55:20.062412 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3300/6590] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:19 2022] DELETE /identity/v3/users/d3ed4523fb1d423abcf98fdb30b37b0a => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:20.075446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:20.240984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:20.637179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:20.650530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b28c6-8891-4212-99fd-dfb184f5d715 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:20.728381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:20.729565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:20.730158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:20.730508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] PATH_INFO: `/v3/projects/b9380daa22eb489dbb2b7e27806c8bb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:20.733872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9380daa22eb489dbb2b7e27806c8bb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:20.749601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:20.967012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9380daa22eb489dbb2b7e27806c8bb3', 'request_id': 'req-11713279-7184-47fc-9b52-b537a6a9e68b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:20.977676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9380daa22eb489dbb2b7e27806c8bb3', 'request_id': 'req-11713279-7184-47fc-9b52-b537a6a9e68b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:21.074375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9380daa22eb489dbb2b7e27806c8bb3', 'request_id': 'req-11713279-7184-47fc-9b52-b537a6a9e68b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:21.088251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] The token cache is being invalidate because project b9380daa22eb489dbb2b7e27806c8bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:21.090890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:21.093604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-11713279-7184-47fc-9b52-b537a6a9e68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:21.095594 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3291/6591] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:20 2022] DELETE /identity/v3/projects/b9380daa22eb489dbb2b7e27806c8bb3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:21.101099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d699e-ddd0-4d01-8cf2-002d705b3820 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.101559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d699e-ddd0-4d01-8cf2-002d705b3820 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.101559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d699e-ddd0-4d01-8cf2-002d705b3820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.139058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4e5d699e-ddd0-4d01-8cf2-002d705b3820 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:21.140535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e5d699e-ddd0-4d01-8cf2-002d705b3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:21.222595 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3301/6592] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:21.230844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f767a-ea21-497f-a52b-db9c08195a70 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.231377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f767a-ea21-497f-a52b-db9c08195a70 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.231838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f767a-ea21-497f-a52b-db9c08195a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.257326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a1f767a-ea21-497f-a52b-db9c08195a70 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:21.258594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a1f767a-ea21-497f-a52b-db9c08195a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:21.266867 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3292/6593] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:21.271560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d699e-ddd0-4d01-8cf2-002d705b3820 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:21.282259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d699e-ddd0-4d01-8cf2-002d705b3820 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:21.289979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:21.290912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.290912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.291274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.291850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:21.292158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:21.293944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:21.328338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3302/6594] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:21.329659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f767a-ea21-497f-a52b-db9c08195a70 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:21.341492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f767a-ea21-497f-a52b-db9c08195a70 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:21.351448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:21.352239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.353690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.354182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.355714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:21.360027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:21.402694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:21.404479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:21.497515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3293/6595] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:21 2022] POST /identity/v3/projects => generated 403 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:21.505114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:21.572012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:21.589880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a623ae7-0d4b-417f-9905-b5c11289dc74 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:21.612299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476e5d-0092-46d5-9d41-ded8f174b7a2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:21.621050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:21.621693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.621980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.622301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.622966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:21.625105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:21.655165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:21.772346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:21.773501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.774352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.774732 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3294/6596] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:21 2022] POST /identity/v3/users => generated 302 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:21.775041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.778103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:21.779452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:21.799488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:21.803491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:21.827137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b3ee2-a65e-4a43-a752-bd61805fe331 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:21.839496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:21.845077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.845967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.846309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.847053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:21.848832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:21.852422 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3303/6597] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:21.879028 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3295/6598] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:21.879450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:21.914234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6c1bd-9ef9-4649-a9e8-818b2eaa7c7d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:21.921536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496441-0613-40ee-8a60-96d235cd6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:21.922291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496441-0613-40ee-8a60-96d235cd6a75 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.925581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496441-0613-40ee-8a60-96d235cd6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.925581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496441-0613-40ee-8a60-96d235cd6a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:21.925581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496441-0613-40ee-8a60-96d235cd6a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:21.929151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496441-0613-40ee-8a60-96d235cd6a75 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:21.953089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:21.953277 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3304/6599] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:21.968888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459dd62-a24d-4917-ac46-8058e96094c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:21.986279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:21.987050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:21.987403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:21.988493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] PATH_INFO: `/v3/projects/48814522a995469c9a7739ca141ded9a/users/6c0e2e7a629546559dbaf18b5daf4e70/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:22.025079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48814522a995469c9a7739ca141ded9a, user_id=6c0e2e7a629546559dbaf18b5daf4e70, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:22.030894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:22.340435 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3296/6600] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:21 2022] PUT /identity/v3/projects/48814522a995469c9a7739ca141ded9a/users/6c0e2e7a629546559dbaf18b5daf4e70/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:22.343422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffcb7c-144b-436e-be26-fe9deb14dddf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:22.344493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffcb7c-144b-436e-be26-fe9deb14dddf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:22.344937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffcb7c-144b-436e-be26-fe9deb14dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:22.381367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c7ffcb7c-144b-436e-be26-fe9deb14dddf None None] MFA Rules not processed for user `6c0e2e7a629546559dbaf18b5daf4e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:22.383419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7ffcb7c-144b-436e-be26-fe9deb14dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:22.523427 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3305/6601] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:22.525215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:22.648125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad50178-43c6-4d98-b8f4-efd6d1dbad0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:22.655351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:22.656784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:22.657236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:22.657976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:22.659264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:22.663133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:22.775986 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3297/6602] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:22 2022] POST /identity/v3/projects => generated 401 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:22.777759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffcb7c-144b-436e-be26-fe9deb14dddf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:22.802940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffcb7c-144b-436e-be26-fe9deb14dddf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:22.916288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:22.917324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:22.917791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:22.918428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:22.919594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:22.922292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:23.007962 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3306/6603] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:22 2022] POST /identity/v3/users => generated 307 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:23.012064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:23.028164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f9b1-54e5-40eb-9848-6a86666997bb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:23.057861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:23.062354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:23.062354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:23.062354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:23.062354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:23.062354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:23.085321 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3298/6604] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:23.091969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:23.106541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb87c-c113-48d6-b415-6c702ddb75c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:23.120200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:23.120833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:23.121358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:23.121836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] PATH_INFO: `/v3/projects/9ebb1281286a4d38a8a57a583659f4bb/users/54c7c117a73e4d9087b44fefbfb1d7f8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:23.147872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb1281286a4d38a8a57a583659f4bb, user_id=54c7c117a73e4d9087b44fefbfb1d7f8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:23.151107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:23.282560 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3307/6605] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:23 2022] PUT /identity/v3/projects/9ebb1281286a4d38a8a57a583659f4bb/users/54c7c117a73e4d9087b44fefbfb1d7f8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:23.286918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:23.307736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b41a9-dacc-4219-bc1f-8fdb540ed8e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:23.415425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905f66-fddd-4c0e-ae73-2ac4ee7c7ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:23.416476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905f66-fddd-4c0e-ae73-2ac4ee7c7ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:23.416876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905f66-fddd-4c0e-ae73-2ac4ee7c7ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:23.417252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905f66-fddd-4c0e-ae73-2ac4ee7c7ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:23.418886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41905f66-fddd-4c0e-ae73-2ac4ee7c7ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:23.421469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41905f66-fddd-4c0e-ae73-2ac4ee7c7ff3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:23.442206 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3299/6606] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:23.445617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:23.464968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fe773-41df-43b6-b70f-e41aac9381aa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:23.492806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:23.497067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:23.498307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:23.500459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] PATH_INFO: `/v3/projects/9ebb1281286a4d38a8a57a583659f4bb/users/54c7c117a73e4d9087b44fefbfb1d7f8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:23.505413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb1281286a4d38a8a57a583659f4bb, user_id=54c7c117a73e4d9087b44fefbfb1d7f8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:23.530857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:23.575751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6402-cbc4-4e89-985f-1c4dac4e0241 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:23.576496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6402-cbc4-4e89-985f-1c4dac4e0241 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:23.576923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b6402-cbc4-4e89-985f-1c4dac4e0241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:23.585446 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3308/6607] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:23 2022] PUT /identity/v3/projects/9ebb1281286a4d38a8a57a583659f4bb/users/54c7c117a73e4d9087b44fefbfb1d7f8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:23.651368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a64b6402-cbc4-4e89-985f-1c4dac4e0241 None None] MFA Rules not processed for user `54c7c117a73e4d9087b44fefbfb1d7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:23.652639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a64b6402-cbc4-4e89-985f-1c4dac4e0241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:23.806104 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3300/6608] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:23.814348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:23.844139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd786-fc35-424a-a360-4bbe274d2e9f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:23.860248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c7c117a73e4d9087b44fefbfb1d7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ebb1281286a4d38a8a57a583659f4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:23.860890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:23.861174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:23.861893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:23.864082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:23.865729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:23.993400 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3309/6609] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:55:23 2022] POST /identity/v3/roles => generated 239 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:23.995012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6402-cbc4-4e89-985f-1c4dac4e0241 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:24.009048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b6402-cbc4-4e89-985f-1c4dac4e0241 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:24.037530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c7c117a73e4d9087b44fefbfb1d7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ebb1281286a4d38a8a57a583659f4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:24.040232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:24.042664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:24.043210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] PATH_INFO: `/v3/projects/48814522a995469c9a7739ca141ded9a/users/6c0e2e7a629546559dbaf18b5daf4e70/roles/c0970653ad59447a89bec1c05f92be41` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:24.049768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: Authorizing `identity:create_grant(project_id=48814522a995469c9a7739ca141ded9a, user_id=6c0e2e7a629546559dbaf18b5daf4e70, role_id=c0970653ad59447a89bec1c05f92be41)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:24.057224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:24.208411 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3301/6610] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:23 2022] PUT /identity/v3/projects/48814522a995469c9a7739ca141ded9a/users/6c0e2e7a629546559dbaf18b5daf4e70/roles/c0970653ad59447a89bec1c05f92be41 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:24.214576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:24.382078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976ed61-de0b-4640-9c10-bfbd13f2b817 tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:24.474451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da3739-2a20-484b-901a-9c38fba52339 tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0e2e7a629546559dbaf18b5daf4e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48814522a995469c9a7739ca141ded9a', 'project_domain_id': 'default', 'roles': ['tempest-test_role-121879971', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:24.477007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da3739-2a20-484b-901a-9c38fba52339 tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:24.477007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da3739-2a20-484b-901a-9c38fba52339 tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:24.477007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da3739-2a20-484b-901a-9c38fba52339 tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] PATH_INFO: `/v3/users/6c0e2e7a629546559dbaf18b5daf4e70/application_credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:24.477007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da3739-2a20-484b-901a-9c38fba52339 tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] RBAC: Authorizing `identity:create_application_credential(user_id=6c0e2e7a629546559dbaf18b5daf4e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:24.477888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da3739-2a20-484b-901a-9c38fba52339 tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:24.594608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:24.642113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:24.645398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:24.667029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:24.699092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3310/6611] 10.222.0.27 () {60 vars in 1315 bytes} [Tue Oct 18 13:55:24 2022] POST /identity/v3/users/6c0e2e7a629546559dbaf18b5daf4e70/application_credentials => generated 659 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:24.705907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67606f-9cca-4826-b65b-51c816ca2e49 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:24.706685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67606f-9cca-4826-b65b-51c816ca2e49 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:24.706865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67606f-9cca-4826-b65b-51c816ca2e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:24.745489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ae67606f-9cca-4826-b65b-51c816ca2e49 None None] MFA Rules not processed for user `6c0e2e7a629546559dbaf18b5daf4e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:24.746832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ae67606f-9cca-4826-b65b-51c816ca2e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:24.785808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9f99-4e6d-410f-a4bd-f02d53f5f35b tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:24.800687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:24.809505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:24.809505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:24.809505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] PATH_INFO: `/v3/users/12a88d6684f846ac862330c35a5a2a03` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:24.809505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a88d6684f846ac862330c35a5a2a03)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:24.809505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:25.013932 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3311/6612] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 18 13:55:25.015095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67606f-9cca-4826-b65b-51c816ca2e49 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:25.029285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67606f-9cca-4826-b65b-51c816ca2e49 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:25.035575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c0e2e7a629546559dbaf18b5daf4e70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48814522a995469c9a7739ca141ded9a', 'project_domain_id': 'default', 'roles': ['tempest-test_role-121879971', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:25.036187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:25.036619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:25.036905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] PATH_INFO: `/v3/users/6c0e2e7a629546559dbaf18b5daf4e70/application_credentials/543c1b9f8a204f26b96d91bf5d0b0596` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:25.038555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] RBAC: Authorizing `identity:delete_application_credential(user_id=6c0e2e7a629546559dbaf18b5daf4e70, application_credential_id=543c1b9f8a204f26b96d91bf5d0b0596)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:25.039986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:25.138147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a88d6684f846ac862330c35a5a2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:25.146545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a88d6684f846ac862330c35a5a2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:25.201747 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3312/6613] 10.222.0.27 () {58 vars in 1395 bytes} [Tue Oct 18 13:55:25 2022] DELETE /identity/v3/users/6c0e2e7a629546559dbaf18b5daf4e70/application_credentials/543c1b9f8a204f26b96d91bf5d0b0596 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:25.206366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:25.208306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:25.259195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a88d6684f846ac862330c35a5a2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:25.260570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a88d6684f846ac862330c35a5a2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:25.277682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-09ae9f69-8a19-460a-8b5f-f587fda04d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a88d6684f846ac862330c35a5a2a03'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:25.349650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3302/6614] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:24 2022] DELETE /identity/v3/users/12a88d6684f846ac862330c35a5a2a03 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:25.355335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:25.355613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:25.358448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:25.411814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:25.414354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:25.432588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df726d8-ab75-43ca-a04b-f9024f00e2ba tempest-ApplicationCredentialsV3AdminTest-1576799526 tempest-ApplicationCredentialsV3AdminTest-1576799526-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:25.548584 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3303/6615] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:25.556939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:25.558724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:25.596544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54c7c117a73e4d9087b44fefbfb1d7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ebb1281286a4d38a8a57a583659f4bb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:25.601638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:25.605934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:25.605934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] PATH_INFO: `/v3/roles/c0970653ad59447a89bec1c05f92be41` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:25.607555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c0970653ad59447a89bec1c05f92be41)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:25.613191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:25.698633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86a27a-b7d4-4733-ad8b-0a3b1ee341aa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:25.732981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:25.733638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:25.733925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:25.734235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:25.749494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:25.750164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:25.779877 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3304/6616] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:25.921678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Invalidating the token cache because role c0970653ad59447a89bec1c05f92be41 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:25.923291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:25.929003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cdaac881-6b21-4135-acf6-4896805118fc tempest-ApplicationCredentialsV3AdminTest-348693812 tempest-ApplicationCredentialsV3AdminTest-348693812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:25.932801 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3313/6617] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:25 2022] DELETE /identity/v3/roles/c0970653ad59447a89bec1c05f92be41 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:25.937802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:25.939343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:25.962597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c206195-a4e9-4ece-99f8-59e303f54f2a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:26.063972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:26.065104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:26.065394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:26.065722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] PATH_INFO: `/v3/users/6c0e2e7a629546559dbaf18b5daf4e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:26.067119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0e2e7a629546559dbaf18b5daf4e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:26.070148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:26.318473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0e2e7a629546559dbaf18b5daf4e70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:26.319721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0e2e7a629546559dbaf18b5daf4e70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:26.419267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0e2e7a629546559dbaf18b5daf4e70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:26.419922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0e2e7a629546559dbaf18b5daf4e70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:26.431895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0e2e7a629546559dbaf18b5daf4e70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:26.505232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be6bf-4f08-4d26-8066-1d546b8bc972 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:26.505530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be6bf-4f08-4d26-8066-1d546b8bc972 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:26.505783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93be6bf-4f08-4d26-8066-1d546b8bc972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:26.510996 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3305/6618] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:25 2022] DELETE /identity/v3/users/6c0e2e7a629546559dbaf18b5daf4e70 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:26.536637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f93be6bf-4f08-4d26-8066-1d546b8bc972 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:26.537866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f93be6bf-4f08-4d26-8066-1d546b8bc972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:26.666444 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3314/6619] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:26.709346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:26.712378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:26.837440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bc93f-57ce-452a-9ad0-68d11c5263c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:26.842523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:26.843166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:26.843455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:26.843734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:26.856596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:26.858379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:26.871300 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3306/6620] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:26.928124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:27.556517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93be6bf-4f08-4d26-8066-1d546b8bc972 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:27.571514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93be6bf-4f08-4d26-8066-1d546b8bc972 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:27.575934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:27.576813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:27.577249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:27.577696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:27.580449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:27.589272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:27.594017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:27.595131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:27.607522 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3315/6621] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:27.747345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:27.748999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:27.768871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ed555-ce09-4331-80d6-fa8f623014ba service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:27.783844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:27.784532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:27.784820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:27.785102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] PATH_INFO: `/v3/projects/22bff938fc154dbd99890ae00f819091` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:27.787086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bff938fc154dbd99890ae00f819091)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:27.789320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:28.029084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bff938fc154dbd99890ae00f819091', 'request_id': 'req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.042616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bff938fc154dbd99890ae00f819091', 'request_id': 'req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.188303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bff938fc154dbd99890ae00f819091', 'request_id': 'req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.201752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] The token cache is being invalidate because project 22bff938fc154dbd99890ae00f819091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:28.202043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.202780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.204551 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3307/6622] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:27 2022] DELETE /identity/v3/projects/22bff938fc154dbd99890ae00f819091 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:28.208856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:28.221383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044aeed-53fa-47fb-bb56-7d286266791c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:28.282269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:28.283697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:28.303294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:28.303885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:28.304241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:28.304483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] PATH_INFO: `/v3/users/d19a5f35b57143c7b4da43ece9809c97` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:28.305825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19a5f35b57143c7b4da43ece9809c97)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:28.308391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:28.404956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fce21e-e83c-43d4-9982-cb2fcd94c03d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:28.425592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:28.428846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:28.428846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:28.428846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] PATH_INFO: `/v3/users/5b4d0f6fad684ec58010bbf95fed74fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:28.429657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4d0f6fad684ec58010bbf95fed74fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:28.432248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:28.570526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19a5f35b57143c7b4da43ece9809c97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.590005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19a5f35b57143c7b4da43ece9809c97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.594750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19a5f35b57143c7b4da43ece9809c97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.629604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19a5f35b57143c7b4da43ece9809c97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.652691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:28.674422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4d0f6fad684ec58010bbf95fed74fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.675583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4d0f6fad684ec58010bbf95fed74fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.726343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19a5f35b57143c7b4da43ece9809c97'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.733993 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3316/6623] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:28 2022] DELETE /identity/v3/users/d19a5f35b57143c7b4da43ece9809c97 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:28.736965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:28.736965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:28.805751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4d0f6fad684ec58010bbf95fed74fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.807124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4d0f6fad684ec58010bbf95fed74fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.816215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fb58774a-a895-4c5a-8da1-ac0a2eba91ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4d0f6fad684ec58010bbf95fed74fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:28.854991 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3308/6624] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:28 2022] DELETE /identity/v3/users/5b4d0f6fad684ec58010bbf95fed74fc => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:28.859891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:28.860845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:28.861991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:28.890950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7784-abf1-43e0-8ad0-cf5739fc69ff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:28.905100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:28.909276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:29.002829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3309/6625] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:29.004084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:29.004778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:29.005254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:29.005540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] PATH_INFO: `/v3/projects/48814522a995469c9a7739ca141ded9a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:29.013467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48814522a995469c9a7739ca141ded9a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:29.014218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:29.015720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:29.016094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:29.102985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3ecd8-ed6f-4e32-b8c2-0ca1c985140e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:29.105878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:29.105998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:29.106311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:29.106591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:29.125380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:29.127164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:29.169336 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3310/6626] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:29.210076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48814522a995469c9a7739ca141ded9a', 'request_id': 'req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.245477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48814522a995469c9a7739ca141ded9a', 'request_id': 'req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.394948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48814522a995469c9a7739ca141ded9a', 'request_id': 'req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.408803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] The token cache is being invalidate because project 48814522a995469c9a7739ca141ded9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:29.409749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.410807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.412598 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3317/6627] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:28 2022] DELETE /identity/v3/projects/48814522a995469c9a7739ca141ded9a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:29.416758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:29.418365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:29.455724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109aa42-1484-4810-8a37-8781377531ae service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:29.507343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:29.547485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:29.548140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:29.548816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:29.548816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] PATH_INFO: `/v3/users/54c7c117a73e4d9087b44fefbfb1d7f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:29.550625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c7c117a73e4d9087b44fefbfb1d7f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:29.552554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:29.871112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c7c117a73e4d9087b44fefbfb1d7f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.875675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c7c117a73e4d9087b44fefbfb1d7f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.946451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:29.948329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:29.962124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f944-9ed5-4fc5-bbb5-4b05fcfdc9b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:29.964472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c7c117a73e4d9087b44fefbfb1d7f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.965132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c7c117a73e4d9087b44fefbfb1d7f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:29.973340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:29.973340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:29.973340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:29.973340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] PATH_INFO: `/v3/projects/101d652545464e8395bd9e119360da64` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:29.973855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] RBAC: Authorizing `identity:delete_project(project_id=101d652545464e8395bd9e119360da64)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:29.973855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:29.978049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c7c117a73e4d9087b44fefbfb1d7f8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.028717 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3311/6628] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:29 2022] DELETE /identity/v3/users/54c7c117a73e4d9087b44fefbfb1d7f8 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:30.225508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101d652545464e8395bd9e119360da64', 'request_id': 'req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.232642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101d652545464e8395bd9e119360da64', 'request_id': 'req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.256625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:30.259687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:30.360205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433487ae-3c23-4b1a-9a3e-69ca47b784a1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:30.420268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101d652545464e8395bd9e119360da64', 'request_id': 'req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.435892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:30.436872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:30.437386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:30.437921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] PATH_INFO: `/v3/projects/a612cc924660470e86bf8be26951cec9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:30.439374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a612cc924660470e86bf8be26951cec9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:30.442398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:30.460858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] The token cache is being invalidate because project 101d652545464e8395bd9e119360da64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:30.460858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.460858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.460858 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3318/6629] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:29 2022] DELETE /identity/v3/projects/101d652545464e8395bd9e119360da64 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:30.463764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:30.472408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:30.509404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cfa90-26f7-4c9b-a26a-5bfa7b23070f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:30.514913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:30.515570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:30.515857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:30.516137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] PATH_INFO: `/v3/users/910ade33f88341b3b0388ef8a82d8986` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:30.519831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=910ade33f88341b3b0388ef8a82d8986)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:30.522481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:30.625480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a612cc924660470e86bf8be26951cec9', 'request_id': 'req-8768d8c7-38b8-41f8-ac7d-881ffc78be32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.637388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a612cc924660470e86bf8be26951cec9', 'request_id': 'req-8768d8c7-38b8-41f8-ac7d-881ffc78be32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.778593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a612cc924660470e86bf8be26951cec9', 'request_id': 'req-8768d8c7-38b8-41f8-ac7d-881ffc78be32'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.794627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] The token cache is being invalidate because project a612cc924660470e86bf8be26951cec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:30.795361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.795929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8768d8c7-38b8-41f8-ac7d-881ffc78be32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.801988 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3312/6630] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:30 2022] DELETE /identity/v3/projects/a612cc924660470e86bf8be26951cec9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:30.805429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd2fe-6c9f-4bb7-b520-4999af372673 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:30.805794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd2fe-6c9f-4bb7-b520-4999af372673 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:30.806737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd2fe-6c9f-4bb7-b520-4999af372673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:30.839740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910ade33f88341b3b0388ef8a82d8986'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.854917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910ade33f88341b3b0388ef8a82d8986'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.855979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910ade33f88341b3b0388ef8a82d8986'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.862988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7bafd2fe-6c9f-4bb7-b520-4999af372673 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:30.863349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7bafd2fe-6c9f-4bb7-b520-4999af372673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:30.869946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910ade33f88341b3b0388ef8a82d8986'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.903505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:30.952173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3313/6631] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:30.962711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a7b5-2d55-433e-a171-fa88a06898d9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:30.963005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a7b5-2d55-433e-a171-fa88a06898d9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:30.963278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a7b5-2d55-433e-a171-fa88a06898d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:30.966159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910ade33f88341b3b0388ef8a82d8986'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:30.978344 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3319/6632] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:30 2022] DELETE /identity/v3/users/910ade33f88341b3b0388ef8a82d8986 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:31.008230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0e09a7b5-2d55-433e-a171-fa88a06898d9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:31.009481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e09a7b5-2d55-433e-a171-fa88a06898d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:31.127811 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3314/6633] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:31.131953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:31.147405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721d205-f260-4335-a3f5-e5def9dbbd60 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:31.173308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:31.177333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:31.177874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:31.178359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:31.179295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:31.179616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:31.181340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:31.201298 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3320/6634] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:31.205582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09a7b5-2d55-433e-a171-fa88a06898d9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:31.225649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09a7b5-2d55-433e-a171-fa88a06898d9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:31.231608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:31.232590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:31.233058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:31.233508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:31.234356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:31.237936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:31.354604 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3315/6635] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:31 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:31.355008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:31.371969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837045-82dc-40c1-bd63-f19a77820c56 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:31.523414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:31.524088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:31.524794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:31.525150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:31.525721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:31.528408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:31.547081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:31.699306 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3321/6636] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:31 2022] POST /identity/v3/users => generated 284 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:31.703326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:31.728998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba569f-387e-43d8-9c12-bde13a825bcf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:31.735706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:31.736422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:31.736723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:31.737085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:31.739598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:31.743578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:31.754137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:31.756178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:31.774983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee23f57-be78-42e3-8982-384ba7e79287 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:31.779420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3316/6637] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:31.780704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:31.797764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67504739-eab2-45d0-933b-66c2c66cbccf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:31.805818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:31.806599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:31.806952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:31.807303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:31.808033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:31.809031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:31.810146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:31.811713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:31.812011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:31.813530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] PATH_INFO: `/v3/projects/9ebb1281286a4d38a8a57a583659f4bb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:31.816050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebb1281286a4d38a8a57a583659f4bb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:31.818457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:31.833922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3317/6638] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:31.837956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:31.865876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:31.866990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40911e-cd1a-4ba6-8367-a836caae208b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:31.872778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:31.873656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:31.878574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:31.878574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] PATH_INFO: `/v3/projects/568898c6dda04e64b2f2935caee560c9/users/9a385c4711ed4af6a6db7a04c056c497/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:31.901729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568898c6dda04e64b2f2935caee560c9, user_id=9a385c4711ed4af6a6db7a04c056c497, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:31.904871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:32.001180 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3318/6639] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:31 2022] PUT /identity/v3/projects/568898c6dda04e64b2f2935caee560c9/users/9a385c4711ed4af6a6db7a04c056c497/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:32.005027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:32.007960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.022398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebb1281286a4d38a8a57a583659f4bb', 'request_id': 'req-cc208edc-98dd-48f5-aa79-cb29f5d218d1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.039059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebb1281286a4d38a8a57a583659f4bb', 'request_id': 'req-cc208edc-98dd-48f5-aa79-cb29f5d218d1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.120849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f681d-34e2-4687-b94e-02f7eda8af40 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:32.136052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebb1281286a4d38a8a57a583659f4bb', 'request_id': 'req-cc208edc-98dd-48f5-aa79-cb29f5d218d1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.150870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] The token cache is being invalidate because project 9ebb1281286a4d38a8a57a583659f4bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:32.151164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.152018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc208edc-98dd-48f5-aa79-cb29f5d218d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.153641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3322/6640] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:31 2022] DELETE /identity/v3/projects/9ebb1281286a4d38a8a57a583659f4bb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:32.158606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c30da-f2dd-4d85-950e-5992af515085 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.158882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c30da-f2dd-4d85-950e-5992af515085 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.159892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c30da-f2dd-4d85-950e-5992af515085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.209521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:32.209521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.209521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.209521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] PATH_INFO: `/v3/projects/7b5ccd12e7d6447f9a0e3f4979d69f2a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.212212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5ccd12e7d6447f9a0e3f4979d69f2a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:32.212212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:32.225537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-875c30da-f2dd-4d85-950e-5992af515085 None None] MFA Rules not processed for user `9a385c4711ed4af6a6db7a04c056c497`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:32.227234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-875c30da-f2dd-4d85-950e-5992af515085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.344053 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3323/6641] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:32.345875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.346297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.368417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.373270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:32.374993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.385023 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3324/6642] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:32.386015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:32.387493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.400998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cfecc-7583-4b58-8eab-2dbc5cb22b34 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:32.406210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb54614-5bc4-43b7-9604-5a673957347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:32.406852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54614-5bc4-43b7-9604-5a673957347b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.407134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54614-5bc4-43b7-9604-5a673957347b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.407396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb54614-5bc4-43b7-9604-5a673957347b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.408029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb54614-5bc4-43b7-9604-5a673957347b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:32.410703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb54614-5bc4-43b7-9604-5a673957347b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:32.575670 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3325/6643] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:32.575670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258ba4b-9455-4f68-b41c-0f9e7c2d9583 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.575670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258ba4b-9455-4f68-b41c-0f9e7c2d9583 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.575670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258ba4b-9455-4f68-b41c-0f9e7c2d9583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.597681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7258ba4b-9455-4f68-b41c-0f9e7c2d9583 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:32.599565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7258ba4b-9455-4f68-b41c-0f9e7c2d9583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.616831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5ccd12e7d6447f9a0e3f4979d69f2a', 'request_id': 'req-8b97b8a0-547f-4452-8e76-48049db1a4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.641622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5ccd12e7d6447f9a0e3f4979d69f2a', 'request_id': 'req-8b97b8a0-547f-4452-8e76-48049db1a4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.725809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3326/6644] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:32.727228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258ba4b-9455-4f68-b41c-0f9e7c2d9583 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:32.740739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5ccd12e7d6447f9a0e3f4979d69f2a', 'request_id': 'req-8b97b8a0-547f-4452-8e76-48049db1a4f6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.750163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258ba4b-9455-4f68-b41c-0f9e7c2d9583 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:32.758293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] The token cache is being invalidate because project 7b5ccd12e7d6447f9a0e3f4979d69f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:32.758761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.759688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:32.761510 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3319/6645] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:32 2022] DELETE /identity/v3/projects/7b5ccd12e7d6447f9a0e3f4979d69f2a => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:32.762500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:32.764306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.772243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:32.773577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.774048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.775010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.778161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:32.780868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:32.881450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97b8a0-547f-4452-8e76-48049db1a4f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:32.881450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650764c5-a94e-4cf7-8177-7ea9e3f4ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:32.881450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650764c5-a94e-4cf7-8177-7ea9e3f4ce5b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.881450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650764c5-a94e-4cf7-8177-7ea9e3f4ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.882067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650764c5-a94e-4cf7-8177-7ea9e3f4ce5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.882067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650764c5-a94e-4cf7-8177-7ea9e3f4ce5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:32.882067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650764c5-a94e-4cf7-8177-7ea9e3f4ce5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:32.882067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650764c5-a94e-4cf7-8177-7ea9e3f4ce5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:32.894152 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3320/6646] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:32.895701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.895986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.896378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.917623 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3327/6647] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:32.923852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:32.928701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:32.930104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.940192 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3321/6648] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:32.942235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:32.944798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:32.960312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201609f-fe7d-4561-a889-63905f179e6c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:32.960470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22025d63-c552-472e-b9b0-ee32aaec7651 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:32.966682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:32.967422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3bdd0-5385-41fc-8add-6a223a8db654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:32.968080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3bdd0-5385-41fc-8add-6a223a8db654 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.968322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3bdd0-5385-41fc-8add-6a223a8db654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.968594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3bdd0-5385-41fc-8add-6a223a8db654 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.969250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3bdd0-5385-41fc-8add-6a223a8db654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:32.970700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.971002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3bdd0-5385-41fc-8add-6a223a8db654 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:32.971331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.971796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:32.972634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:32.974778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:32.982481 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3322/6649] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:32.983889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89b94a-a6b5-4dd8-917d-cfeca2be38a4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:32.984169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89b94a-a6b5-4dd8-917d-cfeca2be38a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:32.984443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89b94a-a6b5-4dd8-917d-cfeca2be38a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.009889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5c89b94a-a6b5-4dd8-917d-cfeca2be38a4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:33.011213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5c89b94a-a6b5-4dd8-917d-cfeca2be38a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:33.019519 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3323/6650] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:33.023206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89b94a-a6b5-4dd8-917d-cfeca2be38a4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.032732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89b94a-a6b5-4dd8-917d-cfeca2be38a4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.038658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.039336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.039613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.039886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] PATH_INFO: `/v3/projects/27dc7682612c4905912e65f7455afd46/users/4c63ea3803f546c6b3312fcc5e75507f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.056098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27dc7682612c4905912e65f7455afd46, user_id=4c63ea3803f546c6b3312fcc5e75507f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.058804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.145234 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3328/6651] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:32 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:33.147427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.187163 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3324/6652] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:33 2022] PUT /identity/v3/projects/27dc7682612c4905912e65f7455afd46/users/4c63ea3803f546c6b3312fcc5e75507f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:33.187163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.224451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553ce1-c419-4424-be80-a339188c8d03 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.262515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa148a-b34a-43e5-96a3-30c514ce8280 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.269813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.270829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.271272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.271878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.272880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.276980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.366313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.367203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.367596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.368077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.368836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:33.369422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.371204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.384827 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3329/6653] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:33.386108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.400367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187adcdc-9b06-418a-86b6-433a124018ef admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.405714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.406544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.406930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.407468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.408354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.410854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.431329 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3325/6654] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:33 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:33.432479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.438325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3330/6655] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:33.438325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.460068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902ff59-03e8-4efc-8e6e-e89d131d8995 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.470308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d566d-fb6a-471f-a144-06168fd8155f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.475675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.475883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.476647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.476981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.477113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.477356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.477807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.478079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.478497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.479485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.481121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.481545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.493427 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3331/6656] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:33.500879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.507902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b252a89-7736-4906-8d87-c3eae1d66c6c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.515764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.516795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.517266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.517960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] PATH_INFO: `/v3/projects/27dc7682612c4905912e65f7455afd46/users/4c63ea3803f546c6b3312fcc5e75507f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.520859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27dc7682612c4905912e65f7455afd46, user_id=4c63ea3803f546c6b3312fcc5e75507f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.523864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.537054 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3332/6657] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:33 2022] PUT /identity/v3/projects/27dc7682612c4905912e65f7455afd46/users/4c63ea3803f546c6b3312fcc5e75507f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:33.538195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.572970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:33.628909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab593fe-64f1-4203-aa9c-7f218fc5a92d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.645097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674f211-ff92-4c5f-bc93-14247e4a3898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.645743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f211-ff92-4c5f-bc93-14247e4a3898 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.646306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f211-ff92-4c5f-bc93-14247e4a3898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.647069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f211-ff92-4c5f-bc93-14247e4a3898 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.647468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f211-ff92-4c5f-bc93-14247e4a3898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.649160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f211-ff92-4c5f-bc93-14247e4a3898 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.663091 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3333/6658] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:33.663711 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3326/6659] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:33 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:33.664509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af93bb-779a-4b32-b848-7c03c27a0dd0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.665455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af93bb-779a-4b32-b848-7c03c27a0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.665455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af93bb-779a-4b32-b848-7c03c27a0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.666321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.701866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f9af93bb-779a-4b32-b848-7c03c27a0dd0 None None] MFA Rules not processed for user `4c63ea3803f546c6b3312fcc5e75507f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:33.703403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9af93bb-779a-4b32-b848-7c03c27a0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:33.761368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fdcf1-4a1c-45d6-9b06-1e5774f75e3a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.766749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.767410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.768141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.768141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.768721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.771116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.814003 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3334/6660] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:33.815054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af93bb-779a-4b32-b848-7c03c27a0dd0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.828560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af93bb-779a-4b32-b848-7c03c27a0dd0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:33.834372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:33.835075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:33.835358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:33.835635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] PATH_INFO: `/v3/projects/ae59bd9e21d6428bb7debb15ff28e852/users/4d55413757e24b66af66e0329b893bbc/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:33.855511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae59bd9e21d6428bb7debb15ff28e852, user_id=4d55413757e24b66af66e0329b893bbc, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:33.860332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:33.896301 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3327/6661] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:33 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:33.897397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:33.899329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:33.903411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=21,keystone:SELECT=76,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:33.938282 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3335/6662] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:33 2022] PUT /identity/v3/projects/ae59bd9e21d6428bb7debb15ff28e852/users/4d55413757e24b66af66e0329b893bbc/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:33.949399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.029937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0396-40c1-42a8-877e-245e76f9528c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.073195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82697f-7fff-4f12-a26c-475faa18a04e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.084536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb3d48-debf-49c4-82e4-cfb6ea86930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.085396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3d48-debf-49c4-82e4-cfb6ea86930e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.085774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3d48-debf-49c4-82e4-cfb6ea86930e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.086364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb3d48-debf-49c4-82e4-cfb6ea86930e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.087318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb3d48-debf-49c4-82e4-cfb6ea86930e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.089112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb3d48-debf-49c4-82e4-cfb6ea86930e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.104684 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3336/6663] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:34.108616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4c01-d98c-457f-9b49-dc8d9757158b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.109859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4c01-d98c-457f-9b49-dc8d9757158b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.111262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4c01-d98c-457f-9b49-dc8d9757158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.147355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.147907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.148410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.149273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.158443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ee8e4c01-d98c-457f-9b49-dc8d9757158b None None] MFA Rules not processed for user `4d55413757e24b66af66e0329b893bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:34.160732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee8e4c01-d98c-457f-9b49-dc8d9757158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:34.236399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.240744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.254330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3337/6664] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:34.254330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4c01-d98c-457f-9b49-dc8d9757158b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.264039 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3328/6665] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:34.264039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.268104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087880b6-6509-4f56-94a3-9e87b4aef32a service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.268308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4c01-d98c-457f-9b49-dc8d9757158b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.276384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.276943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.277283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.277562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.278334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.278501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.278824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.279144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.279651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.280151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.283605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.283794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.304517 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3338/6666] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:34.310467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.324867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0843eee-7b06-426f-9ea5-5b14a7624d6f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.332500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.333306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.333656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.333944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] PATH_INFO: `/v3/projects/5eff6394f60946e28239c9a29a50c3a9/users/cb471e745b9b4be0a95d6aee4dcf9bef/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.354981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eff6394f60946e28239c9a29a50c3a9, user_id=cb471e745b9b4be0a95d6aee4dcf9bef, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.357937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.441745 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3329/6667] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:34 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:34.446662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.453754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:34.501989 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3339/6668] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:34 2022] PUT /identity/v3/projects/5eff6394f60946e28239c9a29a50c3a9/users/cb471e745b9b4be0a95d6aee4dcf9bef/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:34.513883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.528736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171ae82-5e6d-4c91-874d-4441be9bcafd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.586002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05559e31-7345-4b85-9aa2-0d8b9669bb86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.586684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05559e31-7345-4b85-9aa2-0d8b9669bb86 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.587092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05559e31-7345-4b85-9aa2-0d8b9669bb86 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.587417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05559e31-7345-4b85-9aa2-0d8b9669bb86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.589538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05559e31-7345-4b85-9aa2-0d8b9669bb86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:34.600630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fedf4-f99a-4b32-a51a-7003561e8cb2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.609755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.610974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.611784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.612363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.614685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.617229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.687360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05559e31-7345-4b85-9aa2-0d8b9669bb86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.690513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05559e31-7345-4b85-9aa2-0d8b9669bb86 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.707958 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3330/6669] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:55:34.718878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.719602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.719602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.742207 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3340/6670] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:34 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:34.747143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.778269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f8ff0-7557-4aba-a3bb-dd3d5513c5e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.795501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] MFA Rules not processed for user `cb471e745b9b4be0a95d6aee4dcf9bef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:34.796085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.796780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:34.797606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.798835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.801760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.802983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.809442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.828584 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3341/6671] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:34.833797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.861987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888dd0d-cb29-4bb0-8899-1154ae6c5f17 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:34.881337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:34.882236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:34.882574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:34.883998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] PATH_INFO: `/v3/projects/16129e505f4c41ba948346fdf622294d/users/20271554a0244c1fb28c28d5bfd9752e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:34.934046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16129e505f4c41ba948346fdf622294d, user_id=20271554a0244c1fb28c28d5bfd9752e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:34.938488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:34.968696 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3331/6672] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:34.996090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:34.999329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:35.043842 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3342/6673] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:34 2022] PUT /identity/v3/projects/16129e505f4c41ba948346fdf622294d/users/20271554a0244c1fb28c28d5bfd9752e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:35.048610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:35.185800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7653f9-4080-4b33-ae27-67b898bc7f26 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:35.193477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:35.194588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:35.194979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:35.195441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:35.196418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:35.199650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:35.213013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1892f-8a82-438c-b30b-aea66c09b5ac None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:35.230475 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3343/6674] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:55:35.234699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:35.257924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e8e27-bf08-433c-b374-6e189f26266f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:35.280628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548785b-32c1-4621-9c74-0b794b4d4771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:35.281693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548785b-32c1-4621-9c74-0b794b4d4771 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:35.282179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548785b-32c1-4621-9c74-0b794b4d4771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:35.282614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548785b-32c1-4621-9c74-0b794b4d4771 admin admin] PATH_INFO: `/v3/projects/16129e505f4c41ba948346fdf622294d/users/20271554a0244c1fb28c28d5bfd9752e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:35.286603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548785b-32c1-4621-9c74-0b794b4d4771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16129e505f4c41ba948346fdf622294d, user_id=20271554a0244c1fb28c28d5bfd9752e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:35.294898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548785b-32c1-4621-9c74-0b794b4d4771 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:35.323477 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3344/6675] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:35 2022] PUT /identity/v3/projects/16129e505f4c41ba948346fdf622294d/users/20271554a0244c1fb28c28d5bfd9752e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:35.334999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8e870-fe0c-4400-9b31-cd2cbcacc48a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:35.335306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8e870-fe0c-4400-9b31-cd2cbcacc48a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:35.339830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8e870-fe0c-4400-9b31-cd2cbcacc48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:35.363565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:35.366407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:35.366407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:35.366407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:35.442618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ccf8e870-fe0c-4400-9b31-cd2cbcacc48a None None] MFA Rules not processed for user `20271554a0244c1fb28c28d5bfd9752e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:35.444453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccf8e870-fe0c-4400-9b31-cd2cbcacc48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:35.477574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:35.480804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:35.493528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3332/6676] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:35.613743 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3345/6677] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:35.619028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:35.691989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:35.740450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29266-ace2-42c3-bff2-da81b6d3ea4f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:35.749076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:35.750390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:35.752319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:35.752319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:35.752319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:35.755022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:35.841151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8e870-fe0c-4400-9b31-cd2cbcacc48a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:35.850019 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3333/6678] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 13:55:35 2022] POST /identity/v3/domains => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:35.853017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8e870-fe0c-4400-9b31-cd2cbcacc48a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:36.056556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:36.057207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:36.057498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:36.057781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:36.058518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:36.072345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:36.158797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:36.265480 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3346/6679] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:35 2022] POST /identity/v3/projects => generated 410 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:36.275620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:36.290088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d297dc-f069-4ada-ad43-17e6b6af655d tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:36.479762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:36.480989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:36.481433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:36.481884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:36.482763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:36.488022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:36.599345 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3334/6680] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:36 2022] POST /identity/v3/users => generated 347 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:36.600352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:36.616324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d7c29-8f2a-472f-b5a0-a98a691ccf77 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:36.628402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c9b20-a3e4-4e8f-97c6-5298d2bb5b58 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:36.629088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9b20-a3e4-4e8f-97c6-5298d2bb5b58 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:36.629521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9b20-a3e4-4e8f-97c6-5298d2bb5b58 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:36.629805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9b20-a3e4-4e8f-97c6-5298d2bb5b58 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:36.630496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c9b20-a3e4-4e8f-97c6-5298d2bb5b58 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:36.632234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c9b20-a3e4-4e8f-97c6-5298d2bb5b58 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:36.658868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3347/6681] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:36.665136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:36.684066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388b63-639a-4f49-9f72-0fb3e89c33fe tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:36.693678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b15efd-070a-4a7f-be6e-706737da3c92 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:36.695204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b15efd-070a-4a7f-be6e-706737da3c92 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:36.695732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b15efd-070a-4a7f-be6e-706737da3c92 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:36.701529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b15efd-070a-4a7f-be6e-706737da3c92 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/projects/2ef75a49b0b846f78d99ab062a696591/users/c6086f5fff9a4bfdada9f8d9f876aabe/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:36.718486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b15efd-070a-4a7f-be6e-706737da3c92 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2ef75a49b0b846f78d99ab062a696591, user_id=c6086f5fff9a4bfdada9f8d9f876aabe, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:36.736571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b15efd-070a-4a7f-be6e-706737da3c92 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:36.844098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3335/6682] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:36 2022] PUT /identity/v3/projects/2ef75a49b0b846f78d99ab062a696591/users/c6086f5fff9a4bfdada9f8d9f876aabe/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:36.848441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982914-6dfd-4fb4-b4fe-c1875181c5f2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:36.848727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982914-6dfd-4fb4-b4fe-c1875181c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:36.849004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982914-6dfd-4fb4-b4fe-c1875181c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:37.015307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b0982914-6dfd-4fb4-b4fe-c1875181c5f2 None None] MFA Rules not processed for user `c6086f5fff9a4bfdada9f8d9f876aabe`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:37.017623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b0982914-6dfd-4fb4-b4fe-c1875181c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:37.068408 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3348/6683] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:37.070415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7869e-ea45-4da0-add0-6b9da2a8805f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:37.071943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7869e-ea45-4da0-add0-6b9da2a8805f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:37.072359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7869e-ea45-4da0-add0-6b9da2a8805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:37.133661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-aec7869e-ea45-4da0-add0-6b9da2a8805f None None] MFA Rules not processed for user `c6086f5fff9a4bfdada9f8d9f876aabe`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:37.136434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aec7869e-ea45-4da0-add0-6b9da2a8805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:37.161109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3336/6684] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:37.162321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0982914-6dfd-4fb4-b4fe-c1875181c5f2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:37.178301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0982914-6dfd-4fb4-b4fe-c1875181c5f2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:37.190592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6086f5fff9a4bfdada9f8d9f876aabe', 'user_domain_id': 'af94e70d8c564a1da758b96f13a8e7fc', 'system_scope': None, 'project_id': '2ef75a49b0b846f78d99ab062a696591', 'project_domain_id': 'af94e70d8c564a1da758b96f13a8e7fc', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:37.192236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:37.192523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:37.192808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:37.211761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:37.215236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:37.243504 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3349/6685] 10.222.0.27 () {56 vars in 1284 bytes} [Tue Oct 18 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:37.245706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7869e-ea45-4da0-add0-6b9da2a8805f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:37.403086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7869e-ea45-4da0-add0-6b9da2a8805f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:37.423495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:37.426988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:37.427567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:37.429541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/users/c6086f5fff9a4bfdada9f8d9f876aabe` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:37.432042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c6086f5fff9a4bfdada9f8d9f876aabe)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:37.434373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:37.679553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6086f5fff9a4bfdada9f8d9f876aabe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:37.680906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6086f5fff9a4bfdada9f8d9f876aabe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:37.803838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6086f5fff9a4bfdada9f8d9f876aabe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:37.805707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6086f5fff9a4bfdada9f8d9f876aabe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:37.819853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6086f5fff9a4bfdada9f8d9f876aabe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:37.861006 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3337/6686] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:37 2022] DELETE /identity/v3/users/c6086f5fff9a4bfdada9f8d9f876aabe => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:37.865052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:37.880507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fabe9e-80ff-463c-b46f-cc621c1b62ee tempest-test_project-1143828694 tempest-user-308768168] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:37.954847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:37.955475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:37.955837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:37.956712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/projects/2ef75a49b0b846f78d99ab062a696591` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:37.957890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ef75a49b0b846f78d99ab062a696591)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:37.959833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:38.128879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef75a49b0b846f78d99ab062a696591', 'request_id': 'req-9ce70183-62a8-4196-927c-ef581db5a14f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.137845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef75a49b0b846f78d99ab062a696591', 'request_id': 'req-9ce70183-62a8-4196-927c-ef581db5a14f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.285482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef75a49b0b846f78d99ab062a696591', 'request_id': 'req-9ce70183-62a8-4196-927c-ef581db5a14f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.300606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] The token cache is being invalidate because project 2ef75a49b0b846f78d99ab062a696591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:38.301245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.302205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.303930 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3350/6687] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:37 2022] DELETE /identity/v3/projects/2ef75a49b0b846f78d99ab062a696591 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:38.308182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:38.309848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:38.325879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4e5b5-3edc-4e7f-a007-7ae6621490c1 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:38.426539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:38.495278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:38.496273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:38.496712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:38.497356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/domains/af94e70d8c564a1da758b96f13a8e7fc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:38.501322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=af94e70d8c564a1da758b96f13a8e7fc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:38.507394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:38.552659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.565116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.658345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.659617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.663640 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3338/6688] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 13:55:38 2022] PATCH /identity/v3/domains/af94e70d8c564a1da758b96f13a8e7fc => generated 247 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:38.667482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:38.669021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:38.688704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70183-62a8-4196-927c-ef581db5a14f tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:38.829845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:38.845540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20271554a0244c1fb28c28d5bfd9752e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16129e505f4c41ba948346fdf622294d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:38.846389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:38.847547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:38.847879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] PATH_INFO: `/v3/domains/af94e70d8c564a1da758b96f13a8e7fc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:38.860576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=af94e70d8c564a1da758b96f13a8e7fc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:38.863061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:38.898094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:38.910757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.152664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc', 'request_id': 'req-fad01e36-a15c-449a-aceb-605df4e8a230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.160096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc', 'request_id': 'req-fad01e36-a15c-449a-aceb-605df4e8a230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.280015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc', 'request_id': 'req-fad01e36-a15c-449a-aceb-605df4e8a230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.292475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] The token cache is being invalidate because project af94e70d8c564a1da758b96f13a8e7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:39.292892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.293654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.304888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc', 'request_id': 'req-fad01e36-a15c-449a-aceb-605df4e8a230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.305794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc', 'request_id': 'req-fad01e36-a15c-449a-aceb-605df4e8a230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.310553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fad01e36-a15c-449a-aceb-605df4e8a230 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'af94e70d8c564a1da758b96f13a8e7fc', 'request_id': 'req-fad01e36-a15c-449a-aceb-605df4e8a230'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.323385 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3351/6689] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 13:55:38 2022] DELETE /identity/v3/domains/af94e70d8c564a1da758b96f13a8e7fc => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:39.324877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:39.326756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:39.411938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c5935-345c-402d-b051-366e82ee71e2 tempest-TestDefaultProjectId-1387770955 tempest-TestDefaultProjectId-1387770955-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:39.482001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:39.482697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:39.483367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:39.483367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] PATH_INFO: `/v3/users/4d55413757e24b66af66e0329b893bbc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:39.484575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d55413757e24b66af66e0329b893bbc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:39.486567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:39.744166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d55413757e24b66af66e0329b893bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.745197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d55413757e24b66af66e0329b893bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.855296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d55413757e24b66af66e0329b893bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.859934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d55413757e24b66af66e0329b893bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.864938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d55413757e24b66af66e0329b893bbc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:39.885537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3339/6690] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:39 2022] DELETE /identity/v3/users/4d55413757e24b66af66e0329b893bbc => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:39.889876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:39.890204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:39.890486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:39.915608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:39.916713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:40.047157 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3352/6691] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:40.064589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:40.066318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:40.179074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c41b8-5566-44b1-b7b3-c500a4e821c1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:40.187165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:40.187926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:40.188448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:40.189003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:40.203992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:40.203992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:40.215186 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3340/6692] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:40.879354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:40.959443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:40.961607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:40.980915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d3c47-ae59-43e1-8f2f-0bb8764b805e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:40.998741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:40.999401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:40.999878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:41.000310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] PATH_INFO: `/v3/projects/ae59bd9e21d6428bb7debb15ff28e852` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:41.002771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae59bd9e21d6428bb7debb15ff28e852)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:41.005941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:41.193064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae59bd9e21d6428bb7debb15ff28e852', 'request_id': 'req-1868ce9b-7baf-4a56-a3f3-b56b9043080e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.206873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae59bd9e21d6428bb7debb15ff28e852', 'request_id': 'req-1868ce9b-7baf-4a56-a3f3-b56b9043080e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.297039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae59bd9e21d6428bb7debb15ff28e852', 'request_id': 'req-1868ce9b-7baf-4a56-a3f3-b56b9043080e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.313615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] The token cache is being invalidate because project ae59bd9e21d6428bb7debb15ff28e852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:41.313902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.314600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.316829 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3353/6693] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:40 2022] DELETE /identity/v3/projects/ae59bd9e21d6428bb7debb15ff28e852 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:41.321051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:41.331852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0862edc-3d1f-40b6-a8a0-e34f6b8b69b5 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:41.360540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:41.362928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:41.407828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:41.409554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:41.409916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:41.410286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] PATH_INFO: `/v3/users/20271554a0244c1fb28c28d5bfd9752e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:41.411526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=20271554a0244c1fb28c28d5bfd9752e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:41.413574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:41.445529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868ce9b-7baf-4a56-a3f3-b56b9043080e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:41.448278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:41.449060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:41.449348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:41.449627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] PATH_INFO: `/v3/users/9a385c4711ed4af6a6db7a04c056c497` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:41.450888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a385c4711ed4af6a6db7a04c056c497)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:41.452827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:41.587838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:41.626560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20271554a0244c1fb28c28d5bfd9752e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.627491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20271554a0244c1fb28c28d5bfd9752e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.711086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a385c4711ed4af6a6db7a04c056c497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.718514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a385c4711ed4af6a6db7a04c056c497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.719193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a385c4711ed4af6a6db7a04c056c497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.723768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20271554a0244c1fb28c28d5bfd9752e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.726262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20271554a0244c1fb28c28d5bfd9752e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.737878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1bc25dc5-7815-4eef-ae66-74203e8cde2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20271554a0244c1fb28c28d5bfd9752e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.749613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a385c4711ed4af6a6db7a04c056c497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.760728 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3341/6694] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:41 2022] DELETE /identity/v3/users/20271554a0244c1fb28c28d5bfd9752e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:41.828863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a385c4711ed4af6a6db7a04c056c497'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:41.842525 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3354/6695] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:41 2022] DELETE /identity/v3/users/9a385c4711ed4af6a6db7a04c056c497 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:41.843563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:41.844518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:41.844518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:41.867205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:41.868603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:41.946511 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3342/6696] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:55:41.958205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:41.959072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:42.039614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5d70-a136-4f3f-bfa0-ce0b1f44cbaa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:42.044166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55a2d6-f231-43f9-aede-cb5392b8c18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:42.044910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a2d6-f231-43f9-aede-cb5392b8c18a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:42.045196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a2d6-f231-43f9-aede-cb5392b8c18a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:42.045469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a2d6-f231-43f9-aede-cb5392b8c18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:42.057627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55a2d6-f231-43f9-aede-cb5392b8c18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:42.058674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55a2d6-f231-43f9-aede-cb5392b8c18a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:42.071040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3355/6697] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:42.460409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:42.462172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:42.490096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de64137-41c4-4465-ab38-9eda5aef8af6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:42.500130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:42.500887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:42.501518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:42.501913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] PATH_INFO: `/v3/projects/16129e505f4c41ba948346fdf622294d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:42.503432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16129e505f4c41ba948346fdf622294d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:42.507882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:42.676618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16129e505f4c41ba948346fdf622294d', 'request_id': 'req-0d5fc92f-b4b4-46d1-889d-f15b7b968645'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:42.683978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16129e505f4c41ba948346fdf622294d', 'request_id': 'req-0d5fc92f-b4b4-46d1-889d-f15b7b968645'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:42.754731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16129e505f4c41ba948346fdf622294d', 'request_id': 'req-0d5fc92f-b4b4-46d1-889d-f15b7b968645'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:42.772762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] The token cache is being invalidate because project 16129e505f4c41ba948346fdf622294d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:42.773114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:42.773751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:42.778773 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3343/6698] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:42 2022] DELETE /identity/v3/projects/16129e505f4c41ba948346fdf622294d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:42.780630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77396-98c9-4179-9d72-b1f3e33fac3e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:42.780944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77396-98c9-4179-9d72-b1f3e33fac3e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:42.781219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac77396-98c9-4179-9d72-b1f3e33fac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:42.816384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8ac77396-98c9-4179-9d72-b1f3e33fac3e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:42.816384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ac77396-98c9-4179-9d72-b1f3e33fac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:42.906841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:42.906841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:42.907126 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3356/6699] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:42.907211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fc92f-b4b4-46d1-889d-f15b7b968645 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:42.914383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1b15a-c69c-4777-865c-b3a11b6607e0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:42.914692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1b15a-c69c-4777-865c-b3a11b6607e0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:42.917184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1b15a-c69c-4777-865c-b3a11b6607e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:42.933415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:42.934266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:42.936916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:42.936916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:42.936916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] PATH_INFO: `/v3/projects/568898c6dda04e64b2f2935caee560c9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:42.941708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=568898c6dda04e64b2f2935caee560c9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:42.945735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:42.975454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-adc1b15a-c69c-4777-865c-b3a11b6607e0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:42.975454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adc1b15a-c69c-4777-865c-b3a11b6607e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:42.984158 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3357/6700] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:42.988853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1b15a-c69c-4777-865c-b3a11b6607e0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.000564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1b15a-c69c-4777-865c-b3a11b6607e0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.006419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.007066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.007348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.007619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.008272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:43.008577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.010218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:43.023956 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3358/6701] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:55:43.028131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.038901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e31c14-c6a4-4554-8b2e-39e67890d8fa admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.043264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.043870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.044361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.044816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.045616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.047832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:43.126809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568898c6dda04e64b2f2935caee560c9', 'request_id': 'req-f241fe29-ba01-44d0-b060-0695a048c5fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.140281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568898c6dda04e64b2f2935caee560c9', 'request_id': 'req-f241fe29-ba01-44d0-b060-0695a048c5fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.184077 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3359/6702] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:43 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:43.191192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.240130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568898c6dda04e64b2f2935caee560c9', 'request_id': 'req-f241fe29-ba01-44d0-b060-0695a048c5fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.253519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] The token cache is being invalidate because project 568898c6dda04e64b2f2935caee560c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:43.253940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.254891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.256815 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3344/6703] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:42 2022] DELETE /identity/v3/projects/568898c6dda04e64b2f2935caee560c9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:43.259522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93da37-2e47-4edd-a0f9-31e936fbd08c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.260567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.262036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:43.264889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.265497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.265989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.266293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.267122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.269768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:43.331159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241fe29-ba01-44d0-b060-0695a048c5fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.336196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.336845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.337132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.337460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] PATH_INFO: `/v3/users/4c63ea3803f546c6b3312fcc5e75507f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.338693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c63ea3803f546c6b3312fcc5e75507f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.340768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:43.354982 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3360/6704] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:43 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:43.359366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.362679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:43.381131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab521d5-d8a8-4edf-b4fd-f6c597ec51de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.386222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.386838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.392723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.392723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.392723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.392723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:43.400738 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3361/6705] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:55:43.404782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.416487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ae8fc-fc1c-45ae-959f-72a115c2c0e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.421665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.422362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.422827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.423294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.424078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.425942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:43.438882 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3362/6706] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:55:43.443100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.452848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ceba-8722-446f-8077-545d641d6fac admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.458534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b995c-ebfe-49b0-bff4-7d8435244a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.459190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b995c-ebfe-49b0-bff4-7d8435244a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.459469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b995c-ebfe-49b0-bff4-7d8435244a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.459739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b995c-ebfe-49b0-bff4-7d8435244a5c admin admin] PATH_INFO: `/v3/projects/234015fcc298401b9a79afd2bfd59635/users/96a13b26548a412c9a296c7f73e5b3c4/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.479851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b995c-ebfe-49b0-bff4-7d8435244a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=234015fcc298401b9a79afd2bfd59635, user_id=96a13b26548a412c9a296c7f73e5b3c4, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.482611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b995c-ebfe-49b0-bff4-7d8435244a5c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:43.543241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:43.558774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c63ea3803f546c6b3312fcc5e75507f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.559492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c63ea3803f546c6b3312fcc5e75507f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.576543 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3363/6707] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:43 2022] PUT /identity/v3/projects/234015fcc298401b9a79afd2bfd59635/users/96a13b26548a412c9a296c7f73e5b3c4/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:43.587778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.588064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.588338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.620344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] MFA Rules not processed for user `96a13b26548a412c9a296c7f73e5b3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:43.621556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:43.680311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c63ea3803f546c6b3312fcc5e75507f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.680949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c63ea3803f546c6b3312fcc5e75507f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.696925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c63ea3803f546c6b3312fcc5e75507f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:43.714493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3364/6708] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:43.718981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:43.723028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:43.727972 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3345/6709] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:43 2022] DELETE /identity/v3/users/4c63ea3803f546c6b3312fcc5e75507f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:43.839871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea1c9a-8261-4ca7-a3e7-49b595b72622 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:43.904140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:43.905244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:43.905244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:43.905434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:43.906168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:43.907914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:44.039027 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3365/6710] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:43 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:44.040848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:44.055158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e4e6c-6646-4031-860f-e7417d4bdde0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:44.146694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:44.147436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:44.147855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:44.148237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:44.149270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:44.153002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:44.308242 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3346/6711] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:44 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:44.309507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:44.334432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13922-ea6b-4c5a-919c-eac40638fb0c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:44.340518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:44.341506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:44.341859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:44.342240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:44.342966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:44.344783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:44.358482 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3366/6712] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:44.361591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:44.374701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47651b52-408a-4be7-a24c-3050b216ce2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:44.381432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:44.382484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:44.382775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:44.383140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] PATH_INFO: `/v3/projects/908321cde5fe45dbb18bda8ace5f418f/users/6774cb2f2f044a098e689ffbdb65ae82/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:44.404774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=908321cde5fe45dbb18bda8ace5f418f, user_id=6774cb2f2f044a098e689ffbdb65ae82, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:44.409505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:44.526668 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3347/6713] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:44 2022] PUT /identity/v3/projects/908321cde5fe45dbb18bda8ace5f418f/users/6774cb2f2f044a098e689ffbdb65ae82/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:44.533507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:44.552662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569eb8-9a31-4c58-96bf-15777a056a19 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:44.667045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:44.699010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:44.699831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:44.700124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:44.700407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:44.701551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:44.703268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:44.718985 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3367/6714] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:44.723416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:44.740659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabff4-eacd-4f50-8697-dc1c6389fd4c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:44.750712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:44.754402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:44.772355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea1738-3d31-4a9c-804a-d47cbeb99650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:44.773307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea1738-3d31-4a9c-804a-d47cbeb99650 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:44.778426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea1738-3d31-4a9c-804a-d47cbeb99650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:44.778426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea1738-3d31-4a9c-804a-d47cbeb99650 admin admin] PATH_INFO: `/v3/projects/908321cde5fe45dbb18bda8ace5f418f/users/6774cb2f2f044a098e689ffbdb65ae82/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:44.778426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea1738-3d31-4a9c-804a-d47cbeb99650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908321cde5fe45dbb18bda8ace5f418f, user_id=6774cb2f2f044a098e689ffbdb65ae82, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:44.779471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea1738-3d31-4a9c-804a-d47cbeb99650 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:44.785808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b1b2-43b1-4862-9f12-46bfc0f51656 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:44.801362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:44.806605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:44.806605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:44.806605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] PATH_INFO: `/v3/projects/27dc7682612c4905912e65f7455afd46` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:44.807014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3348/6715] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:44 2022] PUT /identity/v3/projects/908321cde5fe45dbb18bda8ace5f418f/users/6774cb2f2f044a098e689ffbdb65ae82/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:44.816108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27dc7682612c4905912e65f7455afd46)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:44.816108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:44.820290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989044f-0422-45c7-85ed-a095515642ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:44.820814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989044f-0422-45c7-85ed-a095515642ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:44.821272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989044f-0422-45c7-85ed-a095515642ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:44.880193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d989044f-0422-45c7-85ed-a095515642ec None None] MFA Rules not processed for user `6774cb2f2f044a098e689ffbdb65ae82`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:44.881433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d989044f-0422-45c7-85ed-a095515642ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:44.963987 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3349/6716] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:44.972264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989044f-0422-45c7-85ed-a095515642ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:44.984842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989044f-0422-45c7-85ed-a095515642ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:44.991887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27dc7682612c4905912e65f7455afd46', 'request_id': 'req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:45.002210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27dc7682612c4905912e65f7455afd46', 'request_id': 'req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:45.069804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27dc7682612c4905912e65f7455afd46', 'request_id': 'req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:45.076416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.077124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.077417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.077751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.078507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.079536 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:55:45.079536 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:55:45.079536 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:55:45.080487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.086647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] The token cache is being invalidate because project 27dc7682612c4905912e65f7455afd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:45.087065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:45.088003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-76383c44-8325-48e0-b3e5-8a6a5d7c1e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:45.089835 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3368/6717] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:44 2022] DELETE /identity/v3/projects/27dc7682612c4905912e65f7455afd46 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:45.097402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ca19e-0929-4613-9e54-c075f3aafd30 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.097747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ca19e-0929-4613-9e54-c075f3aafd30 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.098117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ca19e-0929-4613-9e54-c075f3aafd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.121272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-393ca19e-0929-4613-9e54-c075f3aafd30 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:45.122693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-393ca19e-0929-4613-9e54-c075f3aafd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:45.179869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3350/6718] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:44 2022] POST /identity/v3/services => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:45.182399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.184741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:45.238911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed48f8-a4bb-4e23-b8a4-77e30b2b91b8 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.242797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3369/6719] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:45.253374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1df175-8642-4172-a14a-a89c84b41dce None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.253850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1df175-8642-4172-a14a-a89c84b41dce None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.254328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1df175-8642-4172-a14a-a89c84b41dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.258479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.260143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.261278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.262294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.263642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.269301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: 'False' Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.285135 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:55:45.287726 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 18 13:55:45.290090 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.293234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-be1df175-8642-4172-a14a-a89c84b41dce None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:45.294760 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3351/6720] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:55:45 2022] POST /identity/v3/endpoints => generated 283 bytes in 114 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:55:45.300597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be1df175-8642-4172-a14a-a89c84b41dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:45.301761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.331547 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3370/6721] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:45.332681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1df175-8642-4172-a14a-a89c84b41dce None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.333072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c40787-4cb4-4d3d-b4b9-e26e0b6964fb tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.343281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:45.345066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1df175-8642-4172-a14a-a89c84b41dce None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.348277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.348910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.349232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.349468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.350222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.351855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.354699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.356201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.356588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.357198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.358129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:45.358540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.360360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: 'True' Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.365633 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:55:45.367572 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.371214 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3352/6722] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:55:45 2022] POST /identity/v3/endpoints => generated 281 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:55:45.372737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.395872 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3371/6723] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:45.397133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.413937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c1775-bdb0-4a42-8b64-c68e8aa6625d tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.418768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bbb14-4ae3-430f-bebe-6a3989d8b3c3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.425227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.425878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.426260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.426610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.428396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.429545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.430199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.434850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.434850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.434850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.435177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:45.435274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.442863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.552008 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-295626056. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:55:45.552008 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:55:45.552008 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:55:45.620020 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3372/6724] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:45 2022] POST /identity/v3/projects => generated 359 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:45.624236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.662568 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3353/6725] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:55:45 2022] POST /identity/v3/endpoints => generated 359 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:45.677203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.702657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f2b66-d766-4f28-96f1-bf08f668eb52 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.717113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23849-c58a-466a-bfa2-d76111fdb3e6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.738636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.738873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.739142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.747100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.747100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.747100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.778510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.779360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.779550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.779782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/regions/tempest-region-295626056` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.780391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-295626056)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.781471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.783628 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3354/6726] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Oct 18 13:55:45 2022] GET /identity/v3/regions/tempest-region-295626056 => generated 178 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:45.789322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.800397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aebb95-331d-4b7c-b12d-9110dd4d8493 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.805397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.806030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.806353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.806799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints/9dcdf65168da4e56bbd19b6f7b7e2af8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.812490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=9dcdf65168da4e56bbd19b6f7b7e2af8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.813519 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:55:45.813519 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:55:45.813519 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:55:45.814491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: 'False' Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.822174 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:55:45.825502 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'False' Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:45.832735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3355/6727] 10.222.0.27 () {60 vars in 1255 bytes} [Tue Oct 18 13:55:45 2022] PATCH /identity/v3/endpoints/9dcdf65168da4e56bbd19b6f7b7e2af8 => generated 283 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 18 13:55:45.835453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.855922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11919a-5a04-41af-abd6-571d7f1a8f6c tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.863480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.863656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.864003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.864355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints/9dcdf65168da4e56bbd19b6f7b7e2af8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.865733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9dcdf65168da4e56bbd19b6f7b7e2af8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.867496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.919169 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3373/6728] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:45 2022] POST /identity/v3/users => generated 280 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:45.925134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.936110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea590-fc25-4fe2-86fa-ac929f6ea77c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.941787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.942434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.942733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.942982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.943635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.945259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.955945 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3374/6729] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:45.959805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:45.970039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb255e9-6f7f-4af9-932a-1ee67878a804 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:45.974825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:45.975542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:45.975832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:45.976110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:45.976890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:45.978521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:45.990022 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3375/6730] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:55:45.994016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.005610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c2a23-f3f4-42b7-b3a6-ea649d0faac1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.010696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9dcdf65168da4e56bbd19b6f7b7e2af8', 'request_id': 'req-3f4fdeb6-ff01-4475-9126-afb92d787365'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:46.018438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfa343-16b5-4652-ae6b-9db2f59cfd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.019805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfa343-16b5-4652-ae6b-9db2f59cfd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.020409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfa343-16b5-4652-ae6b-9db2f59cfd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.020908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfa343-16b5-4652-ae6b-9db2f59cfd64 admin admin] PATH_INFO: `/v3/projects/956d0b092c31436fbc64e382a7f553f9/users/640b9e512b8044d99a842b46d31c23d7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.024903 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3356/6731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:45 2022] DELETE /identity/v3/endpoints/9dcdf65168da4e56bbd19b6f7b7e2af8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:46.025971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.039987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:46.044630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfa343-16b5-4652-ae6b-9db2f59cfd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956d0b092c31436fbc64e382a7f553f9, user_id=640b9e512b8044d99a842b46d31c23d7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.049423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfa343-16b5-4652-ae6b-9db2f59cfd64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:46.058898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fdeb6-ff01-4475-9126-afb92d787365 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.064779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.065558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.070400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.070400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/regions/tempest-region-295626056` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.070400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-295626056)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.070400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:46.155954 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3357/6732] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:55:46 2022] DELETE /identity/v3/regions/tempest-region-295626056 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:46.162764 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3376/6733] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:45 2022] PUT /identity/v3/projects/956d0b092c31436fbc64e382a7f553f9/users/640b9e512b8044d99a842b46d31c23d7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:46.163470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.179437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.179437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.179437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.200285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d875e0-a03d-4b0e-98f4-5e7af40459c2 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.236230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] MFA Rules not processed for user `640b9e512b8044d99a842b46d31c23d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:46.238388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:46.292314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.293435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.293884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.294723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.298869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.298869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:46.302646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:46.350314 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3377/6734] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:46 2022] POST /identity/v3/auth/tokens => generated 3370 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:46.371440 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1801267201. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:55:46.371440 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:55:46.371440 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:55:46.395414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.398445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:46.485752 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3358/6735] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 18 13:55:46 2022] POST /identity/v3/endpoints => generated 359 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:46.502560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.533346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6508887-7ddd-4600-b759-303fd34ea02e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.581519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3956-8fd5-4d5a-964a-4d6bcfa62fb9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.581519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.583245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.583682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.585582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/regions/tempest-region-1801267201` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.586557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1801267201)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.590615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:46.595133 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3359/6736] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Oct 18 13:55:46 2022] GET /identity/v3/regions/tempest-region-1801267201 => generated 180 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:46.599649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.601336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.602616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.603422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.603422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.620604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ca7a-e3fc-40cb-96f5-b3eee0f5251e tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.622819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.626358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:46.643642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.644690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.644986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.645321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints/fde34a204094430991e05541c8eb0d44` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.657007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=fde34a204094430991e05541c8eb0d44)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.664366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: On instance['enabled']: Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: 'True' Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:46.678263 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:55:46.680824 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'True' Oct 18 13:55:46.683210 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:46.702947 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3378/6738] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:46 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:55:46.702947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.703267 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3360/6738] 10.222.0.27 () {60 vars in 1255 bytes} [Tue Oct 18 13:55:46 2022] PATCH /identity/v3/endpoints/fde34a204094430991e05541c8eb0d44 => generated 281 bytes in 86 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 18 13:55:46.715995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.728863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:46.736072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685946c-02c3-4bc3-afb2-69cbaa82f9e0 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.753420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.754303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.754610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.754866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/endpoints/fde34a204094430991e05541c8eb0d44` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.758410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fde34a204094430991e05541c8eb0d44)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.760082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:46.822626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fde34a204094430991e05541c8eb0d44', 'request_id': 'req-3b27d18e-6bf1-4347-b08a-971404c15912'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:46.839089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3379/6739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:46 2022] DELETE /identity/v3/endpoints/fde34a204094430991e05541c8eb0d44 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:46.845871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:46.890266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc848bf-609c-444b-a298-412c12678420 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.918777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27d18e-6bf1-4347-b08a-971404c15912 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:46.925404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:46.926500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:46.927115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:46.927624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/regions/tempest-region-1801267201` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:46.928583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1801267201)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:46.930613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:47.005681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:47.006748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:47.007231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:47.007706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] PATH_INFO: `/v3/users/640b9e512b8044d99a842b46d31c23d7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:47.009873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=640b9e512b8044d99a842b46d31c23d7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:47.013845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:47.052969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:47.073731 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1801267201. To ensure interoperability, identifiers should be a valid uuid. Oct 18 13:55:47.073731 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 13:55:47.073731 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 13:55:47.081672 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3380/6740] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Oct 18 13:55:46 2022] DELETE /identity/v3/regions/tempest-region-1801267201 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:47.087056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:47.127140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34490c-e3ae-44cd-9b2a-05b441e081fc tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:47.134854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6774cb2f2f044a098e689ffbdb65ae82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '908321cde5fe45dbb18bda8ace5f418f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:47.135600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:47.135964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:47.136256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] PATH_INFO: `/v3/services/96bee8f2229b4ff09ee45be41ac1b356` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:47.137063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorizing `identity:delete_service(service_id=96bee8f2229b4ff09ee45be41ac1b356)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:47.139089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:47.195428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:47.273048 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3381/6741] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:47 2022] DELETE /identity/v3/services/96bee8f2229b4ff09ee45be41ac1b356 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:47.281679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:47.295455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:47.310575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640b9e512b8044d99a842b46d31c23d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.311301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640b9e512b8044d99a842b46d31c23d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.347048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63398-b44c-4725-8e12-94e2560da7b9 tempest-EndpointsNegativeTestJSON-1998809270 tempest-EndpointsNegativeTestJSON-1998809270-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:47.354696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:47.362706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:47.363197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:47.364282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] PATH_INFO: `/v3/users/96a13b26548a412c9a296c7f73e5b3c4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:47.366111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a13b26548a412c9a296c7f73e5b3c4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:47.375312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:47.431398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640b9e512b8044d99a842b46d31c23d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.433185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640b9e512b8044d99a842b46d31c23d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.476865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b83645fe-cf0d-4220-aaa3-ccee275aecf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640b9e512b8044d99a842b46d31c23d7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.558349 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3361/6742] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:46 2022] DELETE /identity/v3/users/640b9e512b8044d99a842b46d31c23d7 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:47.561337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:47.561853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:47.562390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:47.608839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:47.614823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:47.705273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a13b26548a412c9a296c7f73e5b3c4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.726118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a13b26548a412c9a296c7f73e5b3c4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.729060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a13b26548a412c9a296c7f73e5b3c4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.757451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a13b26548a412c9a296c7f73e5b3c4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.791962 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3362/6743] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:47.809201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:47.809201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:47.829630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-950b655a-1888-4856-b6e4-8a08593dc88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a13b26548a412c9a296c7f73e5b3c4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:47.840238 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3382/6744] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:47 2022] DELETE /identity/v3/users/96a13b26548a412c9a296c7f73e5b3c4 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:47.846934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50edc-83b9-4aed-a470-c2c89c619279 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:47.847308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50edc-83b9-4aed-a470-c2c89c619279 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:47.847653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd50edc-83b9-4aed-a470-c2c89c619279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:47.875726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6fd50edc-83b9-4aed-a470-c2c89c619279 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:47.877751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6fd50edc-83b9-4aed-a470-c2c89c619279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:47.902849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:47.972658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3383/6745] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:47.985381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd50edc-83b9-4aed-a470-c2c89c619279 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:48.010107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc80fbb-3485-4d72-8f48-926a382fc615 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:48.050628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd50edc-83b9-4aed-a470-c2c89c619279 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:48.054854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:48.057101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:48.057389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:48.057668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:48.069362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:48.071029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:48.079360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:48.080408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:48.080934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:48.081415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:48.083160 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3384/6746] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:48.084701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:48.096863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:48.098455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:48.111432 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3363/6747] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:55:48.548373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:UPDATE=1,keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:48.761727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:48.763285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:48.781027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8217-8d69-4d63-9873-2cbf9ae284e7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:48.791921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:48.792298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:48.793482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:48.794278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:48.794640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:48.794924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] PATH_INFO: `/v3/projects/234015fcc298401b9a79afd2bfd59635` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:48.796359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=234015fcc298401b9a79afd2bfd59635)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:48.798655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:48.811930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b954ed-66bf-4d07-a7a4-7da65ef3c018 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:48.817101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:48.817765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:48.818110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:48.818402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] PATH_INFO: `/v3/projects/956d0b092c31436fbc64e382a7f553f9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:48.819844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=956d0b092c31436fbc64e382a7f553f9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:48.821814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:48.972322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956d0b092c31436fbc64e382a7f553f9', 'request_id': 'req-6cda0672-57d7-46e2-a159-3ab92c2350dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:48.983037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956d0b092c31436fbc64e382a7f553f9', 'request_id': 'req-6cda0672-57d7-46e2-a159-3ab92c2350dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.034732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234015fcc298401b9a79afd2bfd59635', 'request_id': 'req-888d29cc-51c3-43e7-9703-8cf1524715ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.051091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234015fcc298401b9a79afd2bfd59635', 'request_id': 'req-888d29cc-51c3-43e7-9703-8cf1524715ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.097811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956d0b092c31436fbc64e382a7f553f9', 'request_id': 'req-6cda0672-57d7-46e2-a159-3ab92c2350dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.110436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] The token cache is being invalidate because project 956d0b092c31436fbc64e382a7f553f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:49.110748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.111543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cda0672-57d7-46e2-a159-3ab92c2350dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.114093 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3364/6748] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:48 2022] DELETE /identity/v3/projects/956d0b092c31436fbc64e382a7f553f9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:49.118926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc28a2-ec45-4868-a1b8-789e2b48cfb2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:49.119367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc28a2-ec45-4868-a1b8-789e2b48cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:49.119711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc28a2-ec45-4868-a1b8-789e2b48cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:49.125046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:49.143830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-82bc28a2-ec45-4868-a1b8-789e2b48cfb2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:49.145319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82bc28a2-ec45-4868-a1b8-789e2b48cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:49.175871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234015fcc298401b9a79afd2bfd59635', 'request_id': 'req-888d29cc-51c3-43e7-9703-8cf1524715ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.194344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] The token cache is being invalidate because project 234015fcc298401b9a79afd2bfd59635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:49.194666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.195494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.200184 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3385/6749] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:48 2022] DELETE /identity/v3/projects/234015fcc298401b9a79afd2bfd59635 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:49.201473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:49.203245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:49.256477 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3365/6750] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:49.259722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6ed2-1cd8-42b7-8499-e119f86bbea5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:49.260363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6ed2-1cd8-42b7-8499-e119f86bbea5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:49.261078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6ed2-1cd8-42b7-8499-e119f86bbea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:49.289849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-405c6ed2-1cd8-42b7-8499-e119f86bbea5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:49.295975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-405c6ed2-1cd8-42b7-8499-e119f86bbea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:49.301558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d29cc-51c3-43e7-9703-8cf1524715ba admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:49.306719 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3366/6751] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:49.308196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6ed2-1cd8-42b7-8499-e119f86bbea5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:49.313502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:49.314546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:49.315617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:49.318819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] PATH_INFO: `/v3/users/6774cb2f2f044a098e689ffbdb65ae82` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:49.320995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6ed2-1cd8-42b7-8499-e119f86bbea5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:49.321258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6774cb2f2f044a098e689ffbdb65ae82)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:49.323929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:49.327762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:49.329068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:49.329177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:49.329471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:49.330136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:49.330469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:49.334091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:49.350884 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3367/6752] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:49.354357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:49.370899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff033ac-e196-4b6e-a5db-99ec392342c8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:49.378381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:49.379101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:49.379288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:49.379694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:49.380485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:49.382685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:49.564517 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3368/6753] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:49 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:49.572553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:49.643234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6774cb2f2f044a098e689ffbdb65ae82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.671288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6774cb2f2f044a098e689ffbdb65ae82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.671880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa84cd-9874-426c-9a68-8d946d7b7a8d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:49.672753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6774cb2f2f044a098e689ffbdb65ae82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.678958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:49.679827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:49.680303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:49.680744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:49.681717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:49.684221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:49.704774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:49.714743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6774cb2f2f044a098e689ffbdb65ae82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.837738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6774cb2f2f044a098e689ffbdb65ae82'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:49.851559 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3369/6754] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:49 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:49.855363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:49.858411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:49.866277 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3386/6755] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:49 2022] DELETE /identity/v3/users/6774cb2f2f044a098e689ffbdb65ae82 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:49.878510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf21a6-823a-4f6f-8476-c5916442e1cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:49.937946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:49.959233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:49.959982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:49.960335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:49.960836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:49.961592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:49.963412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:49.989434 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3370/6756] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:55:49.993366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:50.006268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3901d-271a-47c8-b98c-b49690e5266d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:50.013531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fcfad-d989-463a-8638-bebf700bea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:50.014596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fcfad-d989-463a-8638-bebf700bea04 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:50.015123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fcfad-d989-463a-8638-bebf700bea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:50.015657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fcfad-d989-463a-8638-bebf700bea04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:50.016748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fcfad-d989-463a-8638-bebf700bea04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:50.019568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fcfad-d989-463a-8638-bebf700bea04 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:50.034225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3387/6757] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:50.038949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:50.068514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a058-0742-4b0d-a59d-6cef4a21d211 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:50.083638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:50.084325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:50.084606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:50.084883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] PATH_INFO: `/v3/projects/91a7a4d23c5042058f06e1680ff88bd7/users/3b3a38c1295743a786cb38d44c115f39/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:50.103484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a7a4d23c5042058f06e1680ff88bd7, user_id=3b3a38c1295743a786cb38d44c115f39, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:50.107320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:50.230575 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3371/6758] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:50 2022] PUT /identity/v3/projects/91a7a4d23c5042058f06e1680ff88bd7/users/3b3a38c1295743a786cb38d44c115f39/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:50.241173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:50.241515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:50.241799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:50.282895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] MFA Rules not processed for user `3b3a38c1295743a786cb38d44c115f39`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:50.284770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:50.429967 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3388/6759] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:50.446499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:50.446499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:50.485450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:50.487666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:50.590283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e406bf-bb4d-489a-b289-fcea1ce8eae3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:50.605443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b740763-a78f-4874-8a41-c7dd37eb72b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:50.605443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740763-a78f-4874-8a41-c7dd37eb72b5 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:50.605443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740763-a78f-4874-8a41-c7dd37eb72b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:50.605443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b740763-a78f-4874-8a41-c7dd37eb72b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:50.606781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:50.635844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95aed2e-7050-487f-85a5-a4ea5c7b63ee None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:50.635963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740763-a78f-4874-8a41-c7dd37eb72b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:50.635963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b740763-a78f-4874-8a41-c7dd37eb72b5 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:50.644503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:50.649296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:50.649296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:50.649296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] PATH_INFO: `/v3/projects/908321cde5fe45dbb18bda8ace5f418f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:50.649296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908321cde5fe45dbb18bda8ace5f418f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:50.649296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:50.655596 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3372/6760] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:50.794767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908321cde5fe45dbb18bda8ace5f418f', 'request_id': 'req-5b77b83a-162a-4cf2-8079-48c6688344c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:50.809266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908321cde5fe45dbb18bda8ace5f418f', 'request_id': 'req-5b77b83a-162a-4cf2-8079-48c6688344c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:50.908434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908321cde5fe45dbb18bda8ace5f418f', 'request_id': 'req-5b77b83a-162a-4cf2-8079-48c6688344c9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:50.931505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] The token cache is being invalidate because project 908321cde5fe45dbb18bda8ace5f418f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:50.931803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:50.932568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5b77b83a-162a-4cf2-8079-48c6688344c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:50.934737 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3389/6761] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:50 2022] DELETE /identity/v3/projects/908321cde5fe45dbb18bda8ace5f418f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:50.939451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612f4e-dec8-4489-9442-a68c1dfbf9f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:50.940590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612f4e-dec8-4489-9442-a68c1dfbf9f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:50.941206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612f4e-dec8-4489-9442-a68c1dfbf9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:50.965531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-36612f4e-dec8-4489-9442-a68c1dfbf9f9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:50.966696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-36612f4e-dec8-4489-9442-a68c1dfbf9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:51.090679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3373/6762] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:55:51.104641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fe122-6cdb-46ad-8582-6a103624d9b8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:51.105028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fe122-6cdb-46ad-8582-6a103624d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:51.105485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fe122-6cdb-46ad-8582-6a103624d9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:51.132672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4c5fe122-6cdb-46ad-8582-6a103624d9b8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:51.135804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c5fe122-6cdb-46ad-8582-6a103624d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:51.152180 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3390/6763] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:51.156294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612f4e-dec8-4489-9442-a68c1dfbf9f9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:51.175333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612f4e-dec8-4489-9442-a68c1dfbf9f9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:51.182254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:51.183137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:51.183614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:51.184159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:51.185011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:51.185519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:51.187550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:51.203978 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3374/6764] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:51.208928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fe122-6cdb-46ad-8582-6a103624d9b8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:51.220649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fe122-6cdb-46ad-8582-6a103624d9b8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:51.228027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:51.230187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:51.230187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:51.230187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:51.230647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:51.233103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:51.347606 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3391/6765] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:51 2022] POST /identity/v3/projects => generated 395 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:51.351973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:51.363323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93737473-3adf-4fb6-8562-79f7621e9f13 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:51.458336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:51.459929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:51.460468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:51.460956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:51.465891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:51.465891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:51.467506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:51.635587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3375/6766] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:51 2022] POST /identity/v3/users => generated 298 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:51.639493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:51.655902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772906e5-7544-43e3-aa5b-0ea6352ae4bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:51.665041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:51.666315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:51.667726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:51.674892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:51.674892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:51.674892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:51.691206 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3392/6767] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:51.778754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:51.790302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5393-26c2-45f5-ba93-958f7ca6dc61 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:51.796328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa69fd-540b-45f9-afe4-8029a2ba2c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:51.797324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa69fd-540b-45f9-afe4-8029a2ba2c50 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:51.797824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa69fd-540b-45f9-afe4-8029a2ba2c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:51.798351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa69fd-540b-45f9-afe4-8029a2ba2c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:51.804055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa69fd-540b-45f9-afe4-8029a2ba2c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:51.804055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa69fd-540b-45f9-afe4-8029a2ba2c50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:51.814468 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3376/6768] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:55:51.818132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:51.837291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8b2d-0055-48f2-a6dc-31d5ed42f756 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:51.842322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:51.843089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:51.843374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:51.843650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] PATH_INFO: `/v3/projects/ba827ca6e57649e4915d0d425af55593/users/6a234c77a202454db9836512e8a6ace6/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:51.882493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba827ca6e57649e4915d0d425af55593, user_id=6a234c77a202454db9836512e8a6ace6, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:51.885530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:51.994781 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3393/6769] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:51 2022] PUT /identity/v3/projects/ba827ca6e57649e4915d0d425af55593/users/6a234c77a202454db9836512e8a6ace6/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:52.012451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744e33d-c5c5-4261-ab6e-61865f52e7b0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:52.012733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744e33d-c5c5-4261-ab6e-61865f52e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:52.013249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744e33d-c5c5-4261-ab6e-61865f52e7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:52.086990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6744e33d-c5c5-4261-ab6e-61865f52e7b0 None None] MFA Rules not processed for user `6a234c77a202454db9836512e8a6ace6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:52.088490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6744e33d-c5c5-4261-ab6e-61865f52e7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:52.245190 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3377/6770] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:52.246233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:52.291347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:52.323732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29a888-3670-49ec-9527-4b1ef529718e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:52.328656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:52.329296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:52.329578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:52.329854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:52.331304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:52.333370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:52.429202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3394/6771] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:52 2022] POST /identity/v3/projects => generated 397 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:55:52.430595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744e33d-c5c5-4261-ab6e-61865f52e7b0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:52.469753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744e33d-c5c5-4261-ab6e-61865f52e7b0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:52.671020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:52.682133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:52.682430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:52.682713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:52.683377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:52.703461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:52.832418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3378/6772] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:52 2022] POST /identity/v3/users => generated 305 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:52.837661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:52.858862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca0027-d94e-4665-9954-c03f84ad7906 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:52.865701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:52.866673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:52.867109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:52.867533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:52.869120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:52.872297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:52.899366 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3395/6773] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:52.904176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:52.924333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566734-8ce5-46a8-aec9-7429aafccf30 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:52.932119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:52.932815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:52.933089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:52.933389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] PATH_INFO: `/v3/projects/e6b7cc134a88467fa30e4a5907a5c700/users/395546ed026247fb915c14fd501e903c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:52.957057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b7cc134a88467fa30e4a5907a5c700, user_id=395546ed026247fb915c14fd501e903c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:52.960617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:53.106950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3379/6774] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:52 2022] PUT /identity/v3/projects/e6b7cc134a88467fa30e4a5907a5c700/users/395546ed026247fb915c14fd501e903c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:53.110895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:53.132508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f3d50-1565-4eda-91d3-0c03829fa8df admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:53.270687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab2209-e79f-4835-8597-24b9f8a88fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:53.271327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2209-e79f-4835-8597-24b9f8a88fad admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.271446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:53.271847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2209-e79f-4835-8597-24b9f8a88fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.271847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab2209-e79f-4835-8597-24b9f8a88fad admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.272517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2209-e79f-4835-8597-24b9f8a88fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:53.274700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab2209-e79f-4835-8597-24b9f8a88fad admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:53.296493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3396/6775] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:53.298384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:53.312153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6cec9-8e53-43f3-8032-fcf45fe6aa73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:53.318968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:53.320058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.320514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.320934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] PATH_INFO: `/v3/projects/e6b7cc134a88467fa30e4a5907a5c700/users/395546ed026247fb915c14fd501e903c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.323111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b7cc134a88467fa30e4a5907a5c700, user_id=395546ed026247fb915c14fd501e903c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:53.325946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:53.338694 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3380/6776] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:53 2022] PUT /identity/v3/projects/e6b7cc134a88467fa30e4a5907a5c700/users/395546ed026247fb915c14fd501e903c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:53.348515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f78574-e151-4200-8162-19cd3f6afbff None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.349129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f78574-e151-4200-8162-19cd3f6afbff None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.349792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f78574-e151-4200-8162-19cd3f6afbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.395619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2f78574-e151-4200-8162-19cd3f6afbff None None] MFA Rules not processed for user `395546ed026247fb915c14fd501e903c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:53.400853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2f78574-e151-4200-8162-19cd3f6afbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:53.487304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:53.589954 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3397/6777] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:53.594825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:53.711084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae13712-6842-4407-ba95-24365aa061cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:53.716782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a234c77a202454db9836512e8a6ace6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba827ca6e57649e4915d0d425af55593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:53.718954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.718954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.719372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.720199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 18 13:55:53.728160 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.733353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3381/6778] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:55:53 2022] POST /identity/v3/projects => generated 136 bytes in 136 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 18 13:55:53.735731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f78574-e151-4200-8162-19cd3f6afbff None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:53.761254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f78574-e151-4200-8162-19cd3f6afbff None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:53.781838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395546ed026247fb915c14fd501e903c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b7cc134a88467fa30e4a5907a5c700', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:53.782918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.784324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.785851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.791111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:53.794618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Invalid input for field 'name': '' is too short Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: On instance['name']: Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: On instance['name']: Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: '' Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise error Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application '' Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.809457 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:55:53.811034 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application '' Oct 18 13:55:53.812308 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.815090 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3398/6779] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:55:53 2022] POST /identity/v3/projects => generated 283 bytes in 80 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:55:53.820346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:53.835787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41440140-2696-4970-8692-6de2f67e17d4 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:53.841224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395546ed026247fb915c14fd501e903c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b7cc134a88467fa30e4a5907a5c700', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:53.842047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.842364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.842640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.843274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:53.852773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: On instance['name']: Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: On instance['name']: Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise error Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:55:53.861514 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:53.863341 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application On instance['name']: Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:55:53.864507 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:53.868645 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3382/6780] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:55:53 2022] POST /identity/v3/projects => generated 412 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:55:53.869550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:53.897893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677faa5-c51e-43cc-9592-10e6b709c8d2 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:53.910232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395546ed026247fb915c14fd501e903c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b7cc134a88467fa30e4a5907a5c700', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:53.910905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.911189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.919406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] PATH_INFO: `/v3/projects/4f8f6d8046a647868a6789e02997ec48` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.930534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f8f6d8046a647868a6789e02997ec48)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:53.937372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Could not find project: 4f8f6d8046a647868a6789e02997ec48.: keystone.exception.ProjectNotFound: Could not find project: 4f8f6d8046a647868a6789e02997ec48. Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 18 13:55:53.954309 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4f8f6d8046a647868a6789e02997ec48. Oct 18 13:55:53.955831 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:55:53.958277 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3399/6781] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:53 2022] DELETE /identity/v3/projects/4f8f6d8046a647868a6789e02997ec48 => generated 113 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:55:53.964338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:53.983280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683e47-c229-49c6-a750-8dac19547271 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:53.991177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a234c77a202454db9836512e8a6ace6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba827ca6e57649e4915d0d425af55593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:53.991803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:53.993955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:53.993955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:53.993955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 18 13:55:54.002424 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._list_projects() Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 18 13:55:54.003477 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.005679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3383/6782] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 13:55:53 2022] GET /identity/v3/projects => generated 135 bytes in 42 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:55:54.010614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:54.030104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32e92-7422-444a-814f-c3baf47157b6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:54.039159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395546ed026247fb915c14fd501e903c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b7cc134a88467fa30e4a5907a5c700', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:54.040421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:54.041806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:54.042107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:54.042929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:54.049092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:54.318848 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3400/6783] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:54 2022] POST /identity/v3/projects => generated 356 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:54.322962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:54.347162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5234-5eb8-40b2-87f9-318a4af8da08 tempest-ProjectsNegativeStaticTestJSON-820730113 tempest-ProjectsNegativeStaticTestJSON-820730113-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:54.510896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395546ed026247fb915c14fd501e903c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b7cc134a88467fa30e4a5907a5c700', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:54.512073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:54.512368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:54.512758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:54.514527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:54.516929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:54.573206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.sql.core [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-604494503' for key 'project.ixu_project_name_domain_id'") Oct 18 13:55:54.573206 n-d-858383-13 devstack@keystone.service[82161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:55:54.573206 n-d-858383-13 devstack@keystone.service[82161]: [parameters: {'id': 'e3c4101209ca4fc493d729e6f61a8054', 'name': 'tempest-project-dup-604494503', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 13:55:54.573206 n-d-858383-13 devstack@keystone.service[82161]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82161) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-604494503, project id e3c4101209ca4fc493d729e6f61a8054.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-604494503, project id e3c4101209ca4fc493d729e6f61a8054. Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:55:54.589105 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-604494503' for key 'project.ixu_project_name_domain_id'") Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 13:55:54.590137 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application yield resource Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application next(self.gen) Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise self.value Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 13:55:54.595188 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application session.commit() Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.session.flush() Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application compat.raise_( Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 13:55:54.597334 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 13:55:54.598742 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application conn.query(q) Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application result.read() Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:55:54.599936 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-604494503' for key 'project.ixu_project_name_domain_id'") Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [parameters: {'id': 'e3c4101209ca4fc493d729e6f61a8054', 'name': 'tempest-project-dup-604494503', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:54.601166 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-604494503 at domain ID default. Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:55:54.603068 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-604494503, project id e3c4101209ca4fc493d729e6f61a8054. Oct 18 13:55:54.606811 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:55:54.608048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:54.608352 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3384/6784] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:55:54 2022] POST /identity/v3/projects => generated 284 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 13:55:54.616264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e087a94-07d4-429a-ae2f-852794af49f6 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:54.624992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395546ed026247fb915c14fd501e903c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b7cc134a88467fa30e4a5907a5c700', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:54.625662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:54.625947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:54.626627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] PATH_INFO: `/v3/projects/4b33a34e77354415bf57d1f6f3828a36` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:54.628129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b33a34e77354415bf57d1f6f3828a36)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:54.630625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:54.921328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:54.924625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b33a34e77354415bf57d1f6f3828a36', 'request_id': 'req-25e16bb3-7893-4b36-8848-95f3bb25c68b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:54.944762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b33a34e77354415bf57d1f6f3828a36', 'request_id': 'req-25e16bb3-7893-4b36-8848-95f3bb25c68b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.040548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:55.109287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b33a34e77354415bf57d1f6f3828a36', 'request_id': 'req-25e16bb3-7893-4b36-8848-95f3bb25c68b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.123307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] The token cache is being invalidate because project 4b33a34e77354415bf57d1f6f3828a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:55.123843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.125528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-25e16bb3-7893-4b36-8848-95f3bb25c68b tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.133754 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3401/6785] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:54 2022] DELETE /identity/v3/projects/4b33a34e77354415bf57d1f6f3828a36 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:55.134293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:55.136507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:55.239703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dc5a3-71c0-4c41-8937-bd27608b4582 tempest-ProjectsNegativeStaticTestJSON-1470064078 tempest-ProjectsNegativeStaticTestJSON-1470064078-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:55.334332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:55.335791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:55.336391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:55.337010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] PATH_INFO: `/v3/users/6a234c77a202454db9836512e8a6ace6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:55.338719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a234c77a202454db9836512e8a6ace6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:55.341513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:55.560917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a234c77a202454db9836512e8a6ace6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.561842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a234c77a202454db9836512e8a6ace6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.635409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a234c77a202454db9836512e8a6ace6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.636891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a234c77a202454db9836512e8a6ace6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.654222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a234c77a202454db9836512e8a6ace6'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:55.696394 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3385/6786] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:55 2022] DELETE /identity/v3/users/6a234c77a202454db9836512e8a6ace6 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:55.701431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:55.702393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:55.702837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:55.733222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:55.734959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:55.866219 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3402/6787] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:55.876599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:55.880547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:55.965569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773b511-4959-46f4-883c-2df8d6238f02 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:55.971130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:55.972833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:55.973399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:55.973849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:55.987868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:55.989830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:56.004077 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3386/6788] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:56.257771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:56.589295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:56.599064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:56.632238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dea2e-fd27-47a2-b670-56b64a991b27 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:56.747151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:56.747151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:56.747151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:56.756171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] PATH_INFO: `/v3/users/cb471e745b9b4be0a95d6aee4dcf9bef` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:56.760571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb471e745b9b4be0a95d6aee4dcf9bef)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:56.765836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:56.786994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:56.789326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:56.831871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad440-4310-4e8a-8e4e-35bfad79e8c8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:56.842260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:56.843218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:56.843695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:56.844118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] PATH_INFO: `/v3/projects/ba827ca6e57649e4915d0d425af55593` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:56.845544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba827ca6e57649e4915d0d425af55593)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:56.848577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:56.953401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:57.043519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba827ca6e57649e4915d0d425af55593', 'request_id': 'req-f485e846-4010-4eb7-b584-e03b4606e192'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.044677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb471e745b9b4be0a95d6aee4dcf9bef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.055005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba827ca6e57649e4915d0d425af55593', 'request_id': 'req-f485e846-4010-4eb7-b584-e03b4606e192'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.059026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb471e745b9b4be0a95d6aee4dcf9bef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.060680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb471e745b9b4be0a95d6aee4dcf9bef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.074641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb471e745b9b4be0a95d6aee4dcf9bef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.143394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba827ca6e57649e4915d0d425af55593', 'request_id': 'req-f485e846-4010-4eb7-b584-e03b4606e192'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.155076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] The token cache is being invalidate because project ba827ca6e57649e4915d0d425af55593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:57.160148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.160148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.160148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3387/6789] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:56 2022] DELETE /identity/v3/projects/ba827ca6e57649e4915d0d425af55593 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:57.162094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:57.163492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:57.229501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485e846-4010-4eb7-b584-e03b4606e192 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:57.234765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:57.235472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:57.235818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:57.236156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] PATH_INFO: `/v3/users/395546ed026247fb915c14fd501e903c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:57.237473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395546ed026247fb915c14fd501e903c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:57.239517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:57.251911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d83bd52c-4b0c-4220-8252-9be92cf95dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb471e745b9b4be0a95d6aee4dcf9bef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.262002 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3403/6790] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:56 2022] DELETE /identity/v3/users/cb471e745b9b4be0a95d6aee4dcf9bef => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:57.276036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:57.276760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:57.277486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:57.317081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:57.318613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:57.418587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3404/6791] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:55:57.430873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:57.432871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:57.496472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395546ed026247fb915c14fd501e903c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.497171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395546ed026247fb915c14fd501e903c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.527597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546988e-4bf6-4f03-b7a1-0f3bb5c21242 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:57.535527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:57.536331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:57.536666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:57.537020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:57.538936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:57.571135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:57.573878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:57.593254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395546ed026247fb915c14fd501e903c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.594651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395546ed026247fb915c14fd501e903c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.597385 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3405/6792] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:55:57.605336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4067cb0e-c4c1-418a-9d40-aae40e4ab037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395546ed026247fb915c14fd501e903c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:57.654254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3388/6793] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:55:57 2022] DELETE /identity/v3/users/395546ed026247fb915c14fd501e903c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:55:57.899606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:57.901202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:57.914272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:57.933797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cdc6d-5381-41ae-9b71-eb478c4afefe service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:58.061439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:58.062170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:58.063152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:58.063453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] PATH_INFO: `/v3/projects/5eff6394f60946e28239c9a29a50c3a9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:58.065571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eff6394f60946e28239c9a29a50c3a9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:58.068705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:58.304970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eff6394f60946e28239c9a29a50c3a9', 'request_id': 'req-ff425c9c-37eb-4f44-9900-a8247ef662e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:58.313398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eff6394f60946e28239c9a29a50c3a9', 'request_id': 'req-ff425c9c-37eb-4f44-9900-a8247ef662e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:58.409770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eff6394f60946e28239c9a29a50c3a9', 'request_id': 'req-ff425c9c-37eb-4f44-9900-a8247ef662e5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:58.427755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] The token cache is being invalidate because project 5eff6394f60946e28239c9a29a50c3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:58.428055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:58.430380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff425c9c-37eb-4f44-9900-a8247ef662e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:58.438756 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3406/6794] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:57 2022] DELETE /identity/v3/projects/5eff6394f60946e28239c9a29a50c3a9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:58.444106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80248ec-3fd5-490b-ba05-22496c231994 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:58.447319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80248ec-3fd5-490b-ba05-22496c231994 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:58.447319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80248ec-3fd5-490b-ba05-22496c231994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:58.502679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b80248ec-3fd5-490b-ba05-22496c231994 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:58.508208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b80248ec-3fd5-490b-ba05-22496c231994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:58.671351 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3389/6795] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:58.673142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:58.673429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:58.673706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:58.713696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:58.717527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:58.740858 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3407/6796] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:58.742186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80248ec-3fd5-490b-ba05-22496c231994 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:58.758167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80248ec-3fd5-490b-ba05-22496c231994 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:58.767421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:58.768534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:58.769239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:58.769714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:58.770395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:58.770856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:58.771316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:58.772178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:58.774904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:58.796102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7a257-02cf-490e-a822-a3a298978778 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:58.796849 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3390/6797] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:55:58.800459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:58.808339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:58.810253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:58.812786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:58.813492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] PATH_INFO: `/v3/projects/e6b7cc134a88467fa30e4a5907a5c700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:58.817338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b7cc134a88467fa30e4a5907a5c700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:58.819968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:58.837067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae9511-79e3-4a54-9850-f341041756dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:58.845021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:58.846443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:58.846934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:58.847365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:58.848218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:58.850595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:58.914712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:58.953806 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3391/6798] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:58 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:58.957677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:58.985922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b7cc134a88467fa30e4a5907a5c700', 'request_id': 'req-ff94ab1d-8a26-47df-bc11-95726fde6e38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:58.995554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b7cc134a88467fa30e4a5907a5c700', 'request_id': 'req-ff94ab1d-8a26-47df-bc11-95726fde6e38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:59.068067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b7cc134a88467fa30e4a5907a5c700', 'request_id': 'req-ff94ab1d-8a26-47df-bc11-95726fde6e38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:59.085232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdda66e-2b50-4d1c-80e8-eb93c1d559f3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:59.093427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:59.094465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.096881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.097165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.098128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] The token cache is being invalidate because project e6b7cc134a88467fa30e4a5907a5c700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:55:59.098456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:59.098851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:59.100206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff94ab1d-8a26-47df-bc11-95726fde6e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:55:59.101532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:59.103478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3408/6799] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:55:58 2022] DELETE /identity/v3/projects/e6b7cc134a88467fa30e4a5907a5c700 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:59.108802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26811e-2931-44b8-a3b2-29aac6e6f9e7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.113212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26811e-2931-44b8-a3b2-29aac6e6f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.113212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26811e-2931-44b8-a3b2-29aac6e6f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.145626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ad26811e-2931-44b8-a3b2-29aac6e6f9e7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:59.146917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad26811e-2931-44b8-a3b2-29aac6e6f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:59.156222 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3409/6800] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:55:59.173857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208461-c7fa-4102-b88a-1a69108555c4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.175576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208461-c7fa-4102-b88a-1a69108555c4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.175943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208461-c7fa-4102-b88a-1a69108555c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.209945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e208461-c7fa-4102-b88a-1a69108555c4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:59.212126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e208461-c7fa-4102-b88a-1a69108555c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:59.219826 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3410/6801] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:59.224785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208461-c7fa-4102-b88a-1a69108555c4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:59.235161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208461-c7fa-4102-b88a-1a69108555c4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:59.241147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:59.241770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.242072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.242363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.243020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:55:59.243324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:59.244811 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3392/6802] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:58 2022] POST /identity/v3/users => generated 287 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:59.247334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:59.249512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:59.253657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:59.271585 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3411/6803] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:55:59.272696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:59.273044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7c1fa-8ef3-460c-8b89-2c51072a2243 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:59.290761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25423f4-27b4-4fc8-840b-d38ae0a22970 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:59.296331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:59.296964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.297247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.297525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.298198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:59.300240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:59.311290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:59.312276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.312749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.313189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.314283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:59.338791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:59.362394 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3393/6804] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:59.363347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:59.375691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc43b9c-8155-4224-920c-c8fa2651d23d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:59.385608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:59.386904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.387193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.387468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.388386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:59.390098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:59.406165 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3394/6805] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:55:59.411253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:59.424543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2614ce-e303-481d-b96e-dcf8cd9e9b03 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:59.429874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439832c-8be2-4513-bb2b-54adb17f8b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:59.431710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439832c-8be2-4513-bb2b-54adb17f8b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.431710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439832c-8be2-4513-bb2b-54adb17f8b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.431710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439832c-8be2-4513-bb2b-54adb17f8b11 admin admin] PATH_INFO: `/v3/projects/3f03e0a532694e77aa33a4fe6027dd63/users/d131ce1fc9b0499880e2c5f5557ac250/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.461019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439832c-8be2-4513-bb2b-54adb17f8b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f03e0a532694e77aa33a4fe6027dd63, user_id=d131ce1fc9b0499880e2c5f5557ac250, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:59.463959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439832c-8be2-4513-bb2b-54adb17f8b11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:59.493964 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3412/6806] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:55:59 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:55:59.498243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:59.578582 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3395/6807] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:55:59 2022] PUT /identity/v3/projects/3f03e0a532694e77aa33a4fe6027dd63/users/d131ce1fc9b0499880e2c5f5557ac250/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:55:59.592067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.592944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.593396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.636102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] MFA Rules not processed for user `d131ce1fc9b0499880e2c5f5557ac250`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:55:59.639021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:59.690954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cc0a8-1fe5-407d-9445-be0e436f49a1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:55:59.823580 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3396/6808] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:55:59.824857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:55:59.831444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:55:59.867448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:55:59.868087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:55:59.868369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:55:59.868815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:55:59.869288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:55:59.891535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:55:59.995959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6858c25-9950-48bf-a999-eec88191b94a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:00.008311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:00.008974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:00.009225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:00.009496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:00.010587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3413/6809] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:55:59 2022] POST /identity/v3/users => generated 285 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:00.015126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:00.031457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:00.032933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:00.035227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9ccd1-5de3-4266-b94d-fd2aed40b4e2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:00.050578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:00.052246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:00.052846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:00.053560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:00.054559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:00.056326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:00.058094 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3397/6810] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:55:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:00.072367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:00.082305 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3414/6811] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:56:00.086492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:00.107435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9a126-a9c3-43c9-8ff1-675d3797f84a service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:00.121058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155cfba-bd14-458c-b7dd-8d82826eaf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:00.121841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155cfba-bd14-458c-b7dd-8d82826eaf59 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:00.122168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155cfba-bd14-458c-b7dd-8d82826eaf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:00.122439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155cfba-bd14-458c-b7dd-8d82826eaf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:00.123104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155cfba-bd14-458c-b7dd-8d82826eaf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:00.124747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155cfba-bd14-458c-b7dd-8d82826eaf59 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:00.149309 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3398/6812] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:00.153635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:00.168828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde4b5f-245a-419f-8d71-ffa6d76eb4ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:00.188183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:00.189291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:00.190179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:00.190699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] PATH_INFO: `/v3/projects/2bec5ca56a79421b9b0cfce3b9a95184/users/18fe09c650464327af5548dc75964012/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:00.219033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bec5ca56a79421b9b0cfce3b9a95184, user_id=18fe09c650464327af5548dc75964012, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:00.222875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:00.367761 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3415/6813] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:00 2022] PUT /identity/v3/projects/2bec5ca56a79421b9b0cfce3b9a95184/users/18fe09c650464327af5548dc75964012/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:00.369788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954f21d-1c81-4038-8ad2-d2f6f900a4eb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:00.370471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954f21d-1c81-4038-8ad2-d2f6f900a4eb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:00.370908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954f21d-1c81-4038-8ad2-d2f6f900a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:00.448087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5954f21d-1c81-4038-8ad2-d2f6f900a4eb None None] MFA Rules not processed for user `18fe09c650464327af5548dc75964012`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:00.450019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5954f21d-1c81-4038-8ad2-d2f6f900a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:00.555186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:00.686403 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3399/6814] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:00.691575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:00.827295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:00.854485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f6bab-c30f-47ca-81e7-e73310b1ca2c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:00.870414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:00.871056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:00.871339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:00.871621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:00.872441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:00.874757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:01.036654 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3416/6815] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:00 2022] POST /identity/v3/projects => generated 369 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:01.040637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954f21d-1c81-4038-8ad2-d2f6f900a4eb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:01.078912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954f21d-1c81-4038-8ad2-d2f6f900a4eb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:01.211166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:01.246477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:01.257012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:01.257012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:01.257012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:01.257012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:01.257012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:01.357604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:01.387396 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3400/6816] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:01 2022] POST /identity/v3/users => generated 291 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:01.392478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:01.411251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852958f4-0606-4b45-a8e4-358caf3ecfd9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:01.453645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:01.454813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:01.455649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:01.456159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:01.459896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:01.466871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:01.500219 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3417/6817] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:01.508040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:01.542215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c147d-82f0-4647-9da5-3e6a8828814b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:01.557356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:01.557830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:01.558137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:01.558416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] PATH_INFO: `/v3/projects/d687a2f6e80245db8d34a44bb7c467f8/users/61cb70268eda49aaac6c6e9ebb4c0c5f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:01.595748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d687a2f6e80245db8d34a44bb7c467f8, user_id=61cb70268eda49aaac6c6e9ebb4c0c5f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:01.603182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:01.645297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:01.715298 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3401/6818] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:01 2022] PUT /identity/v3/projects/d687a2f6e80245db8d34a44bb7c467f8/users/61cb70268eda49aaac6c6e9ebb4c0c5f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:01.717689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:01.770504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:01.780812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e6245-cf07-4750-838b-75ed59d7d8fe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:01.935583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940eee-c936-4042-8b19-c7b4fb31742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:01.936285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940eee-c936-4042-8b19-c7b4fb31742b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:01.936632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940eee-c936-4042-8b19-c7b4fb31742b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:01.936970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940eee-c936-4042-8b19-c7b4fb31742b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:01.937678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940eee-c936-4042-8b19-c7b4fb31742b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:01.939386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940eee-c936-4042-8b19-c7b4fb31742b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:01.950788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3418/6819] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:01.954951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:01.966915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0dfa-ac25-4f8c-987b-c3c79a6455bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:01.988943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:01.989661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:01.990010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:01.990417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] PATH_INFO: `/v3/projects/d687a2f6e80245db8d34a44bb7c467f8/users/61cb70268eda49aaac6c6e9ebb4c0c5f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:01.992799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d687a2f6e80245db8d34a44bb7c467f8, user_id=61cb70268eda49aaac6c6e9ebb4c0c5f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:01.995660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:02.009922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3402/6820] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:01 2022] PUT /identity/v3/projects/d687a2f6e80245db8d34a44bb7c467f8/users/61cb70268eda49aaac6c6e9ebb4c0c5f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:02.025221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84761a-2abe-47c2-a06e-ecf216391fda None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:02.025949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84761a-2abe-47c2-a06e-ecf216391fda None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:02.026477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84761a-2abe-47c2-a06e-ecf216391fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:02.066285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:02.068290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:02.068431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4e84761a-2abe-47c2-a06e-ecf216391fda None None] MFA Rules not processed for user `61cb70268eda49aaac6c6e9ebb4c0c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:02.070282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4e84761a-2abe-47c2-a06e-ecf216391fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:02.231756 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3419/6821] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:02.232935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84761a-2abe-47c2-a06e-ecf216391fda None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:02.244928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a24947-143c-4fb5-a61d-75ec34b45545 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:02.257510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84761a-2abe-47c2-a06e-ecf216391fda None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:02.262700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:02.269510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:02.269510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:02.269510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] PATH_INFO: `/v3/users/b58627a63ea04c6a8a7a62c0f28208c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:02.269510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58627a63ea04c6a8a7a62c0f28208c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:02.273366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:02.273558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:02.273662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:02.273903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:02.274920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:02.275771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:02.278524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:02.386652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:02.480180 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3420/6822] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:56:02 2022] POST /identity/v3/projects => generated 328 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:02.490355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:02.583800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543badca-d8f4-4bf5-853a-7bdc4ba0e305 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:02.589147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:02.589786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:02.590097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:02.590429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:02.591413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:02.593620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:02.598974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58627a63ea04c6a8a7a62c0f28208c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:02.599918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58627a63ea04c6a8a7a62c0f28208c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:02.689146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58627a63ea04c6a8a7a62c0f28208c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:02.690143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58627a63ea04c6a8a7a62c0f28208c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:02.702158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58627a63ea04c6a8a7a62c0f28208c2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:02.720560 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3421/6823] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:02 2022] POST /identity/v3/users => generated 413 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:56:02.725987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:02.729082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:02.734613 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3403/6824] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:02 2022] DELETE /identity/v3/users/b58627a63ea04c6a8a7a62c0f28208c2 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:02.745602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f4b89-89db-4836-b2b8-96d703e5ab7a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:02.879824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:02.880844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:02.881322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:02.886214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:02.887636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:02.892211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:03.035782 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3422/6825] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:02 2022] POST /identity/v3/roles => generated 244 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:03.047197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:03.063086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56ae5-b0f3-426f-8585-05e9076fefc4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:03.072402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:03.073373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:03.074281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:03.074647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:03.075463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:03.077765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:03.091421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:03.165104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:03.166757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:03.176746 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3404/6826] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:03 2022] POST /identity/v3/roles => generated 246 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:03.182873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:03.196219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8f3a-0cd8-486d-89a2-5bb8a7f8faae tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:03.202570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:03.265243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:03.265243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:03.265243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/c19da95279a242b6b9d2cf761f6abbe0/users/5c9771adcc27428196086931a737115c/roles/35069481416e4ded9f6d9431300f6ab1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:03.265243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c19da95279a242b6b9d2cf761f6abbe0, user_id=5c9771adcc27428196086931a737115c, role_id=35069481416e4ded9f6d9431300f6ab1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:03.267033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:03.274018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33cd20-fc54-45a6-a879-7b71a3cb60b7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:03.279427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:03.280229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:03.280615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:03.280993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] PATH_INFO: `/v3/projects/e7caeabfa27f4070843694f55f857581` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:03.282464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7caeabfa27f4070843694f55f857581)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:03.285176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:03.385886 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3405/6827] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:03 2022] PUT /identity/v3/projects/c19da95279a242b6b9d2cf761f6abbe0/users/5c9771adcc27428196086931a737115c/roles/35069481416e4ded9f6d9431300f6ab1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:03.390618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:03.462981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aaa128-bf5f-413d-8c88-1e75eb49f16b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:03.467911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:03.468609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:03.468896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:03.469184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/c19da95279a242b6b9d2cf761f6abbe0/users/5c9771adcc27428196086931a737115c/roles/ab5b7454f763417b83f3374b2984eba6` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:03.471504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c19da95279a242b6b9d2cf761f6abbe0, user_id=5c9771adcc27428196086931a737115c, role_id=ab5b7454f763417b83f3374b2984eba6)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:03.474184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:03.610319 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3406/6828] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:03 2022] PUT /identity/v3/projects/c19da95279a242b6b9d2cf761f6abbe0/users/5c9771adcc27428196086931a737115c/roles/ab5b7454f763417b83f3374b2984eba6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:03.616275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:03.719655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7caeabfa27f4070843694f55f857581', 'request_id': 'req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:03.736831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7caeabfa27f4070843694f55f857581', 'request_id': 'req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:03.781502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ed5ab-2677-4229-a2d9-25f328af3c48 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:03.810854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7caeabfa27f4070843694f55f857581', 'request_id': 'req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:03.840155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] The token cache is being invalidate because project e7caeabfa27f4070843694f55f857581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:03.840769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:03.850562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e0c8c2aa-0771-44fc-bfb4-de42cbe99299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:03.852913 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3423/6829] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:03 2022] DELETE /identity/v3/projects/e7caeabfa27f4070843694f55f857581 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:03.858263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0179f8-2d9e-4e41-bea9-a2d66ead1560 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:03.858577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0179f8-2d9e-4e41-bea9-a2d66ead1560 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:03.858973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0179f8-2d9e-4e41-bea9-a2d66ead1560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:03.884114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f450407-2940-4e33-92b3-7814071fe37b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:03.884757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f450407-2940-4e33-92b3-7814071fe37b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:03.885096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f450407-2940-4e33-92b3-7814071fe37b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:03.885385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f450407-2940-4e33-92b3-7814071fe37b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:03.886114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f450407-2940-4e33-92b3-7814071fe37b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:03.888559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f450407-2940-4e33-92b3-7814071fe37b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:03.889809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1e0179f8-2d9e-4e41-bea9-a2d66ead1560 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:03.891142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e0179f8-2d9e-4e41-bea9-a2d66ead1560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:03.936914 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3407/6830] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:03 2022] GET /identity/v3/users => generated 7491 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:03.939801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae520-37b7-4bab-8c47-ff1cea077b20 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:03.940219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae520-37b7-4bab-8c47-ff1cea077b20 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:03.940507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae520-37b7-4bab-8c47-ff1cea077b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:03.992579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-134ae520-37b7-4bab-8c47-ff1cea077b20 None None] MFA Rules not processed for user `5c9771adcc27428196086931a737115c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:03.994346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-134ae520-37b7-4bab-8c47-ff1cea077b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:04.036605 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3424/6831] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:56:04.046130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144e54-d924-4dde-b572-d337e2cf687d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.046785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144e54-d924-4dde-b572-d337e2cf687d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.047989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144e54-d924-4dde-b572-d337e2cf687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.083691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d8144e54-d924-4dde-b572-d337e2cf687d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:04.085238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d8144e54-d924-4dde-b572-d337e2cf687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:04.099345 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3425/6832] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:04.102666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8144e54-d924-4dde-b572-d337e2cf687d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.114883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8144e54-d924-4dde-b572-d337e2cf687d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.121703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.127116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.127116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.127116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.127116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:56:04.127116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.127116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.127654 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3408/6833] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:56:04.138892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6065b5-604b-40dc-b700-7bfc740c8cfa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.139128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6065b5-604b-40dc-b700-7bfc740c8cfa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.139351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6065b5-604b-40dc-b700-7bfc740c8cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.147771 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3426/6834] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:04.148470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:04.159171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.173794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eb6065b5-604b-40dc-b700-7bfc740c8cfa None None] MFA Rules not processed for user `5c9771adcc27428196086931a737115c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:04.176866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb6065b5-604b-40dc-b700-7bfc740c8cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:04.184135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fa499-c8c8-4637-885b-dca16c0d47bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.187258 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3409/6835] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:04.193277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6065b5-604b-40dc-b700-7bfc740c8cfa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.193934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.194877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.195473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.195971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.197161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.199992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.211895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6065b5-604b-40dc-b700-7bfc740c8cfa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.217685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c9771adcc27428196086931a737115c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19da95279a242b6b9d2cf761f6abbe0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-259067013', 'tempest-DelegatedRole-1387980456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.218406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.219044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.219258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.220286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.221941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.337545 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3427/6836] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:04 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:04.342691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.488984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683fbcd-de45-48ce-bcbd-fd88216ef3d9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.495139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.495873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.496224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.496671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.497955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.506794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.521668 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3410/6837] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:56:04 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:56:04.526929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.530086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:04.559491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ae512-f586-4551-b33c-ee7ba52bf815 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.610418 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3428/6838] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:04 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:04.615981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.631520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:04.641181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a457-20ea-4018-9884-f82b4273c6eb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.657203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.658828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.660726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.661055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.661904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.664460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.679998 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3429/6839] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:04 2022] GET /identity/v3/roles => generated 1892 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:04.684328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.697828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b7e0f-78b3-41c5-ab2d-468cf1376b2a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.703280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.705285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.705285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.705285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.706342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.707110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.707495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.708051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.708763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.712122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.718146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.719668 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 13:56:04.719668 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 13:56:04.719668 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 13:56:04.728467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.744566 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3430/6840] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:04 2022] GET /identity/v3/roles => generated 1892 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:04.745634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.761626 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3411/6841] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 18 13:56:04 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:04.763711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:04.768958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd8577-e931-4ff0-a453-53e94de40cb1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.786923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6487f-6f99-426c-8279-b5dc34870a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.787751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6487f-6f99-426c-8279-b5dc34870a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.788111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6487f-6f99-426c-8279-b5dc34870a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.788547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6487f-6f99-426c-8279-b5dc34870a3f admin admin] PATH_INFO: `/v3/projects/4474d29a061642a2820fab69697ea4fe/users/7963aa7a74c147cdab99b56131a66842/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.822069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6487f-6f99-426c-8279-b5dc34870a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4474d29a061642a2820fab69697ea4fe, user_id=7963aa7a74c147cdab99b56131a66842, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.826643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6487f-6f99-426c-8279-b5dc34870a3f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.885099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303df4-030a-47af-8ac9-ad5756028fba tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:04.890222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c9771adcc27428196086931a737115c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19da95279a242b6b9d2cf761f6abbe0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-259067013', 'tempest-DelegatedRole-1387980456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:04.898779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.898779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.898779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] PATH_INFO: `/v3/OS-TRUST/trusts/64a894819998425f9515dadf2d184d45` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.902161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] RBAC: Authorizing `identity:delete_trust(trust_id=64a894819998425f9515dadf2d184d45)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:04.903677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:04.924700 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3431/6842] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:04 2022] PUT /identity/v3/projects/4474d29a061642a2820fab69697ea4fe/users/7963aa7a74c147cdab99b56131a66842/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:04.929992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:04.930315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:04.930589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:04.940627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:04.952268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:04.953586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:05.027603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '64a894819998425f9515dadf2d184d45', 'request_id': 'req-cd889807-4620-4381-ab0d-00dcbb2a968a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:05.028388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '64a894819998425f9515dadf2d184d45', 'request_id': 'req-cd889807-4620-4381-ab0d-00dcbb2a968a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:05.029138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '64a894819998425f9515dadf2d184d45', 'request_id': 'req-cd889807-4620-4381-ab0d-00dcbb2a968a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:05.054275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:05.066655 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3432/6843] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:05.094990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:05.097429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:05.141835 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3412/6844] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:56:04 2022] DELETE /identity/v3/OS-TRUST/trusts/64a894819998425f9515dadf2d184d45 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:05.147959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:05.149557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:05.182500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889807-4620-4381-ab0d-00dcbb2a968a tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:05.197935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650154f-2cfd-49c2-aac7-0e4e6c258f70 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:05.213344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:05.214523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:05.214989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:05.215862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:05.235788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:05.238940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:05.270997 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3433/6845] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:56:05.300586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c9771adcc27428196086931a737115c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c19da95279a242b6b9d2cf761f6abbe0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-259067013', 'tempest-DelegatedRole-1387980456'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:05.304932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:05.304932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:05.304932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] PATH_INFO: `/v3/OS-TRUST/trusts/64a894819998425f9515dadf2d184d45` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Could not find trust: 64a894819998425f9515dadf2d184d45.: keystone.exception.TrustNotFound: Could not find trust: 64a894819998425f9515dadf2d184d45. Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 13:56:05.336796 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 64a894819998425f9515dadf2d184d45. Oct 18 13:56:05.338300 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:56:05.339377 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3413/6846] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:05 2022] GET /identity/v3/OS-TRUST/trusts/64a894819998425f9515dadf2d184d45 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:56:05.342818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:05.346559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:05.354508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:05.428787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f0a17-31f3-45d9-8959-4dd247c43400 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:05.435178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:05.436323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:05.436839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:05.437386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/ab5b7454f763417b83f3374b2984eba6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:05.439120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ab5b7454f763417b83f3374b2984eba6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:05.446787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:05.490035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:05.640047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role ab5b7454f763417b83f3374b2984eba6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:05.640456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:05.642885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:05.645780 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3434/6847] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:05 2022] DELETE /identity/v3/roles/ab5b7454f763417b83f3374b2984eba6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:05.651522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:05.653658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:05.686997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdbba7-3be8-4d95-b507-6ac1b4434923 tempest-TrustsV3TestJSON-662755218 tempest-user-162415216] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:05.752824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:05.793278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:05.805725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:05.806215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:05.806215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:05.806215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/35069481416e4ded9f6d9431300f6ab1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:05.806215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=35069481416e4ded9f6d9431300f6ab1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:05.806215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:05.989637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 35069481416e4ded9f6d9431300f6ab1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:05.990271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:05.991100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:05.994474 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3414/6848] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:05 2022] DELETE /identity/v3/roles/35069481416e4ded9f6d9431300f6ab1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:05.998354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:06.011310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:06.015989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91557a1-fe20-4123-9ec1-857328c8025c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:06.101787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:06.102858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:06.103233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:06.103584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users/5c9771adcc27428196086931a737115c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:06.104871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5c9771adcc27428196086931a737115c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:06.107181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:06.353758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:06.370357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9771adcc27428196086931a737115c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:06.384369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9771adcc27428196086931a737115c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:06.385221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9771adcc27428196086931a737115c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:06.401357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9771adcc27428196086931a737115c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:06.503798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9771adcc27428196086931a737115c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:06.536989 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3435/6849] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:05 2022] DELETE /identity/v3/users/5c9771adcc27428196086931a737115c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:06.542129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:06.543676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:06.558961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4dfb-25dd-452e-aa5e-f38c199668b2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:06.639439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:06.640238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:06.640565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:06.640852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/c19da95279a242b6b9d2cf761f6abbe0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:06.642074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c19da95279a242b6b9d2cf761f6abbe0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:06.644715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:06.726637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:06.987526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19da95279a242b6b9d2cf761f6abbe0', 'request_id': 'req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:07.005271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19da95279a242b6b9d2cf761f6abbe0', 'request_id': 'req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:07.096836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19da95279a242b6b9d2cf761f6abbe0', 'request_id': 'req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:07.119122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] The token cache is being invalidate because project c19da95279a242b6b9d2cf761f6abbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:07.119503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:07.120157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:07.133175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:07.133750 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3415/6850] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:06 2022] DELETE /identity/v3/projects/c19da95279a242b6b9d2cf761f6abbe0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:07.134839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:07.164145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaaf6f-ba95-4180-841f-42aa6e611a07 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:07.200351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:07.287098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:07.287098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:07.287446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:07.287659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:07.288492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:07.292273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:07.462664 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3436/6851] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:56:07 2022] POST /identity/v3/projects => generated 328 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:07.465319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:07.467842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:07.488912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bf95-77ef-47fc-bb94-6ee41bed4aa2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:07.575799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:07.577371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:07.578924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:07.579483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:07.581554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:07.587004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:07.739300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:07.747953 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3416/6852] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:07 2022] POST /identity/v3/users => generated 413 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:07.756101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3c9b0-92aa-4637-adf4-168c33f313c2 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:07.765175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:07.766781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:07.767236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:07.767638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:07.768995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:07.771619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:07.896482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:07.897592 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3437/6853] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:07 2022] POST /identity/v3/roles => generated 244 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:07.917129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba55149-ef4e-4cd0-b9b6-51a0fc01f251 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:07.944777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:07.945585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:07.946176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:07.946941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:07.948002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:07.949847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:08.040645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:08.048731 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3417/6854] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:07 2022] POST /identity/v3/roles => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:08.061911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826669e-5fa9-4f8f-8630-42353dba567f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:08.078242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:08.078954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:08.081732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:08.082080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/3aa567bd93fe4a5ea2425508438f602d/users/6496ad4639d9481fb4931ef8df2c6897/roles/064ddf13f92748409fb5b5b46a7addf3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:08.123360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3aa567bd93fe4a5ea2425508438f602d, user_id=6496ad4639d9481fb4931ef8df2c6897, role_id=064ddf13f92748409fb5b5b46a7addf3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:08.126862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:08.244455 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3438/6855] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:08 2022] PUT /identity/v3/projects/3aa567bd93fe4a5ea2425508438f602d/users/6496ad4639d9481fb4931ef8df2c6897/roles/064ddf13f92748409fb5b5b46a7addf3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:08.248566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:08.265636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b41f5-e3f4-4131-8ca9-c955cc1c050f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:08.283825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:08.365307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404b4c0-44f8-4056-85ed-2aef4d2ee644 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:08.366313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404b4c0-44f8-4056-85ed-2aef4d2ee644 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:08.367430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404b4c0-44f8-4056-85ed-2aef4d2ee644 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:08.367787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404b4c0-44f8-4056-85ed-2aef4d2ee644 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/3aa567bd93fe4a5ea2425508438f602d/users/6496ad4639d9481fb4931ef8df2c6897/roles/b705ef107b7e4c9eaadd89e96bb76303` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:08.371919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404b4c0-44f8-4056-85ed-2aef4d2ee644 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3aa567bd93fe4a5ea2425508438f602d, user_id=6496ad4639d9481fb4931ef8df2c6897, role_id=b705ef107b7e4c9eaadd89e96bb76303)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:08.374989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404b4c0-44f8-4056-85ed-2aef4d2ee644 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:08.482548 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3418/6856] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:08 2022] PUT /identity/v3/projects/3aa567bd93fe4a5ea2425508438f602d/users/6496ad4639d9481fb4931ef8df2c6897/roles/b705ef107b7e4c9eaadd89e96bb76303 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:08.493303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:08.508586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48cb3c-85ec-4963-aef4-6c1bec553cad tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:08.616970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:08.626623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e619b-90ee-4227-b8bb-2e2c4c4d1b55 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:08.629753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e619b-90ee-4227-b8bb-2e2c4c4d1b55 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:08.630142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e619b-90ee-4227-b8bb-2e2c4c4d1b55 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:08.631696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e619b-90ee-4227-b8bb-2e2c4c4d1b55 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:08.632709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e619b-90ee-4227-b8bb-2e2c4c4d1b55 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:08.637033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e619b-90ee-4227-b8bb-2e2c4c4d1b55 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:08.697706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3439/6857] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:08 2022] GET /identity/v3/users => generated 7772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:08.698736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7639-0fad-48d9-a028-6a2de033096d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:08.702645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7639-0fad-48d9-a028-6a2de033096d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:08.702645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7639-0fad-48d9-a028-6a2de033096d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:08.792701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5ffd7639-0fad-48d9-a028-6a2de033096d None None] MFA Rules not processed for user `6496ad4639d9481fb4931ef8df2c6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:08.794206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ffd7639-0fad-48d9-a028-6a2de033096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:08.936649 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3419/6858] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:56:08.947334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53fb1-3c5a-4891-8b9c-ad1569b9881d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:08.947642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53fb1-3c5a-4891-8b9c-ad1569b9881d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:08.947924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53fb1-3c5a-4891-8b9c-ad1569b9881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:08.973547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-62e53fb1-3c5a-4891-8b9c-ad1569b9881d None None] MFA Rules not processed for user `6496ad4639d9481fb4931ef8df2c6897`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:08.974836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-62e53fb1-3c5a-4891-8b9c-ad1569b9881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:08.994497 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3440/6859] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:09.001702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd7639-0fad-48d9-a028-6a2de033096d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:09.020682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd7639-0fad-48d9-a028-6a2de033096d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:09.029860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6496ad4639d9481fb4931ef8df2c6897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3aa567bd93fe4a5ea2425508438f602d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1884017374', 'tempest-NotDelegatedRole-436022133'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:09.036155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:09.036155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:09.036155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:09.039727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:09.040980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:09.441632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:09.624119 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3420/6860] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:56:08 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 629 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:09.629889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e53fb1-3c5a-4891-8b9c-ad1569b9881d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:09.663511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e53fb1-3c5a-4891-8b9c-ad1569b9881d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:09.678942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6496ad4639d9481fb4931ef8df2c6897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3aa567bd93fe4a5ea2425508438f602d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1884017374', 'tempest-NotDelegatedRole-436022133'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:09.679591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:09.684846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:09.684846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:09.684846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:09.684846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:09.748001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:09.748703 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3441/6861] 10.222.0.27 () {58 vars in 1252 bytes} [Tue Oct 18 13:56:09 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=6496ad4639d9481fb4931ef8df2c6897 => generated 611 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:09.793164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e72634-5201-4160-b71e-95814dab046c tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:09.810805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6496ad4639d9481fb4931ef8df2c6897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3aa567bd93fe4a5ea2425508438f602d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1884017374', 'tempest-NotDelegatedRole-436022133'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:09.812806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:09.813098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:09.813381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] PATH_INFO: `/v3/OS-TRUST/trusts/131a58d1ebc7483697d142c02049cd63` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:09.836158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: Authorizing `identity:delete_trust(trust_id=131a58d1ebc7483697d142c02049cd63)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:09.837849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:09.923591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '131a58d1ebc7483697d142c02049cd63', 'request_id': 'req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:09.925087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '131a58d1ebc7483697d142c02049cd63', 'request_id': 'req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:09.925783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '131a58d1ebc7483697d142c02049cd63', 'request_id': 'req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:10.055045 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3421/6862] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:56:09 2022] DELETE /identity/v3/OS-TRUST/trusts/131a58d1ebc7483697d142c02049cd63 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:10.059851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:10.064383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:10.093368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3c5b3-7bd0-414d-b436-7d32fec638e9 tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:10.114508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6496ad4639d9481fb4931ef8df2c6897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3aa567bd93fe4a5ea2425508438f602d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1884017374', 'tempest-NotDelegatedRole-436022133'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:10.115190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:10.115476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:10.115756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] PATH_INFO: `/v3/OS-TRUST/trusts/131a58d1ebc7483697d142c02049cd63` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Could not find trust: 131a58d1ebc7483697d142c02049cd63.: keystone.exception.TrustNotFound: Could not find trust: 131a58d1ebc7483697d142c02049cd63. Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 13:56:10.146621 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 131a58d1ebc7483697d142c02049cd63. Oct 18 13:56:10.148008 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:10.152308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:10.153749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:10.162334 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3442/6863] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:10 2022] GET /identity/v3/OS-TRUST/trusts/131a58d1ebc7483697d142c02049cd63 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:56:10.184839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8adfdb-cebe-43a1-bec7-d0e1071390bb tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:10.192510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:10.193172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:10.193560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:10.193845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/b705ef107b7e4c9eaadd89e96bb76303` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:10.202283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b705ef107b7e4c9eaadd89e96bb76303)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:10.203995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:10.404840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role b705ef107b7e4c9eaadd89e96bb76303 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:10.405142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:10.406705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:10.411766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3422/6864] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:10 2022] DELETE /identity/v3/roles/b705ef107b7e4c9eaadd89e96bb76303 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:10.415762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:10.417815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:10.464673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2be57e-2879-4cfc-83df-17bd5b7604ba tempest-TrustsV3TestJSON-375564523 tempest-user-448332001] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:10.617816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:10.630299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:10.630299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:10.630299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/064ddf13f92748409fb5b5b46a7addf3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:10.630299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=064ddf13f92748409fb5b5b46a7addf3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:10.630299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:10.669943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:10.671574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:10.762663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:10.861437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834c34f-aced-4126-b598-c1be3bbe3e65 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:10.869524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:10.870665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:10.871193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:10.871780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:10.873998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:10.896208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:10.899636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:10.917202 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3423/6865] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:10.934699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 064ddf13f92748409fb5b5b46a7addf3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:10.934699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:10.934699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:10.935968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3443/6866] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:10 2022] DELETE /identity/v3/roles/064ddf13f92748409fb5b5b46a7addf3 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:10.940909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:10.960993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf1493-20f9-4cfd-a226-1e0737288b34 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:11.141161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:11.142164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:11.143000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:11.143398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users/6496ad4639d9481fb4931ef8df2c6897` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:11.147839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6496ad4639d9481fb4931ef8df2c6897)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:11.151211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:11.364906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6496ad4639d9481fb4931ef8df2c6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:11.365817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6496ad4639d9481fb4931ef8df2c6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:11.440731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6496ad4639d9481fb4931ef8df2c6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:11.441543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6496ad4639d9481fb4931ef8df2c6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:11.457845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6496ad4639d9481fb4931ef8df2c6897'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:11.484293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:11.486862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:11.507736 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3424/6867] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:10 2022] DELETE /identity/v3/users/6496ad4639d9481fb4931ef8df2c6897 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:11.521308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:11.521308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:11.622442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ff54d-8aff-43f9-a04a-b03572dc5214 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:11.710428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc685-272d-4725-8fd3-2222f32a5791 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:11.724166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:11.724166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:11.724619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:11.724619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/3aa567bd93fe4a5ea2425508438f602d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:11.728748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3aa567bd93fe4a5ea2425508438f602d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:11.733226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:11.740948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:11.754360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:11.755015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:11.755301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:11.755582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:11.762990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:11.772703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:11.789929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:11.793565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:11.826279 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3444/6868] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:56:12.011391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:12.013210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:12.031417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa567bd93fe4a5ea2425508438f602d', 'request_id': 'req-db8343d6-6c09-4e8f-9148-d85bbbd17759'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:12.048259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa567bd93fe4a5ea2425508438f602d', 'request_id': 'req-db8343d6-6c09-4e8f-9148-d85bbbd17759'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:12.058892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5867a-3c02-4ea9-a6e9-59cfa5f0519d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:12.206581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:12.210457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:12.210457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:12.210824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa567bd93fe4a5ea2425508438f602d', 'request_id': 'req-db8343d6-6c09-4e8f-9148-d85bbbd17759'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:12.210938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:12.212754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:12.238996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] The token cache is being invalidate because project 3aa567bd93fe4a5ea2425508438f602d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:12.239900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:12.240766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:12.242698 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3425/6869] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:11 2022] DELETE /identity/v3/projects/3aa567bd93fe4a5ea2425508438f602d => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:12.250417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:12.256041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:12.394554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8343d6-6c09-4e8f-9148-d85bbbd17759 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:12.424341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:12.424341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:12.424341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:12.424791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:12.424932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:12.427047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:12.431074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:12.432861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:12.519080 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3445/6870] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:12.577665 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3426/6871] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:56:12 2022] POST /identity/v3/projects => generated 328 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:12.585174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:12.608923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200586a-3190-4dea-badd-8a4173c65b1c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:12.742546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:12.743479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:12.744798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:12.745316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:12.748975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:12.754009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:12.907225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3446/6872] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:12 2022] POST /identity/v3/users => generated 416 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:12.911310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:12.930428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46c64-09f1-40c3-a376-464ff4594141 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:12.954504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:12.955353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:12.960696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:12.961091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:12.961901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:12.971467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:13.075425 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3427/6873] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:12 2022] POST /identity/v3/roles => generated 243 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:13.080412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:13.107735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44522438-f029-4279-9f27-f92ad311ba43 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:13.128605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:13.130432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:13.130966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:13.131464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:13.132468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:13.134964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:13.224047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:13.233883 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3447/6874] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:13 2022] POST /identity/v3/roles => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:13.236379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:13.255754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfb736-13a7-4989-9296-aaa76da5d635 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:13.269995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:13.271529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:13.272523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:13.273376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/cdbdf5fcd3344097b73fba5fbc63cd91/users/980f26bc8d2048f1a8e42562e7898105/roles/681e32ae62ba493bbd869bb6f76a225f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:13.307712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:13.316815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cdbdf5fcd3344097b73fba5fbc63cd91, user_id=980f26bc8d2048f1a8e42562e7898105, role_id=681e32ae62ba493bbd869bb6f76a225f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:13.324136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:13.433907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3428/6875] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:13 2022] PUT /identity/v3/projects/cdbdf5fcd3344097b73fba5fbc63cd91/users/980f26bc8d2048f1a8e42562e7898105/roles/681e32ae62ba493bbd869bb6f76a225f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:13.436853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:13.482767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dda302-ed17-4bef-9174-73ac54702646 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:13.651368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137cf12-b7b3-499c-9513-74cde2e6e9eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:13.653411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137cf12-b7b3-499c-9513-74cde2e6e9eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:13.654963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137cf12-b7b3-499c-9513-74cde2e6e9eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:13.659270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137cf12-b7b3-499c-9513-74cde2e6e9eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/cdbdf5fcd3344097b73fba5fbc63cd91/users/980f26bc8d2048f1a8e42562e7898105/roles/9e7bd02327704fce84ef6a864a6d2fac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:13.666397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137cf12-b7b3-499c-9513-74cde2e6e9eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cdbdf5fcd3344097b73fba5fbc63cd91, user_id=980f26bc8d2048f1a8e42562e7898105, role_id=9e7bd02327704fce84ef6a864a6d2fac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:13.674608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137cf12-b7b3-499c-9513-74cde2e6e9eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:13.839017 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3448/6876] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:13 2022] PUT /identity/v3/projects/cdbdf5fcd3344097b73fba5fbc63cd91/users/980f26bc8d2048f1a8e42562e7898105/roles/9e7bd02327704fce84ef6a864a6d2fac => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:13.842820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:13.872970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c9890-1046-4db6-8f62-0fbdbae03c3f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:14.048468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47f0a8-1cd9-4064-97a9-4a9cb78f3754 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:14.049383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47f0a8-1cd9-4064-97a9-4a9cb78f3754 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:14.051427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47f0a8-1cd9-4064-97a9-4a9cb78f3754 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:14.051739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47f0a8-1cd9-4064-97a9-4a9cb78f3754 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:14.052450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47f0a8-1cd9-4064-97a9-4a9cb78f3754 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:14.054367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47f0a8-1cd9-4064-97a9-4a9cb78f3754 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:14.092703 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3429/6877] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:13 2022] GET /identity/v3/users => generated 7775 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:14.098159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836ae7-6b9f-43b1-8088-678546bd83e5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:14.098913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836ae7-6b9f-43b1-8088-678546bd83e5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:14.099501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836ae7-6b9f-43b1-8088-678546bd83e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:14.188624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7a836ae7-6b9f-43b1-8088-678546bd83e5 None None] MFA Rules not processed for user `980f26bc8d2048f1a8e42562e7898105`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:14.191528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7a836ae7-6b9f-43b1-8088-678546bd83e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:14.368608 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3449/6878] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:14.371431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490928d7-afc2-45b0-8939-37936c18399d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:14.371865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490928d7-afc2-45b0-8939-37936c18399d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:14.377529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490928d7-afc2-45b0-8939-37936c18399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:14.428753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-490928d7-afc2-45b0-8939-37936c18399d None None] MFA Rules not processed for user `980f26bc8d2048f1a8e42562e7898105`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:14.437963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-490928d7-afc2-45b0-8939-37936c18399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:14.471297 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3430/6879] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:14.476557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836ae7-6b9f-43b1-8088-678546bd83e5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:14.493368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836ae7-6b9f-43b1-8088-678546bd83e5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:14.503439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:14.504093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:14.504536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:14.504993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:14.505824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:create_trust()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:14.510807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:14.841089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490928d7-afc2-45b0-8939-37936c18399d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:14.843634 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3450/6880] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:56:14 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:14.851291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490928d7-afc2-45b0-8939-37936c18399d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:14.866011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:14.866933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:14.867315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:14.867688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:14.883342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:get_trust(trust_id=6987a59e1c684275ae940e3fe357935a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:14.885243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:14.895229 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3431/6881] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:14 2022] GET /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a => generated 858 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:56:14.899633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:14.911292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845149-21b6-4b1c-8b66-72b57579adde tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:14.916750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:14.917730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:14.918361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:14.918882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:14.921135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:14.959214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6987a59e1c684275ae940e3fe357935a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:14.964896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:14.993891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:14.994943 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3451/6882] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:56:14 2022] GET /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles => generated 370 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:15.007924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e79995-6de1-47a1-9073-7283b23cf505 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:15.018775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:15.020045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:15.020546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:15.021106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/681e32ae62ba493bbd869bb6f76a225f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:15.035838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6987a59e1c684275ae940e3fe357935a, role_id=681e32ae62ba493bbd869bb6f76a225f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:15.039654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:15.059477 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3432/6883] 10.222.0.27 () {58 vars in 1368 bytes} [Tue Oct 18 13:56:14 2022] GET /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/681e32ae62ba493bbd869bb6f76a225f => generated 243 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:15.060518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:15.089541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a860f-eed5-4c1e-9d2a-cba662ada259 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:15.115626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:15.120668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:15.120961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:15.121250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/681e32ae62ba493bbd869bb6f76a225f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:15.155462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6987a59e1c684275ae940e3fe357935a, role_id=681e32ae62ba493bbd869bb6f76a225f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:15.157597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:15.186466 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3452/6884] 10.222.0.27 () {58 vars in 1369 bytes} [Tue Oct 18 13:56:15 2022] HEAD /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/681e32ae62ba493bbd869bb6f76a225f => generated 0 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:15.191411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:15.204605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dbfdb-53ca-4f45-8bab-2bf43062fb2a tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:15.217955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:15.218928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:15.219422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:15.219932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/9e7bd02327704fce84ef6a864a6d2fac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:15.231995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6987a59e1c684275ae940e3fe357935a, role_id=9e7bd02327704fce84ef6a864a6d2fac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:15.234495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Could not find role: 9e7bd02327704fce84ef6a864a6d2fac.: keystone.exception.RoleNotFound: Could not find role: 9e7bd02327704fce84ef6a864a6d2fac. Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:56:15.264979 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9e7bd02327704fce84ef6a864a6d2fac. Oct 18 13:56:15.266384 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:56:15.266384 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3433/6885] 10.222.0.27 () {58 vars in 1368 bytes} [Tue Oct 18 13:56:15 2022] GET /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/9e7bd02327704fce84ef6a864a6d2fac => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:56:15.269154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:15.281321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b14a8-5e83-49f2-9db2-980a254bb881 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:15.301495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:15.301902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:15.302327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:15.302715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/9e7bd02327704fce84ef6a864a6d2fac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:15.355162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6987a59e1c684275ae940e3fe357935a, role_id=9e7bd02327704fce84ef6a864a6d2fac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:15.356652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Could not find role: 9e7bd02327704fce84ef6a864a6d2fac.: keystone.exception.RoleNotFound: Could not find role: 9e7bd02327704fce84ef6a864a6d2fac. Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:56:15.380229 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9e7bd02327704fce84ef6a864a6d2fac. Oct 18 13:56:15.381541 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:15.387132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3453/6886] 10.222.0.27 () {58 vars in 1369 bytes} [Tue Oct 18 13:56:15 2022] HEAD /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a/roles/9e7bd02327704fce84ef6a864a6d2fac => generated 0 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 18 13:56:15.391433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:15.405449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d9b2-b731-4257-a4cb-cf729da9bf84 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:15.419496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:15.420303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:15.420699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:15.421082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:15.438152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorizing `identity:delete_trust(trust_id=6987a59e1c684275ae940e3fe357935a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:15.440419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:15.544173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6987a59e1c684275ae940e3fe357935a', 'request_id': 'req-bb507f87-4524-41f5-b673-8e8646b852a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:15.544979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6987a59e1c684275ae940e3fe357935a', 'request_id': 'req-bb507f87-4524-41f5-b673-8e8646b852a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:15.545792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6987a59e1c684275ae940e3fe357935a', 'request_id': 'req-bb507f87-4524-41f5-b673-8e8646b852a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:15.698173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3434/6887] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:56:15 2022] DELETE /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:15.702546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:15.704496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:15.732616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e435a44-4c01-4627-ac23-66e1b19f6074 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:15.742877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980f26bc8d2048f1a8e42562e7898105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-469062846', 'tempest-NotDelegatedRole-133811310'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:15.743955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:15.744421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:15.744876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] PATH_INFO: `/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Could not find trust: 6987a59e1c684275ae940e3fe357935a.: keystone.exception.TrustNotFound: Could not find trust: 6987a59e1c684275ae940e3fe357935a. Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 13:56:15.762716 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6987a59e1c684275ae940e3fe357935a. Oct 18 13:56:15.763802 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:15.771990 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3454/6888] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:15 2022] GET /identity/v3/OS-TRUST/trusts/6987a59e1c684275ae940e3fe357935a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 13:56:15.776174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:15.777817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:15.816923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507f87-4524-41f5-b673-8e8646b852a4 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:15.832171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:15.835897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:15.836222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:15.836508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/9e7bd02327704fce84ef6a864a6d2fac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:15.842119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9e7bd02327704fce84ef6a864a6d2fac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:15.853377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:16.220904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 9e7bd02327704fce84ef6a864a6d2fac has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:16.222011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:16.222906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:16.229734 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3435/6889] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:15 2022] DELETE /identity/v3/roles/9e7bd02327704fce84ef6a864a6d2fac => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:16.230547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:16.232586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:16.265275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46768f69-fb5e-486b-a55c-1602f474a976 tempest-TrustsV3TestJSON-643823898 tempest-user-1748290848] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:16.431315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:16.432412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:16.435409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:16.435992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/681e32ae62ba493bbd869bb6f76a225f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:16.438027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=681e32ae62ba493bbd869bb6f76a225f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:16.440350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:16.678798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 681e32ae62ba493bbd869bb6f76a225f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:16.679648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:16.691687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-52d34f0c-3505-499e-9b42-69cd33c2bf90 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:16.693623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:16.702067 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3455/6890] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:16 2022] DELETE /identity/v3/roles/681e32ae62ba493bbd869bb6f76a225f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:16.714016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b894140-b40e-4792-bca7-3dbd71eb6389 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:16.721941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:16.873735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:16.874654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:16.875328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:16.875793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users/980f26bc8d2048f1a8e42562e7898105` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:16.884664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_user(user_id=980f26bc8d2048f1a8e42562e7898105)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:16.887166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:17.050543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980f26bc8d2048f1a8e42562e7898105'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.060121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980f26bc8d2048f1a8e42562e7898105'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.166257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:17.166555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:17.166843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:17.176610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980f26bc8d2048f1a8e42562e7898105'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.178132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980f26bc8d2048f1a8e42562e7898105'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.192516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980f26bc8d2048f1a8e42562e7898105'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.229529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] MFA Rules not processed for user `7963aa7a74c147cdab99b56131a66842`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:17.232425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:17.278913 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3436/6891] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:16 2022] DELETE /identity/v3/users/980f26bc8d2048f1a8e42562e7898105 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:17.283551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:17.287127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:17.455404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:17.457326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa3062-fdc7-41ff-a61d-c226b9a80665 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:17.465886 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3456/6892] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:17.473970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:17.475810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:17.486512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:17.486512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:17.486512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:17.486969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/cdbdf5fcd3344097b73fba5fbc63cd91` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:17.488989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cdbdf5fcd3344097b73fba5fbc63cd91)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:17.494811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:17.678224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:17.753266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbd57-0521-4cb8-8768-7542c0e929bb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:17.798624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'request_id': 'req-bec55034-f366-4160-b26a-c44604e63353'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.814856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'request_id': 'req-bec55034-f366-4160-b26a-c44604e63353'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.947364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdbdf5fcd3344097b73fba5fbc63cd91', 'request_id': 'req-bec55034-f366-4160-b26a-c44604e63353'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.970369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] The token cache is being invalidate because project cdbdf5fcd3344097b73fba5fbc63cd91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:17.971290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.974451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:17.977373 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3437/6893] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:17 2022] DELETE /identity/v3/projects/cdbdf5fcd3344097b73fba5fbc63cd91 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:17.983026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:17.986780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:18.040106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:18.040751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:18.041040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:18.041321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:18.053241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:18.233717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec55034-f366-4160-b26a-c44604e63353 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:18.252725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:18.257637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:18.260448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:18.261099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:18.261384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:18.261661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:18.262381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:18.264317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:18.303298 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3457/6894] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 830 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:18.465710 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3438/6895] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:56:17 2022] POST /identity/v3/projects => generated 328 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:18.469742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:18.509133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f30c55-3f0a-46c5-a2dd-5cb1b7e68c3b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:18.599380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:18.636027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:18.638941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:18.639286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:18.639628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:18.640419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:18.643351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:18.748114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3458/6896] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:18 2022] POST /identity/v3/users => generated 416 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:18.752521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:18.772718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c60304-b438-4aa8-bd03-ec9dd80c0ff7 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:18.801623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:18.802387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:18.802756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:18.803049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:18.804662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:18.814663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:18.934588 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3439/6897] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:18 2022] POST /identity/v3/roles => generated 244 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:18.936185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:18.951956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ec87c-22bc-4093-87c5-8ed4c2274491 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:18.963336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:18.969407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:18.969407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:18.969407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:18.969407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:18.972778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:19.064850 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3459/6898] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:18 2022] POST /identity/v3/roles => generated 247 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:19.070469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:19.101617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6676c7e-897a-4042-91ce-1a0f699101eb tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:19.127730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:19.128417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:19.134261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:19.135724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/657dfc2d26844ae49a15bb452b715a2a/users/5869dd4c3b224216bbbd995d5691c766/roles/06a342c2b69d4ef49e0f0331167474b4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:19.211060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=657dfc2d26844ae49a15bb452b715a2a, user_id=5869dd4c3b224216bbbd995d5691c766, role_id=06a342c2b69d4ef49e0f0331167474b4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:19.217103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:19.361190 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3440/6899] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:19 2022] PUT /identity/v3/projects/657dfc2d26844ae49a15bb452b715a2a/users/5869dd4c3b224216bbbd995d5691c766/roles/06a342c2b69d4ef49e0f0331167474b4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:19.365861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:19.385383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee774-01f0-4ec5-8af0-0706771da1c8 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:19.585614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c0cb2-abc5-4e08-8b85-17b640dd73bc tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:19.586617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0cb2-abc5-4e08-8b85-17b640dd73bc tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:19.588853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0cb2-abc5-4e08-8b85-17b640dd73bc tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:19.594316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0cb2-abc5-4e08-8b85-17b640dd73bc tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/657dfc2d26844ae49a15bb452b715a2a/users/5869dd4c3b224216bbbd995d5691c766/roles/629315c4810246599bb47214c8eed7e2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:19.603139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c0cb2-abc5-4e08-8b85-17b640dd73bc tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=657dfc2d26844ae49a15bb452b715a2a, user_id=5869dd4c3b224216bbbd995d5691c766, role_id=629315c4810246599bb47214c8eed7e2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:19.613387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c0cb2-abc5-4e08-8b85-17b640dd73bc tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:19.742403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3460/6900] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:19 2022] PUT /identity/v3/projects/657dfc2d26844ae49a15bb452b715a2a/users/5869dd4c3b224216bbbd995d5691c766/roles/629315c4810246599bb47214c8eed7e2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:19.744368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:19.768454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b163e97-9900-4daa-95b7-28fef6aad611 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:19.903440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3533cb-8ce1-4aae-bc42-2ad0859d997b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:19.904390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3533cb-8ce1-4aae-bc42-2ad0859d997b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:19.904835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3533cb-8ce1-4aae-bc42-2ad0859d997b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:19.905270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3533cb-8ce1-4aae-bc42-2ad0859d997b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:19.906429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3533cb-8ce1-4aae-bc42-2ad0859d997b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:19.908819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3533cb-8ce1-4aae-bc42-2ad0859d997b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:19.923725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:19.971621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4e32-090c-4cc9-b30f-f46391e946bc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:19.971901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4e32-090c-4cc9-b30f-f46391e946bc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:19.972374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc4e32-090c-4cc9-b30f-f46391e946bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:19.977536 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3441/6901] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:19 2022] GET /identity/v3/users => generated 7775 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:20.048694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f4cc4e32-090c-4cc9-b30f-f46391e946bc None None] MFA Rules not processed for user `5869dd4c3b224216bbbd995d5691c766`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:20.050279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4cc4e32-090c-4cc9-b30f-f46391e946bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:20.200361 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3461/6902] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:20.210997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba18f2-e6ab-4180-8e16-6984fa191124 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:20.211550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba18f2-e6ab-4180-8e16-6984fa191124 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:20.211995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba18f2-e6ab-4180-8e16-6984fa191124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:20.268037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6eba18f2-e6ab-4180-8e16-6984fa191124 None None] MFA Rules not processed for user `5869dd4c3b224216bbbd995d5691c766`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:20.269314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6eba18f2-e6ab-4180-8e16-6984fa191124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:20.299874 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3442/6903] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:20.304455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc4e32-090c-4cc9-b30f-f46391e946bc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:20.327961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc4e32-090c-4cc9-b30f-f46391e946bc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:20.339190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5869dd4c3b224216bbbd995d5691c766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657dfc2d26844ae49a15bb452b715a2a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1594393588', 'tempest-DelegatedRole-1119075833'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:20.339988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:20.340395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:20.340779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:20.341567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] RBAC: Authorizing `identity:create_trust()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:20.342882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:20.414346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 18 13:56:20.496096 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 18 13:56:20.497253 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 18 13:56:20.498411 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 18 13:56:20.498411 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 18 13:56:20.498411 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 18 13:56:20.498411 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 18 13:56:20.498411 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 18 13:56:20.498411 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:20.503170 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3462/6904] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:56:20 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 199 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 13:56:20.507087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba18f2-e6ab-4180-8e16-6984fa191124 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:20.543437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba18f2-e6ab-4180-8e16-6984fa191124 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:20.556826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:20.557660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:20.558531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:20.558984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/629315c4810246599bb47214c8eed7e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:20.567437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=629315c4810246599bb47214c8eed7e2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:20.576976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:20.837249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 629315c4810246599bb47214c8eed7e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:20.839693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:20.841373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:20.844387 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3443/6905] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:20 2022] DELETE /identity/v3/roles/629315c4810246599bb47214c8eed7e2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:20.848662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:20.850712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:20.881272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093ee3a-6a98-4d9f-b75e-421a5e6f4069 tempest-TrustsV3TestJSON-288688694 tempest-user-1749795932] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:21.123439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:21.124250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:21.125362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:21.127300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/06a342c2b69d4ef49e0f0331167474b4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:21.129297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=06a342c2b69d4ef49e0f0331167474b4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:21.131913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:21.417295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 06a342c2b69d4ef49e0f0331167474b4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:21.418007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:21.418391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:21.421106 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3463/6906] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:20 2022] DELETE /identity/v3/roles/06a342c2b69d4ef49e0f0331167474b4 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:21.426210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:21.441285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d920145-1645-4db5-9eb5-beb2445a5e09 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:21.606025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:21.606704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:21.607031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:21.610186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users/5869dd4c3b224216bbbd995d5691c766` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:21.622668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5869dd4c3b224216bbbd995d5691c766)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:21.625811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:21.807093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5869dd4c3b224216bbbd995d5691c766'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:21.809180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5869dd4c3b224216bbbd995d5691c766'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:21.940551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5869dd4c3b224216bbbd995d5691c766'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:21.942101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5869dd4c3b224216bbbd995d5691c766'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:21.951225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5869dd4c3b224216bbbd995d5691c766'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.013792 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3444/6907] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:21 2022] DELETE /identity/v3/users/5869dd4c3b224216bbbd995d5691c766 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:22.028125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:22.029755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:22.060240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87620-c685-4ec8-be73-3e84a9763e2b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:22.164766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:22.166310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:22.261054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:22.304510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:22.305088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:22.305371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:22.305647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/657dfc2d26844ae49a15bb452b715a2a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:22.307057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=657dfc2d26844ae49a15bb452b715a2a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:22.319017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:22.353945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31192e38-491b-4cca-974d-af01022083e4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:22.361947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:22.363305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:22.363774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:22.364344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] PATH_INFO: `/v3/users/d131ce1fc9b0499880e2c5f5557ac250` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:22.365915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d131ce1fc9b0499880e2c5f5557ac250)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:22.368448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:22.445730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:22.466442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657dfc2d26844ae49a15bb452b715a2a', 'request_id': 'req-de2b90bf-5406-4c48-a5a5-82744e1ab179'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.476247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657dfc2d26844ae49a15bb452b715a2a', 'request_id': 'req-de2b90bf-5406-4c48-a5a5-82744e1ab179'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.550851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657dfc2d26844ae49a15bb452b715a2a', 'request_id': 'req-de2b90bf-5406-4c48-a5a5-82744e1ab179'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.569193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] The token cache is being invalidate because project 657dfc2d26844ae49a15bb452b715a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:22.569494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.571371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.574708 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3464/6908] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:22 2022] DELETE /identity/v3/projects/657dfc2d26844ae49a15bb452b715a2a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:22.583359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:22.587768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:22.629187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd131ce1fc9b0499880e2c5f5557ac250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.630043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd131ce1fc9b0499880e2c5f5557ac250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.732858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b90bf-5406-4c48-a5a5-82744e1ab179 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:22.746175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:22.747173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:22.747654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:22.748124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:22.749004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:22.751568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:22.754640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd131ce1fc9b0499880e2c5f5557ac250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.755652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd131ce1fc9b0499880e2c5f5557ac250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.767640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-68ab31f3-b706-42f9-92f0-96afd3c2f237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd131ce1fc9b0499880e2c5f5557ac250'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:22.791502 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3445/6909] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:22 2022] DELETE /identity/v3/users/d131ce1fc9b0499880e2c5f5557ac250 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:22.796306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:22.796474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:22.796864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:22.826510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:22.828058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:22.877612 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3465/6910] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:56:22 2022] POST /identity/v3/projects => generated 329 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:22.883564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:22.886093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:23.000196 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3446/6911] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:23.017937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b582-6c3a-481c-bd27-ecdcb4370402 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:23.023583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:23.026022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:23.039499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:23.041349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:23.042365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:23.042747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:23.044079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:23.061939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:23.182564 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3466/6912] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:22 2022] POST /identity/v3/users => generated 413 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:56:23.182760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:23.183989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:23.191314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5353-a561-48db-bad5-7940d8c1cdde None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:23.196795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ffb0-ff3b-4231-aefe-7f3b4d41b34e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:23.202663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:23.203380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:23.203734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:23.204086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:23.205791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:23.211426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:23.317076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:23.318265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:23.321741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:23.322273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:23.408078 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3467/6913] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:23 2022] POST /identity/v3/roles => generated 243 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:23.409015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:23.431158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4392-55c5-4145-8309-46ee58e0097c tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:23.440903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:23.440903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:23.446199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:23.447545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:23.448075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:23.448760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:23.449892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:23.451774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:23.466971 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3447/6914] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:56:23.549734 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3468/6915] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:23 2022] POST /identity/v3/roles => generated 247 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:23.553980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:23.570110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaf6dc-50f4-4758-b452-ac6396a53d12 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:23.575731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:23.577744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:23.578557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:23.579052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/f06a5c61813449e6b6c2ff90a0954425/users/315994daedcf4d568d41cfc13b987113/roles/408334fda8f743759d254ce9e4686d26` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:23.607558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f06a5c61813449e6b6c2ff90a0954425, user_id=315994daedcf4d568d41cfc13b987113, role_id=408334fda8f743759d254ce9e4686d26)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:23.612307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:23.699473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:23.702860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:23.731766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3448/6916] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:23 2022] PUT /identity/v3/projects/f06a5c61813449e6b6c2ff90a0954425/users/315994daedcf4d568d41cfc13b987113/roles/408334fda8f743759d254ce9e4686d26 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:23.736448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:23.756965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:23.921052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba94765-021b-4476-bff1-1dbe6e7c3696 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:23.944882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e548c56-23d0-4822-9ce5-64e0bf95f18b tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:23.956370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70e15c-1c54-448c-88c2-50d1b6bc1030 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:23.958473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e15c-1c54-448c-88c2-50d1b6bc1030 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:23.960204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e15c-1c54-448c-88c2-50d1b6bc1030 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:23.960712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70e15c-1c54-448c-88c2-50d1b6bc1030 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/f06a5c61813449e6b6c2ff90a0954425/users/315994daedcf4d568d41cfc13b987113/roles/45d8909fe0c54673b7a45cc4ce97871f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:23.965471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70e15c-1c54-448c-88c2-50d1b6bc1030 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f06a5c61813449e6b6c2ff90a0954425, user_id=315994daedcf4d568d41cfc13b987113, role_id=45d8909fe0c54673b7a45cc4ce97871f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:23.973541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70e15c-1c54-448c-88c2-50d1b6bc1030 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:24.082110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:24.083833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.084129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.084408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.094995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:24.125845 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3449/6917] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:23 2022] PUT /identity/v3/projects/f06a5c61813449e6b6c2ff90a0954425/users/315994daedcf4d568d41cfc13b987113/roles/45d8909fe0c54673b7a45cc4ce97871f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:56:24.129089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.129594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.130152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.171920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] MFA Rules not processed for user `7963aa7a74c147cdab99b56131a66842`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:24.177285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:24.205226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:24.208311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:24.255289 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3469/6918] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:24.273002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:24.297834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531245b-6103-4b1e-b7f0-785b4e19613a service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:24.312303 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3450/6919] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:24.313438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:24.315564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:24.369099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:24.443716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e042ce-cf9f-4e4e-a14c-ebc2fdaa4d06 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:24.444663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e042ce-cf9f-4e4e-a14c-ebc2fdaa4d06 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.447087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e042ce-cf9f-4e4e-a14c-ebc2fdaa4d06 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.450035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e042ce-cf9f-4e4e-a14c-ebc2fdaa4d06 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.451545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e042ce-cf9f-4e4e-a14c-ebc2fdaa4d06 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:24.456868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e042ce-cf9f-4e4e-a14c-ebc2fdaa4d06 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:24.497879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac4b2-22a4-45fc-afd4-e4fcaa8d8f0a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:24.504294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:24.505112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.505399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.505674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] PATH_INFO: `/v3/projects/3f03e0a532694e77aa33a4fe6027dd63` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.506932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f03e0a532694e77aa33a4fe6027dd63)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:24.509031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:24.545142 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3470/6920] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:24 2022] GET /identity/v3/users => generated 7494 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:24.552156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca67ca-b510-405a-8c38-53906ade2c3b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.558278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca67ca-b510-405a-8c38-53906ade2c3b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.558278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca67ca-b510-405a-8c38-53906ade2c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.623244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:24.645330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f03e0a532694e77aa33a4fe6027dd63', 'request_id': 'req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:24.646665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-72ca67ca-b510-405a-8c38-53906ade2c3b None None] MFA Rules not processed for user `315994daedcf4d568d41cfc13b987113`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:24.648117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72ca67ca-b510-405a-8c38-53906ade2c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:24.663828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f03e0a532694e77aa33a4fe6027dd63', 'request_id': 'req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:24.762345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f03e0a532694e77aa33a4fe6027dd63', 'request_id': 'req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:24.780530 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3471/6921] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:24.790754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb6ed-b345-499f-b3cd-7f920f976ba2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.791224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb6ed-b345-499f-b3cd-7f920f976ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.791656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb6ed-b345-499f-b3cd-7f920f976ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.794816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] The token cache is being invalidate because project 3f03e0a532694e77aa33a4fe6027dd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:24.795615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:24.796910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4c6917f-f32c-4cb9-b6cb-f59406ca85cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:24.800268 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3451/6922] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:24 2022] DELETE /identity/v3/projects/3f03e0a532694e77aa33a4fe6027dd63 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:24.807693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5e1cc-b63a-4300-81d4-f5c84668c5f4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.808230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5e1cc-b63a-4300-81d4-f5c84668c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.808684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5e1cc-b63a-4300-81d4-f5c84668c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.818707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c0cb6ed-b345-499f-b3cd-7f920f976ba2 None None] MFA Rules not processed for user `315994daedcf4d568d41cfc13b987113`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:24.820914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c0cb6ed-b345-499f-b3cd-7f920f976ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:24.834672 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3472/6923] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:56:24.840052 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cb6ed-b345-499f-b3cd-7f920f976ba2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:24.841010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10c5e1cc-b63a-4300-81d4-f5c84668c5f4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:24.842607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10c5e1cc-b63a-4300-81d4-f5c84668c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:24.852918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cb6ed-b345-499f-b3cd-7f920f976ba2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:24.859238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:24.859950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.860238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.860586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.865484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:create_trust()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:24.865484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:24.903932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:24.920552 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3452/6924] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:24.928499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59997528-2f5c-4ff0-b9fc-6e0a6a3075fc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:24.928499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59997528-2f5c-4ff0-b9fc-6e0a6a3075fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:24.928499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59997528-2f5c-4ff0-b9fc-6e0a6a3075fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:24.978010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-59997528-2f5c-4ff0-b9fc-6e0a6a3075fc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:24.979180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59997528-2f5c-4ff0-b9fc-6e0a6a3075fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:24.988961 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3453/6925] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:24.994724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59997528-2f5c-4ff0-b9fc-6e0a6a3075fc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.006960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59997528-2f5c-4ff0-b9fc-6e0a6a3075fc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.013783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.014226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.015340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.015638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.016378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:56:25.016865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.019979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.035144 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3454/6926] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:25.039537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.059548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323856f-c5a9-4664-8359-38447e8fa56f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.070473 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3473/6927] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:56:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:56:25.070716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.071592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.071739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.071842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.071936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.072537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.077049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.090297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb039-2425-4d81-85b8-a5da46e141ac tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.098023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.099062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.099376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.108867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.108867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:get_trust(trust_id=0d5fed945d864512b374407a88d6756c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.125104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.166220 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3474/6928] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:25 2022] GET /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c => generated 833 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:56:25.167720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.190629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3455/6929] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:25 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:25.195261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.197046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8837dd-ed24-4d48-8642-39c25703c517 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.324584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49170-f43a-49e2-9576-f0d3b03487d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.329780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.330470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.330796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.330930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.331063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.331820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.332202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.332574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.333662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.337255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.340462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:25.343465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=0d5fed945d864512b374407a88d6756c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.346340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.374179 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3475/6930] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:56:25 2022] GET /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:25.379233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.410794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7beb46-8e84-403d-9b99-e58a5626d9a5 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.416519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.417344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.417859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.418332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/408334fda8f743759d254ce9e4686d26` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.427776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0d5fed945d864512b374407a88d6756c, role_id=408334fda8f743759d254ce9e4686d26)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.437281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.440501 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3476/6931] 10.222.0.27 () {58 vars in 1368 bytes} [Tue Oct 18 13:56:25 2022] GET /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/408334fda8f743759d254ce9e4686d26 => generated 243 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:25.445611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.464752 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3456/6932] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:25 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:56:25.464966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631fefa-4296-4a13-a917-5c20b7eb359e tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.471598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.485074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.488205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.488615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.488958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/408334fda8f743759d254ce9e4686d26` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.492634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209d60d-fe8e-4a51-8297-d804e17b7652 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.502924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0d5fed945d864512b374407a88d6756c, role_id=408334fda8f743759d254ce9e4686d26)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.504592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.516097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.516754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.517818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.518121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.518784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.520398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.521346 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3477/6933] 10.222.0.27 () {58 vars in 1369 bytes} [Tue Oct 18 13:56:25 2022] HEAD /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/408334fda8f743759d254ce9e4686d26 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 18 13:56:25.525475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.536755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e067dd-cad1-4921-ae75-cfdaa7a0c852 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.545359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3457/6934] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:25 2022] GET /identity/v3/roles => generated 1892 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:56:25.549746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.550021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.551225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.553296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.553586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/45d8909fe0c54673b7a45cc4ce97871f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.561641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bb5a8-05cb-497b-94c7-9ef4e623bf0a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.571207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0d5fed945d864512b374407a88d6756c, role_id=45d8909fe0c54673b7a45cc4ce97871f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.572703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Could not find role: 45d8909fe0c54673b7a45cc4ce97871f.: keystone.exception.RoleNotFound: Could not find role: 45d8909fe0c54673b7a45cc4ce97871f. Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:56:25.584712 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 45d8909fe0c54673b7a45cc4ce97871f. Oct 18 13:56:25.585989 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:25.587124 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3478/6935] 10.222.0.27 () {58 vars in 1368 bytes} [Tue Oct 18 13:56:25 2022] GET /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/45d8909fe0c54673b7a45cc4ce97871f => generated 110 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:56:25.587290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.588128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.588511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.590240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.591003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.593671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.599345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.628095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213638e5-e27e-4bd2-8a4c-6d37d5a808a9 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.634044 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3458/6936] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:25 2022] GET /identity/v3/roles => generated 1892 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:25.634044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.636059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.636059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.636059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.636335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/45d8909fe0c54673b7a45cc4ce97871f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.650107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0d5fed945d864512b374407a88d6756c, role_id=45d8909fe0c54673b7a45cc4ce97871f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.650107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.652474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c79bf-28af-4a2b-9909-76dde8b579a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Could not find role: 45d8909fe0c54673b7a45cc4ce97871f.: keystone.exception.RoleNotFound: Could not find role: 45d8909fe0c54673b7a45cc4ce97871f. Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:56:25.664004 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 45d8909fe0c54673b7a45cc4ce97871f. Oct 18 13:56:25.665098 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:25.669487 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3479/6937] 10.222.0.27 () {58 vars in 1369 bytes} [Tue Oct 18 13:56:25 2022] HEAD /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c/roles/45d8909fe0c54673b7a45cc4ce97871f => generated 0 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 18 13:56:25.670998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.686525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d25716-fda5-48b7-9b7c-f37d04af7e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.687418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d25716-fda5-48b7-9b7c-f37d04af7e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.687701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d25716-fda5-48b7-9b7c-f37d04af7e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.688030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d25716-fda5-48b7-9b7c-f37d04af7e09 admin admin] PATH_INFO: `/v3/projects/ecac93d1d86a4c2fae12c27bce1849f5/users/f42d7700a69b4cbb8edce674fca2ee72/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.725670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d25716-fda5-48b7-9b7c-f37d04af7e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecac93d1d86a4c2fae12c27bce1849f5, user_id=f42d7700a69b4cbb8edce674fca2ee72, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.726022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db742b-a5f9-4187-adbd-79c3ce007d4a tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:25.728390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d25716-fda5-48b7-9b7c-f37d04af7e09 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.741417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:25.742093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.742381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.742656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.749188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorizing `identity:delete_trust(trust_id=0d5fed945d864512b374407a88d6756c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:25.750850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:25.833355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '0d5fed945d864512b374407a88d6756c', 'request_id': 'req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:25.839289 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3459/6938] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:25 2022] PUT /identity/v3/projects/ecac93d1d86a4c2fae12c27bce1849f5/users/f42d7700a69b4cbb8edce674fca2ee72/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:25.851554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:25.851554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:25.851878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:25.903252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] MFA Rules not processed for user `f42d7700a69b4cbb8edce674fca2ee72`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:25.905095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:25.918928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0d5fed945d864512b374407a88d6756c', 'request_id': 'req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:25.919981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0d5fed945d864512b374407a88d6756c', 'request_id': 'req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:25.929274 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3480/6939] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:56:25 2022] DELETE /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:25.933874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:25.935394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:25.982049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee44a56-f7bf-40dc-ab98-2c9af7a16e85 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:26.008300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:26.046219 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3460/6940] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:26.060144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:26.062215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:26.088093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315994daedcf4d568d41cfc13b987113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f06a5c61813449e6b6c2ff90a0954425', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-263268655', 'tempest-NotDelegatedRole-1450549563'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:26.088871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:26.089560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:26.089560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] PATH_INFO: `/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Could not find trust: 0d5fed945d864512b374407a88d6756c.: keystone.exception.TrustNotFound: Could not find trust: 0d5fed945d864512b374407a88d6756c. Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 13:56:26.107301 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 0d5fed945d864512b374407a88d6756c. Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:26.112179 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3481/6941] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:25 2022] GET /identity/v3/OS-TRUST/trusts/0d5fed945d864512b374407a88d6756c => generated 111 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:56:26.114275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:26.117172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:26.142232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71649-dbfb-4641-92a7-f80edc8f9771 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:26.147604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:26.148684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:26.149134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:26.149578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:26.162882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:26.165000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:26.180277 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3461/6942] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:56:26.193118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:26.226404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d449e8-45d8-4670-811b-83d798127be6 tempest-TrustsV3TestJSON-1561863843 tempest-user-981188288] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:26.231639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:26.232245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:26.232566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:26.232799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/45d8909fe0c54673b7a45cc4ce97871f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:26.234256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=45d8909fe0c54673b7a45cc4ce97871f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:26.236623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:26.512355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 45d8909fe0c54673b7a45cc4ce97871f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:26.514400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:26.520039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:26.536427 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3482/6943] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:26 2022] DELETE /identity/v3/roles/45d8909fe0c54673b7a45cc4ce97871f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:26.537114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:26.556561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af23bcb-0b5e-4b0f-83b7-1c32eaf7c4f6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:26.683800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:26.687204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:26.707774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:26.707774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/408334fda8f743759d254ce9e4686d26` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:26.709484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=408334fda8f743759d254ce9e4686d26)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:26.711645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:26.948266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role 408334fda8f743759d254ce9e4686d26 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:26.948851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:26.949746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:26.954033 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3462/6944] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:26 2022] DELETE /identity/v3/roles/408334fda8f743759d254ce9e4686d26 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:26.958417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:26.970187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:26.996993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4937ec-171e-4774-a15a-e01707520868 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:27.106426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:27.107349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:27.107833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:27.108444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users/315994daedcf4d568d41cfc13b987113` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:27.110002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_user(user_id=315994daedcf4d568d41cfc13b987113)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:27.113592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:27.350853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315994daedcf4d568d41cfc13b987113'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:27.374442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315994daedcf4d568d41cfc13b987113'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:27.375294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315994daedcf4d568d41cfc13b987113'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:27.394033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315994daedcf4d568d41cfc13b987113'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:27.512551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315994daedcf4d568d41cfc13b987113'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:27.526804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3483/6945] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:26 2022] DELETE /identity/v3/users/315994daedcf4d568d41cfc13b987113 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:27.527741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:27.530620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:27.586665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c641ed-6d15-4d44-a187-6fa4b8f99ff0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:27.734968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:27.736280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:27.736616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:27.736945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/f06a5c61813449e6b6c2ff90a0954425` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:27.738204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f06a5c61813449e6b6c2ff90a0954425)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:27.740913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:27.742787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:27.963913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06a5c61813449e6b6c2ff90a0954425', 'request_id': 'req-363c11c6-daf6-48f5-a6e7-a498a876c94e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:27.977947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06a5c61813449e6b6c2ff90a0954425', 'request_id': 'req-363c11c6-daf6-48f5-a6e7-a498a876c94e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:28.145843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06a5c61813449e6b6c2ff90a0954425', 'request_id': 'req-363c11c6-daf6-48f5-a6e7-a498a876c94e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:28.174126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] The token cache is being invalidate because project f06a5c61813449e6b6c2ff90a0954425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:28.177220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:28.177220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:28.180353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3463/6946] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:27 2022] DELETE /identity/v3/projects/f06a5c61813449e6b6c2ff90a0954425 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:28.185723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:28.188503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:28.208850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bd13-a8aa-4aa5-84e5-0fc65b8f4da5 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:28.304878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:28.371676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:28.372463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:28.372752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:28.373028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:28.373779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:28.375829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:28.468577 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3484/6947] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 13:56:28 2022] POST /identity/v3/projects => generated 329 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:28.472988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:28.474911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:28.497699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c11c6-daf6-48f5-a6e7-a498a876c94e tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:28.661472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:28.666298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:28.666298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:28.666298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:28.666298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:28.667229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:28.801029 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3464/6948] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:28 2022] POST /identity/v3/users => generated 416 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:28.814128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:28.850103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2e5ce-47ba-4470-949e-932316b841a1 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:28.869598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:28.870493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:28.870787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:28.871117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:28.875122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:28.878716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:29.012202 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3485/6949] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:28 2022] POST /identity/v3/roles => generated 244 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:29.013364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:29.045177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49d77-43f4-442c-9998-6c3e176c98ed tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:29.078348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:29.079456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:29.079808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:29.080150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:29.087838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:29.087838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:29.203465 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3465/6950] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 13:56:29 2022] POST /identity/v3/roles => generated 247 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:29.211930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:29.245199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f161c54-51bb-4b60-8e54-64818264d625 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:29.252751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:29.254262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:29.258250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:29.258712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/377e7bc2dd7c4ba09c2ed3feda6f3001/users/fadbb60c81f74807b0de6ffeb6ff2499/roles/f5b1e20a702f4d6696a1d0d9c301fc78` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:29.281796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=377e7bc2dd7c4ba09c2ed3feda6f3001, user_id=fadbb60c81f74807b0de6ffeb6ff2499, role_id=f5b1e20a702f4d6696a1d0d9c301fc78)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:29.294796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:29.497665 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3486/6951] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:29 2022] PUT /identity/v3/projects/377e7bc2dd7c4ba09c2ed3feda6f3001/users/fadbb60c81f74807b0de6ffeb6ff2499/roles/f5b1e20a702f4d6696a1d0d9c301fc78 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:29.501755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:29.524620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049c401-d4c4-4d87-b1ba-6ab96bf15f2a tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:29.698523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc83f0-cd1c-481e-9bd6-867b47c31bca tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:29.707999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc83f0-cd1c-481e-9bd6-867b47c31bca tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:29.709533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc83f0-cd1c-481e-9bd6-867b47c31bca tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:29.709953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc83f0-cd1c-481e-9bd6-867b47c31bca tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/377e7bc2dd7c4ba09c2ed3feda6f3001/users/fadbb60c81f74807b0de6ffeb6ff2499/roles/f53846c8c36e40e68072869a8ff80644` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:29.718984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc83f0-cd1c-481e-9bd6-867b47c31bca tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:create_grant(project_id=377e7bc2dd7c4ba09c2ed3feda6f3001, user_id=fadbb60c81f74807b0de6ffeb6ff2499, role_id=f53846c8c36e40e68072869a8ff80644)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:29.723613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc83f0-cd1c-481e-9bd6-867b47c31bca tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:29.846402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:29.853085 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3466/6952] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:29 2022] PUT /identity/v3/projects/377e7bc2dd7c4ba09c2ed3feda6f3001/users/fadbb60c81f74807b0de6ffeb6ff2499/roles/f53846c8c36e40e68072869a8ff80644 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:29.857328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:29.870158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a829b71-3ea0-4374-8a1c-b11e66c33fb4 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:29.978919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe556a-95cc-484e-8cf8-073b54239d66 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:29.980285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe556a-95cc-484e-8cf8-073b54239d66 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:29.981050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe556a-95cc-484e-8cf8-073b54239d66 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:29.981667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe556a-95cc-484e-8cf8-073b54239d66 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:29.982718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe556a-95cc-484e-8cf8-073b54239d66 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:29.985019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe556a-95cc-484e-8cf8-073b54239d66 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:30.026392 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3487/6953] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:29 2022] GET /identity/v3/users => generated 7774 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:30.034719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e662b-72ec-4448-a6dd-87403935a9ee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.035464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e662b-72ec-4448-a6dd-87403935a9ee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.036111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e662b-72ec-4448-a6dd-87403935a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.093944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a6e662b-72ec-4448-a6dd-87403935a9ee None None] MFA Rules not processed for user `fadbb60c81f74807b0de6ffeb6ff2499`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:30.096533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a6e662b-72ec-4448-a6dd-87403935a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:30.179101 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3467/6954] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:30 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:56:30.191140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d5e15-f932-426c-8b51-e785245a1407 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.191729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d5e15-f932-426c-8b51-e785245a1407 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.192248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d5e15-f932-426c-8b51-e785245a1407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.237611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-079d5e15-f932-426c-8b51-e785245a1407 None None] MFA Rules not processed for user `fadbb60c81f74807b0de6ffeb6ff2499`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:30.273383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-079d5e15-f932-426c-8b51-e785245a1407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:30.293643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e662b-72ec-4448-a6dd-87403935a9ee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:30.304253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e662b-72ec-4448-a6dd-87403935a9ee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:30.304629 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3488/6955] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:30 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:30.309710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:30.310366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.310641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.311436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.311764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:create_trust()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:30.314445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:30.604829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3468/6956] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Oct 18 13:56:30 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:30.604946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d5e15-f932-426c-8b51-e785245a1407 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:30.616242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d5e15-f932-426c-8b51-e785245a1407 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:30.625456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:30.626760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.627116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.628889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.644951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:get_trust(trust_id=1357581b46ce461e9c8855b54530a0ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:30.648061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:30.674154 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3489/6957] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:30 2022] GET /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac => generated 835 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:30.675691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:30.694778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5eed8-c673-452c-8462-dc43e766d8cb tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:30.706700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:30.707927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.708287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.708636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.718731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=1357581b46ce461e9c8855b54530a0ac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:30.727130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:30.749756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3469/6958] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Oct 18 13:56:30 2022] GET /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:30.750029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:30.759761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f6e67-ca13-4240-93b7-15129e2ab946 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:30.765204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:30.765869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.766283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.766594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f5b1e20a702f4d6696a1d0d9c301fc78` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.781241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1357581b46ce461e9c8855b54530a0ac, role_id=f5b1e20a702f4d6696a1d0d9c301fc78)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:30.783172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:30.797515 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3490/6959] 10.222.0.27 () {58 vars in 1368 bytes} [Tue Oct 18 13:56:30 2022] GET /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f5b1e20a702f4d6696a1d0d9c301fc78 => generated 244 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:56:30.805903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:30.818088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e89d04-a2ba-41fb-ad38-519fc3b378ba tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:30.838390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:30.839151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.839442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.839723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f5b1e20a702f4d6696a1d0d9c301fc78` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.861486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1357581b46ce461e9c8855b54530a0ac, role_id=f5b1e20a702f4d6696a1d0d9c301fc78)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:30.863526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:30.880169 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3470/6960] 10.222.0.27 () {58 vars in 1369 bytes} [Tue Oct 18 13:56:30 2022] HEAD /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f5b1e20a702f4d6696a1d0d9c301fc78 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 18 13:56:30.886953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:30.902075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b4f66-40ab-4e1c-b9ae-7375d1886806 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:30.912640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:30.913422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.913703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.914204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f53846c8c36e40e68072869a8ff80644` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.921073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1357581b46ce461e9c8855b54530a0ac, role_id=f53846c8c36e40e68072869a8ff80644)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:30.922955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Could not find role: f53846c8c36e40e68072869a8ff80644.: keystone.exception.RoleNotFound: Could not find role: f53846c8c36e40e68072869a8ff80644. Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:56:30.935757 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f53846c8c36e40e68072869a8ff80644. Oct 18 13:56:30.942324 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 13:56:30.942324 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3491/6961] 10.222.0.27 () {58 vars in 1368 bytes} [Tue Oct 18 13:56:30 2022] GET /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f53846c8c36e40e68072869a8ff80644 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:56:30.944432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:30.958088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c8987-87ec-402b-b716-537d2abf3e60 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:30.969405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:30.970491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:30.970929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:30.971361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f53846c8c36e40e68072869a8ff80644` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:30.986754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1357581b46ce461e9c8855b54530a0ac, role_id=f53846c8c36e40e68072869a8ff80644)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:30.990529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Could not find role: f53846c8c36e40e68072869a8ff80644.: keystone.exception.RoleNotFound: Could not find role: f53846c8c36e40e68072869a8ff80644. Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 13:56:31.018307 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: f53846c8c36e40e68072869a8ff80644. Oct 18 13:56:31.019714 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:56:31.021754 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3471/6962] 10.222.0.27 () {58 vars in 1369 bytes} [Tue Oct 18 13:56:30 2022] HEAD /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac/roles/f53846c8c36e40e68072869a8ff80644 => generated 0 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 18 13:56:31.026169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:31.045175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e763fa6-f1fb-46fa-9bf5-d6f31177985e tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:31.067544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:31.069959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:31.071287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:31.071719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:31.103369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorizing `identity:delete_trust(trust_id=1357581b46ce461e9c8855b54530a0ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:31.105338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:31.109270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:31.267057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1357581b46ce461e9c8855b54530a0ac', 'request_id': 'req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:31.365521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1357581b46ce461e9c8855b54530a0ac', 'request_id': 'req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:31.366467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1357581b46ce461e9c8855b54530a0ac', 'request_id': 'req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:31.379658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3492/6963] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 18 13:56:31 2022] DELETE /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:31.380798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:31.382969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:31.445405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ff0d0-60a2-4b3d-b20a-d445a8f05b11 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:31.473189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fadbb60c81f74807b0de6ffeb6ff2499', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2056140177', 'tempest-DelegatedRole-1209097774'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:31.473855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:31.478988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:31.479950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] PATH_INFO: `/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Could not find trust: 1357581b46ce461e9c8855b54530a0ac.: keystone.exception.TrustNotFound: Could not find trust: 1357581b46ce461e9c8855b54530a0ac. Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 13:56:31.502380 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1357581b46ce461e9c8855b54530a0ac. Oct 18 13:56:31.503727 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 13:56:31.508092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:31.509923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:31.523083 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3472/6964] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 18 13:56:31 2022] GET /identity/v3/OS-TRUST/trusts/1357581b46ce461e9c8855b54530a0ac => generated 111 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 13:56:31.554575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad49b5-0c7e-4f5d-810e-8335e6ca3f4b tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:31.564694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:31.566086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:31.566422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:31.566700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/f53846c8c36e40e68072869a8ff80644` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:31.568885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f53846c8c36e40e68072869a8ff80644)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:31.570750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:31.791841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role f53846c8c36e40e68072869a8ff80644 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:31.792171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:31.793060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:31.796570 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3493/6965] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:31 2022] DELETE /identity/v3/roles/f53846c8c36e40e68072869a8ff80644 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:31.800822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:31.802503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:31.849375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5ea80-a8b7-4e33-91d0-f6b20b0a49b6 tempest-TrustsV3TestJSON-1493026771 tempest-user-1280096985] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:31.890986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:32.083468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:32.084192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:32.084545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:32.084884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/roles/f5b1e20a702f4d6696a1d0d9c301fc78` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:32.086526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f5b1e20a702f4d6696a1d0d9c301fc78)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:32.088291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:32.404189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invalidating the token cache because role f5b1e20a702f4d6696a1d0d9c301fc78 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:32.404733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:32.409738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:32.409738 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3473/6966] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:31 2022] DELETE /identity/v3/roles/f5b1e20a702f4d6696a1d0d9c301fc78 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:32.411637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:32.425166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37b3f5-2e3e-4941-a44e-3e1f82ef4b4f tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:32.537336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:32.540525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:32.540875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:32.541264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/users/fadbb60c81f74807b0de6ffeb6ff2499` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:32.543343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fadbb60c81f74807b0de6ffeb6ff2499)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:32.545807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:32.747859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadbb60c81f74807b0de6ffeb6ff2499'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:32.757872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadbb60c81f74807b0de6ffeb6ff2499'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:32.758894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadbb60c81f74807b0de6ffeb6ff2499'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:32.784730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadbb60c81f74807b0de6ffeb6ff2499'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:32.915486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadbb60c81f74807b0de6ffeb6ff2499'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:32.927596 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3494/6967] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:32 2022] DELETE /identity/v3/users/fadbb60c81f74807b0de6ffeb6ff2499 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:32.931984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:32.933522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:32.961761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140b453-4cef-458c-8921-dc59f2798dc0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:33.139785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61cb70268eda49aaac6c6e9ebb4c0c5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd687a2f6e80245db8d34a44bb7c467f8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:33.140812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:33.141359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:33.142618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] PATH_INFO: `/v3/projects/377e7bc2dd7c4ba09c2ed3feda6f3001` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:33.144050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorizing `identity:delete_project(project_id=377e7bc2dd7c4ba09c2ed3feda6f3001)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:33.146375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:33.493651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'request_id': 'req-94bab954-2425-43a1-b79a-f5dcbd31b9c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:33.494707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'request_id': 'req-94bab954-2425-43a1-b79a-f5dcbd31b9c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:33.655474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377e7bc2dd7c4ba09c2ed3feda6f3001', 'request_id': 'req-94bab954-2425-43a1-b79a-f5dcbd31b9c0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:33.669173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] The token cache is being invalidate because project 377e7bc2dd7c4ba09c2ed3feda6f3001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:33.669970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:33.670661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-94bab954-2425-43a1-b79a-f5dcbd31b9c0 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:33.674137 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3474/6968] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:32 2022] DELETE /identity/v3/projects/377e7bc2dd7c4ba09c2ed3feda6f3001 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:33.684696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:33.688152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:33.729260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:33.809774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d615f-3fa5-4f86-bf71-1442efe89f19 tempest-TrustsV3TestJSON-1730173619 tempest-TrustsV3TestJSON-1730173619-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:33.914270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:33.914270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:33.914270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:33.914270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] PATH_INFO: `/v3/users/18fe09c650464327af5548dc75964012` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:33.922548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fe09c650464327af5548dc75964012)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:33.922548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:34.239131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fe09c650464327af5548dc75964012'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:34.257324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fe09c650464327af5548dc75964012'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:34.258934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fe09c650464327af5548dc75964012'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:34.306959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fe09c650464327af5548dc75964012'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:34.461176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fe09c650464327af5548dc75964012'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:34.479535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3495/6969] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:33 2022] DELETE /identity/v3/users/18fe09c650464327af5548dc75964012 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:34.498136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:34.498966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:34.499387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:34.508505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:34.541178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:34.543840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:34.681686 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3475/6970] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:34.707058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:34.707058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:34.847148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641f70-598a-40c5-a177-e24a233c0fee admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:34.865495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:34.870134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:34.870574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:34.871152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:34.889912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:34.891587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:34.919231 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3496/6971] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:35.010242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:35.944010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:35.946622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:35.970519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40246-a368-47c7-b230-26c59096af71 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:35.977142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:35.978109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:35.978567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:35.979170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] PATH_INFO: `/v3/projects/2bec5ca56a79421b9b0cfce3b9a95184` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:35.983381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bec5ca56a79421b9b0cfce3b9a95184)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:35.988100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:36.198919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bec5ca56a79421b9b0cfce3b9a95184', 'request_id': 'req-6fae0d6d-4a21-4f86-9eb8-34453385c27d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:36.209663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bec5ca56a79421b9b0cfce3b9a95184', 'request_id': 'req-6fae0d6d-4a21-4f86-9eb8-34453385c27d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:36.365540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bec5ca56a79421b9b0cfce3b9a95184', 'request_id': 'req-6fae0d6d-4a21-4f86-9eb8-34453385c27d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:36.395388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] The token cache is being invalidate because project 2bec5ca56a79421b9b0cfce3b9a95184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:36.395732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:36.397615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:36.404219 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3476/6972] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:35 2022] DELETE /identity/v3/projects/2bec5ca56a79421b9b0cfce3b9a95184 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:36.408183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:36.430023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b9ea7-510d-49df-9f24-9dc68dcacfd3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:36.643279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:36.643279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:36.643279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:36.643279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] PATH_INFO: `/v3/users/61cb70268eda49aaac6c6e9ebb4c0c5f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:36.643745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cb70268eda49aaac6c6e9ebb4c0c5f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:36.647491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:36.994725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cb70268eda49aaac6c6e9ebb4c0c5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:37.012433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cb70268eda49aaac6c6e9ebb4c0c5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:37.013413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cb70268eda49aaac6c6e9ebb4c0c5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:37.037576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cb70268eda49aaac6c6e9ebb4c0c5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:37.180934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7157ce5-7e8a-4dbf-9ff2-6417e55b6f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cb70268eda49aaac6c6e9ebb4c0c5f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:37.187621 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3497/6973] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:36 2022] DELETE /identity/v3/users/61cb70268eda49aaac6c6e9ebb4c0c5f => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:39.456607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:39.460336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:39.491951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae0d6d-4a21-4f86-9eb8-34453385c27d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:39.606118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:39.617771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:39.618386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:39.618701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] PATH_INFO: `/v3/projects/d687a2f6e80245db8d34a44bb7c467f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:39.621502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d687a2f6e80245db8d34a44bb7c467f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:39.624258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:39.779982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:39.841540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd687a2f6e80245db8d34a44bb7c467f8', 'request_id': 'req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:39.854207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd687a2f6e80245db8d34a44bb7c467f8', 'request_id': 'req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:39.945932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd687a2f6e80245db8d34a44bb7c467f8', 'request_id': 'req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:39.959610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] The token cache is being invalidate because project d687a2f6e80245db8d34a44bb7c467f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:39.960237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:39.961158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-624f45b7-9f0f-4b7f-a554-f54f0b02c2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:39.970457 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3477/6974] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:39 2022] DELETE /identity/v3/projects/d687a2f6e80245db8d34a44bb7c467f8 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:39.971956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c263c-b979-4a34-aafc-e3ce030e3055 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:39.972432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c263c-b979-4a34-aafc-e3ce030e3055 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:39.972645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c263c-b979-4a34-aafc-e3ce030e3055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.002667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8b6c263c-b979-4a34-aafc-e3ce030e3055 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:40.003960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b6c263c-b979-4a34-aafc-e3ce030e3055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:40.129455 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3498/6975] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:56:40.137816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b495-c910-4734-9386-b2e91ca76e9e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:40.138193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b495-c910-4734-9386-b2e91ca76e9e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:40.138730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b495-c910-4734-9386-b2e91ca76e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.164959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-22d5b495-c910-4734-9386-b2e91ca76e9e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:40.166167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22d5b495-c910-4734-9386-b2e91ca76e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:40.194388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c263c-b979-4a34-aafc-e3ce030e3055 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:40.199929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:40.205516 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3478/6976] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:40.207198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c263c-b979-4a34-aafc-e3ce030e3055 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:40.213204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:40.214413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:40.214881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:40.216071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.216956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:56:40.217441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:40.221482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:40.243378 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3499/6977] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:40.244693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5b495-c910-4734-9386-b2e91ca76e9e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:40.257915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5b495-c910-4734-9386-b2e91ca76e9e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:40.268715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:40.276099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:40.276099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:40.276099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.276099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:40.276099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:40.436619 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3479/6978] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:40 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:40.443905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:40.524370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f3044-1f5b-4505-a48e-af991ea114db admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:40.681753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:40.682467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:40.682850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:40.683080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.684074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:40.687565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:40.802578 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3500/6979] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:40 2022] POST /identity/v3/users => generated 284 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:40.807089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:40.839274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582e788-06e7-47ef-8e91-f76adc445a4b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:40.847645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:40.848298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:40.848578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:40.849062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.849906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:40.853357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:40.866956 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3480/6980] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:40.871248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:40.883881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e808-e028-4253-a5a1-fdf16b7a7981 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:40.890215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41547dd-5402-49e8-b923-edce9e4445be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:40.890949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41547dd-5402-49e8-b923-edce9e4445be admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:40.891307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41547dd-5402-49e8-b923-edce9e4445be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:40.892377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41547dd-5402-49e8-b923-edce9e4445be admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.893171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41547dd-5402-49e8-b923-edce9e4445be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:40.895157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41547dd-5402-49e8-b923-edce9e4445be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:40.909933 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3501/6981] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:40.914188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:40.929617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2969f-1f8f-471a-9ce7-5af538c1b262 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:40.938039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:40.945216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:40.945216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:40.945216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] PATH_INFO: `/v3/projects/9026e49583a141efaff55288e714bf37/users/36d43b211dde4b81838a096ebfb8b28e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:40.961373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9026e49583a141efaff55288e714bf37, user_id=36d43b211dde4b81838a096ebfb8b28e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:40.965200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:41.077708 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3481/6982] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:40 2022] PUT /identity/v3/projects/9026e49583a141efaff55288e714bf37/users/36d43b211dde4b81838a096ebfb8b28e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:41.080108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728dff7-3fc7-43fe-98e7-5c0008b2b624 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.080562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728dff7-3fc7-43fe-98e7-5c0008b2b624 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.082696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728dff7-3fc7-43fe-98e7-5c0008b2b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:41.121603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f728dff7-3fc7-43fe-98e7-5c0008b2b624 None None] MFA Rules not processed for user `36d43b211dde4b81838a096ebfb8b28e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:41.123394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f728dff7-3fc7-43fe-98e7-5c0008b2b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:41.212303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:41.219862 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3502/6983] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:41.225417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc65a5-d742-4d8b-878e-c01af5ec1fd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:41.230151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728625cc-d7d0-4fa1-b4d1-5b827ccfb32c tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d43b211dde4b81838a096ebfb8b28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9026e49583a141efaff55288e714bf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:41.231043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728625cc-d7d0-4fa1-b4d1-5b827ccfb32c tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.231816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728625cc-d7d0-4fa1-b4d1-5b827ccfb32c tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.232092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728625cc-d7d0-4fa1-b4d1-5b827ccfb32c tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:41.234918 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3482/6984] 10.222.0.27 () {58 vars in 1104 bytes} [Tue Oct 18 13:56:41 2022] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:41.239918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728dff7-3fc7-43fe-98e7-5c0008b2b624 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:41.249937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728dff7-3fc7-43fe-98e7-5c0008b2b624 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:41.255993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b20d3-99d2-42c1-b861-b16911827d6d tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d43b211dde4b81838a096ebfb8b28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9026e49583a141efaff55288e714bf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:41.256616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b20d3-99d2-42c1-b861-b16911827d6d tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.256903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b20d3-99d2-42c1-b861-b16911827d6d tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.257183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b20d3-99d2-42c1-b861-b16911827d6d tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] PATH_INFO: `/v3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:41.262354 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3503/6985] 10.222.0.27 () {58 vars in 1104 bytes} [Tue Oct 18 13:56:41 2022] GET /identity/v3 => generated 255 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:41.267553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728625cc-d7d0-4fa1-b4d1-5b827ccfb32c tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:41.277666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728625cc-d7d0-4fa1-b4d1-5b827ccfb32c tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:41.282439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f5b0-55fc-4813-83e5-a7978e506b8b tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36d43b211dde4b81838a096ebfb8b28e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9026e49583a141efaff55288e714bf37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:41.283407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f5b0-55fc-4813-83e5-a7978e506b8b tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.283599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f5b0-55fc-4813-83e5-a7978e506b8b tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.283989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707f5b0-55fc-4813-83e5-a7978e506b8b tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] PATH_INFO: `/v3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:41.291685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b90b5-ceb0-4bf4-8f44-d26486d7517c None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.292021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b90b5-ceb0-4bf4-8f44-d26486d7517c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.292307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b90b5-ceb0-4bf4-8f44-d26486d7517c None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:41.294191 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3504/6986] 10.222.0.27 () {56 vars in 895 bytes} [Tue Oct 18 13:56:41 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 13:56:41.298576 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3483/6987] 10.222.0.27 () {58 vars in 1104 bytes} [Tue Oct 18 13:56:41 2022] GET /identity/v3 => generated 255 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:41.302972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169a3e2-34d5-4e16-88c3-4951615b1110 None None] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.303509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169a3e2-34d5-4e16-88c3-4951615b1110 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.304017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169a3e2-34d5-4e16-88c3-4951615b1110 None None] PATH_INFO: `/` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:41.305652 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3505/6988] 10.222.0.27 () {56 vars in 895 bytes} [Tue Oct 18 13:56:41 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 13:56:41.311107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f5b0-55fc-4813-83e5-a7978e506b8b tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:41.444280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707f5b0-55fc-4813-83e5-a7978e506b8b tempest-TestApiDiscovery-523430713 tempest-TestApiDiscovery-523430713-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:41.460047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:41.461046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.462328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.462795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] PATH_INFO: `/v3/users/36d43b211dde4b81838a096ebfb8b28e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:41.464673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d43b211dde4b81838a096ebfb8b28e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:41.466885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:41.759459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:41.764171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d43b211dde4b81838a096ebfb8b28e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:41.764879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d43b211dde4b81838a096ebfb8b28e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:41.918270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d43b211dde4b81838a096ebfb8b28e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:41.918965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d43b211dde4b81838a096ebfb8b28e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:41.934886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d43b211dde4b81838a096ebfb8b28e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:41.980938 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3484/6989] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:41 2022] DELETE /identity/v3/users/36d43b211dde4b81838a096ebfb8b28e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:41.986346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:41.986639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:41.986920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:42.015076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:42.015504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:42.078526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:42.080873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:42.102366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:42.152335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3506/6990] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:42.164999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:42.168267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:42.248792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fa7b5-9d83-4b01-aaff-d1ebb011b62b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:42.257604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:42.259208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:42.260079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:42.261972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:42.265008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:42.294122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d54968-963c-4b74-8ba6-25484b984d02 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:42.296028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:42.300488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:42.306131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d92f8-a988-44e0-b03b-342ef0bfcda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:42.307305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d92f8-a988-44e0-b03b-342ef0bfcda0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:42.307790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d92f8-a988-44e0-b03b-342ef0bfcda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:42.308309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d92f8-a988-44e0-b03b-342ef0bfcda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:42.330888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3485/6991] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:56:42.337049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d92f8-a988-44e0-b03b-342ef0bfcda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:42.339470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d92f8-a988-44e0-b03b-342ef0bfcda0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:42.355042 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3507/6992] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:56:43.006626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:43.007767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:43.022453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c45fc-ace4-43a1-a547-ad052edb7725 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:43.029481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:43.030821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:43.030821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:43.031927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] PATH_INFO: `/v3/projects/9026e49583a141efaff55288e714bf37` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:43.034760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9026e49583a141efaff55288e714bf37)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:43.040250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:43.299376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9026e49583a141efaff55288e714bf37', 'request_id': 'req-1170d835-7062-4460-9119-c7824c82be95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:43.307726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9026e49583a141efaff55288e714bf37', 'request_id': 'req-1170d835-7062-4460-9119-c7824c82be95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:43.414294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9026e49583a141efaff55288e714bf37', 'request_id': 'req-1170d835-7062-4460-9119-c7824c82be95'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:43.431225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] The token cache is being invalidate because project 9026e49583a141efaff55288e714bf37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:43.432116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:43.434552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1170d835-7062-4460-9119-c7824c82be95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:43.442293 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3486/6993] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:43 2022] DELETE /identity/v3/projects/9026e49583a141efaff55288e714bf37 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:43.444095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b717-a874-41e8-8451-b88cb6c0462b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:43.444555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b717-a874-41e8-8451-b88cb6c0462b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:43.444555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85b717-a874-41e8-8451-b88cb6c0462b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:43.494869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a85b717-a874-41e8-8451-b88cb6c0462b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:43.496102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a85b717-a874-41e8-8451-b88cb6c0462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:43.586850 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3508/6994] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:43.589354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2cc2b-0299-4921-a3e1-8515409e3d6c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:43.589744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2cc2b-0299-4921-a3e1-8515409e3d6c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:43.590019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2cc2b-0299-4921-a3e1-8515409e3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:43.691786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e7f2cc2b-0299-4921-a3e1-8515409e3d6c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:43.693749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e7f2cc2b-0299-4921-a3e1-8515409e3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:43.713040 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3487/6995] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:43.717602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85b717-a874-41e8-8451-b88cb6c0462b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:43.729277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85b717-a874-41e8-8451-b88cb6c0462b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:43.736303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:43.737392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:43.737892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:43.738406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:43.739291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:56:43.739830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:43.743755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:43.773571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2cc2b-0299-4921-a3e1-8515409e3d6c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:43.781120 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3509/6996] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:56:43.788892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2cc2b-0299-4921-a3e1-8515409e3d6c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:43.810349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:43.811138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:43.811341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:43.811536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:43.812164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:43.814850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:43.942010 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3488/6997] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:43 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:43.946313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:43.978675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6b70d-c929-4c48-a45f-39d927071eb0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:44.158300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:44.158948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:44.159737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:44.160027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:44.160688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:44.162784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:44.311091 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3510/6998] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:43 2022] POST /identity/v3/users => generated 292 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:44.312383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:44.320869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:44.333840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22e8c-6107-41de-bb09-6f4957d80cf7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:44.350483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:44.351246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:44.352477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:44.352865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:44.353637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:44.355744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:44.373471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3489/6999] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:44.378186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:44.389608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44867e-fa5b-4180-8c7f-0ac9b7698b77 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:44.408207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30dc00-00c2-4925-990f-aa46500930a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:44.409219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30dc00-00c2-4925-990f-aa46500930a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:44.410459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30dc00-00c2-4925-990f-aa46500930a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:44.410953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30dc00-00c2-4925-990f-aa46500930a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:44.411809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30dc00-00c2-4925-990f-aa46500930a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:44.413891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30dc00-00c2-4925-990f-aa46500930a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:44.450601 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3511/7000] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:44.456962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:44.480358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e9d2b-0504-41cf-883b-0b9957ae40ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:44.495193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:44.495884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:44.496429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:44.496710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] PATH_INFO: `/v3/projects/80400fe1aff94d3c99dc66ead6e23f2e/users/459c2955caa64677a62e985735d4d827/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:44.567223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80400fe1aff94d3c99dc66ead6e23f2e, user_id=459c2955caa64677a62e985735d4d827, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:44.574789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:44.698726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e96d-abbe-4723-b3c5-458af2408a36 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:44.699181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e96d-abbe-4723-b3c5-458af2408a36 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:44.699641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11e96d-abbe-4723-b3c5-458af2408a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:44.708123 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3490/7001] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:44 2022] PUT /identity/v3/projects/80400fe1aff94d3c99dc66ead6e23f2e/users/459c2955caa64677a62e985735d4d827/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:44.713120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:44.755989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9c11e96d-abbe-4723-b3c5-458af2408a36 None None] MFA Rules not processed for user `459c2955caa64677a62e985735d4d827`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:44.757339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c11e96d-abbe-4723-b3c5-458af2408a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:44.951847 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3512/7002] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:44.953693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:45.056965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936d036-a555-4273-9868-c45c80ac62d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:45.075276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:45.080439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:45.083448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:45.083448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:45.083448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:45.089956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:45.283020 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3491/7003] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:44 2022] POST /identity/v3/projects => generated 383 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:45.287237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11e96d-abbe-4723-b3c5-458af2408a36 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:45.307145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11e96d-abbe-4723-b3c5-458af2408a36 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:45.435449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:45.436300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:45.436585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:45.436864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:45.437521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:45.440258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:45.578143 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3513/7004] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:45 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:56:45.582292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:45.597632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490785e6-5a0b-4ed8-868a-5e90d2f4fed6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:45.603129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:45.604104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:45.604395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:45.604673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:45.605331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:45.606968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:45.627409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:45.641828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3492/7005] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:56:45.645018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbcc69-5966-4ebf-bdb6-8032c081570b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:45.651182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bd68-3d3d-443a-839a-088a117608f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:45.651820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd68-3d3d-443a-839a-088a117608f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:45.652147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd68-3d3d-443a-839a-088a117608f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:45.652427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bd68-3d3d-443a-839a-088a117608f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:45.653387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bd68-3d3d-443a-839a-088a117608f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:45.655048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7bd68-3d3d-443a-839a-088a117608f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:45.677113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:45.678406 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3514/7006] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:45.690874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab1f9a-062f-4975-be2c-7582eeb90893 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:45.697331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:45.698372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:45.699249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:45.699631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] PATH_INFO: `/v3/projects/529b426eb50049b792e0463071aa1919/users/b1d608f5c90c47d3a8ad4fa6286412b0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:45.718610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529b426eb50049b792e0463071aa1919, user_id=b1d608f5c90c47d3a8ad4fa6286412b0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:45.723480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:45.814107 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3493/7007] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:45 2022] PUT /identity/v3/projects/529b426eb50049b792e0463071aa1919/users/b1d608f5c90c47d3a8ad4fa6286412b0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:45.823363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23262fe-1efe-4275-90cb-d94d6c7915f0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:45.823656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23262fe-1efe-4275-90cb-d94d6c7915f0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:45.823951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23262fe-1efe-4275-90cb-d94d6c7915f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:45.886858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b23262fe-1efe-4275-90cb-d94d6c7915f0 None None] MFA Rules not processed for user `b1d608f5c90c47d3a8ad4fa6286412b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:45.888105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b23262fe-1efe-4275-90cb-d94d6c7915f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:46.003759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:46.008298 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3515/7008] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:46.013154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:46.133616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad36e4-2ed0-43cd-8828-3c45ef932861 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:46.140788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:46.142286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:46.142824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:46.143294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:46.144007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:46.146136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:46.345577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23262fe-1efe-4275-90cb-d94d6c7915f0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:46.352531 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3494/7009] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:46.382486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23262fe-1efe-4275-90cb-d94d6c7915f0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:46.536642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:46.537801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:46.538283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:46.538743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:46.539575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:46.545189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:46.644071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:46.645683 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3516/7010] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:46 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:46.651779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:46.658792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad96795-947e-4dde-9723-0aae0884aa42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:46.675505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:46.676341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:46.676694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:46.677046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:46.677791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:46.682538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:46.696086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3495/7011] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:46.701075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:46.723794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12265ce-97f9-406d-b2e5-43853e0d1a65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:46.736344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:46.738646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:46.739182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:46.741804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] PATH_INFO: `/v3/projects/e51046208b9d498285c209197f00d075/users/8fdf59902659432ca31ec11c54a5c53f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:46.764711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51046208b9d498285c209197f00d075, user_id=8fdf59902659432ca31ec11c54a5c53f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:46.770259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:46.854034 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3517/7012] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:46 2022] PUT /identity/v3/projects/e51046208b9d498285c209197f00d075/users/8fdf59902659432ca31ec11c54a5c53f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:46.857766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:46.894897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2475be-17f0-40bb-a6e0-b0dba538cd26 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:47.075422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d24ec-1730-427d-b8d1-11fc61379c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:47.076626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d24ec-1730-427d-b8d1-11fc61379c90 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:47.081000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d24ec-1730-427d-b8d1-11fc61379c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:47.081000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d24ec-1730-427d-b8d1-11fc61379c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:47.081000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d24ec-1730-427d-b8d1-11fc61379c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:47.082937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d24ec-1730-427d-b8d1-11fc61379c90 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:47.121067 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3496/7013] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:47.125366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:47.143506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfda092-d184-4bd9-9f30-fbef6ed8393f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:47.158881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:47.159815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:47.160235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:47.160587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] PATH_INFO: `/v3/projects/e51046208b9d498285c209197f00d075/users/8fdf59902659432ca31ec11c54a5c53f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:47.164651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51046208b9d498285c209197f00d075, user_id=8fdf59902659432ca31ec11c54a5c53f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:47.167654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:47.210467 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3518/7014] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:47 2022] PUT /identity/v3/projects/e51046208b9d498285c209197f00d075/users/8fdf59902659432ca31ec11c54a5c53f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:47.211361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:47.211678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:47.211963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:47.291215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] MFA Rules not processed for user `8fdf59902659432ca31ec11c54a5c53f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:47.292566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:47.422809 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3497/7015] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:47.439435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:47.443567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:47.637692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b6c2e-e37d-4377-a4bd-69dd9d091df5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:47.653277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb74678-9cf5-42a9-a9c8-3c319adef1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:47.654213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74678-9cf5-42a9-a9c8-3c319adef1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:47.654499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74678-9cf5-42a9-a9c8-3c319adef1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:47.654776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74678-9cf5-42a9-a9c8-3c319adef1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:47.827825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb74678-9cf5-42a9-a9c8-3c319adef1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:47.830389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb74678-9cf5-42a9-a9c8-3c319adef1c1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:47.873905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3519/7016] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:52.214476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:52.216008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:52.313900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2f5c-b9b2-4e27-a8dc-fa2bf786bbbc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:52.318870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:52.319504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:52.319790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:52.320273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] PATH_INFO: `/v3/users/3b3a38c1295743a786cb38d44c115f39` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:52.321462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3a38c1295743a786cb38d44c115f39)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:52.324244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:52.341768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:52.518943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3a38c1295743a786cb38d44c115f39'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:52.521198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3a38c1295743a786cb38d44c115f39'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:52.605007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3a38c1295743a786cb38d44c115f39'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:52.605843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3a38c1295743a786cb38d44c115f39'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:52.615021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3a38c1295743a786cb38d44c115f39'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:52.638328 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3498/7017] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:56:52 2022] DELETE /identity/v3/users/3b3a38c1295743a786cb38d44c115f39 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:52.642788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:52.643291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:52.643447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:52.659150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:52.665023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:52.666322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:52.763429 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3520/7018] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:52.773112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:52.776994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:52.867469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773e55-c34d-4fff-9ac6-0541c0c9083b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:52.871967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efa5ec-78d8-4f96-8cff-60ede2ced514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:52.872591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa5ec-78d8-4f96-8cff-60ede2ced514 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:52.873085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa5ec-78d8-4f96-8cff-60ede2ced514 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:52.873369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa5ec-78d8-4f96-8cff-60ede2ced514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:52.885402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efa5ec-78d8-4f96-8cff-60ede2ced514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:52.887272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efa5ec-78d8-4f96-8cff-60ede2ced514 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:52.900442 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3499/7019] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:56:54.207086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:54.208597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:54.223709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5925c-e7d1-46e9-8ad2-50dad77bee1a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:54.229199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:54.230237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:54.230921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:54.237279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] PATH_INFO: `/v3/projects/91a7a4d23c5042058f06e1680ff88bd7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:54.237279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a7a4d23c5042058f06e1680ff88bd7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:54.237279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:54.352880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a7a4d23c5042058f06e1680ff88bd7', 'request_id': 'req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:54.362451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a7a4d23c5042058f06e1680ff88bd7', 'request_id': 'req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:54.494991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a7a4d23c5042058f06e1680ff88bd7', 'request_id': 'req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:54.513388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] The token cache is being invalidate because project 91a7a4d23c5042058f06e1680ff88bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:56:54.513968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:54.514842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a5d4d31e-fae2-43ce-a4cf-a227bad73a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:56:54.521523 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3521/7020] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:56:54 2022] DELETE /identity/v3/projects/91a7a4d23c5042058f06e1680ff88bd7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:54.523066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b56a5-4cb4-4fe3-9d4d-b90bf7a2eb01 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:54.523561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b56a5-4cb4-4fe3-9d4d-b90bf7a2eb01 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:54.524418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b56a5-4cb4-4fe3-9d4d-b90bf7a2eb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:54.564126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-714b56a5-4cb4-4fe3-9d4d-b90bf7a2eb01 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:54.567725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-714b56a5-4cb4-4fe3-9d4d-b90bf7a2eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:54.653641 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3500/7021] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:54.662499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5ccb-0ddc-4c38-b928-8f6d292c7104 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:54.663106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5ccb-0ddc-4c38-b928-8f6d292c7104 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:54.663106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5ccb-0ddc-4c38-b928-8f6d292c7104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:54.700843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-205b5ccb-0ddc-4c38-b928-8f6d292c7104 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:54.702666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-205b5ccb-0ddc-4c38-b928-8f6d292c7104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:54.731717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3522/7022] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:56:54.733549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b56a5-4cb4-4fe3-9d4d-b90bf7a2eb01 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:54.752142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b56a5-4cb4-4fe3-9d4d-b90bf7a2eb01 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:54.757961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:54.758636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:54.758916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:54.759188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:54.759843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:56:54.760146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:54.774430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:54.807198 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3501/7023] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:56:54.812440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5ccb-0ddc-4c38-b928-8f6d292c7104 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:54.826467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5ccb-0ddc-4c38-b928-8f6d292c7104 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:54.839383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:54.840023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:54.840303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:54.840582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:54.841235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:54.843220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:55.020490 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3523/7024] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:56:54 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:55.026090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:55.034677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937f8f7-063e-427d-ab1b-b94d2531d16e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:55.064429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:55.112255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:55.112891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:55.113174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:55.113502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:55.114161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:55.116189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:55.283465 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3502/7025] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:56:55 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:56:55.287374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:55.302699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dee49f-d3cd-4e45-9d59-95c21e5668f9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:55.311852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:55.315465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:55.315465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:55.315465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:55.315465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:55.317186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:55.348920 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3524/7026] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:55.353869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:55.368730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453f797-f78c-49a2-9727-f0ec2fe50bf3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:55.381914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2c542-bc58-49b0-8b33-8ab4e9823ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:55.382726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2c542-bc58-49b0-8b33-8ab4e9823ebf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:55.382898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2c542-bc58-49b0-8b33-8ab4e9823ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:55.383136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2c542-bc58-49b0-8b33-8ab4e9823ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:55.383803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2c542-bc58-49b0-8b33-8ab4e9823ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:55.385644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2c542-bc58-49b0-8b33-8ab4e9823ebf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:55.412595 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3503/7027] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:56:55.417429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:55.440105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff114b-7a5a-4c53-b6f1-83c984b4fb95 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:55.459364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:55.460089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:55.460380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:55.460651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] PATH_INFO: `/v3/projects/2f63f2b607ed48de81f8cd5d6e0835e6/users/08157ad800244327a8a0748b96b396d3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:55.500451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f63f2b607ed48de81f8cd5d6e0835e6, user_id=08157ad800244327a8a0748b96b396d3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:55.503588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:55.600383 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3525/7028] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:56:55 2022] PUT /identity/v3/projects/2f63f2b607ed48de81f8cd5d6e0835e6/users/08157ad800244327a8a0748b96b396d3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:56:55.615573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:55.616084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:55.616230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:55.648466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] MFA Rules not processed for user `08157ad800244327a8a0748b96b396d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:56:55.649725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:55.760691 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3504/7029] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:56:55.773782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:56:55.776127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:56:55.892740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:55.951939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb5e5b-190f-40ee-8021-5715254e1475 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:56:55.951939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbf0c8-fe03-4b6e-a521-76727a84da3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:56:55.951939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf0c8-fe03-4b6e-a521-76727a84da3c service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:56:55.951939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf0c8-fe03-4b6e-a521-76727a84da3c service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:56:55.952440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbf0c8-fe03-4b6e-a521-76727a84da3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:56:55.961635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbf0c8-fe03-4b6e-a521-76727a84da3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:56:55.962829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbf0c8-fe03-4b6e-a521-76727a84da3c service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:56:55.974610 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3526/7030] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:56:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:57:04.741810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:04.743990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:04.922468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5506e-8ec1-42fa-a81c-afe387a623fd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:04.939530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:04.940335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:04.940622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:04.941659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:04.943374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:05.062922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:05.126880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:05.129988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:05.159841 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3505/7031] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:57:06.272015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=14 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:08.139287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:08.140353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:08.140994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:08.176059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] MFA Rules not processed for user `69a2792ee20e450e877d4f016c031768`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:08.180947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:08.345116 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3527/7032] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:15.706881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:16.107245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:16.121424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6f3b3-6931-4076-b726-8f3165e4ab5f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:16.127181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:16.128195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:16.128676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:16.129147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:16.131249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:16.305765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:16.314947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:16.337380 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3506/7033] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:57:18.337273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=29 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:18.364381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:18.367139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:18.566979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e422a4-d21f-49fb-abc5-b0a03c5a386a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:18.612975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396576-b4c3-4578-ba42-6243a04423b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:18.616573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396576-b4c3-4578-ba42-6243a04423b0 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:18.619922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396576-b4c3-4578-ba42-6243a04423b0 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:18.619922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396576-b4c3-4578-ba42-6243a04423b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:18.620432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ff396576-b4c3-4578-ba42-6243a04423b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:18.639405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff396576-b4c3-4578-ba42-6243a04423b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:18.647531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff396576-b4c3-4578-ba42-6243a04423b0 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:18.673937 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3528/7034] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:57:25.982230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:26.089917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922558-68de-48c7-baf5-2e428f89d6ee service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:26.099368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:26.100448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:26.100983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:26.101594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] PATH_INFO: `/v3/users/08157ad800244327a8a0748b96b396d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:26.103762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=08157ad800244327a8a0748b96b396d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:26.106089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:26.352997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08157ad800244327a8a0748b96b396d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:26.353907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08157ad800244327a8a0748b96b396d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:26.460096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08157ad800244327a8a0748b96b396d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:26.460837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08157ad800244327a8a0748b96b396d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:26.487303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08157ad800244327a8a0748b96b396d3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:26.542008 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3507/7035] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:57:25 2022] DELETE /identity/v3/users/08157ad800244327a8a0748b96b396d3 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:26.543732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:26.544526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:26.544985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:26.602822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:26.605136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:26.757207 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3529/7036] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:26.789473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:26.789473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:26.841899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:26.932701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289373-5291-4eb2-8bdc-38694b67a2ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:26.937756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9741073-d636-4622-8999-3682562ad80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:26.938559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741073-d636-4622-8999-3682562ad80e service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:26.938849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741073-d636-4622-8999-3682562ad80e service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:26.939123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741073-d636-4622-8999-3682562ad80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:26.950663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9741073-d636-4622-8999-3682562ad80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:26.952298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9741073-d636-4622-8999-3682562ad80e service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:26.965595 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3508/7037] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:57:27.827527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:27.832202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:27.856906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebb179-e466-4ce0-a922-078d0e00ff7b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:27.869182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:27.870377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:27.871367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:27.871853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] PATH_INFO: `/v3/projects/2f63f2b607ed48de81f8cd5d6e0835e6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:27.873847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f63f2b607ed48de81f8cd5d6e0835e6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:27.877625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:28.037677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f63f2b607ed48de81f8cd5d6e0835e6', 'request_id': 'req-8fd5cd14-11df-4203-8b72-3d651c679a51'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:28.046469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f63f2b607ed48de81f8cd5d6e0835e6', 'request_id': 'req-8fd5cd14-11df-4203-8b72-3d651c679a51'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:28.148016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f63f2b607ed48de81f8cd5d6e0835e6', 'request_id': 'req-8fd5cd14-11df-4203-8b72-3d651c679a51'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:28.165197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] The token cache is being invalidate because project 2f63f2b607ed48de81f8cd5d6e0835e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:57:28.165995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:28.166888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8fd5cd14-11df-4203-8b72-3d651c679a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:28.170157 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3530/7038] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:57:27 2022] DELETE /identity/v3/projects/2f63f2b607ed48de81f8cd5d6e0835e6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:28.174422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408c742-067e-4d48-a271-36b8d823aa75 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:28.174926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408c742-067e-4d48-a271-36b8d823aa75 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:28.175147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408c742-067e-4d48-a271-36b8d823aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:28.222880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6408c742-067e-4d48-a271-36b8d823aa75 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:28.224180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6408c742-067e-4d48-a271-36b8d823aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:28.378635 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3509/7039] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:28.385656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe934-742f-4b0e-83cd-ea096ea40add None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:28.386819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe934-742f-4b0e-83cd-ea096ea40add None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:28.387291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe934-742f-4b0e-83cd-ea096ea40add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:28.422913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-36ffe934-742f-4b0e-83cd-ea096ea40add None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:28.431909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-36ffe934-742f-4b0e-83cd-ea096ea40add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:28.452346 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3531/7040] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:28.454586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408c742-067e-4d48-a271-36b8d823aa75 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:28.473827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408c742-067e-4d48-a271-36b8d823aa75 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:28.483256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:28.484026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:28.484389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:28.484661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:28.485369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:57:28.485675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:28.487549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:28.513274 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3510/7041] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 13:57:28.520882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe934-742f-4b0e-83cd-ea096ea40add None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:28.534739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe934-742f-4b0e-83cd-ea096ea40add None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:28.546194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:28.547591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:28.547876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:28.548148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:28.548783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:28.559781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:28.570617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:28.659625 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3532/7042] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:57:28 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:57:28.664112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:28.679699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe694-22ec-4c87-ba1f-87d7d8ef7fb3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:28.842487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:28.844508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:28.845198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:28.846808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:28.848766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:28.855084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:28.994308 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3511/7043] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:57:28 2022] POST /identity/v3/users => generated 292 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:57:28.995413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:29.011956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4e42c-1fa0-4074-b669-93ed360ce22e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:29.035871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:29.037095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:29.037735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:29.038244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:29.044331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:29.049582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:29.075260 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3533/7044] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:57:29.079046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:29.116107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b92756-7a22-4354-8fc4-b2a035f3c8d9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:29.136575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb44dee-e6aa-49a7-8751-53a247601671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:29.137222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb44dee-e6aa-49a7-8751-53a247601671 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:29.137508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb44dee-e6aa-49a7-8751-53a247601671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:29.137839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb44dee-e6aa-49a7-8751-53a247601671 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:29.138595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb44dee-e6aa-49a7-8751-53a247601671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:29.141163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb44dee-e6aa-49a7-8751-53a247601671 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:29.175658 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3512/7045] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:57:29.180061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:29.194999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec1d4e-48e3-411d-87e6-3ae461045789 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:29.207579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:29.209087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:29.210017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:29.212249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] PATH_INFO: `/v3/projects/480e0bfa755e4b99bb01ea3084d7c214/users/b28a5b73e4fa4ce0aadd144e09a6f977/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:29.251346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480e0bfa755e4b99bb01ea3084d7c214, user_id=b28a5b73e4fa4ce0aadd144e09a6f977, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:29.255982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:29.368547 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3534/7046] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:57:29 2022] PUT /identity/v3/projects/480e0bfa755e4b99bb01ea3084d7c214/users/b28a5b73e4fa4ce0aadd144e09a6f977/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:57:29.373701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73a041-8580-4550-ae98-36bc62c2d86d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:29.373994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73a041-8580-4550-ae98-36bc62c2d86d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:29.374564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73a041-8580-4550-ae98-36bc62c2d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:29.411996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ed73a041-8580-4550-ae98-36bc62c2d86d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:29.422463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed73a041-8580-4550-ae98-36bc62c2d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:29.475976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:29.535682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3513/7047] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:29.576098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:29.578211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:29.682637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70bef-4bb8-4fe6-910c-12cd364e9e82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:29.689764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:29.690571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:29.692411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:29.692800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:29.712827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:29.714804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:29.733207 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3535/7048] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:57:29.833002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:29.834557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:29.835318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:29.939180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:29.940799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:30.059637 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3514/7049] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:57:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:30.208181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:30.210722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:30.423472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d5bb-37a2-4a16-a4b9-c24083c6f4c7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:30.446366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a368c6-7518-43e6-9932-5e042406c9ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:30.447794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a368c6-7518-43e6-9932-5e042406c9ee service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:30.448313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a368c6-7518-43e6-9932-5e042406c9ee service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:30.448825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a368c6-7518-43e6-9932-5e042406c9ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:30.471941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a368c6-7518-43e6-9932-5e042406c9ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:30.476132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a368c6-7518-43e6-9932-5e042406c9ee service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:30.497485 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3536/7050] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:57:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:57:32.238595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:32.240385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:32.295632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a04bd5-c931-4e98-8bb6-f5a7dbb5157b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:32.324214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:32.324933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:32.325217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:32.325488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] PATH_INFO: `/v3/users/459c2955caa64677a62e985735d4d827` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:32.326971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459c2955caa64677a62e985735d4d827)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:32.329730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:32.565487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459c2955caa64677a62e985735d4d827'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:32.566597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459c2955caa64677a62e985735d4d827'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:32.670900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459c2955caa64677a62e985735d4d827'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:32.672142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459c2955caa64677a62e985735d4d827'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:32.754262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-85b6ab00-828f-47e1-a345-d9d259a94598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459c2955caa64677a62e985735d4d827'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:32.775061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:32.775536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:32.775642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:32.860826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3515/7051] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:57:32 2022] DELETE /identity/v3/users/459c2955caa64677a62e985735d4d827 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:32.878113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:32.878113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:32.878113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:32.893311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] MFA Rules not processed for user `b28a5b73e4fa4ce0aadd144e09a6f977`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:32.895561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:32.909280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:32.939818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:32.941859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:32.943360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:33.104624 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3537/7052] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:57:33.109762 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3516/7053] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:33.123443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:33.125806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:33.216119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:33.217705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:33.295991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32186eb-373e-4c34-9678-c685436deea6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:33.313255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:33.314043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:33.316900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:33.317698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:33.347785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a75774-a9d4-45ff-ad56-c4dd041b9b44 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:33.356207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:33.361208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:33.361846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:33.362522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:33.362807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:33.363080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:33.399142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:33.407106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:33.411732 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3538/7054] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:57:33.433114 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3517/7055] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:57:34.534662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:34.539504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:34.595912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6624557-7334-4dea-8fdd-c249fa4c60c2 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:34.612304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:34.612984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:34.613277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:34.613697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] PATH_INFO: `/v3/projects/80400fe1aff94d3c99dc66ead6e23f2e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:34.623685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80400fe1aff94d3c99dc66ead6e23f2e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:34.625896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:34.909855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80400fe1aff94d3c99dc66ead6e23f2e', 'request_id': 'req-ce24f8e5-aca0-45e2-a389-cb4206a79a00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:34.934207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80400fe1aff94d3c99dc66ead6e23f2e', 'request_id': 'req-ce24f8e5-aca0-45e2-a389-cb4206a79a00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.025338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80400fe1aff94d3c99dc66ead6e23f2e', 'request_id': 'req-ce24f8e5-aca0-45e2-a389-cb4206a79a00'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.052109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] The token cache is being invalidate because project 80400fe1aff94d3c99dc66ead6e23f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:57:35.052792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.054322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.058957 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3539/7056] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:57:34 2022] DELETE /identity/v3/projects/80400fe1aff94d3c99dc66ead6e23f2e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:35.064207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:35.080083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc009-c85e-4865-836b-8b1f6b21d248 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:35.214042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:35.215036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:35.215549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:35.216047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] PATH_INFO: `/v3/users/b1d608f5c90c47d3a8ad4fa6286412b0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:35.220288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d608f5c90c47d3a8ad4fa6286412b0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:35.224060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:35.550009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d608f5c90c47d3a8ad4fa6286412b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.552494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d608f5c90c47d3a8ad4fa6286412b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.555342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:35.660109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d608f5c90c47d3a8ad4fa6286412b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.660890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d608f5c90c47d3a8ad4fa6286412b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.676005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d608f5c90c47d3a8ad4fa6286412b0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:35.717595 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3518/7057] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:57:35 2022] DELETE /identity/v3/users/b1d608f5c90c47d3a8ad4fa6286412b0 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:37.606481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:37.608940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:37.627611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24f8e5-aca0-45e2-a389-cb4206a79a00 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:37.719684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:37.754744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:37.755595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:37.756021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:37.756404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] PATH_INFO: `/v3/projects/529b426eb50049b792e0463071aa1919` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:37.758138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=529b426eb50049b792e0463071aa1919)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:37.762542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:38.010118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529b426eb50049b792e0463071aa1919', 'request_id': 'req-ecc239ff-9ce4-4477-914b-717102b9c55a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.020333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529b426eb50049b792e0463071aa1919', 'request_id': 'req-ecc239ff-9ce4-4477-914b-717102b9c55a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.097933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529b426eb50049b792e0463071aa1919', 'request_id': 'req-ecc239ff-9ce4-4477-914b-717102b9c55a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.115262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] The token cache is being invalidate because project 529b426eb50049b792e0463071aa1919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:57:38.115551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.116500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.122164 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3540/7058] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:57:37 2022] DELETE /identity/v3/projects/529b426eb50049b792e0463071aa1919 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:38.123274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:38.125411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:38.144517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6461c52-34cd-4623-8f86-5b57f30fd81b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:38.216082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:38.219077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:38.219077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:38.219077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] PATH_INFO: `/v3/users/8fdf59902659432ca31ec11c54a5c53f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:38.221582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdf59902659432ca31ec11c54a5c53f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:38.223638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:38.547756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdf59902659432ca31ec11c54a5c53f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.550261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdf59902659432ca31ec11c54a5c53f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.685326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdf59902659432ca31ec11c54a5c53f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.688850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdf59902659432ca31ec11c54a5c53f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.698298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-33e863db-0f14-41eb-88d5-9bf0bf97361b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdf59902659432ca31ec11c54a5c53f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:38.730482 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3519/7059] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:57:38 2022] DELETE /identity/v3/users/8fdf59902659432ca31ec11c54a5c53f => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:39.437399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:39.442554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:39.477384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc239ff-9ce4-4477-914b-717102b9c55a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:39.648992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:39.648992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:39.648992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:39.648992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] PATH_INFO: `/v3/projects/e51046208b9d498285c209197f00d075` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:39.652667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51046208b9d498285c209197f00d075)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:39.654793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:39.823914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51046208b9d498285c209197f00d075', 'request_id': 'req-d2f87f00-606b-4d16-9c47-e95520d44b5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:39.844585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51046208b9d498285c209197f00d075', 'request_id': 'req-d2f87f00-606b-4d16-9c47-e95520d44b5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:39.981845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51046208b9d498285c209197f00d075', 'request_id': 'req-d2f87f00-606b-4d16-9c47-e95520d44b5e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:40.003198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:40.026463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] The token cache is being invalidate because project e51046208b9d498285c209197f00d075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:57:40.029520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:40.030680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d2f87f00-606b-4d16-9c47-e95520d44b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:57:40.033813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3541/7060] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:57:39 2022] DELETE /identity/v3/projects/e51046208b9d498285c209197f00d075 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:40.040921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19159-564e-49b5-a4b1-b8703cd8f62f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:40.043851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19159-564e-49b5-a4b1-b8703cd8f62f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:40.043851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd19159-564e-49b5-a4b1-b8703cd8f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:40.083535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bcd19159-564e-49b5-a4b1-b8703cd8f62f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:40.085052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bcd19159-564e-49b5-a4b1-b8703cd8f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:40.179580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:40.232635 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3520/7061] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:40.235707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3060427-69f2-4bbb-8e3d-11e40ecac9de None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:40.236184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3060427-69f2-4bbb-8e3d-11e40ecac9de None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:40.236557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3060427-69f2-4bbb-8e3d-11e40ecac9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:40.312812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a3060427-69f2-4bbb-8e3d-11e40ecac9de None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:40.326625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3060427-69f2-4bbb-8e3d-11e40ecac9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:40.364409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd19159-564e-49b5-a4b1-b8703cd8f62f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:40.365379 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3542/7062] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:40.380898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd19159-564e-49b5-a4b1-b8703cd8f62f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:40.410156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:40.410790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:40.411071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:40.411347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:40.412109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:57:40.412429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:40.417396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:40.436356 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3521/7063] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:57:40.443529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3060427-69f2-4bbb-8e3d-11e40ecac9de None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:40.473604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3060427-69f2-4bbb-8e3d-11e40ecac9de None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:40.503359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:40.504520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:40.506590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:40.507067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:40.508143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:40.519509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:40.702805 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3543/7064] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:57:40 2022] POST /identity/v3/projects => generated 389 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:57:40.707065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:40.723371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98693768-d491-466f-a2db-83cebabcadb9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:40.986235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:40.987438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:40.987438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:40.987438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:41.015197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:41.017111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:41.194600 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3522/7065] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:57:40 2022] POST /identity/v3/users => generated 295 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:57:41.205944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:41.217890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b990fa-1397-4508-9624-1305d5a8df5e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:41.230595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:41.231230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:41.231511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:41.231783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:41.232492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:41.234206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:41.289342 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3544/7066] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:57:41.291000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:41.322415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a39a0-d770-4ecd-a6b6-6d97a11b4857 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:41.352294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e5ba9-d0c6-4887-83a8-a0d465621564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:41.353289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5ba9-d0c6-4887-83a8-a0d465621564 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:41.353767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5ba9-d0c6-4887-83a8-a0d465621564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:41.354268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e5ba9-d0c6-4887-83a8-a0d465621564 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:41.360158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5ba9-d0c6-4887-83a8-a0d465621564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:41.370231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e5ba9-d0c6-4887-83a8-a0d465621564 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:41.418410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:41.418843 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3523/7067] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:57:41.438749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743167dc-5571-4059-b7dc-e6608e0eb4be admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:41.470224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:41.471702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:41.472176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:41.472640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] PATH_INFO: `/v3/projects/6dd7f42f104f4985b830a9f15e94ed1e/users/c84d73486b144e19835a11290fe3dc71/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:41.501303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd7f42f104f4985b830a9f15e94ed1e, user_id=c84d73486b144e19835a11290fe3dc71, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:41.504962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:41.685801 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3545/7068] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:57:41 2022] PUT /identity/v3/projects/6dd7f42f104f4985b830a9f15e94ed1e/users/c84d73486b144e19835a11290fe3dc71/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:57:41.703320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:41.703865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:41.704322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:41.787788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] MFA Rules not processed for user `c84d73486b144e19835a11290fe3dc71`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:57:41.789582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:41.942327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:41.944810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:41.953762 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3524/7069] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:57:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:57:42.084274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7493753-115e-429d-82ac-fecd84ab6d7b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:42.090432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f15fa-1a29-4994-af54-36aa67818de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:42.091507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f15fa-1a29-4994-af54-36aa67818de7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:42.091979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f15fa-1a29-4994-af54-36aa67818de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:42.092416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f15fa-1a29-4994-af54-36aa67818de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:42.107857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f15fa-1a29-4994-af54-36aa67818de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:42.110749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f15fa-1a29-4994-af54-36aa67818de7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:42.152932 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3546/7070] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:57:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:57:51.919809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:52.122700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:56.587267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:57:56.591229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:56.761233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e3d9-c206-4ab8-8817-ec4fabf3f89f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:57:56.767312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:57:56.767879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:57:56.768170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:57:56.768467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:57:56.770806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:57:56.907390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:57:56.909355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:57:56.928463 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3525/7071] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 13:58:01.639308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:01.640237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:01.640237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:01.697700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:01.699821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:01.809154 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3547/7072] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:58:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:01.832984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:01.847239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc612-f7af-473e-acb1-67d58b969579 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:01.852838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:01.853611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:01.854177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:01.854568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:01.867366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:01.871152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:01.884429 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3526/7073] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:58:05.161095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:05.170934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:05.389364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56dd4-b8f0-4858-8264-459aa8fe329a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:05.406578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:05.407221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:05.407704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:05.408670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:05.412159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:05.601686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:05.601686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:05.601686 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3548/7074] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:58:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:58:11.221368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:11.245095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c788-3add-48ac-81c0-636161f08956 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:11.253559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b830-5343-4322-8877-ade8ffbfdbf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:11.254127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b830-5343-4322-8877-ade8ffbfdbf0 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:11.259774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b830-5343-4322-8877-ade8ffbfdbf0 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:11.260539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b830-5343-4322-8877-ade8ffbfdbf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:11.267158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4180b830-5343-4322-8877-ade8ffbfdbf0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:11.430041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b830-5343-4322-8877-ade8ffbfdbf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:11.431731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b830-5343-4322-8877-ade8ffbfdbf0 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:11.467385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3527/7075] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:58:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:58:12.496792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:12.646143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b34b-1564-49d3-8f57-c14513f06399 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:12.697725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:12.700011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:12.703212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:12.707733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] PATH_INFO: `/v3/users/c84d73486b144e19835a11290fe3dc71` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:12.711684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84d73486b144e19835a11290fe3dc71)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:12.732861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:13.022942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:13.044498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84d73486b144e19835a11290fe3dc71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:13.076930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84d73486b144e19835a11290fe3dc71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:13.080737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84d73486b144e19835a11290fe3dc71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:13.119842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84d73486b144e19835a11290fe3dc71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:13.277237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84d73486b144e19835a11290fe3dc71'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:13.293716 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3549/7076] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:58:12 2022] DELETE /identity/v3/users/c84d73486b144e19835a11290fe3dc71 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:58:13.303036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:13.303990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:13.304517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:13.346293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:13.349556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:13.404224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:13.498516 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3528/7077] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:13.547384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:13.549528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:13.682749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd940c-0d5d-495b-8fc7-a0333d4f2751 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:13.688794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229420f-c0eb-45fe-b526-998db7a286b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:13.690205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229420f-c0eb-45fe-b526-998db7a286b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:13.690893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229420f-c0eb-45fe-b526-998db7a286b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:13.691433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229420f-c0eb-45fe-b526-998db7a286b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:13.728273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229420f-c0eb-45fe-b526-998db7a286b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:13.730841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229420f-c0eb-45fe-b526-998db7a286b3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:13.743983 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3550/7078] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:58:14.650188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:14.651937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:14.689718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c813d5-4592-42e3-80df-48b0275aee24 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:14.698027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:14.703482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:14.704542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:14.704542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] PATH_INFO: `/v3/projects/6dd7f42f104f4985b830a9f15e94ed1e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:14.706112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd7f42f104f4985b830a9f15e94ed1e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:14.708236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:14.856336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd7f42f104f4985b830a9f15e94ed1e', 'request_id': 'req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:14.863732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd7f42f104f4985b830a9f15e94ed1e', 'request_id': 'req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:15.127622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd7f42f104f4985b830a9f15e94ed1e', 'request_id': 'req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:15.143658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] The token cache is being invalidate because project 6dd7f42f104f4985b830a9f15e94ed1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:58:15.144181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:15.145028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e807ae03-4a2a-4f2c-8701-8d3f30fc6204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:15.146933 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3529/7079] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:58:14 2022] DELETE /identity/v3/projects/6dd7f42f104f4985b830a9f15e94ed1e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:58:15.152252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675f5c-792b-43f7-b84d-76cebf46cae0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:15.152801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675f5c-792b-43f7-b84d-76cebf46cae0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:15.152801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675f5c-792b-43f7-b84d-76cebf46cae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:15.176767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cf675f5c-792b-43f7-b84d-76cebf46cae0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:15.178706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cf675f5c-792b-43f7-b84d-76cebf46cae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:15.358492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9132c2-6ec0-4750-bc5d-cda0f4b9b555 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:15.359082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9132c2-6ec0-4750-bc5d-cda0f4b9b555 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:15.359491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9132c2-6ec0-4750-bc5d-cda0f4b9b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:15.360889 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3551/7080] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:15.396829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cf9132c2-6ec0-4750-bc5d-cda0f4b9b555 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:15.401740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf9132c2-6ec0-4750-bc5d-cda0f4b9b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:15.426886 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3530/7081] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:58:15.429511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675f5c-792b-43f7-b84d-76cebf46cae0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:15.448818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675f5c-792b-43f7-b84d-76cebf46cae0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:15.458839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:15.459632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:15.460040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:15.460389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:15.461302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:58:15.461705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:15.463550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:15.481695 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3552/7082] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:58:15.485965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9132c2-6ec0-4750-bc5d-cda0f4b9b555 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:15.497708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9132c2-6ec0-4750-bc5d-cda0f4b9b555 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:15.510469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:15.511163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:15.511448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:15.511724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:15.512388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:15.527574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:15.656863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3531/7083] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:58:15 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:58:15.661174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:15.673902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25b36-b9a6-49a7-8906-42544f81186e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:15.791934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:15.842933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:15.843786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:15.845916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:15.846337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:15.847113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:15.849194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:15.953595 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3553/7084] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:58:15 2022] POST /identity/v3/users => generated 284 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:58:15.957623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:15.974935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb8424-455a-42e7-bf9d-729fb3624f37 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:15.994897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:15.995699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:15.996085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:15.996469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:15.997235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:15.999522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:16.019538 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3532/7085] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:58:16.024118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:16.048398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b514-79c1-4111-8332-dab39862d08d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:16.058554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea134c-a224-4b78-8c57-6001c0cf9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:16.059557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea134c-a224-4b78-8c57-6001c0cf9158 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:16.060092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea134c-a224-4b78-8c57-6001c0cf9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:16.060594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea134c-a224-4b78-8c57-6001c0cf9158 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:16.062041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea134c-a224-4b78-8c57-6001c0cf9158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:16.063902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea134c-a224-4b78-8c57-6001c0cf9158 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:16.095166 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3554/7086] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:58:16.096420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:16.113506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cd980-25ed-4190-9a97-7363b6016175 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:16.132942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:16.134076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:16.134449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:16.134797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] PATH_INFO: `/v3/projects/c3cd58715b2640c99f1bd5caf6f03a5b/users/9e6c0d2aa70041cead19620cef655508/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:16.168358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cd58715b2640c99f1bd5caf6f03a5b, user_id=9e6c0d2aa70041cead19620cef655508, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:16.171639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:16.302750 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3533/7087] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:58:16 2022] PUT /identity/v3/projects/c3cd58715b2640c99f1bd5caf6f03a5b/users/9e6c0d2aa70041cead19620cef655508/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:58:16.313197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:16.315770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:16.315770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:16.354227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] MFA Rules not processed for user `9e6c0d2aa70041cead19620cef655508`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:16.355884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:16.512748 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3555/7088] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:16.523163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:16.525114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:16.709825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:16.723175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0cd10-8053-4605-a6aa-b13319ab165b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:16.729555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c854c3d-81d3-4fb6-bba4-27c01c6bfb80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:16.731068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c854c3d-81d3-4fb6-bba4-27c01c6bfb80 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:16.731611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c854c3d-81d3-4fb6-bba4-27c01c6bfb80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:16.732096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c854c3d-81d3-4fb6-bba4-27c01c6bfb80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:16.782632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c854c3d-81d3-4fb6-bba4-27c01c6bfb80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:16.787306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c854c3d-81d3-4fb6-bba4-27c01c6bfb80 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:16.808059 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3534/7089] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:58:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:58:26.469554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:26.473231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:26.504106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:26.609900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6e0c-bf26-4248-8bd7-d842b2b9bcc8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:26.615203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:26.615990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:26.617376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:26.617919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] PATH_INFO: `/v3/users/f42d7700a69b4cbb8edce674fca2ee72` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:26.619401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42d7700a69b4cbb8edce674fca2ee72)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:26.621677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:26.815289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42d7700a69b4cbb8edce674fca2ee72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:26.831218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:26.832502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42d7700a69b4cbb8edce674fca2ee72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:26.833463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42d7700a69b4cbb8edce674fca2ee72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:26.850108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42d7700a69b4cbb8edce674fca2ee72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:26.909912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42d7700a69b4cbb8edce674fca2ee72'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:26.919039 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3556/7090] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:58:26 2022] DELETE /identity/v3/users/f42d7700a69b4cbb8edce674fca2ee72 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:58:26.924287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:26.924673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:26.925013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:26.953871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:26.956485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:27.098625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3535/7091] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:27.116203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:27.117867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:27.224513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098dd1c-56d4-4dc0-a676-2f9d8b1fb217 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:27.232832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e803e-db6a-4a91-aca5-f2c4cb7a51a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:27.234566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e803e-db6a-4a91-aca5-f2c4cb7a51a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:27.235025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e803e-db6a-4a91-aca5-f2c4cb7a51a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:27.235587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e803e-db6a-4a91-aca5-f2c4cb7a51a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:27.249910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e803e-db6a-4a91-aca5-f2c4cb7a51a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:27.251461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e803e-db6a-4a91-aca5-f2c4cb7a51a6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:27.267314 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3557/7092] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:58:27.935202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:27.940539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:27.969230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db4959-4ab1-49f2-b7a3-015c38ecb861 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:27.996623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:27.998049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:27.998049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:27.998049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] PATH_INFO: `/v3/projects/ecac93d1d86a4c2fae12c27bce1849f5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:27.999846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecac93d1d86a4c2fae12c27bce1849f5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:28.001788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:28.229828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecac93d1d86a4c2fae12c27bce1849f5', 'request_id': 'req-89a6b939-ed50-47a9-9bd0-349787d98162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:28.240351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecac93d1d86a4c2fae12c27bce1849f5', 'request_id': 'req-89a6b939-ed50-47a9-9bd0-349787d98162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:28.384236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecac93d1d86a4c2fae12c27bce1849f5', 'request_id': 'req-89a6b939-ed50-47a9-9bd0-349787d98162'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:28.413655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] The token cache is being invalidate because project ecac93d1d86a4c2fae12c27bce1849f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:58:28.413960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:28.416561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89a6b939-ed50-47a9-9bd0-349787d98162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:58:28.424665 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3536/7093] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:58:27 2022] DELETE /identity/v3/projects/ecac93d1d86a4c2fae12c27bce1849f5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:58:28.426812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409abc5-3467-49ff-a089-6bf43e90b48c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:28.427270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409abc5-3467-49ff-a089-6bf43e90b48c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:28.427470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409abc5-3467-49ff-a089-6bf43e90b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:28.484061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7409abc5-3467-49ff-a089-6bf43e90b48c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:28.485692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7409abc5-3467-49ff-a089-6bf43e90b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:28.513818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:28.627879 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3558/7094] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:28.636077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b450-aa54-4b3b-93d0-e12ab8426f5d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:28.639273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b450-aa54-4b3b-93d0-e12ab8426f5d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:28.639273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b450-aa54-4b3b-93d0-e12ab8426f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:28.692009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a945b450-aa54-4b3b-93d0-e12ab8426f5d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:28.695147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a945b450-aa54-4b3b-93d0-e12ab8426f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:28.722310 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3537/7095] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:28.731560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409abc5-3467-49ff-a089-6bf43e90b48c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:28.740493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409abc5-3467-49ff-a089-6bf43e90b48c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:28.759010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:28.759583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:28.759935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:28.760217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:28.760889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:58:28.761198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:28.762879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:28.780388 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3559/7096] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:58:28.785391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b450-aa54-4b3b-93d0-e12ab8426f5d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:28.797069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b450-aa54-4b3b-93d0-e12ab8426f5d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:28.803065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:28.803702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:28.804190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:28.804633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:28.807369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:28.811117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:28.940816 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3538/7097] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:58:28 2022] POST /identity/v3/projects => generated 357 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:58:28.945023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:28.955996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129687-bb51-401c-9094-713ecad115ec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:29.022955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:29.023733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:29.024078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:29.024464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:29.025197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:29.027630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:29.170012 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3560/7098] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:58:28 2022] POST /identity/v3/users => generated 279 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 13:58:29.174344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:29.195442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9b86-9a32-440f-b6a0-49be4acecc16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:29.202804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:29.203456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:29.203742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:29.204018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:29.204896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:29.206850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:29.221735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3539/7099] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:58:29.226389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:29.240997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009e27b-3db9-49d2-b66b-6bc5b1aee0bc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:29.246640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf2621-3db6-4c8f-92a7-d4a90b7f5eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:29.247269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf2621-3db6-4c8f-92a7-d4a90b7f5eda admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:29.247607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf2621-3db6-4c8f-92a7-d4a90b7f5eda admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:29.247951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf2621-3db6-4c8f-92a7-d4a90b7f5eda admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:29.249327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf2621-3db6-4c8f-92a7-d4a90b7f5eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:29.251124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf2621-3db6-4c8f-92a7-d4a90b7f5eda admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:29.271958 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3561/7100] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:58:29.272893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:29.287616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc9762-0725-4e36-8150-e4d158cafe7a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:29.293052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:29.293963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:29.294510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:29.295550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] PATH_INFO: `/v3/projects/9631ff6508ab4fc78dd51f95c9e8ab86/users/0c5970ca45ec45109092c283c6dfa30e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:29.318350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] RBAC: Authorizing `identity:create_grant(project_id=9631ff6508ab4fc78dd51f95c9e8ab86, user_id=0c5970ca45ec45109092c283c6dfa30e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:29.321869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:29.390193 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3540/7101] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:58:29 2022] PUT /identity/v3/projects/9631ff6508ab4fc78dd51f95c9e8ab86/users/0c5970ca45ec45109092c283c6dfa30e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:58:29.400825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60419374-305c-4adf-b374-f4c0192fa932 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:29.400825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60419374-305c-4adf-b374-f4c0192fa932 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:29.400825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60419374-305c-4adf-b374-f4c0192fa932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:29.443701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60419374-305c-4adf-b374-f4c0192fa932 None None] MFA Rules not processed for user `0c5970ca45ec45109092c283c6dfa30e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:29.445739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60419374-305c-4adf-b374-f4c0192fa932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:29.555431 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3562/7102] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:58:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:29.567848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:29.569669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:29.617637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:29.733760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65072f6d-57af-4ae0-b9f6-6c2c274b2def admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:29.740790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:29.740790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:29.740790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:29.740790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:29.765306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:29.766768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:29.789533 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3541/7103] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:58:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:58:32.969353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:32.969945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:32.970187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:33.008634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:33.010529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:33.089890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:33.228152 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3563/7104] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 13:58:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:33.269197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:33.272486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:33.512413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c0ad-15cf-44ba-ad5b-97e022cc0b5f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:33.525639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e954dbb-0569-471a-b204-77478aed72d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:33.526539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e954dbb-0569-471a-b204-77478aed72d2 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:33.526981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e954dbb-0569-471a-b204-77478aed72d2 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:33.527439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e954dbb-0569-471a-b204-77478aed72d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:33.546723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e954dbb-0569-471a-b204-77478aed72d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:33.548323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e954dbb-0569-471a-b204-77478aed72d2 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:33.586403 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3542/7105] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:58:39.605338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:39.611074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:39.751090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b46635-bf5a-4c6e-a909-749fcae93094 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:39.762903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:39.764500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:39.765027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:39.765544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:39.767714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:39.799094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:39.804198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:39.848813 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3564/7106] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:58:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:58:43.572111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=49 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:49.834910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=49 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:55.534200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:55.534767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:55.534767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:55.573376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:55.574995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:55.588142 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3543/7107] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:58:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:58:55.606192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:55.686542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff1c3a-5699-4111-9171-efb7cbeec901 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:55.696500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4386e8-73bc-4494-9e32-2eb2dc829d8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:55.697548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4386e8-73bc-4494-9e32-2eb2dc829d8c service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:55.697838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4386e8-73bc-4494-9e32-2eb2dc829d8c service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:55.698144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4386e8-73bc-4494-9e32-2eb2dc829d8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:55.710833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4386e8-73bc-4494-9e32-2eb2dc829d8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:55.713851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4386e8-73bc-4494-9e32-2eb2dc829d8c service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:55.735283 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3565/7108] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:58:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:58:57.906480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:57.908135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:57.922703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b1058-d3fe-4164-abe9-bf89079bc0c4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:57.926696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:57.927309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:57.927583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:57.927851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:57.929681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:58.018877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:58.020440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:58.036475 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3544/7109] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:58:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 13:58:58.259649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55035e8f-1311-4aaa-a595-36fd46b0c438 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:58.260560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55035e8f-1311-4aaa-a595-36fd46b0c438 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:58.261004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55035e8f-1311-4aaa-a595-36fd46b0c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:58.295312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-55035e8f-1311-4aaa-a595-36fd46b0c438 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:58:58.296760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-55035e8f-1311-4aaa-a595-36fd46b0c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:58:58.321645 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3566/7110] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:58:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:58:58.327504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:58:58.343343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46efda-e3fc-4b2b-85b9-6e75e0921c03 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:58:58.351060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:58:58.352156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:58.352751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:58.353207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:58:58.370160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:58:58.373254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:58:58.392915 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3545/7111] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:58:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:58:59.997749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b98e-c785-4377-9ce5-582faa52fc79 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:58:59.998675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b98e-c785-4377-9ce5-582faa52fc79 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:58:59.999194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b98e-c785-4377-9ce5-582faa52fc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:00.034920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6d16b98e-c785-4377-9ce5-582faa52fc79 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:00.036421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6d16b98e-c785-4377-9ce5-582faa52fc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:00.057873 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3567/7112] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 13:58:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:00.071870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:00.086149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e606a-e68c-4b17-83bd-667f1f43b31a service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:00.094012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:00.094992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:00.096901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:00.096901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:00.107149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:00.109064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:00.161024 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3546/7113] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 13:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 13:59:04.616269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16b98e-c785-4377-9ce5-582faa52fc79 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:04.641042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16b98e-c785-4377-9ce5-582faa52fc79 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:04.655515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff861aa0-6b51-4dd9-bb63-97180f8e15af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:04.656489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff861aa0-6b51-4dd9-bb63-97180f8e15af service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:04.656930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff861aa0-6b51-4dd9-bb63-97180f8e15af service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:04.657401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff861aa0-6b51-4dd9-bb63-97180f8e15af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:04.660683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ff861aa0-6b51-4dd9-bb63-97180f8e15af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:04.689658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff861aa0-6b51-4dd9-bb63-97180f8e15af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:04.696546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff861aa0-6b51-4dd9-bb63-97180f8e15af service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:04.725409 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3568/7114] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:05.352541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:05.379264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e2198-0070-4eb9-9adc-212d70ce9f1f service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:05.391306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:05.392208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:05.392651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:05.393084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:05.395045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:05.435264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:05.437038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:05.478478 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3547/7115] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:10.079276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:10.080834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:10.081115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:10.109512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] MFA Rules not processed for user `7963aa7a74c147cdab99b56131a66842`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:10.111502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:10.202435 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3569/7116] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:11.267211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:11.283114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f47f5-e9e3-4892-a85d-69aeb6c64448 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:11.311684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:11.320468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:11.320468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:11.320468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:11.322640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:11.339652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:11.342099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:11.377671 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3548/7117] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:12.516857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:12.519482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:12.544560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda0006-8742-4074-9da5-f15bf29872a1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:12.553646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4732-e3d1-4966-8ce6-7d2799a1d248 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:12.554600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4732-e3d1-4966-8ce6-7d2799a1d248 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:12.555186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4732-e3d1-4966-8ce6-7d2799a1d248 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:12.555734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4732-e3d1-4966-8ce6-7d2799a1d248 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:12.559621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f12b4732-e3d1-4966-8ce6-7d2799a1d248 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:12.581903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4732-e3d1-4966-8ce6-7d2799a1d248 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:12.583833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4732-e3d1-4966-8ce6-7d2799a1d248 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:12.598242 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3570/7118] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:18.162890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:18.165021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:18.425485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c4f74-23e0-4ef7-8e60-7baa25491d87 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:18.434101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:18.435913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:18.436468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:18.436924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] PATH_INFO: `/v3/users/9e6c0d2aa70041cead19620cef655508` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:18.440455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6c0d2aa70041cead19620cef655508)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:18.442869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:18.446713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:18.665268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6c0d2aa70041cead19620cef655508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:18.666891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6c0d2aa70041cead19620cef655508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:18.749046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6c0d2aa70041cead19620cef655508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:18.749988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6c0d2aa70041cead19620cef655508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:18.760022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6c0d2aa70041cead19620cef655508'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:18.788259 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3549/7119] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:59:18 2022] DELETE /identity/v3/users/9e6c0d2aa70041cead19620cef655508 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:18.792725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:18.793938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:18.794396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:18.818640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:18.820736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:18.962259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3571/7120] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:18.972247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:18.974832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:19.071466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878abbb-0714-4cac-a36f-44dbcd1a8189 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:19.076916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b806-5b47-4018-8368-895ec2bc34ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:19.077551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b806-5b47-4018-8368-895ec2bc34ad service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:19.077838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b806-5b47-4018-8368-895ec2bc34ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:19.078298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b806-5b47-4018-8368-895ec2bc34ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:19.091935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b806-5b47-4018-8368-895ec2bc34ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:19.095105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b806-5b47-4018-8368-895ec2bc34ad service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:19.117698 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3550/7121] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:19.452557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:19.454377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:19.476482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48539f-bf8f-4d05-9c80-02a2ba2a6f79 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:19.485176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:19.486801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:19.487312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:19.490039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] PATH_INFO: `/v3/projects/c3cd58715b2640c99f1bd5caf6f03a5b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:19.491619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cd58715b2640c99f1bd5caf6f03a5b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:19.494033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:19.543218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:19.648522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cd58715b2640c99f1bd5caf6f03a5b', 'request_id': 'req-0bcdb27a-cdd0-450f-91e3-85122212e5b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:19.662933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cd58715b2640c99f1bd5caf6f03a5b', 'request_id': 'req-0bcdb27a-cdd0-450f-91e3-85122212e5b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:19.813611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cd58715b2640c99f1bd5caf6f03a5b', 'request_id': 'req-0bcdb27a-cdd0-450f-91e3-85122212e5b0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:19.829133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] The token cache is being invalidate because project c3cd58715b2640c99f1bd5caf6f03a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:59:19.829693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:19.830774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0bcdb27a-cdd0-450f-91e3-85122212e5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:19.842110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3572/7122] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:59:19 2022] DELETE /identity/v3/projects/c3cd58715b2640c99f1bd5caf6f03a5b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:19.849189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8faa-23e2-4b38-95e9-18144b3828e5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:19.849189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8faa-23e2-4b38-95e9-18144b3828e5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:19.849189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8faa-23e2-4b38-95e9-18144b3828e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:19.873006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-54fd8faa-23e2-4b38-95e9-18144b3828e5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:19.876076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-54fd8faa-23e2-4b38-95e9-18144b3828e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:20.042666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3551/7123] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:20.051400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff710-7677-4356-a172-33588de3f628 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:20.051698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff710-7677-4356-a172-33588de3f628 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:20.051974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff710-7677-4356-a172-33588de3f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:20.109264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fe8ff710-7677-4356-a172-33588de3f628 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:20.114302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe8ff710-7677-4356-a172-33588de3f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:20.135529 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3573/7124] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:20.143019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd8faa-23e2-4b38-95e9-18144b3828e5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:20.170570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd8faa-23e2-4b38-95e9-18144b3828e5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:20.208638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:20.208638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:20.208638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:20.208638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:20.209201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:59:20.209201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:20.209201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:20.235509 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3552/7125] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:59:20.240828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff710-7677-4356-a172-33588de3f628 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:20.256684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff710-7677-4356-a172-33588de3f628 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:20.270709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:20.271345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:20.271618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:20.272080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:20.273012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:20.276934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:20.420436 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3574/7126] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:59:20 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:59:20.425225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:20.440510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a0a6a-3cbe-4dd1-8d25-9929b23d5381 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:20.456845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:20.640935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:20.641578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:20.641931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:20.642235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:20.642885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:20.648983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:20.755567 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3553/7127] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:59:20 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:59:20.756581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:20.777922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3c258-13af-4f71-b8b5-f97d1947268b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:20.795086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:20.796001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:20.796455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:20.796897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:20.797736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:20.799686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:20.824514 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3575/7128] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:59:20.830341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:20.848780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176912f-f772-4190-82a1-812f13093c16 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:20.863023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc7321-8631-4cff-a84d-9469d3a92d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:20.863738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7321-8631-4cff-a84d-9469d3a92d27 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:20.863942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7321-8631-4cff-a84d-9469d3a92d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:20.864222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc7321-8631-4cff-a84d-9469d3a92d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:20.864889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc7321-8631-4cff-a84d-9469d3a92d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:20.866631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc7321-8631-4cff-a84d-9469d3a92d27 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:20.896922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3554/7129] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:59:20.903620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:20.922706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ff78a-d72c-4484-a507-ff121f5a0044 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:20.937196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:20.938231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:20.938699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:20.939134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] PATH_INFO: `/v3/projects/e95d5e8ef3d04b9d8c73c03b3d10191a/users/b77a0d7baed4465786cd71cb4d373505/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:20.980400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95d5e8ef3d04b9d8c73c03b3d10191a, user_id=b77a0d7baed4465786cd71cb4d373505, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:20.984437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:21.115494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3576/7130] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:59:20 2022] PUT /identity/v3/projects/e95d5e8ef3d04b9d8c73c03b3d10191a/users/b77a0d7baed4465786cd71cb4d373505/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:21.128469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:21.129131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:21.129669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:21.182515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] MFA Rules not processed for user `b77a0d7baed4465786cd71cb4d373505`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:21.185581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:21.344460 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3555/7131] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:21.353119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:21.357077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:21.473580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67f91-9767-44f4-a3ca-f3faa284c5f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:21.482034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:21.483025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:21.483454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:21.484499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:21.499746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:21.505067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:21.550930 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3577/7132] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:21.618896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:21.620361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:21.644905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671a74b-f225-4de0-a66e-9cfd369bd5d5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:21.664215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125bbfd-45fa-4859-92e7-5e8891fb70ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:21.664872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125bbfd-45fa-4859-92e7-5e8891fb70ea service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:21.665151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125bbfd-45fa-4859-92e7-5e8891fb70ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:21.665467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125bbfd-45fa-4859-92e7-5e8891fb70ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:21.675503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4125bbfd-45fa-4859-92e7-5e8891fb70ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:22.196603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125bbfd-45fa-4859-92e7-5e8891fb70ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:22.196603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125bbfd-45fa-4859-92e7-5e8891fb70ea service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:22.196603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:22.196603 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3556/7133] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:28.106563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:28.108030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:28.176197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:28.195264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa9e0-7145-4cff-b3a9-67f00fc8fc3c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:28.205339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:28.206276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:28.206748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:28.207219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] PATH_INFO: `/v3/users/69a2792ee20e450e877d4f016c031768` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:28.210728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a2792ee20e450e877d4f016c031768)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:28.212708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:28.558093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a2792ee20e450e877d4f016c031768'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:28.576812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a2792ee20e450e877d4f016c031768'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:28.578422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a2792ee20e450e877d4f016c031768'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:28.648019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a2792ee20e450e877d4f016c031768'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:28.744239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a2792ee20e450e877d4f016c031768'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:28.752827 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3578/7134] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:59:28 2022] DELETE /identity/v3/users/69a2792ee20e450e877d4f016c031768 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:28.757186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:28.757663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:28.757746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:28.793517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:28.797153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:28.919703 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3557/7135] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:28.929356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:28.931184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:29.004366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5493cb5-4a1b-47b0-b182-14de0778c9c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:29.008124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:29.008768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:29.009119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:29.010163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:29.021794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:29.022913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:29.035257 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3579/7136] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:29.519603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:29.521577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:29.561356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceac5d4-57d3-41d4-8e17-11674dd66841 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:29.576989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:29.580094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:29.580094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:29.580094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] PATH_INFO: `/v3/projects/9c7f9282abf546de97aeefc165b7073d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:29.580094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7f9282abf546de97aeefc165b7073d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:29.581398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:29.759794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7f9282abf546de97aeefc165b7073d', 'request_id': 'req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:29.775095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7f9282abf546de97aeefc165b7073d', 'request_id': 'req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:29.891104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7f9282abf546de97aeefc165b7073d', 'request_id': 'req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:29.920593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] The token cache is being invalidate because project 9c7f9282abf546de97aeefc165b7073d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:59:29.921388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:29.923761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:29.929167 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3558/7137] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:59:29 2022] DELETE /identity/v3/projects/9c7f9282abf546de97aeefc165b7073d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:29.932909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:29.956758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20a8f-2f2f-4ab5-8e80-1be609f46285 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:30.155734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:30.156763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:30.157183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:30.157593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] PATH_INFO: `/v3/users/e75b5e687b894134be5eaf009f055a05` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:30.201019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75b5e687b894134be5eaf009f055a05)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:30.205454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:30.209306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:30.531341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75b5e687b894134be5eaf009f055a05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:30.547541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75b5e687b894134be5eaf009f055a05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:30.548409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75b5e687b894134be5eaf009f055a05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:30.573972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75b5e687b894134be5eaf009f055a05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:30.664390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8cc7d601-fa0c-46e3-9f00-c5c514f61a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75b5e687b894134be5eaf009f055a05'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:30.676466 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3580/7138] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 13:59:29 2022] DELETE /identity/v3/users/e75b5e687b894134be5eaf009f055a05 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:31.101784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:31.103675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:31.144615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ef1ae-0c14-4bc8-bce0-9611fe9a3f10 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:31.232945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:31.234205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:31.234488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:31.234761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] PATH_INFO: `/v3/projects/2751b46cd5d74e5ea29be04ae823f86f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:31.252775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2751b46cd5d74e5ea29be04ae823f86f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:31.255027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:31.292748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:31.480344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2751b46cd5d74e5ea29be04ae823f86f', 'request_id': 'req-609348a0-8e1d-4f06-a76e-ae3b085b40ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:31.495231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2751b46cd5d74e5ea29be04ae823f86f', 'request_id': 'req-609348a0-8e1d-4f06-a76e-ae3b085b40ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:31.593746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2751b46cd5d74e5ea29be04ae823f86f', 'request_id': 'req-609348a0-8e1d-4f06-a76e-ae3b085b40ce'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:31.607638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] The token cache is being invalidate because project 2751b46cd5d74e5ea29be04ae823f86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 13:59:31.608415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:31.609209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-609348a0-8e1d-4f06-a76e-ae3b085b40ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 13:59:31.611446 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3559/7139] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 13:59:31 2022] DELETE /identity/v3/projects/2751b46cd5d74e5ea29be04ae823f86f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:31.617887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60757266-0cb6-4e59-ac70-508f224d9f41 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:31.618459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60757266-0cb6-4e59-ac70-508f224d9f41 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:31.618459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60757266-0cb6-4e59-ac70-508f224d9f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:31.643082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60757266-0cb6-4e59-ac70-508f224d9f41 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:31.644638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60757266-0cb6-4e59-ac70-508f224d9f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:31.779589 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3581/7140] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 13:59:31.780621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc995-92c3-46c9-b1ea-a91226a6466a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:31.780909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc995-92c3-46c9-b1ea-a91226a6466a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:31.781530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc995-92c3-46c9-b1ea-a91226a6466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:31.809368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-434dc995-92c3-46c9-b1ea-a91226a6466a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:31.813848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-434dc995-92c3-46c9-b1ea-a91226a6466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:31.831604 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3560/7141] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:31.832193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60757266-0cb6-4e59-ac70-508f224d9f41 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:31.846473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60757266-0cb6-4e59-ac70-508f224d9f41 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:31.859145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:31.859794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:31.860225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:31.860525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:31.861190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 13:59:31.861481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:31.863122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:31.875684 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3582/7142] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 13:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 13:59:31.881146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc995-92c3-46c9-b1ea-a91226a6466a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:31.906294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc995-92c3-46c9-b1ea-a91226a6466a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:31.911634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:31.912361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:31.912697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:31.913135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:31.913807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:31.915835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:32.085481 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3561/7143] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:59:31 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:59:32.089511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:32.109947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f17d35-6f2d-4809-b421-9c23f0e8718c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:32.199890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:32.200859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:32.201282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:32.201709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:32.203712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:32.206134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:32.303211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:32.319716 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3583/7144] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:59:32 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:59:32.321026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:32.340432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f21f5c-a64e-46ed-a2dc-2b7ef91c696a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:32.348273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:32.349456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:32.349856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:32.350270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:32.351040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:32.353278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:32.368394 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3562/7145] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:59:32.369661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:32.383996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8edc8-4348-48f7-ab41-29cf032a4a82 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:32.393377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397435cd-ea66-460a-968d-aec1c9871b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:32.394021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397435cd-ea66-460a-968d-aec1c9871b02 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:32.394754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397435cd-ea66-460a-968d-aec1c9871b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:32.394754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397435cd-ea66-460a-968d-aec1c9871b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:32.395335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397435cd-ea66-460a-968d-aec1c9871b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:32.397040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397435cd-ea66-460a-968d-aec1c9871b02 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:32.414930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:32.423234 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3584/7146] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:59:32.427917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e59672-af7a-47a9-9a56-92cb2ad02429 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:32.435224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:32.436153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:32.436562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:32.436960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] PATH_INFO: `/v3/projects/b10dd8d3e1be4c6e9ceea751db7a775e/users/c0fc58ba6c524ee79755a72aa1f7ce1d/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:32.463182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10dd8d3e1be4c6e9ceea751db7a775e, user_id=c0fc58ba6c524ee79755a72aa1f7ce1d, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:32.467757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:32.551781 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3563/7147] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:59:32 2022] PUT /identity/v3/projects/b10dd8d3e1be4c6e9ceea751db7a775e/users/c0fc58ba6c524ee79755a72aa1f7ce1d/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 13:59:32.559273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29cbe-a662-4815-a8c6-eb916cbec58a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:32.559273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29cbe-a662-4815-a8c6-eb916cbec58a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:32.559273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f29cbe-a662-4815-a8c6-eb916cbec58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:32.603909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48f29cbe-a662-4815-a8c6-eb916cbec58a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:32.605169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48f29cbe-a662-4815-a8c6-eb916cbec58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:32.760028 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3585/7148] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:32.807864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:32.810422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:32.937861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0af7de-ba92-473b-973d-394b2f4c3d3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:32.946803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:32.947620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:32.948210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:32.948784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:32.975180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:32.976630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:33.001057 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3564/7149] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:42.920823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=33 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:42.993305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:43.211341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f723-4abc-43ba-b76f-bb39bb5f7f22 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:43.211828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f723-4abc-43ba-b76f-bb39bb5f7f22 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:43.212779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f723-4abc-43ba-b76f-bb39bb5f7f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:43.256509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0ee9f723-4abc-43ba-b76f-bb39bb5f7f22 None None] MFA Rules not processed for user `b28a5b73e4fa4ce0aadd144e09a6f977`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:43.257848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ee9f723-4abc-43ba-b76f-bb39bb5f7f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:43.361983 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3586/7150] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:43.885509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:43.887956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:43.910723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3334350-9609-403a-a803-ae7f8d47bbf2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:43.921991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:43.923452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:43.925121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:43.925121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:43.937287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:43.965595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:43.973832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:44.000560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3565/7151] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:44.789351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d387abd-ded6-47ba-889b-3b628724e032 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:44.792588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d387abd-ded6-47ba-889b-3b628724e032 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:44.792588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d387abd-ded6-47ba-889b-3b628724e032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:44.857069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7d387abd-ded6-47ba-889b-3b628724e032 None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:44.861090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d387abd-ded6-47ba-889b-3b628724e032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:45.058292 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3587/7152] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:45.064138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:45.078308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e463d6-cc74-4825-be4b-0d2a1d7e938f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:45.084306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:45.085249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:45.085678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:45.086669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:45.087628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:45.089766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:45.214343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d387abd-ded6-47ba-889b-3b628724e032 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:45.225068 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3566/7153] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 13:59:45 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:59:45.236206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d387abd-ded6-47ba-889b-3b628724e032 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:45.460017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:45.460676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:45.460985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:45.461246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:45.461904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:45.463924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:45.591593 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3588/7154] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 13:59:45 2022] POST /identity/v3/users => generated 295 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 13:59:45.595976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:45.614292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998ca89-095b-45c8-8e04-5fc32cf96664 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:45.633195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:45.634348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:45.634838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:45.635309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:45.636182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:45.639198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:45.682887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:45.691975 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3567/7155] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 13:59:45.700475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac301-1a5b-48ff-84b8-17462c47baf0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:45.720972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:45.721749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:45.722199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:45.724261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] PATH_INFO: `/v3/projects/85d046f954fa4d939a022e17c5b0b56a/users/40d59a3675a946b2a1467112fc5975a9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:45.759440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d046f954fa4d939a022e17c5b0b56a, user_id=40d59a3675a946b2a1467112fc5975a9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:45.770749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:45.865922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:45.876961 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3589/7156] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:59:45 2022] PUT /identity/v3/projects/85d046f954fa4d939a022e17c5b0b56a/users/40d59a3675a946b2a1467112fc5975a9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:45.881402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:45.903022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cf5a8-2ff5-4d15-bc6d-42d7e8a0207d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:46.167050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:46.168288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:46.168573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:46.168847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:46.169546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:46.178795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:46.225514 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3568/7157] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 13:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 13:59:46.226183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:46.241482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a6a5a-d595-45dc-aa46-28f95cc2f649 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:46.255604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc88fc2-d411-4a55-bfbc-1c7505dbbb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:46.256591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88fc2-d411-4a55-bfbc-1c7505dbbb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:46.257047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88fc2-d411-4a55-bfbc-1c7505dbbb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:46.257475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc88fc2-d411-4a55-bfbc-1c7505dbbb50 admin admin] PATH_INFO: `/v3/projects/85d046f954fa4d939a022e17c5b0b56a/users/40d59a3675a946b2a1467112fc5975a9/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:46.262975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc88fc2-d411-4a55-bfbc-1c7505dbbb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d046f954fa4d939a022e17c5b0b56a, user_id=40d59a3675a946b2a1467112fc5975a9, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:46.265882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc88fc2-d411-4a55-bfbc-1c7505dbbb50 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:46.301062 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3590/7158] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 13:59:46 2022] PUT /identity/v3/projects/85d046f954fa4d939a022e17c5b0b56a/users/40d59a3675a946b2a1467112fc5975a9/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 13:59:52.634930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:52.637765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:52.815837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913d53-2a6c-4fd8-bdb2-d2b556dd1e5b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:52.908681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:52.946283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:52.947166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:52.947675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:52.948149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:52.952214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:52.979729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:52.987957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:53.017279 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3569/7159] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:56.286987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:57.773787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903a98-6188-4e92-9e4a-faf8da567951 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:57.774425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903a98-6188-4e92-9e4a-faf8da567951 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:57.774425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903a98-6188-4e92-9e4a-faf8da567951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:57.820679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9903a98-6188-4e92-9e4a-faf8da567951 None None] MFA Rules not processed for user `40d59a3675a946b2a1467112fc5975a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 13:59:57.823234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9903a98-6188-4e92-9e4a-faf8da567951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:57.957860 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3591/7160] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 13:59:57.974257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:57.975893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 13:59:58.147508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371820dd-12a1-4872-b475-9856146c44d6 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:58.152301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0183-f410-4a65-bbd7-eda6b749aaac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:58.152928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0183-f410-4a65-bbd7-eda6b749aaac service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:58.153212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0183-f410-4a65-bbd7-eda6b749aaac service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:58.153487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0183-f410-4a65-bbd7-eda6b749aaac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:58.165158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0183-f410-4a65-bbd7-eda6b749aaac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:58.166760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0183-f410-4a65-bbd7-eda6b749aaac service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:58.185039 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3570/7161] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 13:59:58.794087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903a98-6188-4e92-9e4a-faf8da567951 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 13:59:58.811713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903a98-6188-4e92-9e4a-faf8da567951 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 13:59:58.817388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552bbcd-de54-4df6-ab1a-dd1c6d379d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 13:59:58.818456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552bbcd-de54-4df6-ab1a-dd1c6d379d7c service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 13:59:58.819145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552bbcd-de54-4df6-ab1a-dd1c6d379d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 13:59:58.819834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552bbcd-de54-4df6-ab1a-dd1c6d379d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 13:59:58.986852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552bbcd-de54-4df6-ab1a-dd1c6d379d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 13:59:58.986852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552bbcd-de54-4df6-ab1a-dd1c6d379d7c service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 13:59:58.990330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3592/7162] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 13:59:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:00:02.522498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:02.523019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:02.523224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:02.566499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:02.568856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:02.591190 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3571/7163] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:03.184355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e3a1-6690-43d3-b2fb-49e70fdf10b6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:03.184355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e3a1-6690-43d3-b2fb-49e70fdf10b6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:03.184896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e3a1-6690-43d3-b2fb-49e70fdf10b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:03.234306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dc87e3a1-6690-43d3-b2fb-49e70fdf10b6 None None] MFA Rules not processed for user `7963aa7a74c147cdab99b56131a66842`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:03.235884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dc87e3a1-6690-43d3-b2fb-49e70fdf10b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:03.317250 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3593/7164] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:08.399249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:08.401047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:08.554818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fd1ec-d3b8-4dc1-8b64-e4bf22bf67cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:08.563203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:08.565799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:08.566395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:08.567140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] PATH_INFO: `/v3/users/b77a0d7baed4465786cd71cb4d373505` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:08.587532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b77a0d7baed4465786cd71cb4d373505)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:08.590090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:08.914686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77a0d7baed4465786cd71cb4d373505'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:08.922830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77a0d7baed4465786cd71cb4d373505'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:09.304567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77a0d7baed4465786cd71cb4d373505'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:09.318153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77a0d7baed4465786cd71cb4d373505'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:09.322022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77a0d7baed4465786cd71cb4d373505'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:09.333514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:09.357753 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3572/7165] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:00:08 2022] DELETE /identity/v3/users/b77a0d7baed4465786cd71cb4d373505 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:00:09.369312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:09.369879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:09.369957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:09.398529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:09.400022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:09.435512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:09.511672 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3594/7166] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:09.522022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:09.523717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:09.625291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c33789-d791-4ca4-9e60-f5b5e64bfb0b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:09.635982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882be60-2cac-4696-8d13-29259f37d399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:09.636653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882be60-2cac-4696-8d13-29259f37d399 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:09.640678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882be60-2cac-4696-8d13-29259f37d399 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:09.641501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882be60-2cac-4696-8d13-29259f37d399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:09.669582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882be60-2cac-4696-8d13-29259f37d399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:09.671947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882be60-2cac-4696-8d13-29259f37d399 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:09.704017 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3573/7167] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:00:10.167697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:10.172463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:10.223390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f09bc5-4960-45e8-a845-d2cdd52577a2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:10.249548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:10.275573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:10.276058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:10.276875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] PATH_INFO: `/v3/projects/e95d5e8ef3d04b9d8c73c03b3d10191a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:10.280429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95d5e8ef3d04b9d8c73c03b3d10191a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:10.282878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:10.512001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95d5e8ef3d04b9d8c73c03b3d10191a', 'request_id': 'req-c5ff72bd-a172-42ef-be9d-de322f246b17'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:10.534827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95d5e8ef3d04b9d8c73c03b3d10191a', 'request_id': 'req-c5ff72bd-a172-42ef-be9d-de322f246b17'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:10.593534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95d5e8ef3d04b9d8c73c03b3d10191a', 'request_id': 'req-c5ff72bd-a172-42ef-be9d-de322f246b17'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:10.631768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] The token cache is being invalidate because project e95d5e8ef3d04b9d8c73c03b3d10191a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:00:10.632063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:10.634669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c5ff72bd-a172-42ef-be9d-de322f246b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:10.639347 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3595/7168] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:00:10 2022] DELETE /identity/v3/projects/e95d5e8ef3d04b9d8c73c03b3d10191a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:00:10.645771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb84bc-ea4b-4ec1-9c8a-6b2502c72568 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:10.645771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb84bc-ea4b-4ec1-9c8a-6b2502c72568 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:10.645771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb84bc-ea4b-4ec1-9c8a-6b2502c72568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:10.695145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-10cb84bc-ea4b-4ec1-9c8a-6b2502c72568 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:10.696455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-10cb84bc-ea4b-4ec1-9c8a-6b2502c72568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:10.821805 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3574/7169] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:10.823810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4c5c-4da3-4ca1-8fe1-6b73f25186d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:10.824109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4c5c-4da3-4ca1-8fe1-6b73f25186d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:10.824389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4c5c-4da3-4ca1-8fe1-6b73f25186d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:10.858679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-df8c4c5c-4da3-4ca1-8fe1-6b73f25186d0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:10.867731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-df8c4c5c-4da3-4ca1-8fe1-6b73f25186d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:10.891115 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3596/7170] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:10.896684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb84bc-ea4b-4ec1-9c8a-6b2502c72568 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:10.910489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb84bc-ea4b-4ec1-9c8a-6b2502c72568 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:10.923498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:10.926443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:10.928026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:10.928689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:10.930038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:00:10.931633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:10.935366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:10.985610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4c5c-4da3-4ca1-8fe1-6b73f25186d0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:10.999550 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3575/7171] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:00:11.012080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4c5c-4da3-4ca1-8fe1-6b73f25186d0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:11.029158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:11.032827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:11.040406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:11.040406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:11.040406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:11.040406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:11.207037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:11.208789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3597/7172] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:00:10 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:00:11.223179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256b9f0-1757-4f96-9f90-c94a0debae57 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:11.347065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:11.348150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:11.348714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:11.349151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:11.355927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:11.375159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:11.508563 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3576/7173] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:00:11 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:00:11.511829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:11.527735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6f0d5-d3d3-405c-87c8-7c6caac60af3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:11.544857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:11.545714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:11.546174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:11.546615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:11.547725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:11.549514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:11.584685 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3598/7174] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:00:11.588414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:11.603402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11431dd8-bf12-4537-aabb-4bbf94694f05 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:11.618659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46cb196-083e-4da7-9372-0246e36c8a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:11.619307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cb196-083e-4da7-9372-0246e36c8a79 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:11.619591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cb196-083e-4da7-9372-0246e36c8a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:11.619869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46cb196-083e-4da7-9372-0246e36c8a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:11.621219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46cb196-083e-4da7-9372-0246e36c8a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:11.622973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46cb196-083e-4da7-9372-0246e36c8a79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:11.633128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:11.651729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3577/7175] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:00:11.653835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:11.668813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d781bf8-98ee-45e4-b388-826ec10cd953 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:11.686936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:11.706417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:11.706712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:11.707000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] PATH_INFO: `/v3/projects/56095bfd67524ad0bf09717c1ecd61dd/users/fe3b2f47130d4c66bea1f090db3b92dd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:11.756451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56095bfd67524ad0bf09717c1ecd61dd, user_id=fe3b2f47130d4c66bea1f090db3b92dd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:11.759398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:11.883838 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3599/7176] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:00:11 2022] PUT /identity/v3/projects/56095bfd67524ad0bf09717c1ecd61dd/users/fe3b2f47130d4c66bea1f090db3b92dd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:00:11.885670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:11.886588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:11.886868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:11.962790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] MFA Rules not processed for user `fe3b2f47130d4c66bea1f090db3b92dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:11.964981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:12.064095 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3578/7177] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:12.074131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:12.076874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:12.147354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:12.153032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e6c01-8e94-4d70-a91c-a21d3abcff7f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:12.157315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:12.158331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:12.158734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:12.159020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:12.169857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:12.171461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:12.183947 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3600/7178] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:00:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:00:19.038582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:19.040028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:19.092126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf3dc5-4208-440a-afb5-436eb77fdb67 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:19.126805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:19.130070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:19.132833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:19.134277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:19.147569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:19.197642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:19.200141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:19.232729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3579/7179] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:00:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:00:22.621504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:29.216283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=39 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:41.743451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:41.746287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:41.923477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766bd1e-6aa4-48b6-ae22-0366b6ae5bd5 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:41.929779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c05b1-b551-4fbf-a22b-92ead3f4a4cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:41.930826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c05b1-b551-4fbf-a22b-92ead3f4a4cf service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:41.931342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c05b1-b551-4fbf-a22b-92ead3f4a4cf service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:41.933284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c05b1-b551-4fbf-a22b-92ead3f4a4cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:41.936614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9e8c05b1-b551-4fbf-a22b-92ead3f4a4cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:41.958365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c05b1-b551-4fbf-a22b-92ead3f4a4cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:41.961952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c05b1-b551-4fbf-a22b-92ead3f4a4cf service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:42.003688 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3601/7180] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:00:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:00:51.969717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=34 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:52.488288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:52.613132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e287ff-32a2-4c9f-b905-3e54af65e271 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:52.620716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:52.621701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:52.622500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:52.622940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] PATH_INFO: `/v3/users/fe3b2f47130d4c66bea1f090db3b92dd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:52.624305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3b2f47130d4c66bea1f090db3b92dd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:52.626505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:52.872492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3b2f47130d4c66bea1f090db3b92dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:52.873817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3b2f47130d4c66bea1f090db3b92dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:52.964084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3b2f47130d4c66bea1f090db3b92dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:52.964712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3b2f47130d4c66bea1f090db3b92dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:52.976537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3b2f47130d4c66bea1f090db3b92dd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:53.039832 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3580/7181] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:00:52 2022] DELETE /identity/v3/users/fe3b2f47130d4c66bea1f090db3b92dd => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:00:53.044575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:53.045097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:53.046075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:53.127225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:53.128823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:53.262093 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3602/7182] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:53.274487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:53.276871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:53.387463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d24af6-8064-4834-a8fb-8b25c10eb1f6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:53.394692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cb3cc-d554-4956-b802-94008c8e3524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:53.395505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb3cc-d554-4956-b802-94008c8e3524 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:53.398572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb3cc-d554-4956-b802-94008c8e3524 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:53.399842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cb3cc-d554-4956-b802-94008c8e3524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:53.435604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cb3cc-d554-4956-b802-94008c8e3524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:53.437280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cb3cc-d554-4956-b802-94008c8e3524 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:53.449097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3581/7183] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:00:53.868703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:53.871761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:53.900847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb654c-5343-41f7-9466-f6b49f52223e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:53.934399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:53.936330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:53.937974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:53.938281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] PATH_INFO: `/v3/projects/56095bfd67524ad0bf09717c1ecd61dd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:53.942646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56095bfd67524ad0bf09717c1ecd61dd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:53.945936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:54.134613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56095bfd67524ad0bf09717c1ecd61dd', 'request_id': 'req-62bd952e-b814-47a8-a328-a93cd40c2033'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:54.147143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56095bfd67524ad0bf09717c1ecd61dd', 'request_id': 'req-62bd952e-b814-47a8-a328-a93cd40c2033'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:54.238408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56095bfd67524ad0bf09717c1ecd61dd', 'request_id': 'req-62bd952e-b814-47a8-a328-a93cd40c2033'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:54.265672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] The token cache is being invalidate because project 56095bfd67524ad0bf09717c1ecd61dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:00:54.266178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:54.267228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-62bd952e-b814-47a8-a328-a93cd40c2033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:00:54.269327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3603/7184] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:00:53 2022] DELETE /identity/v3/projects/56095bfd67524ad0bf09717c1ecd61dd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:00:54.275648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346293a-d6c9-479b-98e6-1f80bf43ac09 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:54.276161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346293a-d6c9-479b-98e6-1f80bf43ac09 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:54.276576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346293a-d6c9-479b-98e6-1f80bf43ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:54.343994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0346293a-d6c9-479b-98e6-1f80bf43ac09 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:54.351482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0346293a-d6c9-479b-98e6-1f80bf43ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:54.391369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:54.519842 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3582/7185] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:54.529075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdaa98-4be7-40b2-99c3-6beb355f3b44 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:54.529500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdaa98-4be7-40b2-99c3-6beb355f3b44 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:54.529874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdaa98-4be7-40b2-99c3-6beb355f3b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:54.594884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fdcdaa98-4be7-40b2-99c3-6beb355f3b44 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:54.597198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fdcdaa98-4be7-40b2-99c3-6beb355f3b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:54.630613 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3604/7186] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:00:54.635511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346293a-d6c9-479b-98e6-1f80bf43ac09 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:54.654974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346293a-d6c9-479b-98e6-1f80bf43ac09 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:54.673427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:54.676157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:54.679139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:54.679443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:54.682888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:00:54.683205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:54.688486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:54.718707 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3583/7187] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:00:54.722598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdaa98-4be7-40b2-99c3-6beb355f3b44 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:54.737561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdaa98-4be7-40b2-99c3-6beb355f3b44 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:54.749558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:54.755593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:54.755972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:54.756258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:54.757064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:54.759979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:54.890250 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3605/7188] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:00:54 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:00:54.893874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:54.910446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441553e-4e5a-46a3-a1b9-1f1e506d4d18 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:55.077658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:55.078418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:55.079390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:55.079390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:55.080067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:55.085496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:55.258915 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3584/7189] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:00:54 2022] POST /identity/v3/users => generated 287 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:00:55.262941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:55.280074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1a648-49be-4f4f-ba4d-676bcd63a2e9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:55.287093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:55.288062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:55.288585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:55.289118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:55.289998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:55.296841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:55.320465 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3606/7190] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:00:55.321302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:55.336279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca51656-f32c-48e3-a6cf-73b7eba278e5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:55.363777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aaf653-5093-44e5-846b-88b151e62d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:55.364436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaf653-5093-44e5-846b-88b151e62d21 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:55.364721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaf653-5093-44e5-846b-88b151e62d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:55.369637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaf653-5093-44e5-846b-88b151e62d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:55.370527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aaf653-5093-44e5-846b-88b151e62d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:55.372193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aaf653-5093-44e5-846b-88b151e62d21 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:55.424907 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3585/7191] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:00:55.429791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:55.479045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ea7ff-66aa-445c-8700-02fe8e300df9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:55.489342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:55.491132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:55.491712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:55.492803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] PATH_INFO: `/v3/projects/0dece13dfeed44d4984d269752687769/users/e0401a2d038a4944b9cac15b528fb2c0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:55.521096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dece13dfeed44d4984d269752687769, user_id=e0401a2d038a4944b9cac15b528fb2c0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:55.524353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:55.622176 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3607/7192] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:00:55 2022] PUT /identity/v3/projects/0dece13dfeed44d4984d269752687769/users/e0401a2d038a4944b9cac15b528fb2c0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:00:55.627153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:55.627429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:55.627698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:55.704557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] MFA Rules not processed for user `e0401a2d038a4944b9cac15b528fb2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:00:55.706291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:55.886733 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3586/7193] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:00:55.902632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:55.907922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:55.985988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:56.079930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ab8d-e17a-4c11-9ce0-bf7a1ffca242 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:56.108582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e87d65-f92a-47d8-ab97-d9a21ceacf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:56.108582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87d65-f92a-47d8-ab97-d9a21ceacf62 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:56.108582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87d65-f92a-47d8-ab97-d9a21ceacf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:56.108582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e87d65-f92a-47d8-ab97-d9a21ceacf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:56.128776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e87d65-f92a-47d8-ab97-d9a21ceacf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:56.130436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e87d65-f92a-47d8-ab97-d9a21ceacf62 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:56.165961 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3608/7194] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:00:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:00:59.727628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:00:59.729663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:59.757761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61accdec-4328-4538-b2e7-7c81a418cde9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:00:59.775854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:00:59.776502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:00:59.776784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:00:59.777057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:00:59.778920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:00:59.802486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:00:59.803799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:00:59.828341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3587/7195] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:00:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:01.808332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e65fb-8044-4335-b960-0c23cf5d7d20 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:01.808332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e65fb-8044-4335-b960-0c23cf5d7d20 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:01.808332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e65fb-8044-4335-b960-0c23cf5d7d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:01.849703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3c2e65fb-8044-4335-b960-0c23cf5d7d20 None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:01.851548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c2e65fb-8044-4335-b960-0c23cf5d7d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:02.058803 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3609/7196] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:04.721697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:04.723734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:04.737129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:04.895188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cdfb3-193f-4f6e-a12e-1dcc442a2863 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:04.904347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:04.905347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:04.905945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:04.907246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] PATH_INFO: `/v3/users/0c5970ca45ec45109092c283c6dfa30e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:04.908723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5970ca45ec45109092c283c6dfa30e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:04.912165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:05.155832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5970ca45ec45109092c283c6dfa30e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:05.157184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5970ca45ec45109092c283c6dfa30e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:05.283098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5970ca45ec45109092c283c6dfa30e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:05.283753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5970ca45ec45109092c283c6dfa30e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:05.308838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5970ca45ec45109092c283c6dfa30e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:05.364077 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3588/7197] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:04 2022] DELETE /identity/v3/users/0c5970ca45ec45109092c283c6dfa30e => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:05.370703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:05.371743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:05.372408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:05.412506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:05.413747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:05.555661 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3610/7198] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:05.565608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:05.567279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:05.768995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe6c59-b1f0-42d5-b346-a12b0bc54b50 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:05.782093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686819-b9be-4884-a986-302f462d519c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:05.783671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686819-b9be-4884-a986-302f462d519c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:05.786207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686819-b9be-4884-a986-302f462d519c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:05.786856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686819-b9be-4884-a986-302f462d519c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:05.804016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686819-b9be-4884-a986-302f462d519c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:05.805872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686819-b9be-4884-a986-302f462d519c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:05.830034 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3589/7199] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:06.966700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:06.968505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:07.006905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375d265-ca54-49eb-a956-5d2c55ac3fd5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:07.016358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:07.017316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:07.017779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:07.018256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] PATH_INFO: `/v3/projects/9631ff6508ab4fc78dd51f95c9e8ab86` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:07.019861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] RBAC: Authorizing `identity:delete_project(project_id=9631ff6508ab4fc78dd51f95c9e8ab86)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:07.024255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:07.231211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9631ff6508ab4fc78dd51f95c9e8ab86', 'request_id': 'req-4e23ae53-4bc6-4011-a218-f9d1358328de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:07.250930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9631ff6508ab4fc78dd51f95c9e8ab86', 'request_id': 'req-4e23ae53-4bc6-4011-a218-f9d1358328de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:07.365049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9631ff6508ab4fc78dd51f95c9e8ab86', 'request_id': 'req-4e23ae53-4bc6-4011-a218-f9d1358328de'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:07.369031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:07.390578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] The token cache is being invalidate because project 9631ff6508ab4fc78dd51f95c9e8ab86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:07.390578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:07.391489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4e23ae53-4bc6-4011-a218-f9d1358328de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:07.393637 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3611/7200] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:06 2022] DELETE /identity/v3/projects/9631ff6508ab4fc78dd51f95c9e8ab86 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:07.399167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ceb6f-8a97-4242-99c2-677791ef0a17 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:07.402337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ceb6f-8a97-4242-99c2-677791ef0a17 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:07.402714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ceb6f-8a97-4242-99c2-677791ef0a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:07.450423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-776ceb6f-8a97-4242-99c2-677791ef0a17 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:07.454728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-776ceb6f-8a97-4242-99c2-677791ef0a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:07.520565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:07.606020 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3590/7201] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:07.607109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab99d-8da7-46eb-9829-947f5fc02546 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:07.607398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab99d-8da7-46eb-9829-947f5fc02546 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:07.611215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab99d-8da7-46eb-9829-947f5fc02546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:07.633912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c9dab99d-8da7-46eb-9829-947f5fc02546 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:07.635788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c9dab99d-8da7-46eb-9829-947f5fc02546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:07.647058 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3612/7202] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:07.651433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ceb6f-8a97-4242-99c2-677791ef0a17 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:07.666971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ceb6f-8a97-4242-99c2-677791ef0a17 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:07.680130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:07.682585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:07.682585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:07.682585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:07.682585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:01:07.682585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:07.688356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:07.708776 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3591/7203] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:01:07.713676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab99d-8da7-46eb-9829-947f5fc02546 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:07.726543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab99d-8da7-46eb-9829-947f5fc02546 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:07.734374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:07.735556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:07.735998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:07.736465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:07.737705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:07.746444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:07.885948 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3613/7204] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:07 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:07.889957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:07.911271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c33b3-5c35-49a4-a67b-9ecf4bb69df2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:08.141004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:08.142887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:08.146112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:08.146112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:08.146112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:08.154372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:08.300629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3592/7205] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:07 2022] POST /identity/v3/users => generated 286 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:08.307558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:08.343369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68959283-5c96-45d1-837d-f883a7996477 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:08.372532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:08.384883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:08.385891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:08.388880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:08.389792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:08.395333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:08.740344 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3614/7206] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:08.744827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:08.758995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932052f-af08-4bea-b8ae-cfc4bbf39851 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:08.772314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0734a6-ecb5-4cfb-b272-af09eb687a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:08.774264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0734a6-ecb5-4cfb-b272-af09eb687a26 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:08.774264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0734a6-ecb5-4cfb-b272-af09eb687a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:08.774264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0734a6-ecb5-4cfb-b272-af09eb687a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:08.776146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0734a6-ecb5-4cfb-b272-af09eb687a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:08.777920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0734a6-ecb5-4cfb-b272-af09eb687a26 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:08.813195 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3593/7207] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:08.814337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:08.828596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13bb5-2b0d-4643-a18d-7512036a08ff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:08.863023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:08.864004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:08.865733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:08.866297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] PATH_INFO: `/v3/projects/5457b9c9e4084f85b9ebcf4bb5fdd020/users/a37db16d382e46658a98f92bce7a08af/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:08.910324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=5457b9c9e4084f85b9ebcf4bb5fdd020, user_id=a37db16d382e46658a98f92bce7a08af, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:08.913133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:09.006804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3615/7208] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:08 2022] PUT /identity/v3/projects/5457b9c9e4084f85b9ebcf4bb5fdd020/users/a37db16d382e46658a98f92bce7a08af/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:09.017374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c059b0c-5c45-4d91-a835-6e2b20201d85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:09.018111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c059b0c-5c45-4d91-a835-6e2b20201d85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:09.018538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c059b0c-5c45-4d91-a835-6e2b20201d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:09.058314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8c059b0c-5c45-4d91-a835-6e2b20201d85 None None] MFA Rules not processed for user `a37db16d382e46658a98f92bce7a08af`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:09.060332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8c059b0c-5c45-4d91-a835-6e2b20201d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:09.206497 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3594/7209] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:09.211006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:09.339103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc9e10-6de5-4d48-b9ea-fc107cb56cde admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:09.347702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:09.348749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:09.349246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:09.349670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:09.350834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:09.353271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:09.494266 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3616/7210] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:09 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:09.498189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c059b0c-5c45-4d91-a835-6e2b20201d85 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:09.518953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c059b0c-5c45-4d91-a835-6e2b20201d85 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:09.601385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:09.726247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:09.727048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:09.727614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:09.728927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:09.730134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:09.732260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:09.832217 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3595/7211] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:09 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:09.836024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:09.866744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a941-4dd8-4ca2-95de-693eb0f89da7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:09.903946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:09.904583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:09.906817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:09.907960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:09.910328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:09.911015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:09.942508 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3617/7212] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:09.944216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:09.964887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8634e-e2ba-44d7-88a0-039cf4c4bde1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:09.995427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:09.996216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:09.996568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:09.996965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] PATH_INFO: `/v3/projects/711a7d34a09b4264b07db9301f02b5e2/users/6889bb6f0a124af186f2d03b37f92904/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:10.114887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711a7d34a09b4264b07db9301f02b5e2, user_id=6889bb6f0a124af186f2d03b37f92904, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:10.120818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:10.241410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3596/7213] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:09 2022] PUT /identity/v3/projects/711a7d34a09b4264b07db9301f02b5e2/users/6889bb6f0a124af186f2d03b37f92904/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:10.242633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:10.257863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fe5d1-b98e-4a23-99b1-2a127c6acf22 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:10.392035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d8312-1ade-4546-99e5-53796cb3d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:10.392941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8312-1ade-4546-99e5-53796cb3d0bc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:10.396788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8312-1ade-4546-99e5-53796cb3d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:10.397192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d8312-1ade-4546-99e5-53796cb3d0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:10.397967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d8312-1ade-4546-99e5-53796cb3d0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:10.399751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d8312-1ade-4546-99e5-53796cb3d0bc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:10.404412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:10.421294 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3618/7214] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:10.424589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:10.454329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10d1d8-66d5-40c1-b370-a679c067e4d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:10.460175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:10.460877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:10.461209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:10.461446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] PATH_INFO: `/v3/projects/711a7d34a09b4264b07db9301f02b5e2/users/6889bb6f0a124af186f2d03b37f92904/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:10.465452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=711a7d34a09b4264b07db9301f02b5e2, user_id=6889bb6f0a124af186f2d03b37f92904, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:10.466847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:10.496535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60843738-cf36-42f2-8126-f176038030ba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:10.500289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60843738-cf36-42f2-8126-f176038030ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:10.500289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60843738-cf36-42f2-8126-f176038030ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:10.506921 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3597/7215] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:10 2022] PUT /identity/v3/projects/711a7d34a09b4264b07db9301f02b5e2/users/6889bb6f0a124af186f2d03b37f92904/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:10.560469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60843738-cf36-42f2-8126-f176038030ba None None] MFA Rules not processed for user `6889bb6f0a124af186f2d03b37f92904`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:10.562554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60843738-cf36-42f2-8126-f176038030ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:10.679567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3619/7216] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:10.963690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:10.965494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:11.062834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e3194-ef39-4432-9046-1cad4cfd2caa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:11.074299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa528-5e3b-4352-952c-fb5b4c1fa498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:11.075371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa528-5e3b-4352-952c-fb5b4c1fa498 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:11.077683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa528-5e3b-4352-952c-fb5b4c1fa498 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:11.077683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa528-5e3b-4352-952c-fb5b4c1fa498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:11.112801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fa528-5e3b-4352-952c-fb5b4c1fa498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:11.114986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fa528-5e3b-4352-952c-fb5b4c1fa498 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:11.139216 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3598/7217] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:12.658022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60843738-cf36-42f2-8126-f176038030ba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:12.827857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60843738-cf36-42f2-8126-f176038030ba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:12.858545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:12.859310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:12.859592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:12.859899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] PATH_INFO: `/v3/users/a37db16d382e46658a98f92bce7a08af` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:12.863998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37db16d382e46658a98f92bce7a08af)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:12.870335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:13.153370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37db16d382e46658a98f92bce7a08af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:13.167941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37db16d382e46658a98f92bce7a08af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:13.168834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37db16d382e46658a98f92bce7a08af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:13.183738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37db16d382e46658a98f92bce7a08af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:13.278136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37db16d382e46658a98f92bce7a08af'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:13.289022 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3620/7218] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:12 2022] DELETE /identity/v3/users/a37db16d382e46658a98f92bce7a08af => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:13.292773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:13.292773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:13.292773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:13.331951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:13.333521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:13.552851 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3599/7219] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:13.569804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:13.578462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:13.590353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:13.690097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5055833-e555-4a17-a917-f73201102ad5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:13.695168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:13.695891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:13.696238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:13.696667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:13.709974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:13.711709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:13.738152 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3621/7220] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:14.374157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:14.375821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:14.389467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84220d5c-db17-4e65-94e3-82e03bccb964 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:14.400167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:14.400837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:14.401122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:14.401401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] PATH_INFO: `/v3/projects/5457b9c9e4084f85b9ebcf4bb5fdd020` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:14.402593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5457b9c9e4084f85b9ebcf4bb5fdd020)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:14.404522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:14.421687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:14.527097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5457b9c9e4084f85b9ebcf4bb5fdd020', 'request_id': 'req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:14.542248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5457b9c9e4084f85b9ebcf4bb5fdd020', 'request_id': 'req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:14.615865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5457b9c9e4084f85b9ebcf4bb5fdd020', 'request_id': 'req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:14.645815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] The token cache is being invalidate because project 5457b9c9e4084f85b9ebcf4bb5fdd020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:14.647709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:14.648726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:14.652618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3600/7221] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:14 2022] DELETE /identity/v3/projects/5457b9c9e4084f85b9ebcf4bb5fdd020 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:14.656422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:14.669280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ccfa-cf52-47b9-8da1-c0f15cbe3634 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:14.752678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:14.753734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:14.754149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:14.754499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] PATH_INFO: `/v3/users/6889bb6f0a124af186f2d03b37f92904` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:14.755743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6889bb6f0a124af186f2d03b37f92904)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:14.758049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:14.961489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6889bb6f0a124af186f2d03b37f92904'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:14.972707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6889bb6f0a124af186f2d03b37f92904'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:14.973535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6889bb6f0a124af186f2d03b37f92904'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:15.000140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6889bb6f0a124af186f2d03b37f92904'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:15.099292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b1bb7b6-1dee-45ff-bfbc-0d828c8465f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6889bb6f0a124af186f2d03b37f92904'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:15.115759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3622/7222] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:14 2022] DELETE /identity/v3/users/6889bb6f0a124af186f2d03b37f92904 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:15.768131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:15.770180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:15.785076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f05d1-5891-4fb2-a893-e0a7fac880fd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:15.884923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:15.885943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:15.886380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:15.886858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] PATH_INFO: `/v3/projects/711a7d34a09b4264b07db9301f02b5e2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:15.888183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711a7d34a09b4264b07db9301f02b5e2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:15.890296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:16.024128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711a7d34a09b4264b07db9301f02b5e2', 'request_id': 'req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:16.031984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711a7d34a09b4264b07db9301f02b5e2', 'request_id': 'req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:16.113859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711a7d34a09b4264b07db9301f02b5e2', 'request_id': 'req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:16.148711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] The token cache is being invalidate because project 711a7d34a09b4264b07db9301f02b5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:16.150557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:16.150557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5fc41cdb-7860-448c-8dcc-b089c8f8dd20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:16.153195 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3601/7223] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:15 2022] DELETE /identity/v3/projects/711a7d34a09b4264b07db9301f02b5e2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:16.157931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806f9f-1b39-44e8-9584-aeb2fe9ec417 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.158588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806f9f-1b39-44e8-9584-aeb2fe9ec417 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.158588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806f9f-1b39-44e8-9584-aeb2fe9ec417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:16.192533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d6806f9f-1b39-44e8-9584-aeb2fe9ec417 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:16.193928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d6806f9f-1b39-44e8-9584-aeb2fe9ec417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:16.237079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:16.294043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3623/7224] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:16.296088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ba8ef-99a6-4529-b36f-c9bc2469f713 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.296452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ba8ef-99a6-4529-b36f-c9bc2469f713 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.296802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ba8ef-99a6-4529-b36f-c9bc2469f713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:16.381116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-869ba8ef-99a6-4529-b36f-c9bc2469f713 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:16.386863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-869ba8ef-99a6-4529-b36f-c9bc2469f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:16.410846 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3602/7225] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:16.412167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6806f9f-1b39-44e8-9584-aeb2fe9ec417 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:16.424748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6806f9f-1b39-44e8-9584-aeb2fe9ec417 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:16.440073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:16.440727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.441020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.441484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:16.442822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:01:16.447215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:16.447405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:16.483872 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3624/7226] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:01:16.484571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ba8ef-99a6-4529-b36f-c9bc2469f713 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:16.502523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ba8ef-99a6-4529-b36f-c9bc2469f713 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:16.516769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:16.517766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.517766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.518197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:16.518861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:16.526418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:16.663113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3603/7227] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:16 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:16.667330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:16.679060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cc01a-a352-46aa-bd82-8f066608a1e8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:16.748677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:16.749235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.749515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.749786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:16.750601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:16.752950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:16.861132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3625/7228] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:16 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:16.865848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:16.874719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:16.881468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648a7c0-d464-4fdf-8335-ebbb314a82a9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:16.887257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:16.888070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.889364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.889364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:16.889674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:16.891739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:16.908266 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3604/7229] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:16.912227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:16.926452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd99ac-118a-426f-a93f-1cba7b42a770 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:16.933776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff164ba4-0c7b-4141-934d-a4bb0c51ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:16.934677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164ba4-0c7b-4141-934d-a4bb0c51ff41 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.935146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164ba4-0c7b-4141-934d-a4bb0c51ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.936344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164ba4-0c7b-4141-934d-a4bb0c51ff41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:16.937309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff164ba4-0c7b-4141-934d-a4bb0c51ff41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:16.939405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff164ba4-0c7b-4141-934d-a4bb0c51ff41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:16.952590 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3626/7230] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:16.956544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:16.969254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbee0bf-605e-41e1-be6c-b05cb1f0b3b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:16.974255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:16.975003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:16.975287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:16.975622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] PATH_INFO: `/v3/projects/fe93e8cc0b7b4209986c16f9cd3f4c31/users/e45553ff32fb47f0ab3a7229831baf3e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:17.036472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe93e8cc0b7b4209986c16f9cd3f4c31, user_id=e45553ff32fb47f0ab3a7229831baf3e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:17.039556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:17.145017 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3605/7231] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:16 2022] PUT /identity/v3/projects/fe93e8cc0b7b4209986c16f9cd3f4c31/users/e45553ff32fb47f0ab3a7229831baf3e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:17.159957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799bb5d-b295-4058-b495-8bd583a70509 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:17.160441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799bb5d-b295-4058-b495-8bd583a70509 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:17.160563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799bb5d-b295-4058-b495-8bd583a70509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:17.219072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8799bb5d-b295-4058-b495-8bd583a70509 None None] MFA Rules not processed for user `e45553ff32fb47f0ab3a7229831baf3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:17.225448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8799bb5d-b295-4058-b495-8bd583a70509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:17.323487 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3627/7232] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:17.327472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:17.452202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b296882-dde0-4116-bae8-e965f8638746 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:17.456809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:17.457908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:17.462255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:17.462255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:17.462255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:17.462255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:17.538806 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3606/7233] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:17 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:17.543711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799bb5d-b295-4058-b495-8bd583a70509 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:17.558899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799bb5d-b295-4058-b495-8bd583a70509 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:17.583982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:17.647970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:17.648789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:17.649173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:17.649588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:17.650503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:17.652695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:17.758422 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3628/7234] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:17 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:17.763670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:17.780580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850061-0cf8-4bdc-b919-f81ae86c23c9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:17.793152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:17.793936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:17.794420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:17.794700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:17.795374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:17.796975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:17.820766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3607/7235] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:17.822465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:17.838503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29d43b-9533-40c5-8bcf-abb9546ec5b2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:17.849539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:17.850764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:17.854205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:17.854612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] PATH_INFO: `/v3/projects/03a10549c4b8446d89fb657dcd3fe3c9/users/b1c018ff4555416791105403161a403c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:17.891121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a10549c4b8446d89fb657dcd3fe3c9, user_id=b1c018ff4555416791105403161a403c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:17.903888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:18.011335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3629/7236] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:17 2022] PUT /identity/v3/projects/03a10549c4b8446d89fb657dcd3fe3c9/users/b1c018ff4555416791105403161a403c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:01:18.015146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:18.036209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105347e-26a2-418a-b1fe-2fa2ef35b80f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:18.153076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b919e5b-6872-4db2-b55a-9f625d5943c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:18.153975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919e5b-6872-4db2-b55a-9f625d5943c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:18.154385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919e5b-6872-4db2-b55a-9f625d5943c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:18.154807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b919e5b-6872-4db2-b55a-9f625d5943c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:18.155613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b919e5b-6872-4db2-b55a-9f625d5943c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:18.158153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b919e5b-6872-4db2-b55a-9f625d5943c9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:18.170613 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3608/7237] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:18.174475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:18.187726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f587c0-133e-4b59-8a80-36cff029c273 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:18.193756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:18.194764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:18.195147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:18.197783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] PATH_INFO: `/v3/projects/03a10549c4b8446d89fb657dcd3fe3c9/users/b1c018ff4555416791105403161a403c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:18.200541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a10549c4b8446d89fb657dcd3fe3c9, user_id=b1c018ff4555416791105403161a403c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:18.203314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:18.218103 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3630/7238] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:18 2022] PUT /identity/v3/projects/03a10549c4b8446d89fb657dcd3fe3c9/users/b1c018ff4555416791105403161a403c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:18.228997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165918f4-2345-4bd3-9b42-28de6fb14031 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:18.228997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165918f4-2345-4bd3-9b42-28de6fb14031 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:18.228997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165918f4-2345-4bd3-9b42-28de6fb14031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:18.279465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-165918f4-2345-4bd3-9b42-28de6fb14031 None None] MFA Rules not processed for user `b1c018ff4555416791105403161a403c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:18.281649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-165918f4-2345-4bd3-9b42-28de6fb14031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:18.324661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:18.380851 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3609/7239] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:18.771560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:18.773329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:18.912828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d8c93-57a9-4e55-a001-8292276739c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:18.925107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7df3-c2a7-4847-9690-1e53bfbb90e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:18.928429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7df3-c2a7-4847-9690-1e53bfbb90e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:18.929323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7df3-c2a7-4847-9690-1e53bfbb90e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:18.931511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7df3-c2a7-4847-9690-1e53bfbb90e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:18.951885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7df3-c2a7-4847-9690-1e53bfbb90e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:18.955693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7df3-c2a7-4847-9690-1e53bfbb90e2 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:18.983198 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3631/7240] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:19.186804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165918f4-2345-4bd3-9b42-28de6fb14031 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:19.359721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165918f4-2345-4bd3-9b42-28de6fb14031 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:19.365441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:19.366439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:19.366733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:19.367018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] PATH_INFO: `/v3/users/e45553ff32fb47f0ab3a7229831baf3e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:19.368861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45553ff32fb47f0ab3a7229831baf3e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:19.371483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:19.583618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45553ff32fb47f0ab3a7229831baf3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:19.584304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45553ff32fb47f0ab3a7229831baf3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:19.656429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45553ff32fb47f0ab3a7229831baf3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:19.657379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45553ff32fb47f0ab3a7229831baf3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:19.668378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45553ff32fb47f0ab3a7229831baf3e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:19.718837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3610/7241] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:19 2022] DELETE /identity/v3/users/e45553ff32fb47f0ab3a7229831baf3e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:19.723392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:19.724341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:19.724623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:19.770689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:19.771932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:19.892720 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3632/7242] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:19.943915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:19.943915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:20.052005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:20.068516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac375-b4df-4959-b776-cd9f0c9e5ee8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:20.073440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:20.074316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:20.074755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:20.075501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:20.088427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:20.090221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:20.153753 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3611/7243] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:21.283354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:21.286338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:21.333971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f35488-e90a-4a3c-8a81-de8bf62b875f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:21.358727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:21.361043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:21.362491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:21.363492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] PATH_INFO: `/v3/projects/fe93e8cc0b7b4209986c16f9cd3f4c31` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:21.368786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe93e8cc0b7b4209986c16f9cd3f4c31)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:21.374844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:21.422114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:21.621531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe93e8cc0b7b4209986c16f9cd3f4c31', 'request_id': 'req-608ce837-5f7a-4e87-8800-91a274b4061f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:21.621531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe93e8cc0b7b4209986c16f9cd3f4c31', 'request_id': 'req-608ce837-5f7a-4e87-8800-91a274b4061f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:21.773621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe93e8cc0b7b4209986c16f9cd3f4c31', 'request_id': 'req-608ce837-5f7a-4e87-8800-91a274b4061f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:21.798727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] The token cache is being invalidate because project fe93e8cc0b7b4209986c16f9cd3f4c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:21.799024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:21.799813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:21.804271 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3633/7244] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:21 2022] DELETE /identity/v3/projects/fe93e8cc0b7b4209986c16f9cd3f4c31 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:21.810362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:21.817398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523d29f-ca5f-446e-86e0-71bd0a76fce2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:21.908560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:21.909209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:21.909632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:21.909910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] PATH_INFO: `/v3/users/b1c018ff4555416791105403161a403c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:21.911230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c018ff4555416791105403161a403c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:21.913137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:22.149569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c018ff4555416791105403161a403c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:22.150414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c018ff4555416791105403161a403c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:22.236832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c018ff4555416791105403161a403c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:22.237884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c018ff4555416791105403161a403c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:22.250682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e409d726-1712-4749-b053-50e57f4501a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c018ff4555416791105403161a403c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:22.273870 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3612/7245] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:21 2022] DELETE /identity/v3/users/b1c018ff4555416791105403161a403c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:22.895399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:22.897629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:22.919917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ce837-5f7a-4e87-8800-91a274b4061f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:23.038909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:23.039580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.039843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.040994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] PATH_INFO: `/v3/projects/03a10549c4b8446d89fb657dcd3fe3c9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.042172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a10549c4b8446d89fb657dcd3fe3c9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:23.044371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:23.186570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a10549c4b8446d89fb657dcd3fe3c9', 'request_id': 'req-59e5c665-4119-4455-9136-e58e626b56cc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:23.202108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a10549c4b8446d89fb657dcd3fe3c9', 'request_id': 'req-59e5c665-4119-4455-9136-e58e626b56cc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:23.272424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a10549c4b8446d89fb657dcd3fe3c9', 'request_id': 'req-59e5c665-4119-4455-9136-e58e626b56cc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:23.294347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] The token cache is being invalidate because project 03a10549c4b8446d89fb657dcd3fe3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:23.295411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:23.296599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-59e5c665-4119-4455-9136-e58e626b56cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:23.299490 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3634/7246] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:22 2022] DELETE /identity/v3/projects/03a10549c4b8446d89fb657dcd3fe3c9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:23.304194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12eafb7-dc61-4785-9728-869137e1cdb3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.305243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12eafb7-dc61-4785-9728-869137e1cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.308358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12eafb7-dc61-4785-9728-869137e1cdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.346043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e12eafb7-dc61-4785-9728-869137e1cdb3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:23.348305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e12eafb7-dc61-4785-9728-869137e1cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:23.437539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3613/7247] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:23.445192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59d239-b8e4-433e-812a-ab26a4b17047 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.445546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59d239-b8e4-433e-812a-ab26a4b17047 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.445823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59d239-b8e4-433e-812a-ab26a4b17047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.501356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7a59d239-b8e4-433e-812a-ab26a4b17047 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:23.501356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7a59d239-b8e4-433e-812a-ab26a4b17047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:23.519599 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3635/7248] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:23.520657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12eafb7-dc61-4785-9728-869137e1cdb3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:23.529520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:23.534237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12eafb7-dc61-4785-9728-869137e1cdb3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:23.541796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:23.543165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.543728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.544206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.545075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:01:23.545683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:23.548411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:23.564113 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3614/7249] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:01:23.570211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59d239-b8e4-433e-812a-ab26a4b17047 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:23.580558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59d239-b8e4-433e-812a-ab26a4b17047 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:23.585751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:23.586474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.587329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.587685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.588955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:23.590923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:23.637890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:23.650773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:23.770226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:23.770395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dac8b3-0254-4c7f-a12e-de9946ab16ec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:23.770503 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3636/7250] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:23 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:23.770593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:23.770593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.770593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.770593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.772061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:23.772580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:23.844618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b9ca-0fac-4a53-bf4b-d2cfcb63f8b8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:23.851268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:23.852260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.853189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.853697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.854708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:23.857348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:23.883377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:23.883377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:23.895057 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3615/7251] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:23.950732 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3637/7252] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:23 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:23.954957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:23.966482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8c71-bf90-4c85-bd00-3c94719f3053 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:23.977262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:23.978585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:23.978936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:23.979332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:23.980262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:23.981952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:23.995784 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3616/7253] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:24.000180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.013126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ad4c6-39ea-4239-8c46-e9bd2a694c3f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.016718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9845c69-a13d-4685-ad1f-8469119555c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.017347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845c69-a13d-4685-ad1f-8469119555c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.017633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845c69-a13d-4685-ad1f-8469119555c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.017906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9845c69-a13d-4685-ad1f-8469119555c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.018595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9845c69-a13d-4685-ad1f-8469119555c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.020299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9845c69-a13d-4685-ad1f-8469119555c4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:24.033409 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3638/7254] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:24.037207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.091642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff4969-0837-4334-9d2a-db9229b33b9e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.110495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.110968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.113486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.113911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] PATH_INFO: `/v3/projects/ad5e250abd3042e4b9b64e17659f16d1/users/ca2b9006b941440f9bf397638110a809/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.147511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5e250abd3042e4b9b64e17659f16d1, user_id=ca2b9006b941440f9bf397638110a809, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.153208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:24.257925 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3617/7255] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:24 2022] PUT /identity/v3/projects/ad5e250abd3042e4b9b64e17659f16d1/users/ca2b9006b941440f9bf397638110a809/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:24.269042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.269333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.269612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.297849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] MFA Rules not processed for user `ca2b9006b941440f9bf397638110a809`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:24.299212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:24.380049 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3639/7256] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:24.385142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.456404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.458261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:24.465425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:24.491577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc0134-71f5-4a39-90e3-6f315c03668d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.499424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.500340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.501428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.501428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.502264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.504632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:24.553255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed03fd-7148-4262-be2b-f375490eecff None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.558591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.559231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.559521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.559788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] PATH_INFO: `/v3/users/e0401a2d038a4944b9cac15b528fb2c0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.561019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0401a2d038a4944b9cac15b528fb2c0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.563688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:24.575058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:24.629245 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3618/7257] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:24 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:24.631647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.696214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab84a-cfb5-4f78-b03e-bbb459e54b2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.700949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.701513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.701822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.702137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.702774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.704719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:24.778833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0401a2d038a4944b9cac15b528fb2c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:24.785946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0401a2d038a4944b9cac15b528fb2c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:24.786713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0401a2d038a4944b9cac15b528fb2c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:24.799364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0401a2d038a4944b9cac15b528fb2c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:24.818926 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3619/7258] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:24 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:24.820192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.821913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:24.834734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8777-0061-457b-8f6b-b56d791a93cd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.840191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.840809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.841094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.841372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.842026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.843655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:24.854901 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3620/7259] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:24.858743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.868346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a9d3f-bb0f-4bcc-b058-9cf600e1aaf3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.871991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9e8535d7-c821-408d-9e5d-e2120c5a38c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0401a2d038a4944b9cac15b528fb2c0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:24.873207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.873824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.874143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.874444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.875077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.876663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:24.879194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3640/7260] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:24 2022] DELETE /identity/v3/users/e0401a2d038a4944b9cac15b528fb2c0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:24.886940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.887332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.887694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.891055 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3621/7261] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:24.891937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.906713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceca49-d421-409c-94b6-25377898d381 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:24.909772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:24.911102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:24.972516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2bd57-823f-47dc-9d13-85ec4957f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:24.973288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2bd57-823f-47dc-9d13-85ec4957f0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:24.973605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2bd57-823f-47dc-9d13-85ec4957f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:24.973887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2bd57-823f-47dc-9d13-85ec4957f0f7 admin admin] PATH_INFO: `/v3/projects/7de53e41bc514309973041ac1c08e1dc/users/07e7193bff064efe87e326062cafb567/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:24.980186 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3641/7262] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:24.989998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:24.991375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:24.994389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2bd57-823f-47dc-9d13-85ec4957f0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de53e41bc514309973041ac1c08e1dc, user_id=07e7193bff064efe87e326062cafb567, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:24.996965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2bd57-823f-47dc-9d13-85ec4957f0f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.052778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf5dd3-cfb1-4042-806d-57faa77f0ed2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.059801 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3622/7263] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:24 2022] PUT /identity/v3/projects/7de53e41bc514309973041ac1c08e1dc/users/07e7193bff064efe87e326062cafb567/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:01:25.070189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87767513-4fa4-43a4-a810-721c7721841c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.070626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87767513-4fa4-43a4-a810-721c7721841c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.070908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87767513-4fa4-43a4-a810-721c7721841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.098170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:25.106119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.106295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-87767513-4fa4-43a4-a810-721c7721841c None None] MFA Rules not processed for user `07e7193bff064efe87e326062cafb567`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:25.107647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.107647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.107647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.107897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-87767513-4fa4-43a4-a810-721c7721841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:25.121334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:25.173176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.174676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.178090 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3623/7264] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:25.183253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87767513-4fa4-43a4-a810-721c7721841c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.188242 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3642/7265] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:25.194129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87767513-4fa4-43a4-a810-721c7721841c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.203731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.203731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.203731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.203731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.204133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.204133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.317740 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3624/7266] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:25 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:25.319022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.329304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6514caf-e96a-4c07-9d3d-0e4131bc81fe service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.388139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.388757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.389038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.389316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.389939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.391898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.444585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.445034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:25.458403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b6307-b745-4f82-9356-4781e43709be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.463992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.464649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.465114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.465394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] PATH_INFO: `/v3/projects/0dece13dfeed44d4984d269752687769` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.466737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dece13dfeed44d4984d269752687769)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.473445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.501057 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3643/7267] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:25 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:25.509781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.519512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b2f7d-aa76-4248-a44a-df3dd3f0f247 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.524761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.525357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.525644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.525922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.526599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.528194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.538316 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3644/7268] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:25.542894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.553196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20343-8634-4643-9980-d3ccb07a0944 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.558295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.558936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.559313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.559658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] PATH_INFO: `/v3/projects/ba2d5074feb2452e932b093b96781c8a/users/19662939fede4d3ab825519cb5ffffac/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.578022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2d5074feb2452e932b093b96781c8a, user_id=19662939fede4d3ab825519cb5ffffac, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.580852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.667319 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3645/7269] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:25 2022] PUT /identity/v3/projects/ba2d5074feb2452e932b093b96781c8a/users/19662939fede4d3ab825519cb5ffffac/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:25.675833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.689701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dece13dfeed44d4984d269752687769', 'request_id': 'req-f8f41c93-9bef-4a04-b007-3821e66546d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:25.698608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dece13dfeed44d4984d269752687769', 'request_id': 'req-f8f41c93-9bef-4a04-b007-3821e66546d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:25.748352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:25.763207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fecd83-8fb8-44f9-9d26-46e729a0b819 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.764248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dece13dfeed44d4984d269752687769', 'request_id': 'req-f8f41c93-9bef-4a04-b007-3821e66546d5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:25.769035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.769562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.769850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.770183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.770970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.773246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.785142 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3646/7270] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:25.788070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] The token cache is being invalidate because project 0dece13dfeed44d4984d269752687769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:25.788483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:25.789280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8f41c93-9bef-4a04-b007-3821e66546d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:25.790998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.791679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3625/7271] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:25 2022] DELETE /identity/v3/projects/0dece13dfeed44d4984d269752687769 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:01:25.792902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:25.796108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07630689-5041-486f-a889-1e48d8eaaaf7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.796396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07630689-5041-486f-a889-1e48d8eaaaf7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.796670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07630689-5041-486f-a889-1e48d8eaaaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.805807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15a62-869a-46a3-ba49-165b790fa123 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.810736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b61d9-79bb-4e4a-aa79-40c96928407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.811401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b61d9-79bb-4e4a-aa79-40c96928407d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.811689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b61d9-79bb-4e4a-aa79-40c96928407d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.811965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b61d9-79bb-4e4a-aa79-40c96928407d admin admin] PATH_INFO: `/v3/projects/ba2d5074feb2452e932b093b96781c8a/users/19662939fede4d3ab825519cb5ffffac/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.814139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b61d9-79bb-4e4a-aa79-40c96928407d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2d5074feb2452e932b093b96781c8a, user_id=19662939fede4d3ab825519cb5ffffac, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.816791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b61d9-79bb-4e4a-aa79-40c96928407d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:25.819928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-07630689-5041-486f-a889-1e48d8eaaaf7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:25.821624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-07630689-5041-486f-a889-1e48d8eaaaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:25.832252 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3647/7272] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:25 2022] PUT /identity/v3/projects/ba2d5074feb2452e932b093b96781c8a/users/19662939fede4d3ab825519cb5ffffac/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:25.847914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.847914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.847914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.887008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] MFA Rules not processed for user `19662939fede4d3ab825519cb5ffffac`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:25.888452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:25.923024 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3626/7273] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:25.924546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67ff9-d4ea-44ea-a5aa-8813d703f9fe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.924899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67ff9-d4ea-44ea-a5aa-8813d703f9fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.925621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67ff9-d4ea-44ea-a5aa-8813d703f9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.952048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16b67ff9-d4ea-44ea-a5aa-8813d703f9fe None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:25.953456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16b67ff9-d4ea-44ea-a5aa-8813d703f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:25.966156 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3627/7274] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:25.967319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b67ff9-d4ea-44ea-a5aa-8813d703f9fe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.982207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b67ff9-d4ea-44ea-a5aa-8813d703f9fe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:25.986098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3648/7275] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:25.989633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:25.990447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:25.990847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:25.991225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:25.992332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:01:25.992815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:25.993135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:25.994395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:25.995613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.003723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:26.011534 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3628/7276] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:01:26.020226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:26.033241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3da63-bb63-46ca-bc86-8a0faecfe74a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:26.047820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:26.048659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.049061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.049441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.050407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:26.053226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.075754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92aabc-3419-4d6c-8f76-1d6ede0b5a19 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:26.079537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:26.080193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.085951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.085951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.092378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:26.093840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.104762 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3649/7277] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:01:26.159256 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3629/7278] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:26 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:26.163474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:26.174876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aae421-0277-465b-ac33-64452622f619 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:26.249288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:26.249976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.250392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.255425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.255425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:26.255425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.264458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:26.348216 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3650/7279] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:26 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:26.352425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:26.377639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a27379-12b7-42e4-8c25-8cae73be0f8a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:26.383311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:26.384514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.384802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.385081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.385759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:26.387367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.399026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3630/7280] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:26.403221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:26.414356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a960f-a830-4c1d-b0af-3510c250aeb6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:26.422335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf09d21-5daa-4509-a874-dd3ae1660fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:26.423087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf09d21-5daa-4509-a874-dd3ae1660fbe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.423380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf09d21-5daa-4509-a874-dd3ae1660fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.423659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf09d21-5daa-4509-a874-dd3ae1660fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.424305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf09d21-5daa-4509-a874-dd3ae1660fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:26.426249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf09d21-5daa-4509-a874-dd3ae1660fbe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.437951 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3651/7281] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:26.442264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:26.453241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42c2bb-5594-4875-93e9-b32f0516d01b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:26.458611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:26.459310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.459596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.459876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] PATH_INFO: `/v3/projects/af9e110ae9754ac4a8ffc78a44d1ebb6/users/4485a26a98da49fc88cb28de19f6792c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.479917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9e110ae9754ac4a8ffc78a44d1ebb6, user_id=4485a26a98da49fc88cb28de19f6792c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:26.482670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.573237 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3631/7282] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:26 2022] PUT /identity/v3/projects/af9e110ae9754ac4a8ffc78a44d1ebb6/users/4485a26a98da49fc88cb28de19f6792c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:26.585153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.585645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.585932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.623431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] MFA Rules not processed for user `4485a26a98da49fc88cb28de19f6792c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:26.624849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:26.692397 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3652/7283] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:26.703614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:26.705367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:26.786808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed2f0-fd4a-4113-81be-5743f3ba3a5f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:26.792166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:26.792794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:26.793077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:26.793352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:26.802749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:26.804175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:26.814487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3632/7284] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:27.408103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:27.409870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:27.483715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28decc85-13bd-4b51-8aa4-e92cbd2f101a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:27.487571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:27.488187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:27.488472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:27.488750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:27.490526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:27.553268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:27.554765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:27.563827 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3653/7285] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:36.810659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:37.559692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=87 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:39.009220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:39.021774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9624c1a-0378-4964-912e-0b3923120e3d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:39.026159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:39.028414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:39.028414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:39.028414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:39.029029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:39.126438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:39.128421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:39.151114 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3633/7286] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:39.555163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:39.557615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:39.685693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236f74-1278-41b5-aa7d-9ee6b14e2420 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:39.697058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eacd6-4230-47bb-bf38-4f9b84851715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:39.697770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eacd6-4230-47bb-bf38-4f9b84851715 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:39.698043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eacd6-4230-47bb-bf38-4f9b84851715 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:39.698369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eacd6-4230-47bb-bf38-4f9b84851715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:39.700953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-184eacd6-4230-47bb-bf38-4f9b84851715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:39.792522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eacd6-4230-47bb-bf38-4f9b84851715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:39.794547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eacd6-4230-47bb-bf38-4f9b84851715 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:39.807711 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3654/7287] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:40.363901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:40.444571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71f0ce-42ac-4a7f-80bb-b7b500ebf912 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:40.455342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:40.456005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:40.456289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:40.459093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] PATH_INFO: `/v3/users/4485a26a98da49fc88cb28de19f6792c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:40.461137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4485a26a98da49fc88cb28de19f6792c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:40.466158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:40.684289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4485a26a98da49fc88cb28de19f6792c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:40.684960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4485a26a98da49fc88cb28de19f6792c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:40.782912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4485a26a98da49fc88cb28de19f6792c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:40.783745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4485a26a98da49fc88cb28de19f6792c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:40.798103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4485a26a98da49fc88cb28de19f6792c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:40.847313 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3634/7288] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:40 2022] DELETE /identity/v3/users/4485a26a98da49fc88cb28de19f6792c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:40.852895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:40.854136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:40.854390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:40.882690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:40.885370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:40.976140 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3655/7289] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:40.991521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:40.993584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:41.027203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:41.085823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15d3e3-279e-4e81-9179-1374ca429fa0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:41.092466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3261dae-ad36-418f-ac48-4c1af5b674dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:41.093239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3261dae-ad36-418f-ac48-4c1af5b674dd service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:41.093695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3261dae-ad36-418f-ac48-4c1af5b674dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:41.094163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3261dae-ad36-418f-ac48-4c1af5b674dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:41.112518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3261dae-ad36-418f-ac48-4c1af5b674dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:41.126163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3261dae-ad36-418f-ac48-4c1af5b674dd service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:41.134106 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3635/7290] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:41.441296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:41.443068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:41.480046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc184cc-b5fc-4ee0-bad6-6f85dc36dbf4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:41.492578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:41.494363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:41.505212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:41.505212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] PATH_INFO: `/v3/projects/af9e110ae9754ac4a8ffc78a44d1ebb6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:41.513708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9e110ae9754ac4a8ffc78a44d1ebb6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:41.517148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:41.707708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:41.724798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9e110ae9754ac4a8ffc78a44d1ebb6', 'request_id': 'req-2ff110fc-7774-469e-9da1-000f9571885f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:41.736470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9e110ae9754ac4a8ffc78a44d1ebb6', 'request_id': 'req-2ff110fc-7774-469e-9da1-000f9571885f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:41.889663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9e110ae9754ac4a8ffc78a44d1ebb6', 'request_id': 'req-2ff110fc-7774-469e-9da1-000f9571885f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:41.910410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] The token cache is being invalidate because project af9e110ae9754ac4a8ffc78a44d1ebb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:41.910968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:41.911800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2ff110fc-7774-469e-9da1-000f9571885f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:41.913752 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3656/7291] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:41 2022] DELETE /identity/v3/projects/af9e110ae9754ac4a8ffc78a44d1ebb6 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:41.920827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c671ac-362d-4e2f-938d-d11b900a6328 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:41.924762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c671ac-362d-4e2f-938d-d11b900a6328 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:41.924762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c671ac-362d-4e2f-938d-d11b900a6328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:41.955670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-56c671ac-362d-4e2f-938d-d11b900a6328 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:41.957221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-56c671ac-362d-4e2f-938d-d11b900a6328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:42.053969 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3636/7292] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:42.056102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb54c-61cb-4275-9369-20738114a176 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.056598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb54c-61cb-4275-9369-20738114a176 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.056875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb54c-61cb-4275-9369-20738114a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:42.099724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-551fb54c-61cb-4275-9369-20738114a176 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:42.101275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-551fb54c-61cb-4275-9369-20738114a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:42.114911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3657/7293] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:42.116281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c671ac-362d-4e2f-938d-d11b900a6328 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:42.134011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c671ac-362d-4e2f-938d-d11b900a6328 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:42.141480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:42.142422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.142858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.143276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:42.144084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:01:42.144545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:42.146400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:42.170263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3637/7294] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:01:42.170637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fb54c-61cb-4275-9369-20738114a176 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:42.193174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fb54c-61cb-4275-9369-20738114a176 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:42.199006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:42.203465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.203465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.203465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:42.203465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:42.203465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:42.359330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3658/7295] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:42 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:42.361060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:42.375612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a04586-316e-4438-bba3-4fd6ee498866 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:42.484746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:42.485376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.485658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.485935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:42.486642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:42.488693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:42.611636 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3638/7296] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:42 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:42.615720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:42.635636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaae8e-9d5d-4bbd-a80e-bba9f913014b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:42.662982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:42.663718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.664009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.664309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:42.664978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:42.667241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:42.696604 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3659/7297] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:42.697500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:42.709977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e67bc-9776-4430-8554-3a206c7b13da admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:42.719884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d1118-21db-4ae2-9df3-557479d9e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:42.720519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d1118-21db-4ae2-9df3-557479d9e7db admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.720803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d1118-21db-4ae2-9df3-557479d9e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.721080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d1118-21db-4ae2-9df3-557479d9e7db admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:42.721738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d1118-21db-4ae2-9df3-557479d9e7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:42.723397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d1118-21db-4ae2-9df3-557479d9e7db admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:42.739781 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3639/7298] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:42.742785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:42.758466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2725324-ec93-4823-90ef-bafad3ddbc42 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:42.773644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:42.775577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.775935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.777850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] PATH_INFO: `/v3/projects/f5eeacbb87cd495a99203f29ff4ac7dd/users/fa46e76aa154440abdf592e3dd68d107/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:42.823248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5eeacbb87cd495a99203f29ff4ac7dd, user_id=fa46e76aa154440abdf592e3dd68d107, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:42.829336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:42.985415 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3660/7299] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:42 2022] PUT /identity/v3/projects/f5eeacbb87cd495a99203f29ff4ac7dd/users/fa46e76aa154440abdf592e3dd68d107/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:42.998841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7faa05-14ad-4e7d-ba98-10583356b756 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:42.999321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7faa05-14ad-4e7d-ba98-10583356b756 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:42.999434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7faa05-14ad-4e7d-ba98-10583356b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:43.067263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ca7faa05-14ad-4e7d-ba98-10583356b756 None None] MFA Rules not processed for user `fa46e76aa154440abdf592e3dd68d107`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:43.070477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca7faa05-14ad-4e7d-ba98-10583356b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:43.099523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:43.199583 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3640/7300] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:43.203861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:43.330504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd13bb-4d56-4989-8867-134dfeaceaea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:43.337371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:43.339070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:43.339528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:43.343652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:43.343652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:43.344154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:43.462271 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3661/7301] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:43 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:43.472133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7faa05-14ad-4e7d-ba98-10583356b756 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:43.482744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7faa05-14ad-4e7d-ba98-10583356b756 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:43.630488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:43.631198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:43.631480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:43.631773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:43.632717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:43.635000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:43.761650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3641/7302] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:43 2022] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:43.765317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:43.777972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba8caa-d7a1-4e10-8078-fe09d7cac67d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:43.788374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:43.789054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:43.789795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:43.790187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:43.791476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:43.793803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:43.807797 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3662/7303] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:43.811991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:43.823869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb640b4-7571-4933-a6ad-c2c2f9ae1469 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:43.828585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:43.829197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:43.829475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:43.829746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] PATH_INFO: `/v3/projects/5250f6b591334a16a151e7d907f38863/users/5213ba20fb1e4be4b71312ef1a001b96/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:43.846834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5250f6b591334a16a151e7d907f38863, user_id=5213ba20fb1e4be4b71312ef1a001b96, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:43.849408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:43.959022 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3642/7304] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:43 2022] PUT /identity/v3/projects/5250f6b591334a16a151e7d907f38863/users/5213ba20fb1e4be4b71312ef1a001b96/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:43.965525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:43.978032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3d082-d11d-4f7f-b4f5-95b477cd381f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:43.997886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:44.038600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4631311-a0c6-47e8-8e04-574330e5e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:44.039253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4631311-a0c6-47e8-8e04-574330e5e752 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:44.039506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4631311-a0c6-47e8-8e04-574330e5e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:44.039793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4631311-a0c6-47e8-8e04-574330e5e752 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:44.040856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4631311-a0c6-47e8-8e04-574330e5e752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:44.042633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4631311-a0c6-47e8-8e04-574330e5e752 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:44.056595 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3663/7305] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:44.060057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:44.073269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eb62e-b706-4783-9876-cef372034f88 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:44.078073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:44.078842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:44.079206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:44.079483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] PATH_INFO: `/v3/projects/5250f6b591334a16a151e7d907f38863/users/5213ba20fb1e4be4b71312ef1a001b96/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:44.081814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5250f6b591334a16a151e7d907f38863, user_id=5213ba20fb1e4be4b71312ef1a001b96, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:44.084505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:44.099127 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3643/7306] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:44 2022] PUT /identity/v3/projects/5250f6b591334a16a151e7d907f38863/users/5213ba20fb1e4be4b71312ef1a001b96/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:44.108151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:44.108453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:44.108730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:44.143366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] MFA Rules not processed for user `5213ba20fb1e4be4b71312ef1a001b96`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:44.144589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:44.255972 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3664/7307] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:44.430390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:44.432122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:44.518771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebad53-a75a-452f-a2b6-f2a344ebbde5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:44.522407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4317a-5760-4b99-aa9c-bcc2adf0ca6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:44.523025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4317a-5760-4b99-aa9c-bcc2adf0ca6e service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:44.523307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4317a-5760-4b99-aa9c-bcc2adf0ca6e service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:44.523581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4317a-5760-4b99-aa9c-bcc2adf0ca6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:44.545683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:44.592359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4317a-5760-4b99-aa9c-bcc2adf0ca6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:44.593883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4317a-5760-4b99-aa9c-bcc2adf0ca6e service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:44.605290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3644/7308] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:46.512288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:46.513745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:46.703694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b015027-8cd4-4bce-a124-18353a764891 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:46.709859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:46.711201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:46.720524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:46.720524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] PATH_INFO: `/v3/users/ca2b9006b941440f9bf397638110a809` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:46.720524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2b9006b941440f9bf397638110a809)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:46.720524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:46.986066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2b9006b941440f9bf397638110a809'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:46.987580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:46.995688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2b9006b941440f9bf397638110a809'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:46.996788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2b9006b941440f9bf397638110a809'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:47.013927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2b9006b941440f9bf397638110a809'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:47.124113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2b9006b941440f9bf397638110a809'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:47.136532 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3665/7309] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:46 2022] DELETE /identity/v3/users/ca2b9006b941440f9bf397638110a809 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:47.139935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:47.139935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:47.139935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:47.166630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:47.168100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:47.241843 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3645/7310] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:47.251365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:47.252843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:47.352489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8878abf-66bb-4085-b65a-89d41dfea434 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:47.357733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:47.358558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:47.358913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:47.359260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:47.372318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:47.376441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:47.389322 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3666/7311] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:47.874112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:47.875879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:47.906736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900aa0b-f159-475a-acf9-e97bfb047a34 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:47.911895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:47.912666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:47.913054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:47.913434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] PATH_INFO: `/v3/projects/ad5e250abd3042e4b9b64e17659f16d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:47.914744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5e250abd3042e4b9b64e17659f16d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:47.917213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:48.054914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5e250abd3042e4b9b64e17659f16d1', 'request_id': 'req-e3191a15-6787-451e-b73c-0018ee86c5cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.055032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:48.055032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:48.058451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5e250abd3042e4b9b64e17659f16d1', 'request_id': 'req-e3191a15-6787-451e-b73c-0018ee86c5cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.080802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328299f7-eaf8-4285-ac36-dbed86c1894b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:48.117456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5e250abd3042e4b9b64e17659f16d1', 'request_id': 'req-e3191a15-6787-451e-b73c-0018ee86c5cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.135291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] The token cache is being invalidate because project ad5e250abd3042e4b9b64e17659f16d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:48.135668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.138513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.140345 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3646/7312] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:47 2022] DELETE /identity/v3/projects/ad5e250abd3042e4b9b64e17659f16d1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:48.144760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:48.146502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:48.167430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:48.168379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:48.168898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:48.169465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] PATH_INFO: `/v3/users/b01b6239b8a94b2791b537d9fb6a0085` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:48.171176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01b6239b8a94b2791b537d9fb6a0085)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:48.173651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:48.187357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191a15-6787-451e-b73c-0018ee86c5cb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:48.203281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:48.204196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:48.204658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:48.204935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] PATH_INFO: `/v3/users/07e7193bff064efe87e326062cafb567` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:48.206923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e7193bff064efe87e326062cafb567)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:48.208896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:48.500121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:48.507513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e7193bff064efe87e326062cafb567'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.507876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e7193bff064efe87e326062cafb567'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.530421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01b6239b8a94b2791b537d9fb6a0085'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.552142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01b6239b8a94b2791b537d9fb6a0085'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.552920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01b6239b8a94b2791b537d9fb6a0085'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.563938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:48.570739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01b6239b8a94b2791b537d9fb6a0085'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.584802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e7193bff064efe87e326062cafb567'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.585461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e7193bff064efe87e326062cafb567'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.596540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b0f8591e-e669-47ec-92fe-7fb15ae5aecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e7193bff064efe87e326062cafb567'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.617916 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3647/7313] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:48 2022] DELETE /identity/v3/users/07e7193bff064efe87e326062cafb567 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:48.666622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01b6239b8a94b2791b537d9fb6a0085'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:48.675982 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3667/7314] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:48 2022] DELETE /identity/v3/users/b01b6239b8a94b2791b537d9fb6a0085 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:48.681286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:48.681501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:48.681768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:48.718498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:48.719924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:48.831540 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3648/7315] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:48.843016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:48.844610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:48.981071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcc557-49e1-4688-b659-61407642cd0b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:48.985130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:48.985819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:48.986127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:48.986409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:49.014660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:49.020454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:49.052563 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3668/7316] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:49.376887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:49.378822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:49.412413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dbca3-7068-4517-b943-0a641a7078e7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:49.427190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:49.427867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:49.428150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:49.428427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] PATH_INFO: `/v3/projects/7de53e41bc514309973041ac1c08e1dc` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:49.430180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de53e41bc514309973041ac1c08e1dc)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:49.433463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:49.455241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:49.456763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:49.528703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c597b02-da82-4a62-b9eb-94ba656171d9 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:49.556605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:49.557275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:49.557563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:49.557841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] PATH_INFO: `/v3/projects/2da00e8c79804846a4c913cce8015690` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:49.562948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da00e8c79804846a4c913cce8015690)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:49.566675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:49.613663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de53e41bc514309973041ac1c08e1dc', 'request_id': 'req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.621149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de53e41bc514309973041ac1c08e1dc', 'request_id': 'req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.712097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de53e41bc514309973041ac1c08e1dc', 'request_id': 'req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.725323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da00e8c79804846a4c913cce8015690', 'request_id': 'req-b8986bd6-4901-43c2-bac9-1d19539dc9e8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.739575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da00e8c79804846a4c913cce8015690', 'request_id': 'req-b8986bd6-4901-43c2-bac9-1d19539dc9e8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.741212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] The token cache is being invalidate because project 7de53e41bc514309973041ac1c08e1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:49.741715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.743616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.745828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3649/7317] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:49 2022] DELETE /identity/v3/projects/7de53e41bc514309973041ac1c08e1dc => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:49.751310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:49.752987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:49.822435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:49.837136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da00e8c79804846a4c913cce8015690', 'request_id': 'req-b8986bd6-4901-43c2-bac9-1d19539dc9e8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.854079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] The token cache is being invalidate because project 2da00e8c79804846a4c913cce8015690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:49.854784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.855697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b8986bd6-4901-43c2-bac9-1d19539dc9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:49.862282 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3669/7318] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:49 2022] DELETE /identity/v3/projects/2da00e8c79804846a4c913cce8015690 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:01:49.862463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a8d57-fb32-41ea-8dc5-5c6b83db5573 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:49.864554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3725-8f00-4d10-98b5-a957ac522b05 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:49.865125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3725-8f00-4d10-98b5-a957ac522b05 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:49.865580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3725-8f00-4d10-98b5-a957ac522b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:49.898472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7f8f3725-8f00-4d10-98b5-a957ac522b05 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:49.900350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f8f3725-8f00-4d10-98b5-a957ac522b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:49.940741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:49.943502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:49.943502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:49.943502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] PATH_INFO: `/v3/users/19662939fede4d3ab825519cb5ffffac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:49.943502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19662939fede4d3ab825519cb5ffffac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:49.945626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:50.007901 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3670/7319] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:50.016725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c334-7757-4cc5-bb95-0eff3d0e7978 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.017254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c334-7757-4cc5-bb95-0eff3d0e7978 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.017636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5c334-7757-4cc5-bb95-0eff3d0e7978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.040257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9fd5c334-7757-4cc5-bb95-0eff3d0e7978 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:50.042094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9fd5c334-7757-4cc5-bb95-0eff3d0e7978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:50.059974 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3671/7320] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:50.061953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c334-7757-4cc5-bb95-0eff3d0e7978 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:50.072510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5c334-7757-4cc5-bb95-0eff3d0e7978 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:50.074899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:50.079443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:50.080365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.080696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.081042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.081923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:01:50.082375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:50.084251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:50.101360 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3672/7321] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:01:50.106292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:50.132021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19662939fede4d3ab825519cb5ffffac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:50.132944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19662939fede4d3ab825519cb5ffffac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:50.133364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d22a9-fae7-44ac-8665-99a3c4da0ebc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:50.140332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:50.141407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.141748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.142171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.142871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:50.145277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:50.237422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19662939fede4d3ab825519cb5ffffac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:50.239424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19662939fede4d3ab825519cb5ffffac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:50.249761 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3673/7322] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:50 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:50.250951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:50.252934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:50.254862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19662939fede4d3ab825519cb5ffffac'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:50.284520 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3650/7323] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:01:49 2022] DELETE /identity/v3/users/19662939fede4d3ab825519cb5ffffac => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:01:50.336597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce5182-4a66-410e-8ef2-34da5319d18c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:50.403905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:50.404638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.404998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.405346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.406201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:50.408194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:50.510365 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3674/7324] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:50 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:50.517026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:50.529196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4054e1-861a-4c19-a1a0-1a78b85d0ef6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:50.557553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:50.557553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.557553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.557553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.558602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:50.558602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:50.584973 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3651/7325] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:50.591561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:50.618718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec12db-acdf-4301-b422-fad57bf29141 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:50.624297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5927ecf-61c1-4e18-8391-5a1006793cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:50.625020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5927ecf-61c1-4e18-8391-5a1006793cbd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.625540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5927ecf-61c1-4e18-8391-5a1006793cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.625899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5927ecf-61c1-4e18-8391-5a1006793cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.626867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5927ecf-61c1-4e18-8391-5a1006793cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:50.629885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5927ecf-61c1-4e18-8391-5a1006793cbd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:50.642603 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3675/7326] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:50.648056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:50.668180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a0ed-5639-4d75-a599-20dcb5b1686d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:50.681734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:50.682598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.683484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.683828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] PATH_INFO: `/v3/projects/0109abe8e76e4e5e9f622e401f9921b0/users/0b5c1ca9fe7c4461a07baa70d73f04e7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.738095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0109abe8e76e4e5e9f622e401f9921b0, user_id=0b5c1ca9fe7c4461a07baa70d73f04e7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:50.749967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:50.865963 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3652/7327] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:50 2022] PUT /identity/v3/projects/0109abe8e76e4e5e9f622e401f9921b0/users/0b5c1ca9fe7c4461a07baa70d73f04e7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:50.871813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:50.872101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:50.872377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:50.898256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:50.899711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:50.943829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:50.946361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:50.990311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:51.010269 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3676/7328] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:51.022654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:51.024047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:51.030945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:51.065385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25f992-aabb-437f-94fa-66422091aabe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:51.071326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:51.072533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.080935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.080935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] PATH_INFO: `/v3/projects/ba2d5074feb2452e932b093b96781c8a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.080935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2d5074feb2452e932b093b96781c8a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:51.080935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:51.104519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6eeea9-cba3-4212-9eed-ebe4ebe2e3a5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:51.112303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332bafb-16f4-4ad1-a125-9c4285469c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:51.113027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332bafb-16f4-4ad1-a125-9c4285469c55 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.113313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332bafb-16f4-4ad1-a125-9c4285469c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.113586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332bafb-16f4-4ad1-a125-9c4285469c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.125658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332bafb-16f4-4ad1-a125-9c4285469c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:51.127202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332bafb-16f4-4ad1-a125-9c4285469c55 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:51.137805 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3677/7329] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:51.242489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2d5074feb2452e932b093b96781c8a', 'request_id': 'req-4c5f15f8-9f49-4d33-b500-e256997f3e2f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:51.250165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2d5074feb2452e932b093b96781c8a', 'request_id': 'req-4c5f15f8-9f49-4d33-b500-e256997f3e2f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:51.349036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2d5074feb2452e932b093b96781c8a', 'request_id': 'req-4c5f15f8-9f49-4d33-b500-e256997f3e2f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:51.361008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] The token cache is being invalidate because project ba2d5074feb2452e932b093b96781c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:01:51.361301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:51.361950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:01:51.363499 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3653/7330] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:01:50 2022] DELETE /identity/v3/projects/ba2d5074feb2452e932b093b96781c8a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:51.369707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d97bc1-b3bd-4588-9237-505035a0ce87 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.369995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d97bc1-b3bd-4588-9237-505035a0ce87 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.370320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d97bc1-b3bd-4588-9237-505035a0ce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.390904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-60d97bc1-b3bd-4588-9237-505035a0ce87 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:51.392102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-60d97bc1-b3bd-4588-9237-505035a0ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:51.499078 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3678/7331] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:51.531611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:51.534014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:51.617473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e487f-08e1-4ca9-8e46-22898bc1cecc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.618033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e487f-08e1-4ca9-8e46-22898bc1cecc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.618335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e487f-08e1-4ca9-8e46-22898bc1cecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.642492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b77e487f-08e1-4ca9-8e46-22898bc1cecc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:51.643980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b77e487f-08e1-4ca9-8e46-22898bc1cecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:51.658098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3679/7332] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:51.659637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e487f-08e1-4ca9-8e46-22898bc1cecc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:51.673035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e487f-08e1-4ca9-8e46-22898bc1cecc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:51.677930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f15f8-9f49-4d33-b500-e256997f3e2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:51.679368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:51.680160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.680561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.680941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.681934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:01:51.682392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:51.683431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:51.684250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.684678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.686163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.690767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:51.695756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:51.714006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3680/7333] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:01:51.723422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:51.736297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0312eb8-7d3c-417b-9823-f1b639cd4aec admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:51.743210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:51.744649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.745575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.746014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.754378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:51.754378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:51.783966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:51.785656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:51.802947 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3654/7334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:51.851898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:51.856522 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3681/7335] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:51 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:51.869225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffef98a-d171-4c72-8745-13a69539febe service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:51.888891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:51.943193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:51.943717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:51.944003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:51.944284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:51.944927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:51.948075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.053766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3655/7336] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:51 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:01:52.054729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.068177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46ef4-0c02-46b9-8efa-3890c09c0279 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:52.080450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:52.082220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.082591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.082943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.084946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:52.087488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.112137 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3682/7337] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:52.117958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.129135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21fcd-dd77-4cdc-896a-aca836c3552f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:52.134212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5addc4-5690-4c44-ba2d-bdeb0fb34a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:52.134825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5addc4-5690-4c44-ba2d-bdeb0fb34a4a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.135128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5addc4-5690-4c44-ba2d-bdeb0fb34a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.135371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5addc4-5690-4c44-ba2d-bdeb0fb34a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.136013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5addc4-5690-4c44-ba2d-bdeb0fb34a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:52.137590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5addc4-5690-4c44-ba2d-bdeb0fb34a4a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.148071 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3656/7338] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:52.153770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.164397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7243b18-4655-488f-bed9-76e9f205bf70 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:52.172981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:52.173901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.174556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.175008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] PATH_INFO: `/v3/projects/bd432ccf17244a268f41f836b2724bea/users/027bec92af9d4493a9f16df46ab0edbf/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.201452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd432ccf17244a268f41f836b2724bea, user_id=027bec92af9d4493a9f16df46ab0edbf, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:52.201452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.287311 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3683/7339] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:52 2022] PUT /identity/v3/projects/bd432ccf17244a268f41f836b2724bea/users/027bec92af9d4493a9f16df46ab0edbf/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:52.300183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cce96-5f6b-4b8f-8781-b9ffe2d765be None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.300549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cce96-5f6b-4b8f-8781-b9ffe2d765be None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.300758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cce96-5f6b-4b8f-8781-b9ffe2d765be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.329697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-640cce96-5f6b-4b8f-8781-b9ffe2d765be None None] MFA Rules not processed for user `027bec92af9d4493a9f16df46ab0edbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:52.331264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-640cce96-5f6b-4b8f-8781-b9ffe2d765be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:52.405756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3657/7340] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:01:52.408127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.439048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:52.485383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95dfc1-51ea-4b11-8cb5-850c10b49337 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:52.490375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:52.491034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.491444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.491725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.492357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:52.494863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.595865 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3684/7341] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:01:52 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:52.599693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cce96-5f6b-4b8f-8781-b9ffe2d765be None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.612367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cce96-5f6b-4b8f-8781-b9ffe2d765be None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:52.707924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:52.708724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.712374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.712374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.712374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:52.712374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.783045 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3658/7342] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:01:52 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:01:52.787253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.799855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bb29b-48e2-4dae-8ed9-aa5bcdf84633 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:52.805056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:52.805882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.807003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.807446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.808268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:52.810002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.824503 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3685/7343] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:01:52.829020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.842910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a058e38-4e33-47a1-aa23-4d48fa374a28 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:52.848038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:52.849206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:52.849585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:52.850200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] PATH_INFO: `/v3/projects/3d7850fab89246d5b3d94e04c2c22542/users/a9f894d305274b3782164558f3a00bda/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:52.860387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:52.881346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7850fab89246d5b3d94e04c2c22542, user_id=a9f894d305274b3782164558f3a00bda, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:52.887922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:52.966751 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3659/7344] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:52 2022] PUT /identity/v3/projects/3d7850fab89246d5b3d94e04c2c22542/users/a9f894d305274b3782164558f3a00bda/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:52.967776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:52.982313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85083b5-83d1-4644-874a-b65aee16e396 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:53.091017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81132-5242-4b0a-ab4d-dea8e894c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:53.091750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81132-5242-4b0a-ab4d-dea8e894c4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:53.092103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81132-5242-4b0a-ab4d-dea8e894c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:53.092517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81132-5242-4b0a-ab4d-dea8e894c4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:53.093425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc81132-5242-4b0a-ab4d-dea8e894c4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:53.097848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc81132-5242-4b0a-ab4d-dea8e894c4e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:53.108606 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3686/7345] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:01:53.113901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:53.129593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582c9d3-ebf9-4c97-b3ed-4876a632b34c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:53.143482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:53.144395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:53.144826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:53.145273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] PATH_INFO: `/v3/projects/3d7850fab89246d5b3d94e04c2c22542/users/a9f894d305274b3782164558f3a00bda/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:53.149640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7850fab89246d5b3d94e04c2c22542, user_id=a9f894d305274b3782164558f3a00bda, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:53.154539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:53.206306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce624d3-a17f-4c5a-9266-cc5eb9789e87 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:53.206668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce624d3-a17f-4c5a-9266-cc5eb9789e87 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:53.206868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce624d3-a17f-4c5a-9266-cc5eb9789e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:53.210760 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3660/7346] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:01:53 2022] PUT /identity/v3/projects/3d7850fab89246d5b3d94e04c2c22542/users/a9f894d305274b3782164558f3a00bda/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:01:53.264987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8ce624d3-a17f-4c5a-9266-cc5eb9789e87 None None] MFA Rules not processed for user `a9f894d305274b3782164558f3a00bda`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:53.266251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8ce624d3-a17f-4c5a-9266-cc5eb9789e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:53.361982 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3687/7347] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:01:53.385252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:53.387113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:53.510980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a23f5-bf6b-4316-95e0-90c42d84bc2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:53.529441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed3ec-2a61-4681-86e3-1d85df516626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:53.529441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed3ec-2a61-4681-86e3-1d85df516626 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:53.529441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed3ec-2a61-4681-86e3-1d85df516626 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:53.529441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed3ec-2a61-4681-86e3-1d85df516626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:53.553133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ed3ec-2a61-4681-86e3-1d85df516626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:53.557160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ed3ec-2a61-4681-86e3-1d85df516626 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:53.577685 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3661/7348] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:53.792639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce624d3-a17f-4c5a-9266-cc5eb9789e87 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:01:53.815435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce624d3-a17f-4c5a-9266-cc5eb9789e87 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:01:53.821256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee314f-b3bc-492a-95ea-6c2baf90e365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:01:53.823353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee314f-b3bc-492a-95ea-6c2baf90e365 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:53.824600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee314f-b3bc-492a-95ea-6c2baf90e365 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:53.825096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee314f-b3bc-492a-95ea-6c2baf90e365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:53.854398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:53.920328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee314f-b3bc-492a-95ea-6c2baf90e365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:01:53.922238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee314f-b3bc-492a-95ea-6c2baf90e365 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:01:53.939660 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3688/7349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:01:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:01:55.767435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:01:55.767991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:01:55.768188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:01:55.813005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] MFA Rules not processed for user `b28a5b73e4fa4ce0aadd144e09a6f977`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:01:55.814970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:01:55.981551 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3662/7350] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:00.243125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fade098-8b3d-4612-954b-20546cfc20e7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:00.243125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fade098-8b3d-4612-954b-20546cfc20e7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:00.243125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fade098-8b3d-4612-954b-20546cfc20e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:00.375558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8fade098-8b3d-4612-954b-20546cfc20e7 None None] MFA Rules not processed for user `0b5c1ca9fe7c4461a07baa70d73f04e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:00.387437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8fade098-8b3d-4612-954b-20546cfc20e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:00.557327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3689/7351] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:00.558618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:00.565451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:00.745218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e711-edb2-48e0-84d8-1d92136e5c38 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:00.754822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:00.755877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:00.756164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:00.756438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:00.757088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:00.759875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:00.897600 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3663/7352] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:00 2022] POST /identity/v3/projects => generated 381 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:00.901409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fade098-8b3d-4612-954b-20546cfc20e7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:00.921423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fade098-8b3d-4612-954b-20546cfc20e7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:01.082194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:01.083581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:01.084487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:01.085393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:01.086817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:01.091790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:01.194702 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3690/7353] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:00 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:01.203019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:01.209000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c78e2-1cb7-46f2-88ce-8fcae5347e2e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:01.226418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:01.231856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:01.231856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:01.231856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:01.231856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:01.231856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:01.234157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:01.267053 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3664/7354] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:01.268280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:01.281571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c36a9-bbc9-4ead-a9fc-873bde283ee3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:01.294158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:01.294857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:01.295228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:01.295498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] PATH_INFO: `/v3/projects/529ab297422e4846942fc9a3f99d2f24/users/8949c98943fb412cb1c1aef01e6d1dac/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:01.317174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529ab297422e4846942fc9a3f99d2f24, user_id=8949c98943fb412cb1c1aef01e6d1dac, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:01.320327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:01.402709 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3691/7355] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:01 2022] PUT /identity/v3/projects/529ab297422e4846942fc9a3f99d2f24/users/8949c98943fb412cb1c1aef01e6d1dac/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:01.406670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:01.434266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47663-244f-4d50-be36-34b5382d9270 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:01.557963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:01.559207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:01.560253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:01.560720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:01.576162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:01.576162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:01.599055 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3665/7356] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:01.599157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:01.618908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a318db4-6f35-4b4d-9447-5201905d7632 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:01.623884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458b3f3-e464-4f7c-aa9b-2756df5bfc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:01.625948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458b3f3-e464-4f7c-aa9b-2756df5bfc0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:01.625948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458b3f3-e464-4f7c-aa9b-2756df5bfc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:01.625948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458b3f3-e464-4f7c-aa9b-2756df5bfc0c admin admin] PATH_INFO: `/v3/projects/529ab297422e4846942fc9a3f99d2f24/users/8949c98943fb412cb1c1aef01e6d1dac/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:01.628157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458b3f3-e464-4f7c-aa9b-2756df5bfc0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=529ab297422e4846942fc9a3f99d2f24, user_id=8949c98943fb412cb1c1aef01e6d1dac, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:01.632099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458b3f3-e464-4f7c-aa9b-2756df5bfc0c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:01.643441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:01.651812 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3692/7357] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:01 2022] PUT /identity/v3/projects/529ab297422e4846942fc9a3f99d2f24/users/8949c98943fb412cb1c1aef01e6d1dac/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:01.856732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:01.873344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e68c-6ab2-4ff9-872d-b8ee9ec230ad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:02.063272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:02.063889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:02.064373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:02.064671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] PATH_INFO: `/v3/users/027bec92af9d4493a9f16df46ab0edbf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:02.067526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=027bec92af9d4493a9f16df46ab0edbf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:02.069997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:02.373330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027bec92af9d4493a9f16df46ab0edbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:02.374512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027bec92af9d4493a9f16df46ab0edbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:02.477330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027bec92af9d4493a9f16df46ab0edbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:02.478021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027bec92af9d4493a9f16df46ab0edbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:02.493976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027bec92af9d4493a9f16df46ab0edbf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:02.540884 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3666/7358] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:01 2022] DELETE /identity/v3/users/027bec92af9d4493a9f16df46ab0edbf => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:02.552107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:02.553371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:02.553801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:02.621721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:02.623255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:02.733753 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3693/7359] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:02.750253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:02.751781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:02.786176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:03.023522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb74a-b863-4262-a39f-ca2fde1ac86c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:03.040064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:03.040980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:03.041457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:03.042622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:03.060758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:03.062591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:03.080616 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3667/7360] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:03.970277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:03.970277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:03.994734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c578238-b25e-4ee5-ae52-b128643d4ace None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:04.016346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:04.017014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:04.017294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:04.017566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] PATH_INFO: `/v3/projects/bd432ccf17244a268f41f836b2724bea` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:04.020634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd432ccf17244a268f41f836b2724bea)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:04.022631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:04.273116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd432ccf17244a268f41f836b2724bea', 'request_id': 'req-b6a088a5-b1b6-48d4-991d-7e8039f683a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.284252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd432ccf17244a268f41f836b2724bea', 'request_id': 'req-b6a088a5-b1b6-48d4-991d-7e8039f683a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.372106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd432ccf17244a268f41f836b2724bea', 'request_id': 'req-b6a088a5-b1b6-48d4-991d-7e8039f683a4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.390212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] The token cache is being invalidate because project bd432ccf17244a268f41f836b2724bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:04.390610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.391748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.400256 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3694/7361] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:03 2022] DELETE /identity/v3/projects/bd432ccf17244a268f41f836b2724bea => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:04.401209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:04.415537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464ee5c-fed3-46f5-a87c-bf9684996042 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:04.543434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:04.546399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:04.546948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:04.547368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] PATH_INFO: `/v3/users/a9f894d305274b3782164558f3a00bda` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:04.550022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f894d305274b3782164558f3a00bda)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:04.552719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:04.891209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f894d305274b3782164558f3a00bda'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.892120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f894d305274b3782164558f3a00bda'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.981270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f894d305274b3782164558f3a00bda'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.982426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f894d305274b3782164558f3a00bda'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:04.996488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-69dc471e-ed37-472c-9688-a9ed762f5efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f894d305274b3782164558f3a00bda'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:05.062579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3668/7362] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:04 2022] DELETE /identity/v3/users/a9f894d305274b3782164558f3a00bda => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:02:06.583782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:06.588075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:06.609217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a088a5-b1b6-48d4-991d-7e8039f683a4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:06.781207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:06.782278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:06.783500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:06.783500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] PATH_INFO: `/v3/projects/3d7850fab89246d5b3d94e04c2c22542` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:06.786851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7850fab89246d5b3d94e04c2c22542)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:06.795459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:06.857860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:06.991902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7850fab89246d5b3d94e04c2c22542', 'request_id': 'req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:07.001984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7850fab89246d5b3d94e04c2c22542', 'request_id': 'req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:07.091677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7850fab89246d5b3d94e04c2c22542', 'request_id': 'req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:07.108306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] The token cache is being invalidate because project 3d7850fab89246d5b3d94e04c2c22542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:07.108623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:07.110538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2a91d4dd-55f2-48b6-a431-1e0a58232ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:07.115828 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3695/7363] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:06 2022] DELETE /identity/v3/projects/3d7850fab89246d5b3d94e04c2c22542 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:07.118791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264598c-2277-4034-a5e2-b0b15387faad None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:07.119308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264598c-2277-4034-a5e2-b0b15387faad None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:07.119490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264598c-2277-4034-a5e2-b0b15387faad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:07.182723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0264598c-2277-4034-a5e2-b0b15387faad None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:07.184050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0264598c-2277-4034-a5e2-b0b15387faad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:07.191994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:07.321993 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3669/7364] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:07.329989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0de4-3185-45b4-be13-d2af66750e97 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:07.330308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0de4-3185-45b4-be13-d2af66750e97 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:07.330590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0de4-3185-45b4-be13-d2af66750e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:07.360358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3e6b0de4-3185-45b4-be13-d2af66750e97 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:07.360358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3e6b0de4-3185-45b4-be13-d2af66750e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:07.364600 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3696/7365] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:07.369029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264598c-2277-4034-a5e2-b0b15387faad None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:07.381597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264598c-2277-4034-a5e2-b0b15387faad None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:07.390404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:07.390404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:07.390404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:07.390404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:07.390805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:02:07.390805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:07.390980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:07.438077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b0de4-3185-45b4-be13-d2af66750e97 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:07.441718 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3670/7366] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:02:07.451437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b0de4-3185-45b4-be13-d2af66750e97 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:07.457819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:07.458676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:07.459126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:07.461045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:07.462599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:07.464757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:07.623197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:07.629730 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3697/7367] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:07 2022] POST /identity/v3/projects => generated 409 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:07.638182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004fa84-af90-4ca5-b1ce-3c83663754a7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:07.791341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:07.791341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:07.791341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:07.791341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:07.791773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:07.791773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:07.961287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:07.963291 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3671/7368] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:07 2022] POST /identity/v3/users => generated 305 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:07.975269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4694208-af3b-40ae-8807-50624510ad5c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:07.985381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:07.986493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:07.988315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:07.988605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:07.990237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:07.992557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:08.008747 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3698/7369] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:08.012869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:08.026704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa38d3-c370-4a91-85a5-e38969b1567c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:08.032298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635296-cd20-4aac-a932-051a5207bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:08.033003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635296-cd20-4aac-a932-051a5207bc5d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:08.033285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635296-cd20-4aac-a932-051a5207bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:08.033559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635296-cd20-4aac-a932-051a5207bc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:08.034549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88635296-cd20-4aac-a932-051a5207bc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:08.036157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88635296-cd20-4aac-a932-051a5207bc5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:08.051243 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3672/7370] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:08.056477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:08.070565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42c9f2-76d2-42b0-808e-3cf9be9b6079 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:08.080046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:08.081049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:08.081486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:08.081987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] PATH_INFO: `/v3/projects/5828ee3b98ad4d13826c089d4e6a6ae3/users/32bd3a9169b0459b817a23733487a50b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:08.110382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5828ee3b98ad4d13826c089d4e6a6ae3, user_id=32bd3a9169b0459b817a23733487a50b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:08.121029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:08.222741 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3699/7371] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:08 2022] PUT /identity/v3/projects/5828ee3b98ad4d13826c089d4e6a6ae3/users/32bd3a9169b0459b817a23733487a50b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:08.234166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e790-897e-4720-b24f-f73f0da83942 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:08.234659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e790-897e-4720-b24f-f73f0da83942 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:08.235137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e790-897e-4720-b24f-f73f0da83942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:08.298594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8948e790-897e-4720-b24f-f73f0da83942 None None] MFA Rules not processed for user `32bd3a9169b0459b817a23733487a50b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:08.300058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8948e790-897e-4720-b24f-f73f0da83942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:08.334080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:08.337389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:08.448233 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3673/7372] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:08.453981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948e790-897e-4720-b24f-f73f0da83942 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:08.472784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:08.490233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb575-0167-4282-975a-aef218e3bbab admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:08.496465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:08.497955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:08.498507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:08.499266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] PATH_INFO: `/v3/users/fa46e76aa154440abdf592e3dd68d107` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:08.501555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa46e76aa154440abdf592e3dd68d107)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:08.506444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:08.616998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948e790-897e-4720-b24f-f73f0da83942 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:08.631932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:08.634667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:08.637005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:08.637005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:08.637005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:08.639597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:08.749912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa46e76aa154440abdf592e3dd68d107'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:08.752707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:08.760734 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3674/7373] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:08 2022] POST /identity/v3/projects => generated 409 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:08.762985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa46e76aa154440abdf592e3dd68d107'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:08.763956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa46e76aa154440abdf592e3dd68d107'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:08.764992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:08.769813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:08.816040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa46e76aa154440abdf592e3dd68d107'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:08.900937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee1513-c504-4024-87bc-b75dc20a2e2c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:08.907194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:08.907845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:08.908334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:08.908713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:08.909425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:08.912306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:08.920225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c431fa97-cc04-4151-8b10-e3bcb66b8de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa46e76aa154440abdf592e3dd68d107'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:08.930376 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3700/7374] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:08 2022] DELETE /identity/v3/users/fa46e76aa154440abdf592e3dd68d107 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:02:08.935241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:08.935524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:08.935800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:08.963580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:08.965116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:09.048032 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3675/7375] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:08 2022] POST /identity/v3/users => generated 311 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:09.049760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:09.081179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea64ede-aaa8-4be7-b529-bed6a0d36c78 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:09.089245 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3701/7376] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:09.094602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:09.095246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:09.096407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:09.099372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:09.100184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:09.100387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:09.102118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:09.106327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:09.136568 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3676/7377] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:09.139348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:09.170867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6674-0b3f-4e63-971c-172fdf9ed433 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:09.177582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:09.178302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:09.178929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:09.179208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] PATH_INFO: `/v3/projects/e5e6164ab248455bb0cf72d2a94f302e/users/ae89830178c441c8b4eafbd5efcc7bd7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:09.237115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e6164ab248455bb0cf72d2a94f302e, user_id=ae89830178c441c8b4eafbd5efcc7bd7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:09.239186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a688-c35c-4df8-ad12-3d2c6750c249 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:09.243409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:09.252481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:09.253127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:09.253839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:09.254195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:09.269100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:09.270909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:09.284734 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3702/7378] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:02:09.641896 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3677/7379] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:09 2022] PUT /identity/v3/projects/e5e6164ab248455bb0cf72d2a94f302e/users/ae89830178c441c8b4eafbd5efcc7bd7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:09.645805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:09.656676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff54e-cca9-4c4f-8d9f-e0835bccfd0b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:09.732047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30cc78-a71f-411a-930a-de7aa89aeda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:09.732986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30cc78-a71f-411a-930a-de7aa89aeda2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:09.733605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30cc78-a71f-411a-930a-de7aa89aeda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:09.734170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30cc78-a71f-411a-930a-de7aa89aeda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:09.734987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30cc78-a71f-411a-930a-de7aa89aeda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:09.736866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30cc78-a71f-411a-930a-de7aa89aeda2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:09.751776 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3703/7380] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:09.755715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:09.773610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff4a0-2e55-43d3-8ae6-b67486bf0e9e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:09.792747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:09.796664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:09.796664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:09.796664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] PATH_INFO: `/v3/projects/e5e6164ab248455bb0cf72d2a94f302e/users/ae89830178c441c8b4eafbd5efcc7bd7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:09.796664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e6164ab248455bb0cf72d2a94f302e, user_id=ae89830178c441c8b4eafbd5efcc7bd7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:09.802295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:09.825243 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3678/7381] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:09 2022] PUT /identity/v3/projects/e5e6164ab248455bb0cf72d2a94f302e/users/ae89830178c441c8b4eafbd5efcc7bd7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:09.838283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:09.838666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:09.839017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:09.861134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:09.903801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] MFA Rules not processed for user `ae89830178c441c8b4eafbd5efcc7bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:09.905321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:10.034254 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3704/7382] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:09 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:10.046423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:10.048747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:10.054128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:10.058352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:10.104475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:10.167597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17561952-248f-4045-894b-9ee9b556a415 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:10.178522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:10.179162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:10.179438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:10.179705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:10.207377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:10.208835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:10.217379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8857cd2-3466-42b3-9323-a43c06da4e24 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:10.238974 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3679/7383] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:10 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:10.238974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:10.244447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:10.265156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:10.267387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:10.267895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:10.268896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:10.275408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:10.314500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:10.318274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:10.351594 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3705/7384] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:10.489581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5b455-7b5b-4100-a3dd-4183f3cd7d10 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:10.496975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:10.497933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:10.500346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:10.500346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] PATH_INFO: `/v3/projects/f5eeacbb87cd495a99203f29ff4ac7dd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:10.501296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5eeacbb87cd495a99203f29ff4ac7dd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:10.506231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:10.675449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5eeacbb87cd495a99203f29ff4ac7dd', 'request_id': 'req-987589b3-3665-446b-9196-ac97799e2fd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:10.686309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5eeacbb87cd495a99203f29ff4ac7dd', 'request_id': 'req-987589b3-3665-446b-9196-ac97799e2fd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:10.805920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5eeacbb87cd495a99203f29ff4ac7dd', 'request_id': 'req-987589b3-3665-446b-9196-ac97799e2fd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:10.829452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] The token cache is being invalidate because project f5eeacbb87cd495a99203f29ff4ac7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:10.830475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:10.832778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:10.836402 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3680/7385] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:10 2022] DELETE /identity/v3/projects/f5eeacbb87cd495a99203f29ff4ac7dd => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:10.841191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:10.868199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bfd4d-bda8-4d69-bcb2-9326005b68a7 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:10.890706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:10.892393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:10.986303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:10.988087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:10.988380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:10.988654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] PATH_INFO: `/v3/users/5213ba20fb1e4be4b71312ef1a001b96` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:10.990280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5213ba20fb1e4be4b71312ef1a001b96)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:10.992581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:11.015429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987589b3-3665-446b-9196-ac97799e2fd7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:11.026320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebb1c7-3294-4e4a-a63f-ee0d4c4867e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:11.026966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb1c7-3294-4e4a-a63f-ee0d4c4867e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:11.027250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb1c7-3294-4e4a-a63f-ee0d4c4867e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:11.027529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebb1c7-3294-4e4a-a63f-ee0d4c4867e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:11.031181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:11.031935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1eebb1c7-3294-4e4a-a63f-ee0d4c4867e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:11.059721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:11.118851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebb1c7-3294-4e4a-a63f-ee0d4c4867e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:11.120350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebb1c7-3294-4e4a-a63f-ee0d4c4867e2 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:11.131207 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3681/7386] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:10 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:02:11.245359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5213ba20fb1e4be4b71312ef1a001b96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:11.257353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5213ba20fb1e4be4b71312ef1a001b96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:11.257812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5213ba20fb1e4be4b71312ef1a001b96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:11.279515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5213ba20fb1e4be4b71312ef1a001b96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:11.424167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5213ba20fb1e4be4b71312ef1a001b96'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:11.436625 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3706/7387] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:10 2022] DELETE /identity/v3/users/5213ba20fb1e4be4b71312ef1a001b96 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:11.697203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:11.698181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:11.699141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:11.742274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] MFA Rules not processed for user `8949c98943fb412cb1c1aef01e6d1dac`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:11.745347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:11.936840 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3682/7388] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:11.944459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:11.945958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:12.121790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac3279-0366-482a-98e9-4be7c59d7653 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:12.126086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b48033-1510-42cc-a337-cfe45afa331c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:12.126767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48033-1510-42cc-a337-cfe45afa331c service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:12.127231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48033-1510-42cc-a337-cfe45afa331c service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:12.127563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48033-1510-42cc-a337-cfe45afa331c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:12.129766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-69b48033-1510-42cc-a337-cfe45afa331c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:12.211345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:12.212108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:12.252374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b48033-1510-42cc-a337-cfe45afa331c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:12.261883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b48033-1510-42cc-a337-cfe45afa331c service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:12.287143 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3707/7389] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:12.393276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73788d6-fbc7-489d-892f-8d58a288399c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:12.401338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:12.402003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:12.402349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:12.402593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] PATH_INFO: `/v3/projects/5250f6b591334a16a151e7d907f38863` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:12.403974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5250f6b591334a16a151e7d907f38863)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:12.406043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:12.520791 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:12.524216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5250f6b591334a16a151e7d907f38863', 'request_id': 'req-a346f83e-1e7a-4712-9250-3793b7ce2172'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:12.532513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5250f6b591334a16a151e7d907f38863', 'request_id': 'req-a346f83e-1e7a-4712-9250-3793b7ce2172'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:12.616245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5250f6b591334a16a151e7d907f38863', 'request_id': 'req-a346f83e-1e7a-4712-9250-3793b7ce2172'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:12.632499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] The token cache is being invalidate because project 5250f6b591334a16a151e7d907f38863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:12.632905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:12.634743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a346f83e-1e7a-4712-9250-3793b7ce2172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:12.637166 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3683/7390] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:12 2022] DELETE /identity/v3/projects/5250f6b591334a16a151e7d907f38863 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:02:12.644371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873522-25da-46de-96ba-613d9e208cd0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:12.644790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873522-25da-46de-96ba-613d9e208cd0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:12.646474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873522-25da-46de-96ba-613d9e208cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:12.669915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-21873522-25da-46de-96ba-613d9e208cd0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:12.671317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-21873522-25da-46de-96ba-613d9e208cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:12.703404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:12.746961 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3708/7391] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:12.755138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135114f4-58e4-414c-af47-23a910b9200a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:12.755602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135114f4-58e4-414c-af47-23a910b9200a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:12.755717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135114f4-58e4-414c-af47-23a910b9200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:12.779391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-135114f4-58e4-414c-af47-23a910b9200a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:12.782103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-135114f4-58e4-414c-af47-23a910b9200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:12.789061 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3684/7392] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:12.793756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21873522-25da-46de-96ba-613d9e208cd0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:12.807034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21873522-25da-46de-96ba-613d9e208cd0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:12.815763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:12.817367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:12.819770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:12.820176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:12.821348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:02:12.822105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:12.824103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:12.842101 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3709/7393] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:02:12.843322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135114f4-58e4-414c-af47-23a910b9200a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:12.856133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135114f4-58e4-414c-af47-23a910b9200a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:12.861997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:12.865156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:12.865156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:12.865156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:12.865156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:12.866300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:13.022485 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3685/7394] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:12 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:13.026837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:13.041409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2862c6-0656-4cd7-883f-382d518f9e87 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:13.159251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:13.160543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:13.161185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:13.161673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:13.167086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:13.169282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:13.388416 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3710/7395] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:13 2022] POST /identity/v3/users => generated 289 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:02:13.391349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:13.403684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f576301-82ec-48d9-8e61-f0059a089a35 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:13.410230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:13.411534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:13.411893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:13.412317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:13.413216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:13.415660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:13.445199 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3686/7396] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:13.449457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:13.462359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f2a5-9c9d-47ba-b6f2-bc8a2ed0957f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:13.467591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615ff4c-13d3-4449-b352-61de5869a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:13.468400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ff4c-13d3-4449-b352-61de5869a442 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:13.468790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ff4c-13d3-4449-b352-61de5869a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:13.469176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ff4c-13d3-4449-b352-61de5869a442 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:13.471074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615ff4c-13d3-4449-b352-61de5869a442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:13.473841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615ff4c-13d3-4449-b352-61de5869a442 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:13.543055 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3711/7397] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:13.547744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:13.560414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445e727-7e8a-44d9-a3e2-3145fc1be0e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:13.566750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:13.568101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:13.568580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:13.569064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] PATH_INFO: `/v3/projects/25500da16b774b9193ef764ac2849885/users/ba59c2a40e9f46a0b774568bd9a1daec/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:13.619558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25500da16b774b9193ef764ac2849885, user_id=ba59c2a40e9f46a0b774568bd9a1daec, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:13.625802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:13.869917 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3687/7398] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:13 2022] PUT /identity/v3/projects/25500da16b774b9193ef764ac2849885/users/ba59c2a40e9f46a0b774568bd9a1daec/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:02:13.879558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2234-aa24-4b42-9055-7aed72d6525b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:13.880465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2234-aa24-4b42-9055-7aed72d6525b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:13.880972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2234-aa24-4b42-9055-7aed72d6525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:13.919182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dcac2234-aa24-4b42-9055-7aed72d6525b None None] MFA Rules not processed for user `ba59c2a40e9f46a0b774568bd9a1daec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:13.922209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dcac2234-aa24-4b42-9055-7aed72d6525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:14.032609 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3712/7399] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:14.034439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:14.220082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a6fa-4b13-4a63-8760-ea650620a172 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:14.228939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:14.229992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:14.230750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:14.231186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:14.232155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:14.235009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:15.065412 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3688/7400] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:14 2022] POST /identity/v3/projects => generated 377 bytes in 1032 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:15.070844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2234-aa24-4b42-9055-7aed72d6525b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:15.082238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2234-aa24-4b42-9055-7aed72d6525b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:15.106604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:15.144173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:15.144784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:15.145062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:15.145334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:15.145960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:15.150422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:15.546116 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3713/7401] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:15 2022] POST /identity/v3/users => generated 295 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:15.547697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:15.566713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc442f-86d9-48d6-85ad-6ac4b8466e3f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:15.573772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:15.575036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:15.578894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:15.578894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:15.578894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:15.578894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:15.601755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:15.611691 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3689/7402] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:15.618023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3d7b5-3011-4543-ac7b-6f60a8923817 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:15.639302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:15.640417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:15.640417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:15.640812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] PATH_INFO: `/v3/projects/9d598906af32400fab27480360480c21/users/e7a1113e8ed64133a7894ef198dc9023/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:15.666335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d598906af32400fab27480360480c21, user_id=e7a1113e8ed64133a7894ef198dc9023, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:15.669476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:15.767604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:15.778375 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3714/7403] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:15 2022] PUT /identity/v3/projects/9d598906af32400fab27480360480c21/users/e7a1113e8ed64133a7894ef198dc9023/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:15.789696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f82223-0dbf-4265-a30e-60c5823a5d0c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:15.880665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:15.902308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafea5c6-e7fc-448c-8766-e90384244d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:15.903158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafea5c6-e7fc-448c-8766-e90384244d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:15.903483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafea5c6-e7fc-448c-8766-e90384244d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:15.904075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafea5c6-e7fc-448c-8766-e90384244d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:15.905179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafea5c6-e7fc-448c-8766-e90384244d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:15.907450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafea5c6-e7fc-448c-8766-e90384244d07 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:15.920528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3690/7404] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:15.925258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:15.938863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28b3e3-710f-49ee-a6ff-076a86fb5226 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:15.943925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:15.945053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:15.945154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:15.945557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] PATH_INFO: `/v3/projects/9d598906af32400fab27480360480c21/users/e7a1113e8ed64133a7894ef198dc9023/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:15.949177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d598906af32400fab27480360480c21, user_id=e7a1113e8ed64133a7894ef198dc9023, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:15.951898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:15.988427 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3715/7405] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:15 2022] PUT /identity/v3/projects/9d598906af32400fab27480360480c21/users/e7a1113e8ed64133a7894ef198dc9023/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:15.999453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1fcc-25cc-4533-a40e-d407e4bdddd7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:16.000233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1fcc-25cc-4533-a40e-d407e4bdddd7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:16.001608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1fcc-25cc-4533-a40e-d407e4bdddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:16.076033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f34c1fcc-25cc-4533-a40e-d407e4bdddd7 None None] MFA Rules not processed for user `e7a1113e8ed64133a7894ef198dc9023`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:16.078543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f34c1fcc-25cc-4533-a40e-d407e4bdddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:16.214579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3691/7406] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:16.228822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:16.232700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:16.422364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a219615-1fe6-43df-b19f-51095855c72b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:16.446926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:16.447957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:16.448472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:16.449007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:16.601594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:16.601594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:16.610660 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3716/7407] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:17.463541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:17.464416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:17.464947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:17.490838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] MFA Rules not processed for user `7963aa7a74c147cdab99b56131a66842`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:17.493287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:17.641904 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3692/7408] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:20.622106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:20.636017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed2000-3810-4323-868f-3fc1fce0d236 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:20.644885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:20.644885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:20.644885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:20.644885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:20.678388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:20.680193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:20.691183 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3717/7409] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:23.279985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:23.281471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:23.507271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:23.517787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbdd68-dc46-48d7-92da-a8cee23e1498 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:23.523158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08316be2-be2d-4732-839d-cee827cdc9b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:23.524440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08316be2-be2d-4732-839d-cee827cdc9b3 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:23.524780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08316be2-be2d-4732-839d-cee827cdc9b3 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:23.525067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08316be2-be2d-4732-839d-cee827cdc9b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:23.533435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08316be2-be2d-4732-839d-cee827cdc9b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:23.562168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08316be2-be2d-4732-839d-cee827cdc9b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:23.563913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08316be2-be2d-4732-839d-cee827cdc9b3 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:23.583284 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3693/7410] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:29.544401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:29.546047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:29.576769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:29.631365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3dc51-b7f6-4fcb-bb57-016f58d52418 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:29.639904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:29.640574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:29.640848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:29.641133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] PATH_INFO: `/v3/users/32bd3a9169b0459b817a23733487a50b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:29.642501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bd3a9169b0459b817a23733487a50b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:29.644885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:29.920757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bd3a9169b0459b817a23733487a50b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:29.933091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bd3a9169b0459b817a23733487a50b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:29.933842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bd3a9169b0459b817a23733487a50b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:29.947231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bd3a9169b0459b817a23733487a50b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:30.059716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bd3a9169b0459b817a23733487a50b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:30.066837 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3718/7411] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:29 2022] DELETE /identity/v3/users/32bd3a9169b0459b817a23733487a50b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:30.071440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:30.072260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:30.072549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:30.104417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:30.105724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:30.197044 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3694/7412] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:30.207440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:30.208904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:30.296282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62c7c-7bc8-4301-a527-902eaaf2472f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:30.300801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:30.301421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:30.302462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:30.302743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:30.314246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:30.316056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:30.329568 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3719/7413] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:30.886501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:30.888390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:30.922446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d090056-27b4-4d87-b658-fd228f64b142 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:30.937878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:30.941991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:30.942465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:30.943675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] PATH_INFO: `/v3/projects/5828ee3b98ad4d13826c089d4e6a6ae3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:30.949401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5828ee3b98ad4d13826c089d4e6a6ae3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:30.958238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:30.993290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:30.994893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:31.008705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511214b-0b23-4a45-8045-670dba6a12ec service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:31.017847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:31.019398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:31.019905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:31.020274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] PATH_INFO: `/v3/users/ba59c2a40e9f46a0b774568bd9a1daec` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:31.021630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba59c2a40e9f46a0b774568bd9a1daec)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:31.027665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:31.128222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5828ee3b98ad4d13826c089d4e6a6ae3', 'request_id': 'req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.136945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5828ee3b98ad4d13826c089d4e6a6ae3', 'request_id': 'req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.308567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5828ee3b98ad4d13826c089d4e6a6ae3', 'request_id': 'req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.316677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:31.327328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba59c2a40e9f46a0b774568bd9a1daec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.332984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] The token cache is being invalidate because project 5828ee3b98ad4d13826c089d4e6a6ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:31.333487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.335668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.340132 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3695/7414] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:30 2022] DELETE /identity/v3/projects/5828ee3b98ad4d13826c089d4e6a6ae3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:31.345949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:31.349702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:31.367047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba59c2a40e9f46a0b774568bd9a1daec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.368181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba59c2a40e9f46a0b774568bd9a1daec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.390043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba59c2a40e9f46a0b774568bd9a1daec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.473379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49fbb-bd1b-4177-bd8f-bbeecf56cba2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:31.480446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:31.481279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:31.481627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:31.483610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] PATH_INFO: `/v3/users/ae89830178c441c8b4eafbd5efcc7bd7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:31.483839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae89830178c441c8b4eafbd5efcc7bd7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:31.486137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:31.495215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:31.559454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b6c61189-d0e7-41fe-9d39-d26ce1d27b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba59c2a40e9f46a0b774568bd9a1daec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.572502 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3720/7415] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:30 2022] DELETE /identity/v3/users/ba59c2a40e9f46a0b774568bd9a1daec => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:02:31.577388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:31.577766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:31.581108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:31.651075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:31.653858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:31.730373 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3721/7416] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:31.737258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:31.739626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:31.818236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae89830178c441c8b4eafbd5efcc7bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.818921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae89830178c441c8b4eafbd5efcc7bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.829270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16092a-ede2-40fa-868d-00e10c63faf4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:31.833175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:31.833786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:31.834110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:31.834388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:31.836662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:31.851083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:31.853111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:31.863381 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3722/7417] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:02:31.945053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae89830178c441c8b4eafbd5efcc7bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.950761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae89830178c441c8b4eafbd5efcc7bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.957290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae89830178c441c8b4eafbd5efcc7bd7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:31.991331 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3696/7418] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:31 2022] DELETE /identity/v3/users/ae89830178c441c8b4eafbd5efcc7bd7 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:32.580498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:32.582119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:32.583064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:32.585837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:32.613491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccfb96-38b0-4eb4-8e4e-8e7eb025b67a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:32.759786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:32.760621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:32.761219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:32.761634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] PATH_INFO: `/v3/projects/25500da16b774b9193ef764ac2849885` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:32.764577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25500da16b774b9193ef764ac2849885)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:32.769612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:32.790355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba48b6-fe3b-4ebe-a14c-ac904be4c94c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:32.802132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:32.804289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:32.805980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:32.807180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] PATH_INFO: `/v3/projects/e5e6164ab248455bb0cf72d2a94f302e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:32.810325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e6164ab248455bb0cf72d2a94f302e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:32.814113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:34.087565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25500da16b774b9193ef764ac2849885', 'request_id': 'req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.096036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25500da16b774b9193ef764ac2849885', 'request_id': 'req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.128914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e6164ab248455bb0cf72d2a94f302e', 'request_id': 'req-4a7118f0-0504-42b7-adec-91c9263bea40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.145566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e6164ab248455bb0cf72d2a94f302e', 'request_id': 'req-4a7118f0-0504-42b7-adec-91c9263bea40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.215300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25500da16b774b9193ef764ac2849885', 'request_id': 'req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.232880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] The token cache is being invalidate because project 25500da16b774b9193ef764ac2849885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:34.233512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.234506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.236231 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3723/7419] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:32 2022] DELETE /identity/v3/projects/25500da16b774b9193ef764ac2849885 => generated 0 bytes in 1657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:34.242235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:34.244769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:34.310782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e6164ab248455bb0cf72d2a94f302e', 'request_id': 'req-4a7118f0-0504-42b7-adec-91c9263bea40'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.349292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] The token cache is being invalidate because project e5e6164ab248455bb0cf72d2a94f302e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:34.350437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.354728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.358401 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3697/7420] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:32 2022] DELETE /identity/v3/projects/e5e6164ab248455bb0cf72d2a94f302e => generated 0 bytes in 1778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:34.359852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:34.363327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188699c-dcbe-480a-bbfe-7901d3ddfd3b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:34.363766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:34.486292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7118f0-0504-42b7-adec-91c9263bea40 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:34.494940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:34.499224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04a6b3-b68c-4566-8fae-ac6def9d4ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:34.499399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:34.499399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:34.499399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] PATH_INFO: `/v3/users/e7a1113e8ed64133a7894ef198dc9023` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:34.499681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a6b3-b68c-4566-8fae-ac6def9d4ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:34.499681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a6b3-b68c-4566-8fae-ac6def9d4ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:34.499681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04a6b3-b68c-4566-8fae-ac6def9d4ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:34.501015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a1113e8ed64133a7894ef198dc9023)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:34.504498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2e04a6b3-b68c-4566-8fae-ac6def9d4ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:34.507437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:34.642559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a6b3-b68c-4566-8fae-ac6def9d4ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:34.644643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04a6b3-b68c-4566-8fae-ac6def9d4ce3 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:34.670160 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3698/7421] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:34.671801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd881c-5543-4b21-ad7c-31446d92b62f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:34.672042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd881c-5543-4b21-ad7c-31446d92b62f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:34.672321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd881c-5543-4b21-ad7c-31446d92b62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:34.723957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b0fd881c-5543-4b21-ad7c-31446d92b62f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:34.725205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0fd881c-5543-4b21-ad7c-31446d92b62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:34.773476 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3699/7422] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:34.780303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a1113e8ed64133a7894ef198dc9023'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.795559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bfa9c-17d4-4ab8-b0b7-bd9a0dde8d78 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:34.795559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bfa9c-17d4-4ab8-b0b7-bd9a0dde8d78 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:34.795559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bfa9c-17d4-4ab8-b0b7-bd9a0dde8d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:34.808665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a1113e8ed64133a7894ef198dc9023'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.810548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a1113e8ed64133a7894ef198dc9023'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.849868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a1113e8ed64133a7894ef198dc9023'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.850339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c81bfa9c-17d4-4ab8-b0b7-bd9a0dde8d78 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:34.851554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c81bfa9c-17d4-4ab8-b0b7-bd9a0dde8d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:34.879251 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3700/7423] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:34.883405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bfa9c-17d4-4ab8-b0b7-bd9a0dde8d78 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:34.894421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bfa9c-17d4-4ab8-b0b7-bd9a0dde8d78 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:34.900517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:34.901284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:34.901703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:34.902219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:34.903105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:02:34.903391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:34.905151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:34.924792 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3701/7424] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:02:34.928254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:34.941388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687193e-fbc6-462e-96f5-167e0b182fc0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:34.947640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:34.948386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:34.948728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:34.949075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:34.949778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:34.951846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:34.957767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a1113e8ed64133a7894ef198dc9023'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:34.970289 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3724/7425] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:34 2022] DELETE /identity/v3/users/e7a1113e8ed64133a7894ef198dc9023 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:02:35.096890 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3702/7426] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:34 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:35.101130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:35.166336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa74e7-f734-4509-91f2-447bb8595557 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:35.199411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:35.264221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:35.265606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:35.266085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:35.266418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:35.267559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:35.269768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:35.285942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:35.353818 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3725/7427] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:35 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:02:35.354640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:35.368516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038342eb-3ea7-48f9-bb43-0ccfe6fee622 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:35.388642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:35.389287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:35.389569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:35.389843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:35.390534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:35.392246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:35.404598 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3703/7428] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:02:35.408855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:35.419787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69b31-f5e8-4809-ac3c-c9ae43874fe3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:35.424720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:35.425419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:35.425767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:35.426173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:35.426919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:35.428850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:35.440001 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3726/7429] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:35.449883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:35.455465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad66e4-6f44-455b-b5ba-b99894e06aa3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:35.463997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d16750-df02-48b5-9cd0-2df6e328d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:35.464839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16750-df02-48b5-9cd0-2df6e328d95d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:35.471869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16750-df02-48b5-9cd0-2df6e328d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:35.471869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d16750-df02-48b5-9cd0-2df6e328d95d admin admin] PATH_INFO: `/v3/projects/e045cf29260042628b75c5101e37198f/users/f18939151c0849699322abf996093522/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:35.489115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d16750-df02-48b5-9cd0-2df6e328d95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e045cf29260042628b75c5101e37198f, user_id=f18939151c0849699322abf996093522, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:35.492878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d16750-df02-48b5-9cd0-2df6e328d95d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:35.500283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:35.502502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:35.529857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f556-40dc-4d03-978d-6e70299aa120 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:35.537173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:35.538251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:35.539341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:35.539672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] PATH_INFO: `/v3/projects/9d598906af32400fab27480360480c21` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:35.541463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d598906af32400fab27480360480c21)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:35.543859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:35.612384 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3704/7430] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:35 2022] PUT /identity/v3/projects/e045cf29260042628b75c5101e37198f/users/f18939151c0849699322abf996093522/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:35.619261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05083-435d-4bdc-820f-a19193968924 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:35.619909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05083-435d-4bdc-820f-a19193968924 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:35.620414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05083-435d-4bdc-820f-a19193968924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:35.656563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00f05083-435d-4bdc-820f-a19193968924 None None] MFA Rules not processed for user `f18939151c0849699322abf996093522`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:35.658316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00f05083-435d-4bdc-820f-a19193968924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:35.705204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d598906af32400fab27480360480c21', 'request_id': 'req-61b53660-b5f8-4c12-914a-8003706fcf86'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:35.731449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d598906af32400fab27480360480c21', 'request_id': 'req-61b53660-b5f8-4c12-914a-8003706fcf86'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:35.777170 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3705/7431] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:02:35.778208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f05083-435d-4bdc-820f-a19193968924 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:35.820310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d598906af32400fab27480360480c21', 'request_id': 'req-61b53660-b5f8-4c12-914a-8003706fcf86'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:35.851649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] The token cache is being invalidate because project 9d598906af32400fab27480360480c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:35.851866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:35.853146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-61b53660-b5f8-4c12-914a-8003706fcf86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:35.860183 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3727/7432] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:35 2022] DELETE /identity/v3/projects/9d598906af32400fab27480360480c21 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:35.862623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009552a-50d9-4c01-9225-5ac1c92dd9db None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:35.862911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009552a-50d9-4c01-9225-5ac1c92dd9db None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:35.863185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009552a-50d9-4c01-9225-5ac1c92dd9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:35.866361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f05083-435d-4bdc-820f-a19193968924 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:35.895507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5009552a-50d9-4c01-9225-5ac1c92dd9db None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:35.896739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5009552a-50d9-4c01-9225-5ac1c92dd9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:36.007845 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3728/7433] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:36.019522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.020062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca732e3-b92e-4b9b-b352-51ea1939ac44 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.021321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca732e3-b92e-4b9b-b352-51ea1939ac44 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.021321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca732e3-b92e-4b9b-b352-51ea1939ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.021928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.022435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.022986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.023937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.026829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.060473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6ca732e3-b92e-4b9b-b352-51ea1939ac44 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:36.062130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ca732e3-b92e-4b9b-b352-51ea1939ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:36.070967 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3729/7434] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:36.075558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca732e3-b92e-4b9b-b352-51ea1939ac44 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.097300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca732e3-b92e-4b9b-b352-51ea1939ac44 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.105057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.105839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.106187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.108866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.108866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:02:36.108866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.110280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.131023 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3730/7435] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:02:36.140738 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3706/7436] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:35 2022] POST /identity/v3/projects => generated 383 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:36.142169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.144763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.146783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:36.156536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7ad9-eeb4-4d09-ab1b-e27169112692 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.223518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.227181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.227181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.227181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.227181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.227617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf8254-8e2b-4889-9759-ccd59e3f9813 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.227720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.231313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.231925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.232227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.232502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.233156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.235099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.353809 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3731/7437] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:36 2022] POST /identity/v3/projects => generated 393 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:36.354367 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3707/7438] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:36 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:02:36.366283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.372906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.402980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a70cf-831a-4dfd-8c28-0a990d33ca5d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.541812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.542591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.543017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.543298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.544017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.546442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.568900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a966-22f4-4166-8363-1f4676387cc8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.570470 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3708/7439] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:36.573689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.575743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.576380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.576667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.576943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.577639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.579781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.589067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1fba-89fa-4034-becc-14430eeb446a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.597697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.599591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.601764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.602093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] PATH_INFO: `/v3/projects/151e0fa912d047a2b12ad9e4cdfa8256/users/8764b8cf31c845c8aee83c1f90cb06cd/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.650795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151e0fa912d047a2b12ad9e4cdfa8256, user_id=8764b8cf31c845c8aee83c1f90cb06cd, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.653907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.788698 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3732/7440] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:36 2022] POST /identity/v3/users => generated 297 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:36.790529 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3709/7441] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:36 2022] PUT /identity/v3/projects/151e0fa912d047a2b12ad9e4cdfa8256/users/8764b8cf31c845c8aee83c1f90cb06cd/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:36.795305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.797483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:36.815657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee433eb-07f3-4181-ac47-f000c8222519 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.855135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:36.921874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27263ed-2048-43c1-b40c-c1c98844bb33 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:36.959759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:36.967593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.968240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.968521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.968796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.969448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.971085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.987331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:36.988161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:36.988609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:36.989033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:36.989812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:36.991809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:36.998438 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3710/7442] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:37.005259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:37.026820 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3733/7443] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:37.030580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:37.040672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3696f-95ee-40b9-8061-0dedb5110fd9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:37.046754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30056f-3f43-48f2-96ca-5af152c86efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:37.049007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30056f-3f43-48f2-96ca-5af152c86efd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.050210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30056f-3f43-48f2-96ca-5af152c86efd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.050577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30056f-3f43-48f2-96ca-5af152c86efd admin admin] PATH_INFO: `/v3/projects/151e0fa912d047a2b12ad9e4cdfa8256/users/8764b8cf31c845c8aee83c1f90cb06cd/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.053557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101484b-c3be-4c3f-ac1c-d9941e260528 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:37.054633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30056f-3f43-48f2-96ca-5af152c86efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=151e0fa912d047a2b12ad9e4cdfa8256, user_id=8764b8cf31c845c8aee83c1f90cb06cd, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:37.060694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30056f-3f43-48f2-96ca-5af152c86efd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:37.063553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:37.064183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.064464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.064739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.065387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:37.067350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:37.092588 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3711/7444] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:37 2022] PUT /identity/v3/projects/151e0fa912d047a2b12ad9e4cdfa8256/users/8764b8cf31c845c8aee83c1f90cb06cd/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:37.105695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.106192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.106545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.115546 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3734/7445] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:02:37.116643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:37.140327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca063921-6dbe-45a9-9ae5-c32252bfec9e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:37.143127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] MFA Rules not processed for user `8764b8cf31c845c8aee83c1f90cb06cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:37.144835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:37.239186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1769993-88da-4ac1-bbd8-1a4765811851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:37.241246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1769993-88da-4ac1-bbd8-1a4765811851 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.241738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1769993-88da-4ac1-bbd8-1a4765811851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.242252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1769993-88da-4ac1-bbd8-1a4765811851 admin admin] PATH_INFO: `/v3/projects/28a028ac3a4648fc834f095b2ad554db/users/0814cad7eafd415885939484aa6f6bf0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.285182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1769993-88da-4ac1-bbd8-1a4765811851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a028ac3a4648fc834f095b2ad554db, user_id=0814cad7eafd415885939484aa6f6bf0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:37.294381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1769993-88da-4ac1-bbd8-1a4765811851 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:37.314709 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3712/7446] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:37.316052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:37.317698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:37.387761 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3735/7447] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:37 2022] PUT /identity/v3/projects/28a028ac3a4648fc834f095b2ad554db/users/0814cad7eafd415885939484aa6f6bf0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:37.397821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.400256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.400540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.424835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b92dd-13ac-4350-9c71-558678ec8d07 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:37.468545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] MFA Rules not processed for user `0814cad7eafd415885939484aa6f6bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:37.473427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:37.490764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:37.497192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.497192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.497192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.573150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:37.574951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:37.601679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3713/7448] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:37.627891 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3736/7449] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:02:37.639419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:37.745195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee149a6b-0ad5-4598-9c30-d353f36f4287 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:37.751312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:37.752375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.752957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.753841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.754947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:37.757151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:37.867781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:37.869711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:37.888196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc0b3e-53a5-48ec-87f7-ce0abe1f64bf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:37.892030 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3714/7450] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:37 2022] POST /identity/v3/projects => generated 393 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:37.893348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:37.980879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d676-bd5d-4941-9a71-1c53551b24d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:37.981509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d676-bd5d-4941-9a71-1c53551b24d4 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:37.981793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d676-bd5d-4941-9a71-1c53551b24d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:37.982087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d676-bd5d-4941-9a71-1c53551b24d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:37.985806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bb1d676-bd5d-4941-9a71-1c53551b24d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:38.006007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:38.011835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b258d-5898-49ea-b28b-bb68f45d6707 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:38.027828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:38.028605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:38.028892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:38.029168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:38.029817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:38.031850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:38.079363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1d676-bd5d-4941-9a71-1c53551b24d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:38.080865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1d676-bd5d-4941-9a71-1c53551b24d4 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:38.091881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3737/7451] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:02:38.096185 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47936-43d0-4c72-b387-94b9793a4b81 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:38.096875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47936-43d0-4c72-b387-94b9793a4b81 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:38.097161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e47936-43d0-4c72-b387-94b9793a4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:38.133320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-43e47936-43d0-4c72-b387-94b9793a4b81 None None] MFA Rules not processed for user `7963aa7a74c147cdab99b56131a66842`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:38.136649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-43e47936-43d0-4c72-b387-94b9793a4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:38.144922 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3715/7452] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:37 2022] POST /identity/v3/users => generated 303 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:38.153027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:38.168994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d990-d8b4-407d-a2a1-e43659a4ff68 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:38.171289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:38.184376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:38.185019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:38.185302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:38.185584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:38.187328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:38.188946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:38.238346 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3716/7453] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:38.239442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:38.241447 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3738/7454] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:38.255843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62614f-cea4-4ea9-be23-8dab5a01b519 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:38.262290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:38.263284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:38.263653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:38.264029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] PATH_INFO: `/v3/projects/87003952720a48ac81f7086e86478b2e/users/743575fbe21e4d2c9d6885bc7b9f01db/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:38.284698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87003952720a48ac81f7086e86478b2e, user_id=743575fbe21e4d2c9d6885bc7b9f01db, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:38.288145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:38.414010 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3717/7455] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:38 2022] PUT /identity/v3/projects/87003952720a48ac81f7086e86478b2e/users/743575fbe21e4d2c9d6885bc7b9f01db/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:38.416315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47936-43d0-4c72-b387-94b9793a4b81 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:38.439934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e47936-43d0-4c72-b387-94b9793a4b81 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:38.524728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:38.627784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b602810-8b34-4186-9056-33ab5246e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:38.628410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b602810-8b34-4186-9056-33ab5246e7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:38.628965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b602810-8b34-4186-9056-33ab5246e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:38.629269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b602810-8b34-4186-9056-33ab5246e7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:38.629929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b602810-8b34-4186-9056-33ab5246e7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:38.632033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b602810-8b34-4186-9056-33ab5246e7b0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:38.662456 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3739/7456] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:38.666997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:38.681889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971fe46-157f-472b-a2d4-a61b0d7b7e1b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:38.692090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:38.712761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:38.713099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:38.713330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] PATH_INFO: `/v3/projects/87003952720a48ac81f7086e86478b2e/users/743575fbe21e4d2c9d6885bc7b9f01db/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:38.717126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:38.737719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87003952720a48ac81f7086e86478b2e, user_id=743575fbe21e4d2c9d6885bc7b9f01db, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:38.752180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:38.783452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:38.799587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3718/7457] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:38 2022] PUT /identity/v3/projects/87003952720a48ac81f7086e86478b2e/users/743575fbe21e4d2c9d6885bc7b9f01db/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:38.803244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ff297-7b9a-4380-b767-8d6b5e4a5e6e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:38.803734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ff297-7b9a-4380-b767-8d6b5e4a5e6e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:38.804109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ff297-7b9a-4380-b767-8d6b5e4a5e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:38.860450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-284ff297-7b9a-4380-b767-8d6b5e4a5e6e None None] MFA Rules not processed for user `743575fbe21e4d2c9d6885bc7b9f01db`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:38.862327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-284ff297-7b9a-4380-b767-8d6b5e4a5e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:39.022537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:39.062127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:39.128408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:39.172155 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3740/7458] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:39.179117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ff297-7b9a-4380-b767-8d6b5e4a5e6e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:39.276730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7d1a1-567d-40a7-b9e2-2ff360c58e2a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:39.285486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:39.287039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:39.287329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:39.287606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] PATH_INFO: `/v3/users/f18939151c0849699322abf996093522` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:39.289493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18939151c0849699322abf996093522)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:39.291943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:39.308349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ff297-7b9a-4380-b767-8d6b5e4a5e6e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:39.325011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:39.328102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:39.328102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:39.328102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:39.328511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:39.344207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:39.345986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:39.365209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3741/7459] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:02:39.485908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:39.498506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0b41-007f-48d7-9cc1-39f886f6f10a service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:39.506973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b3ad-4fe3-4a8f-956d-b5cce36e2028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:39.508583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b3ad-4fe3-4a8f-956d-b5cce36e2028 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:39.508871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b3ad-4fe3-4a8f-956d-b5cce36e2028 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:39.509234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b3ad-4fe3-4a8f-956d-b5cce36e2028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:39.567304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18939151c0849699322abf996093522'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:39.568528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18939151c0849699322abf996093522'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:39.585448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:39.608068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b3ad-4fe3-4a8f-956d-b5cce36e2028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:39.609594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2b3ad-4fe3-4a8f-956d-b5cce36e2028 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:39.620999 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3742/7460] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:39.645790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18939151c0849699322abf996093522'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:39.646631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18939151c0849699322abf996093522'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:39.673254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18939151c0849699322abf996093522'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:39.718351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:39.718351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:39.718668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:39.737029 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3719/7461] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:39 2022] DELETE /identity/v3/users/f18939151c0849699322abf996093522 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:39.756708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:39.758008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:39.840531 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3743/7462] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:39.850775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:39.852289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:39.983612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9fb5a-effa-4a93-8252-8737ed50bcf5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:39.983612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46914da-5914-4581-a8c9-8319d4423bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:39.983956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46914da-5914-4581-a8c9-8319d4423bea service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:39.984232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46914da-5914-4581-a8c9-8319d4423bea service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:39.984513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46914da-5914-4581-a8c9-8319d4423bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:40.035338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46914da-5914-4581-a8c9-8319d4423bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:40.040681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46914da-5914-4581-a8c9-8319d4423bea service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:40.106232 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3720/7463] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:40.791096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:40.796531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:40.807663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9ada3-7bd2-4f86-9fca-ebe756a3d6d0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:40.812967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:40.813752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:40.814031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:40.814343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] PATH_INFO: `/v3/projects/e045cf29260042628b75c5101e37198f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:40.815569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e045cf29260042628b75c5101e37198f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:40.817502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:40.993604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e045cf29260042628b75c5101e37198f', 'request_id': 'req-679b5231-cb80-4d20-9aaa-e65c2f78396f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.001979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e045cf29260042628b75c5101e37198f', 'request_id': 'req-679b5231-cb80-4d20-9aaa-e65c2f78396f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.084992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f0e82-eb58-4e21-9784-e8d19ee57b1d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:41.084992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f0e82-eb58-4e21-9784-e8d19ee57b1d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:41.085466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f0e82-eb58-4e21-9784-e8d19ee57b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:41.114808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f08f0e82-eb58-4e21-9784-e8d19ee57b1d None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:41.116850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f08f0e82-eb58-4e21-9784-e8d19ee57b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:41.145229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e045cf29260042628b75c5101e37198f', 'request_id': 'req-679b5231-cb80-4d20-9aaa-e65c2f78396f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.165607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] The token cache is being invalidate because project e045cf29260042628b75c5101e37198f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:41.166090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.167591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.171778 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3744/7464] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:40 2022] DELETE /identity/v3/projects/e045cf29260042628b75c5101e37198f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:41.175807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:41.177795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:41.227672 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3721/7465] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:41.280165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b5231-cb80-4d20-9aaa-e65c2f78396f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:41.285954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:41.286650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:41.286935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:41.287208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] PATH_INFO: `/v3/users/8764b8cf31c845c8aee83c1f90cb06cd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:41.288616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8764b8cf31c845c8aee83c1f90cb06cd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:41.291590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:41.295340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:41.615829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8764b8cf31c845c8aee83c1f90cb06cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.628893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8764b8cf31c845c8aee83c1f90cb06cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.630656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8764b8cf31c845c8aee83c1f90cb06cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.663136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8764b8cf31c845c8aee83c1f90cb06cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.833473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-54f7b01c-e6ba-4463-b6e2-1504252a238d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8764b8cf31c845c8aee83c1f90cb06cd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:41.844257 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3745/7466] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:41 2022] DELETE /identity/v3/users/8764b8cf31c845c8aee83c1f90cb06cd => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:42.411569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f0e82-eb58-4e21-9784-e8d19ee57b1d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:42.426694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f0e82-eb58-4e21-9784-e8d19ee57b1d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:42.494769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:42.526937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:42.527712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:42.528060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:42.528405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] PATH_INFO: `/v3/projects/151e0fa912d047a2b12ad9e4cdfa8256` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:42.529742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=151e0fa912d047a2b12ad9e4cdfa8256)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:42.532183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:42.715878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151e0fa912d047a2b12ad9e4cdfa8256', 'request_id': 'req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:42.723272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151e0fa912d047a2b12ad9e4cdfa8256', 'request_id': 'req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:42.884895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151e0fa912d047a2b12ad9e4cdfa8256', 'request_id': 'req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:42.906324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] The token cache is being invalidate because project 151e0fa912d047a2b12ad9e4cdfa8256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:42.906324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:42.906324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-873bbc9f-c5ba-4d67-b678-e1f0ab6d3fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:42.906324 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3722/7467] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:42 2022] DELETE /identity/v3/projects/151e0fa912d047a2b12ad9e4cdfa8256 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:42.908530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523066-b1e7-41ce-a81e-9fa040844eb1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:42.909001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523066-b1e7-41ce-a81e-9fa040844eb1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:42.909170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523066-b1e7-41ce-a81e-9fa040844eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:42.939313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2a523066-b1e7-41ce-a81e-9fa040844eb1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:42.940748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2a523066-b1e7-41ce-a81e-9fa040844eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:43.014555 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3746/7468] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:43.022792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415b65-1fd5-4f2c-a8e8-451c37a1fdc7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.023094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415b65-1fd5-4f2c-a8e8-451c37a1fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.023391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415b65-1fd5-4f2c-a8e8-451c37a1fdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:43.049003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a5415b65-1fd5-4f2c-a8e8-451c37a1fdc7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:43.050426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a5415b65-1fd5-4f2c-a8e8-451c37a1fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:43.062185 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3723/7469] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:43.064786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523066-b1e7-41ce-a81e-9fa040844eb1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:43.079219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523066-b1e7-41ce-a81e-9fa040844eb1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:43.085665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:43.087045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.087453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.087800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:43.088670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:02:43.089354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:43.091423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:43.118273 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3747/7470] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:02:43.122974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415b65-1fd5-4f2c-a8e8-451c37a1fdc7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:43.139548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415b65-1fd5-4f2c-a8e8-451c37a1fdc7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:43.140093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:43.140715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.141016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.141287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:43.141921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:43.143931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:43.329210 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3724/7471] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:43 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:43.330020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:43.342213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338db046-d7ea-44a2-872a-617766b7b3a6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:43.452585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:43.453349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.453699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.454040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:43.454797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:43.470089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:43.604167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:43.622241 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3748/7472] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:43 2022] POST /identity/v3/users => generated 286 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:02:43.627116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:43.645051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74659-9b9c-4ad2-ae62-65fd9ea3d5dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:43.662565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:43.675457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.677187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.677465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:43.678239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:43.680462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:43.692629 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3725/7473] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:43.696883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:43.715553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba294a-cde0-419f-917a-c34d8fe36c8b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:43.722619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26626ca3-f9d6-4a9d-a20b-b8491adbbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:43.723524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26626ca3-f9d6-4a9d-a20b-b8491adbbec0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.723962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26626ca3-f9d6-4a9d-a20b-b8491adbbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.724382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26626ca3-f9d6-4a9d-a20b-b8491adbbec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:43.725827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26626ca3-f9d6-4a9d-a20b-b8491adbbec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:43.729236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26626ca3-f9d6-4a9d-a20b-b8491adbbec0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:43.746192 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3749/7474] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:43.747652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:43.760266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1660e1-b4b0-42ca-8fb0-3f898cbaebe8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:43.765784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:43.766673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.766953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.767226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] PATH_INFO: `/v3/projects/6022758284bd48d9a352b977d3be50a4/users/1a517e7765034cce96051220d49534f7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:43.794131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6022758284bd48d9a352b977d3be50a4, user_id=1a517e7765034cce96051220d49534f7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:43.796829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:43.941415 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3726/7475] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:43 2022] PUT /identity/v3/projects/6022758284bd48d9a352b977d3be50a4/users/1a517e7765034cce96051220d49534f7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:43.954498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:43.955467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:43.955913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:44.005986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] MFA Rules not processed for user `1a517e7765034cce96051220d49534f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:44.007453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:44.140302 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3750/7476] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:44.150309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:44.154422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:44.234027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48087b73-3265-45ef-8280-d132b199fa7c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:44.237771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f99a5-c419-4c1d-9caf-8e559b0519b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:44.238408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f99a5-c419-4c1d-9caf-8e559b0519b4 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:44.238693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f99a5-c419-4c1d-9caf-8e559b0519b4 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:44.238970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f99a5-c419-4c1d-9caf-8e559b0519b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:44.249187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f99a5-c419-4c1d-9caf-8e559b0519b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:44.250891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f99a5-c419-4c1d-9caf-8e559b0519b4 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:44.265911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3727/7477] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:50.411376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:50.413799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:50.612034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21addc5-9bcc-4fb6-b6c2-a40c8f774858 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:50.620423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:50.621588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:50.622137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:50.622832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] PATH_INFO: `/v3/users/0814cad7eafd415885939484aa6f6bf0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:50.624458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0814cad7eafd415885939484aa6f6bf0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:50.626678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:50.952730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0814cad7eafd415885939484aa6f6bf0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:50.983295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0814cad7eafd415885939484aa6f6bf0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:50.986165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0814cad7eafd415885939484aa6f6bf0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:51.008761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0814cad7eafd415885939484aa6f6bf0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:51.013112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:51.107830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0814cad7eafd415885939484aa6f6bf0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:51.115782 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3751/7478] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:50 2022] DELETE /identity/v3/users/0814cad7eafd415885939484aa6f6bf0 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:51.120959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:51.121453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:51.121558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:51.139335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:51.151983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:51.153619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:51.264535 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3728/7479] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:51.271804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:51.273548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:51.428334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbd9d0-2d97-4040-aab1-139fdc5b27d2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:51.453099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:51.454128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:51.454636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:51.459542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:51.479903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:51.481612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:51.542784 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3752/7480] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:52.170345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:52.172370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:52.195036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51fbe9-f175-49e4-a729-5690524b287e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:52.211015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:52.215332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:52.216955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:52.217460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] PATH_INFO: `/v3/projects/28a028ac3a4648fc834f095b2ad554db` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:52.221889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a028ac3a4648fc834f095b2ad554db)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:52.224855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:52.446976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a028ac3a4648fc834f095b2ad554db', 'request_id': 'req-9949193c-941d-4fb2-906e-96777b06d75f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:52.475793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a028ac3a4648fc834f095b2ad554db', 'request_id': 'req-9949193c-941d-4fb2-906e-96777b06d75f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:52.585047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a028ac3a4648fc834f095b2ad554db', 'request_id': 'req-9949193c-941d-4fb2-906e-96777b06d75f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:52.605541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] The token cache is being invalidate because project 28a028ac3a4648fc834f095b2ad554db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:52.606302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:52.606993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:52.611770 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3729/7481] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:52 2022] DELETE /identity/v3/projects/28a028ac3a4648fc834f095b2ad554db => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:52.613949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:52.625687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020193-50da-4762-8cef-f9897652f83f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:52.733161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:52.734788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:52.735212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:52.735635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] PATH_INFO: `/v3/users/743575fbe21e4d2c9d6885bc7b9f01db` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:52.738827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=743575fbe21e4d2c9d6885bc7b9f01db)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:52.744995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:53.028955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743575fbe21e4d2c9d6885bc7b9f01db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:53.047835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743575fbe21e4d2c9d6885bc7b9f01db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:53.048596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743575fbe21e4d2c9d6885bc7b9f01db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:53.066120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743575fbe21e4d2c9d6885bc7b9f01db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:53.157347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e3a56d43-74c4-4684-905c-635fa1416f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743575fbe21e4d2c9d6885bc7b9f01db'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:53.177237 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3753/7482] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:02:52 2022] DELETE /identity/v3/users/743575fbe21e4d2c9d6885bc7b9f01db => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:53.776645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:53.778641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:53.827158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949193c-941d-4fb2-906e-96777b06d75f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:53.947701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:53.948358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:53.948639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:53.948919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] PATH_INFO: `/v3/projects/87003952720a48ac81f7086e86478b2e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:53.952072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=87003952720a48ac81f7086e86478b2e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:53.955651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:54.073722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:54.098548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87003952720a48ac81f7086e86478b2e', 'request_id': 'req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:54.109086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87003952720a48ac81f7086e86478b2e', 'request_id': 'req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:54.206193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87003952720a48ac81f7086e86478b2e', 'request_id': 'req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:54.220212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] The token cache is being invalidate because project 87003952720a48ac81f7086e86478b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:02:54.222196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:54.223908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c1586ebb-8b3a-4f6e-81c4-b3371acf04aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:02:54.227181 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3730/7483] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:02:53 2022] DELETE /identity/v3/projects/87003952720a48ac81f7086e86478b2e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:54.237457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829606-02e3-4043-b65b-7798bdbef704 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:54.237918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829606-02e3-4043-b65b-7798bdbef704 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:54.238269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829606-02e3-4043-b65b-7798bdbef704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:54.260327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:54.342947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7f829606-02e3-4043-b65b-7798bdbef704 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:54.346948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f829606-02e3-4043-b65b-7798bdbef704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:54.413983 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3754/7484] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:54.421691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840dc4-a152-4004-ad8b-92c4004b0edb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:54.421691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840dc4-a152-4004-ad8b-92c4004b0edb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:54.422765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840dc4-a152-4004-ad8b-92c4004b0edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:54.466782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-70840dc4-a152-4004-ad8b-92c4004b0edb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:54.466782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-70840dc4-a152-4004-ad8b-92c4004b0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:54.484667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829606-02e3-4043-b65b-7798bdbef704 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:54.484817 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3731/7485] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:54.502872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829606-02e3-4043-b65b-7798bdbef704 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:54.512000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:54.512869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:54.513565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:54.514010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:54.515198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:02:54.516910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:54.519399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:54.536914 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3755/7486] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:02:54.543739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840dc4-a152-4004-ad8b-92c4004b0edb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:54.554535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840dc4-a152-4004-ad8b-92c4004b0edb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:54.562260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:54.562892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:54.570233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:54.570233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:54.570233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:54.570233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:54.686765 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3732/7487] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:54 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:54.690315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:54.702802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e54b-86be-45a5-b2d8-490c1345d810 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:54.814688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:54.816197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:54.816688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:54.817062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:54.817840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:54.820056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:54.939409 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3756/7488] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:54 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:54.946511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:54.959956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50768608-0674-470a-8209-f0b494a79439 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:54.967122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:54.968067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:54.968397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:54.968693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:54.969337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:54.971231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:54.992561 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3733/7489] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:54.998315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:55.010412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3854d1-8a5f-4815-ac73-f385081652e4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:55.015626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b60feb-4fcf-4842-8237-60d1e7e7096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:55.016242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b60feb-4fcf-4842-8237-60d1e7e7096c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:55.016596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b60feb-4fcf-4842-8237-60d1e7e7096c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:55.017199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b60feb-4fcf-4842-8237-60d1e7e7096c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:55.017929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b60feb-4fcf-4842-8237-60d1e7e7096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:55.019753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b60feb-4fcf-4842-8237-60d1e7e7096c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:55.035451 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3757/7490] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:55.036649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:55.050009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a51db-2387-4131-adf0-9f4c30e1feb6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:55.056670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:55.057349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:55.057715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:55.057997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] PATH_INFO: `/v3/projects/7965bdb234c449ee987344e2f318ffb9/users/f56869520a8d4ad0b371f22afb94ad73/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:55.074411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7965bdb234c449ee987344e2f318ffb9, user_id=f56869520a8d4ad0b371f22afb94ad73, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:55.077014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:55.169834 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3734/7491] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:55 2022] PUT /identity/v3/projects/7965bdb234c449ee987344e2f318ffb9/users/f56869520a8d4ad0b371f22afb94ad73/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:55.180639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74321dc-8471-4775-a679-94d4dad2faca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:55.180935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74321dc-8471-4775-a679-94d4dad2faca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:55.185244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74321dc-8471-4775-a679-94d4dad2faca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:55.244580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e74321dc-8471-4775-a679-94d4dad2faca None None] MFA Rules not processed for user `f56869520a8d4ad0b371f22afb94ad73`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:55.247521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e74321dc-8471-4775-a679-94d4dad2faca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:55.372178 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3758/7492] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:55.379014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:55.452612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:55.497987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3518f23-4b1b-4629-8bba-2ae4d0765e37 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:55.503028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:55.505002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:55.505643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:55.506032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:55.507485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:55.511569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:55.653836 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3735/7493] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:02:55 2022] POST /identity/v3/projects => generated 367 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:02:55.658093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74321dc-8471-4775-a679-94d4dad2faca None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:55.674140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74321dc-8471-4775-a679-94d4dad2faca None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:55.741745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:55.742934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:55.748656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:55.748656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:55.748656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:55.748656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:55.866706 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3759/7494] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:02:55 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:02:55.870518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:55.885825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d0e7-9926-4b34-89ec-fbe13c6ee993 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:55.892422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:55.897768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:55.898303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:55.899304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:55.900561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:55.906579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:55.925394 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3736/7495] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:55.931962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:55.946617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd048e-0011-4599-b24a-8031478b4e5c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:55.953104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:55.953975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:55.954742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:55.954923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] PATH_INFO: `/v3/projects/2c8299631a9a4b708a9429c0c05961a2/users/36fcf5b0f89447fe82303d3ff1865869/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:55.973028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8299631a9a4b708a9429c0c05961a2, user_id=36fcf5b0f89447fe82303d3ff1865869, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:55.976235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:56.101453 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3760/7496] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:55 2022] PUT /identity/v3/projects/2c8299631a9a4b708a9429c0c05961a2/users/36fcf5b0f89447fe82303d3ff1865869/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:56.106228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:56.121915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ae684-82d4-4bea-a338-1bb489bb7ac0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:56.163224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:56.208370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c498f9-edd2-4ad5-9baa-c9e9f1bb4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:56.209125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c498f9-edd2-4ad5-9baa-c9e9f1bb4483 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:56.209477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c498f9-edd2-4ad5-9baa-c9e9f1bb4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:56.210435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c498f9-edd2-4ad5-9baa-c9e9f1bb4483 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:56.212290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c498f9-edd2-4ad5-9baa-c9e9f1bb4483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:56.216543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c498f9-edd2-4ad5-9baa-c9e9f1bb4483 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:56.233090 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3737/7497] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:02:56.238421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:56.252091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff680f63-76dc-4f2c-94aa-da0b1e3f9992 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:56.264978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:56.266648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:56.266932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:56.267214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] PATH_INFO: `/v3/projects/2c8299631a9a4b708a9429c0c05961a2/users/36fcf5b0f89447fe82303d3ff1865869/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:56.270599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8299631a9a4b708a9429c0c05961a2, user_id=36fcf5b0f89447fe82303d3ff1865869, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:56.273505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:56.290919 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3761/7498] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:02:56 2022] PUT /identity/v3/projects/2c8299631a9a4b708a9429c0c05961a2/users/36fcf5b0f89447fe82303d3ff1865869/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:02:56.301464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2055-00d0-4952-892c-a24c3597d094 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:56.301760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2055-00d0-4952-892c-a24c3597d094 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:56.302025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2055-00d0-4952-892c-a24c3597d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:56.352011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-307d2055-00d0-4952-892c-a24c3597d094 None None] MFA Rules not processed for user `36fcf5b0f89447fe82303d3ff1865869`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:02:56.353294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-307d2055-00d0-4952-892c-a24c3597d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:56.488885 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3738/7499] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:02:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:02:56.501345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:56.503150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:02:56.640979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f25cb4-01df-4934-9ee0-4b6c7d968c24 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:56.646992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0a685-baa9-42b0-aecc-dd6a1a99b8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:56.648080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0a685-baa9-42b0-aecc-dd6a1a99b8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:56.648442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0a685-baa9-42b0-aecc-dd6a1a99b8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:56.649361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0a685-baa9-42b0-aecc-dd6a1a99b8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:56.664327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0a685-baa9-42b0-aecc-dd6a1a99b8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:56.668925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0a685-baa9-42b0-aecc-dd6a1a99b8a5 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:56.680794 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3762/7500] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:02:57.035812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2055-00d0-4952-892c-a24c3597d094 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:02:57.055581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2055-00d0-4952-892c-a24c3597d094 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:02:57.065278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:02:57.067832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:02:57.068526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:02:57.068905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:02:57.171622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:02:57.174221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:02:57.187656 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3739/7501] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:02:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:03:00.282260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98998587-2ebb-4436-849d-bd21671b3d32 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:00.290408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98998587-2ebb-4436-849d-bd21671b3d32 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:00.290408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98998587-2ebb-4436-849d-bd21671b3d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:00.359510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-98998587-2ebb-4436-849d-bd21671b3d32 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:00.360777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-98998587-2ebb-4436-849d-bd21671b3d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:00.548264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:00.589964 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3763/7502] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:03:00.805802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:00.808317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:00.921167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:00.974386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114929d-e49d-44d4-accd-836cc29613b2 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:00.984149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:00.984878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:00.986114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:00.986114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:01.015640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:01.020995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:01.051000 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3740/7503] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:03:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:04.422717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98998587-2ebb-4436-849d-bd21671b3d32 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:04.454308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98998587-2ebb-4436-849d-bd21671b3d32 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:04.481381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfecb8-8461-4bf2-bb02-e731957de247 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:04.482092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfecb8-8461-4bf2-bb02-e731957de247 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:04.482378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfecb8-8461-4bf2-bb02-e731957de247 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:04.482650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfecb8-8461-4bf2-bb02-e731957de247 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:04.486677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68dfecb8-8461-4bf2-bb02-e731957de247 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:04.711654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfecb8-8461-4bf2-bb02-e731957de247 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:04.717135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfecb8-8461-4bf2-bb02-e731957de247 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:04.763704 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3764/7504] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:11.071383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:11.132738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:11.346269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aac3e-d3bc-4726-a1c5-6eb42af28362 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:11.361065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:11.361744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:11.362031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:11.362346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] PATH_INFO: `/v3/users/f56869520a8d4ad0b371f22afb94ad73` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:11.363759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56869520a8d4ad0b371f22afb94ad73)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:11.365686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:11.623288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56869520a8d4ad0b371f22afb94ad73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:11.624305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56869520a8d4ad0b371f22afb94ad73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:11.729680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56869520a8d4ad0b371f22afb94ad73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:11.730370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56869520a8d4ad0b371f22afb94ad73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:11.739128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56869520a8d4ad0b371f22afb94ad73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:11.813808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3741/7505] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:03:11 2022] DELETE /identity/v3/users/f56869520a8d4ad0b371f22afb94ad73 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:03:11.818486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:11.818999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:11.819232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:11.885058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:11.894731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:12.095139 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3765/7506] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:03:12.106676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:12.108671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:12.268654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b288-ba2b-4e7f-8c08-8749c73ca330 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:12.280221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:12.280865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:12.281151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:12.281748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:12.306438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:12.307949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:12.332393 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3742/7507] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:03:13.578796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:13.578796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:13.578796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b169d1-f3a4-44d7-bc2e-4aa8be6f4bd0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:13.607202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:13.608320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:13.608671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:13.609033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] PATH_INFO: `/v3/projects/7965bdb234c449ee987344e2f318ffb9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:13.610769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7965bdb234c449ee987344e2f318ffb9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:13.615251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:13.798088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7965bdb234c449ee987344e2f318ffb9', 'request_id': 'req-3d09ac2b-e722-430b-9c5f-5f47c634529a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:13.807434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7965bdb234c449ee987344e2f318ffb9', 'request_id': 'req-3d09ac2b-e722-430b-9c5f-5f47c634529a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:13.920834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7965bdb234c449ee987344e2f318ffb9', 'request_id': 'req-3d09ac2b-e722-430b-9c5f-5f47c634529a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:13.947282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] The token cache is being invalidate because project 7965bdb234c449ee987344e2f318ffb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:03:13.947630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:13.948314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:13.955733 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3766/7508] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:03:13 2022] DELETE /identity/v3/projects/7965bdb234c449ee987344e2f318ffb9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:03:13.961350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:13.985488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dc313-6bb8-40bd-8e97-a9826dd16943 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:14.054201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:14.172726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:14.173340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:14.173625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:14.173902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] PATH_INFO: `/v3/users/36fcf5b0f89447fe82303d3ff1865869` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:14.175118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fcf5b0f89447fe82303d3ff1865869)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:14.177045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:14.550108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fcf5b0f89447fe82303d3ff1865869'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:14.557166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fcf5b0f89447fe82303d3ff1865869'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:14.691693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fcf5b0f89447fe82303d3ff1865869'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:14.691693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fcf5b0f89447fe82303d3ff1865869'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:14.738726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-55fdb226-e510-4485-b92a-cde072024571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fcf5b0f89447fe82303d3ff1865869'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:14.769563 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3743/7509] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:03:13 2022] DELETE /identity/v3/users/36fcf5b0f89447fe82303d3ff1865869 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:03:15.600755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:15.602098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:15.625059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:15.633812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ac2b-e722-430b-9c5f-5f47c634529a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:15.868028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:15.868341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:15.869340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:15.877088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] PATH_INFO: `/v3/projects/2c8299631a9a4b708a9429c0c05961a2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:15.877088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8299631a9a4b708a9429c0c05961a2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:15.877088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:16.067117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8299631a9a4b708a9429c0c05961a2', 'request_id': 'req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:16.090138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8299631a9a4b708a9429c0c05961a2', 'request_id': 'req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:16.204853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8299631a9a4b708a9429c0c05961a2', 'request_id': 'req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:16.222217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] The token cache is being invalidate because project 2c8299631a9a4b708a9429c0c05961a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:03:16.222607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:16.223365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-00a73f38-0fa5-4db8-bde3-4d2b7678fa49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:16.229582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3767/7510] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:03:15 2022] DELETE /identity/v3/projects/2c8299631a9a4b708a9429c0c05961a2 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:03:16.235876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e565e-2517-41ac-ba1d-99515900e2b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:16.236386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e565e-2517-41ac-ba1d-99515900e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:16.236484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e565e-2517-41ac-ba1d-99515900e2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:16.273963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-006e565e-2517-41ac-ba1d-99515900e2b8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:16.282970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-006e565e-2517-41ac-ba1d-99515900e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:16.519727 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3744/7511] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:03:16.528465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f283-220a-4653-8e21-dbc192ef6028 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:16.528762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f283-220a-4653-8e21-dbc192ef6028 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:16.529146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f283-220a-4653-8e21-dbc192ef6028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:16.587357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-86c4f283-220a-4653-8e21-dbc192ef6028 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:16.591858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86c4f283-220a-4653-8e21-dbc192ef6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:16.625327 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3768/7512] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:03:16.630463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e565e-2517-41ac-ba1d-99515900e2b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:16.645516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e565e-2517-41ac-ba1d-99515900e2b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:16.666684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:16.667322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:16.667606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:16.667885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:16.668563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:03:16.668872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:16.681830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:16.717181 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3745/7513] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:03:16.721564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4f283-220a-4653-8e21-dbc192ef6028 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:16.749285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4f283-220a-4653-8e21-dbc192ef6028 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:16.779984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:16.780896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:16.787926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:16.788455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:16.790505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:16.794757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:17.002879 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3769/7514] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:03:16 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:03:17.004693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:17.019936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a28d2-3fb2-4f15-8008-53e807d6379b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:17.087173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:17.176077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:17.177121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:17.177632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:17.178597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:17.180142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:17.183340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:17.323228 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3746/7515] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:03:17 2022] POST /identity/v3/users => generated 291 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:03:17.324092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:17.344013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedefa0e-a1a7-495b-a02e-67a2147f7e8f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:17.357330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:17.358328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:17.358772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:17.359222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:17.360308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:17.362233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:17.378381 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3770/7516] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:03:17.382920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:17.399218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08df411-6c74-4445-86ab-750b7affd7bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:17.418678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706687f-d96b-43e3-9115-530007e53494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:17.419323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706687f-d96b-43e3-9115-530007e53494 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:17.419605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706687f-d96b-43e3-9115-530007e53494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:17.419880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706687f-d96b-43e3-9115-530007e53494 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:17.425831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706687f-d96b-43e3-9115-530007e53494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:17.429466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706687f-d96b-43e3-9115-530007e53494 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:17.471177 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3747/7517] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:03:17.475357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:17.494834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe34b3-53db-4b2f-857b-53ecd21f6b5b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:17.510048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:17.511070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:17.511830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:17.512442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] PATH_INFO: `/v3/projects/6b2d8cd32845447d9acbcaa723f34304/users/7d8561ffff134236b96615cadb38e750/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:17.550258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2d8cd32845447d9acbcaa723f34304, user_id=7d8561ffff134236b96615cadb38e750, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:17.554841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:17.677017 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3771/7518] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:03:17 2022] PUT /identity/v3/projects/6b2d8cd32845447d9acbcaa723f34304/users/7d8561ffff134236b96615cadb38e750/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:03:17.689985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f1d7-a665-49a1-899f-f1da1dbd3306 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:17.690508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f1d7-a665-49a1-899f-f1da1dbd3306 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:17.690879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f1d7-a665-49a1-899f-f1da1dbd3306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:17.788214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b8c7f1d7-a665-49a1-899f-f1da1dbd3306 None None] MFA Rules not processed for user `7d8561ffff134236b96615cadb38e750`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:17.788214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b8c7f1d7-a665-49a1-899f-f1da1dbd3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:17.984625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3748/7519] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:03:17.989234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:18.086751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:18.150132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785852-6ff7-4690-b72a-aadc9a508c4f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:18.155765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:18.156385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:18.156756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:18.157039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:18.157674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:18.159793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:18.284338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3772/7520] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:03:17 2022] POST /identity/v3/projects => generated 383 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:03:18.288448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f1d7-a665-49a1-899f-f1da1dbd3306 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:18.302673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f1d7-a665-49a1-899f-f1da1dbd3306 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:18.444763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:18.446255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:18.446774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:18.447207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:18.448097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:18.451009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:18.622924 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3749/7521] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:03:18 2022] POST /identity/v3/users => generated 298 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:03:18.626282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:18.691631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756c574-a1eb-4e4b-a665-ac927912bb00 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:18.708227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:18.708864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:18.709144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:18.712520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:18.713170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:18.714833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:18.777400 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3773/7522] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:03:18.791598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:18.804481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ae41e-d191-4af1-84de-7fac7e3dae36 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:18.830596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:18.832312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:18.832601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:18.832876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] PATH_INFO: `/v3/projects/24ba4e9733f24729933cb2982b43b3e1/users/d8f8908f83f9450494e2fa864020da38/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:18.863067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ba4e9733f24729933cb2982b43b3e1, user_id=d8f8908f83f9450494e2fa864020da38, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:18.867764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:18.989674 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3750/7523] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:03:18 2022] PUT /identity/v3/projects/24ba4e9733f24729933cb2982b43b3e1/users/d8f8908f83f9450494e2fa864020da38/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:03:18.994891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:19.009851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9353d-3d65-457c-be6c-7d9bd219f524 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:19.172509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81bab-6676-436c-966f-cf0b237aa453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:19.172955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81bab-6676-436c-966f-cf0b237aa453 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:19.173232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81bab-6676-436c-966f-cf0b237aa453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:19.177189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81bab-6676-436c-966f-cf0b237aa453 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:19.177189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b81bab-6676-436c-966f-cf0b237aa453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:19.177189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b81bab-6676-436c-966f-cf0b237aa453 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:19.200758 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3774/7524] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:03:19.204728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:19.225373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:19.232744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e6a3-a8a1-4d89-a506-70ba00876e4c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:19.239532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:19.240478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:19.240959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:19.241391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] PATH_INFO: `/v3/projects/24ba4e9733f24729933cb2982b43b3e1/users/d8f8908f83f9450494e2fa864020da38/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:19.267845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ba4e9733f24729933cb2982b43b3e1, user_id=d8f8908f83f9450494e2fa864020da38, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:19.276921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:19.328722 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3751/7525] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:03:19 2022] PUT /identity/v3/projects/24ba4e9733f24729933cb2982b43b3e1/users/d8f8908f83f9450494e2fa864020da38/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:03:19.342683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:19.343431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:19.343979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:19.493138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] MFA Rules not processed for user `d8f8908f83f9450494e2fa864020da38`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:19.494499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:19.616895 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3775/7526] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:03:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:03:19.630420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:19.633724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:19.773651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5af43a-d75e-4458-a378-38d3937ed051 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:19.779425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:19.780459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:19.780970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:19.781468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:19.965521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:19.969421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:19.997634 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3752/7527] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:03:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:03:22.236889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:22.239266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:22.314967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:22.380555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac51ea-bc26-4fa2-83db-47b37aa7a7d2 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:22.386800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc96da-05f5-4d36-b068-fe4199e15909 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:22.387622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc96da-05f5-4d36-b068-fe4199e15909 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:22.388060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc96da-05f5-4d36-b068-fe4199e15909 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:22.388485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc96da-05f5-4d36-b068-fe4199e15909 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:22.390410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81dc96da-05f5-4d36-b068-fe4199e15909 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:22.411059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc96da-05f5-4d36-b068-fe4199e15909 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:22.413263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc96da-05f5-4d36-b068-fe4199e15909 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:22.431700 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3776/7528] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:03:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:03:29.981553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:32.547598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=21 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:33.439810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:33.439810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:33.539877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d2cef-7120-4fc4-9416-9d68048432af service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:33.545576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:33.546355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:33.546624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:33.546891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:33.557737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:33.559593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:33.585507 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3753/7529] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:43.579921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:50.606805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:50.607808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:50.608319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:50.654504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:50.655932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:50.768777 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3777/7530] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:03:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:03:50.788920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:50.811925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e1a5a-3014-44f2-9ff1-1eff8d5ee59a service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:50.858167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:50.858167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:50.858167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:50.858167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:50.914646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:50.916362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:50.969102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3754/7531] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:03:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:55.218653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:55.218653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:55.271935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625972-b509-4085-bf4f-176df09e28b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:55.286912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da6a07-6960-46cc-b401-a076df8a5bb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:55.289084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da6a07-6960-46cc-b401-a076df8a5bb4 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:55.289825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da6a07-6960-46cc-b401-a076df8a5bb4 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:55.290580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da6a07-6960-46cc-b401-a076df8a5bb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:55.293725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e1da6a07-6960-46cc-b401-a076df8a5bb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:55.363836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da6a07-6960-46cc-b401-a076df8a5bb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:55.369743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da6a07-6960-46cc-b401-a076df8a5bb4 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:55.412386 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3778/7532] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:03:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:03:57.649733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:57.651206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:57.755388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0af1ae-3c81-4347-9d72-cfcd1ec3fbef service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:57.763306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:57.765608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:57.765608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:57.765608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] PATH_INFO: `/v3/users/1a517e7765034cce96051220d49534f7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:57.765943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a517e7765034cce96051220d49534f7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:57.767804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:58.072852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a517e7765034cce96051220d49534f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:58.073553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a517e7765034cce96051220d49534f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:58.151890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a517e7765034cce96051220d49534f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:58.153351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a517e7765034cce96051220d49534f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:58.168444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a517e7765034cce96051220d49534f7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:58.207593 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3755/7533] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:03:57 2022] DELETE /identity/v3/users/1a517e7765034cce96051220d49534f7 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:03:58.211879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:58.212354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:58.212453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:58.251583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:58.254921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:58.428301 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3779/7534] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:03:58.436960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:58.440102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:58.572179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993450a-8d5a-4165-8268-70cecf2cf5e0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:58.590456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:58.591092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:58.615009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:58.615009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:58.615009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:58.626171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:58.655923 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3756/7535] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:03:59.382959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:59.384668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:59.439033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cfad4-0ef4-44b7-8a97-22e376bd158d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:59.464074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:03:59.465183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:59.465622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:59.466695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] PATH_INFO: `/v3/projects/6022758284bd48d9a352b977d3be50a4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:59.469348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6022758284bd48d9a352b977d3be50a4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:03:59.476120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:03:59.674717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6022758284bd48d9a352b977d3be50a4', 'request_id': 'req-34848427-6642-4b77-8f60-1a5aa929fed9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:59.699328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6022758284bd48d9a352b977d3be50a4', 'request_id': 'req-34848427-6642-4b77-8f60-1a5aa929fed9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:59.789865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:03:59.791496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:59.816764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdecef8-cf26-4476-8e41-b43378565c1d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:03:59.824428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6022758284bd48d9a352b977d3be50a4', 'request_id': 'req-34848427-6642-4b77-8f60-1a5aa929fed9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:59.846253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] The token cache is being invalidate because project 6022758284bd48d9a352b977d3be50a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:03:59.848643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:59.856467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:59.861857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34848427-6642-4b77-8f60-1a5aa929fed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:03:59.867057 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3780/7536] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:03:59 2022] DELETE /identity/v3/projects/6022758284bd48d9a352b977d3be50a4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:03:59.871599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d1893-541f-4929-b451-3293007ba02b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:03:59.872151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d1893-541f-4929-b451-3293007ba02b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:03:59.872631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d1893-541f-4929-b451-3293007ba02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:03:59.918755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fa2d1893-541f-4929-b451-3293007ba02b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:03:59.920343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa2d1893-541f-4929-b451-3293007ba02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:03:59.937030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:00.021311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:00.022461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:00.022940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:00.023378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:00.026272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:00.060094 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3781/7537] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:04:00.068473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f583bd-c9f9-48a2-832c-cdfb6c05c2b3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:00.068822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f583bd-c9f9-48a2-832c-cdfb6c05c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:00.069110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f583bd-c9f9-48a2-832c-cdfb6c05c2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:00.134657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-87f583bd-c9f9-48a2-832c-cdfb6c05c2b3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:00.136382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-87f583bd-c9f9-48a2-832c-cdfb6c05c2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:00.155456 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3782/7538] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:04:00.160609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f583bd-c9f9-48a2-832c-cdfb6c05c2b3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:00.186869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f583bd-c9f9-48a2-832c-cdfb6c05c2b3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:00.211355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:00.211990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:00.212268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:00.212549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:00.213202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:04:00.213520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:00.215853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:00.249905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3783/7539] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:04:00.250821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:00.278028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a3f45-6f49-49a3-ba0f-11d703ca6c9c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:00.279571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:00.281033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:00.292758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:00.293380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:00.293790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:00.293928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:00.294578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:00.296497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:00.327561 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3757/7540] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:03:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:04:00.492136 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3784/7541] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:04:00 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:04:00.496690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:00.512810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eebbea-8655-4230-ab9a-a31adc8cf57f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:00.756900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:00.756900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:00.756900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:00.756900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:00.757335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:00.757335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:00.840558 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3758/7542] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:04:00 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:04:00.845086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:00.861098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be3252-3b8e-4417-aa0b-b9c4965f3de3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:00.883303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:00.884149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:00.884590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:00.885249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:00.887241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:00.889086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:00.914090 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3785/7543] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:04:00.917842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:00.932649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dedc50-83ca-4d47-8eab-ea42b0df8db9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:00.943702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e431b9-270f-4e85-aa77-55e7339ee57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:00.945523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e431b9-270f-4e85-aa77-55e7339ee57a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:00.945523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e431b9-270f-4e85-aa77-55e7339ee57a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:00.945523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e431b9-270f-4e85-aa77-55e7339ee57a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:00.947651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e431b9-270f-4e85-aa77-55e7339ee57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:00.949329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e431b9-270f-4e85-aa77-55e7339ee57a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:01.005945 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3759/7544] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:04:01.008414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:01.033931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2a328-3d90-43f4-8350-6d0142cefbd9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:01.054357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:01.056175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:01.056633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:01.057085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] PATH_INFO: `/v3/projects/ccbc15ce8ee64fa1b767c3bfb5926fee/users/8e66870b1baa4c3aaebe72cf76b25453/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:01.096405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbc15ce8ee64fa1b767c3bfb5926fee, user_id=8e66870b1baa4c3aaebe72cf76b25453, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:01.099483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:01.215063 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3786/7545] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:04:01 2022] PUT /identity/v3/projects/ccbc15ce8ee64fa1b767c3bfb5926fee/users/8e66870b1baa4c3aaebe72cf76b25453/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:01.227434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cbf2a-eeac-4c5a-bbcc-897509a3c38d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:01.227978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cbf2a-eeac-4c5a-bbcc-897509a3c38d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:01.228418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cbf2a-eeac-4c5a-bbcc-897509a3c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:01.289093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-047cbf2a-eeac-4c5a-bbcc-897509a3c38d None None] MFA Rules not processed for user `8e66870b1baa4c3aaebe72cf76b25453`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:01.289980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-047cbf2a-eeac-4c5a-bbcc-897509a3c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:01.296164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:01.441062 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3760/7546] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:04:01.442434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:01.580210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026740-aeb1-4970-8008-67b52ea458c8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:01.596125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:01.597007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:01.597469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:01.597909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:01.598750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:01.601480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:01.768397 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3787/7547] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:04:01 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:04:01.769858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cbf2a-eeac-4c5a-bbcc-897509a3c38d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:01.788681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cbf2a-eeac-4c5a-bbcc-897509a3c38d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:01.939196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:01.942809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:01.945347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:01.945813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:01.947060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:01.949193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:02.089683 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3761/7548] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:04:01 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:04:02.094795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:02.110796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878882-9227-4116-8a7c-99fb6461a310 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:02.122183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:02.123873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:02.124165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:02.124522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:02.125188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:02.130756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:02.157392 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3788/7549] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:04:02.161920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:02.176029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6ac6-9219-42f7-9762-affd38cd20fc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:02.190740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:02.195672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:02.195672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:02.195672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] PATH_INFO: `/v3/projects/fa606c38d24a471b968a27745f4ac3f7/users/8289c9d6d9304cdcb6b00b0b938b4d77/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:02.220864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa606c38d24a471b968a27745f4ac3f7, user_id=8289c9d6d9304cdcb6b00b0b938b4d77, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:02.225029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:02.312157 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3762/7550] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:04:02 2022] PUT /identity/v3/projects/fa606c38d24a471b968a27745f4ac3f7/users/8289c9d6d9304cdcb6b00b0b938b4d77/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:02.316401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:02.328929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:02.335730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced0329-a163-4361-a5fb-a90f29e33e53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:02.442851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebd934-f035-4b60-8968-40eb1da3589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:02.446477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd934-f035-4b60-8968-40eb1da3589c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:02.446477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd934-f035-4b60-8968-40eb1da3589c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:02.446477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd934-f035-4b60-8968-40eb1da3589c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:02.446477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebd934-f035-4b60-8968-40eb1da3589c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:02.447519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebd934-f035-4b60-8968-40eb1da3589c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:02.466101 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3789/7551] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:04:02.467672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:02.494178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5f198-29bc-409b-9a3b-d2399663ffd4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:02.510066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:02.510759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:02.511036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:02.511313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] PATH_INFO: `/v3/projects/fa606c38d24a471b968a27745f4ac3f7/users/8289c9d6d9304cdcb6b00b0b938b4d77/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:02.516377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa606c38d24a471b968a27745f4ac3f7, user_id=8289c9d6d9304cdcb6b00b0b938b4d77, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:02.519073 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:02.542104 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3763/7552] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:04:02 2022] PUT /identity/v3/projects/fa606c38d24a471b968a27745f4ac3f7/users/8289c9d6d9304cdcb6b00b0b938b4d77/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:02.543588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91adc-bced-4c61-9772-d1faca68f7ca None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:02.543944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91adc-bced-4c61-9772-d1faca68f7ca None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:02.544290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91adc-bced-4c61-9772-d1faca68f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:02.583642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eed91adc-bced-4c61-9772-d1faca68f7ca None None] MFA Rules not processed for user `8289c9d6d9304cdcb6b00b0b938b4d77`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:02.585945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eed91adc-bced-4c61-9772-d1faca68f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:02.674990 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3790/7553] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:04:02.687795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:02.689499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:02.771840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d51764-6322-4acd-8c12-292373dec35c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:02.778770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:02.779467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:02.779914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:02.780049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:02.797664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:02.854564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:02.856023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:02.866380 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3764/7554] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:06.951116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed91adc-bced-4c61-9772-d1faca68f7ca None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:06.982474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed91adc-bced-4c61-9772-d1faca68f7ca None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:06.987531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a9c1-eda2-46b0-8d0c-a1a0b62ee852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:06.988163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a9c1-eda2-46b0-8d0c-a1a0b62ee852 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:07.005432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a9c1-eda2-46b0-8d0c-a1a0b62ee852 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:07.005841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a9c1-eda2-46b0-8d0c-a1a0b62ee852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:07.014171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8a73a9c1-eda2-46b0-8d0c-a1a0b62ee852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:07.214684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73a9c1-eda2-46b0-8d0c-a1a0b62ee852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:07.216325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73a9c1-eda2-46b0-8d0c-a1a0b62ee852 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:07.233038 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3791/7555] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:07.575760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:07.593303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52950d-0252-4eb0-8a20-fed5ffd52519 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:07.597336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:07.597952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:07.598273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:07.598545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:07.610465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:07.612147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:07.624283 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3765/7556] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:17.223666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:17.618417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=27 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:22.250081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:22.250705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:22.250826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:22.285551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] MFA Rules not processed for user `8e66870b1baa4c3aaebe72cf76b25453`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:22.290346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:22.301322 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3792/7557] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:23.027606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:23.028657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:23.047879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3567c-3b1e-49a3-b1d5-576c769f7b30 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:23.053297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:23.054247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:23.054757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:23.055269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:23.067300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:23.074861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:23.078512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:23.101494 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3766/7558] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:04:24.729621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:24.731196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:24.893325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dfb91-b8d2-48ad-9e8d-c22668fb0022 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:24.926341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:24.928079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:24.928530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:24.928969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:24.938966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:24.973236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:24.975453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:25.007379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:25.014341 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3793/7559] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:25.033000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cde14-33aa-4b5f-bfed-9b09444820bf service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:25.049091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:25.049976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:25.050519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:25.050992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:25.053717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:25.134547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:25.136151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:25.163245 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3767/7560] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:33.663664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:33.688022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa11a-0387-4f5e-99c1-863ad6d0ad94 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:33.706768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:33.707463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:33.707749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:33.708026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:33.712302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:33.735827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:33.738308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:33.781900 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3794/7561] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:33.943769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:33.945211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:33.966007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b097-1a12-4fe9-818c-b8a572b0d1f7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:33.975276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:33.975939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:33.976222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:33.981206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] PATH_INFO: `/v3/users/7963aa7a74c147cdab99b56131a66842` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:33.983643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7963aa7a74c147cdab99b56131a66842)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:33.985879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:34.302839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7963aa7a74c147cdab99b56131a66842'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:34.304046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7963aa7a74c147cdab99b56131a66842'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:34.436272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7963aa7a74c147cdab99b56131a66842'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:34.436934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7963aa7a74c147cdab99b56131a66842'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:34.449574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89eaee0b-ec08-4081-8a10-1b9f2fe68466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7963aa7a74c147cdab99b56131a66842'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:34.480898 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3768/7562] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:04:33 2022] DELETE /identity/v3/users/7963aa7a74c147cdab99b56131a66842 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:35.042564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:35.075986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a91f4-0811-453f-bf23-1efb9174bc62 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:35.199763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:35.199763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:35.199763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:35.199763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] PATH_INFO: `/v3/projects/4474d29a061642a2820fab69697ea4fe` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:35.200518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4474d29a061642a2820fab69697ea4fe)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:35.207434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:35.397214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4474d29a061642a2820fab69697ea4fe', 'request_id': 'req-502e5fb3-46ea-4246-b48e-3fe16a825123'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:35.412742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4474d29a061642a2820fab69697ea4fe', 'request_id': 'req-502e5fb3-46ea-4246-b48e-3fe16a825123'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:35.476253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4474d29a061642a2820fab69697ea4fe', 'request_id': 'req-502e5fb3-46ea-4246-b48e-3fe16a825123'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:35.494385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:35.494385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] The token cache is being invalidate because project 4474d29a061642a2820fab69697ea4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:04:35.494385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:35.495512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-502e5fb3-46ea-4246-b48e-3fe16a825123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:35.497754 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3795/7563] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:04:35 2022] DELETE /identity/v3/projects/4474d29a061642a2820fab69697ea4fe => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:35.502746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc29b-1ca9-449f-8720-701937c751cb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:35.503257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc29b-1ca9-449f-8720-701937c751cb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:35.503341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dc29b-1ca9-449f-8720-701937c751cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:35.524698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-221dc29b-1ca9-449f-8720-701937c751cb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:35.525907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-221dc29b-1ca9-449f-8720-701937c751cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:35.577867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:35.592854 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3769/7564] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:35.601848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4068-d636-4451-a4e2-69a1b63f0178 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:35.602243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4068-d636-4451-a4e2-69a1b63f0178 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:35.602527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4068-d636-4451-a4e2-69a1b63f0178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:35.624378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d62e4068-d636-4451-a4e2-69a1b63f0178 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:35.625608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d62e4068-d636-4451-a4e2-69a1b63f0178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:35.635058 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3796/7565] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:35.639369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dc29b-1ca9-449f-8720-701937c751cb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:35.653550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dc29b-1ca9-449f-8720-701937c751cb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:35.666308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:35.667356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:35.667932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:35.668494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:35.669527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:04:35.670112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:35.672229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:35.707262 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3770/7566] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:04:35.708610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4068-d636-4451-a4e2-69a1b63f0178 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:35.723393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4068-d636-4451-a4e2-69a1b63f0178 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:35.734780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:35.735532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:35.736217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:35.736332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:35.737030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:35.745226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:35.917412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:35.917609 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3797/7567] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:04:35 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:04:35.930286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5a55-a95a-4a6d-9584-1ccafa8ddc41 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:36.055363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:36.056511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:36.057004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:36.057733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:36.059390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:36.081472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:36.210254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3771/7568] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:04:35 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:04:36.210361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:36.230423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bb56e-daa2-4d10-92b2-8f0fbbb80a64 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:36.235290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:36.235906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:36.236183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:36.236453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:36.237092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:36.238926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:36.250275 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3798/7569] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:04:36.254472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:36.265647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b02eb-01e9-4b6f-b89f-e7e8935af9ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:36.270442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a49fac-3f02-4617-aa7e-3e115934818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:36.271665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a49fac-3f02-4617-aa7e-3e115934818c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:36.271968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a49fac-3f02-4617-aa7e-3e115934818c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:36.272239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a49fac-3f02-4617-aa7e-3e115934818c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:36.272876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a49fac-3f02-4617-aa7e-3e115934818c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:36.274532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a49fac-3f02-4617-aa7e-3e115934818c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:36.286759 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3772/7570] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:04:36.291074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:36.303605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a9da1-7462-4ec7-945f-619ae0cd3ab3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:36.309051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c97c6-1588-418a-b1df-ffef1b85218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:36.309610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c97c6-1588-418a-b1df-ffef1b85218a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:36.310156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c97c6-1588-418a-b1df-ffef1b85218a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:36.310584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c97c6-1588-418a-b1df-ffef1b85218a admin admin] PATH_INFO: `/v3/projects/0ecce2c06c92430c960a30e339c67657/users/a30abc68bfe54b08bec23485ea413465/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:36.347693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c97c6-1588-418a-b1df-ffef1b85218a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ecce2c06c92430c960a30e339c67657, user_id=a30abc68bfe54b08bec23485ea413465, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:36.351214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c97c6-1588-418a-b1df-ffef1b85218a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:36.426941 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3799/7571] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:04:36 2022] PUT /identity/v3/projects/0ecce2c06c92430c960a30e339c67657/users/a30abc68bfe54b08bec23485ea413465/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:04:36.460527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:36.460527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:36.465685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:36.512888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] MFA Rules not processed for user `a30abc68bfe54b08bec23485ea413465`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:36.515146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:36.604560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3773/7572] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:36.609672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:36.610097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:36.610396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:36.633365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] MFA Rules not processed for user `a30abc68bfe54b08bec23485ea413465`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:36.634618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:36.654384 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3800/7573] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:36.657544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:36.659229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:36.723140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:36.752288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115441d0-5cda-49b6-bad8-6590f8cb7af4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:36.759499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:36.760328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:36.760614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:36.761041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:36.770262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:36.772477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:36.791357 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3774/7574] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:37.952171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:37.954613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:38.105867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100b235-7e22-4b29-a64c-f5b8eac60178 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:38.111313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:38.112499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:38.113167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:38.113742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:38.117110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:38.307835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:38.309383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:38.331830 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3801/7575] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:39.313877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:39.315474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:39.365723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251950f-5443-4523-8856-80c84d04fecb service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:39.387977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:39.388643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:39.389013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:39.389282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] PATH_INFO: `/v3/users/b28a5b73e4fa4ce0aadd144e09a6f977` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:39.391719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28a5b73e4fa4ce0aadd144e09a6f977)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:39.393883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:39.773481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28a5b73e4fa4ce0aadd144e09a6f977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:39.774215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28a5b73e4fa4ce0aadd144e09a6f977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:39.892851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28a5b73e4fa4ce0aadd144e09a6f977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:39.893897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28a5b73e4fa4ce0aadd144e09a6f977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:39.920373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28a5b73e4fa4ce0aadd144e09a6f977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:39.989594 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3775/7576] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:04:39 2022] DELETE /identity/v3/users/b28a5b73e4fa4ce0aadd144e09a6f977 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:40.415802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:40.439655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bea05-3841-4b20-845e-5e6d91730330 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:40.527100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:40.551557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:40.562104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:40.562104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:40.562104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] PATH_INFO: `/v3/projects/480e0bfa755e4b99bb01ea3084d7c214` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:40.562104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480e0bfa755e4b99bb01ea3084d7c214)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:40.562104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:40.688940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480e0bfa755e4b99bb01ea3084d7c214', 'request_id': 'req-47bb7c76-8789-4a06-b0fd-331981e67e35'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:40.695903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480e0bfa755e4b99bb01ea3084d7c214', 'request_id': 'req-47bb7c76-8789-4a06-b0fd-331981e67e35'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:40.772397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480e0bfa755e4b99bb01ea3084d7c214', 'request_id': 'req-47bb7c76-8789-4a06-b0fd-331981e67e35'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:40.792100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] The token cache is being invalidate because project 480e0bfa755e4b99bb01ea3084d7c214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:04:40.792494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:40.795061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:40.810363 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3802/7577] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:04:40 2022] DELETE /identity/v3/projects/480e0bfa755e4b99bb01ea3084d7c214 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:44.847230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:44.851220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:44.948363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134eb78-c13d-4057-9e62-e256a4890115 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:45.059870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1784a8-b0d1-410b-9587-8c61d623745b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:45.060608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1784a8-b0d1-410b-9587-8c61d623745b service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:45.061019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1784a8-b0d1-410b-9587-8c61d623745b service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:45.061418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1784a8-b0d1-410b-9587-8c61d623745b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:45.063318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7f1784a8-b0d1-410b-9587-8c61d623745b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:45.070319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:45.134879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1784a8-b0d1-410b-9587-8c61d623745b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:45.136324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1784a8-b0d1-410b-9587-8c61d623745b service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:45.148391 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3776/7578] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:49.013637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:49.015248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:49.101999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb7c76-8789-4a06-b0fd-331981e67e35 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:49.107430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:49.108220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:49.108660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:49.108936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] PATH_INFO: `/v3/users/a30abc68bfe54b08bec23485ea413465` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:49.110125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30abc68bfe54b08bec23485ea413465)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:49.112261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:49.477416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30abc68bfe54b08bec23485ea413465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:49.485234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30abc68bfe54b08bec23485ea413465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:49.486264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30abc68bfe54b08bec23485ea413465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:49.500847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:49.506481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30abc68bfe54b08bec23485ea413465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:49.613065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30abc68bfe54b08bec23485ea413465'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:49.623474 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3803/7579] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:04:49 2022] DELETE /identity/v3/users/a30abc68bfe54b08bec23485ea413465 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:49.625480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:49.631583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:49.631583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:49.649139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:49.650710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:49.718735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3777/7580] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:49.728888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:49.730409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:49.795746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c41bf3-c45a-452a-922c-c7a149a7d290 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:49.799691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70aa535-907d-4aaf-849b-c4f764457e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:49.800350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa535-907d-4aaf-849b-c4f764457e96 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:49.800633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa535-907d-4aaf-849b-c4f764457e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:49.800911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa535-907d-4aaf-849b-c4f764457e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:49.810572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70aa535-907d-4aaf-849b-c4f764457e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:49.812026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70aa535-907d-4aaf-849b-c4f764457e96 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:49.821999 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3804/7581] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:50.410192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:50.412489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:50.431126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7096450-2cba-411f-ba88-bf0f705eac8c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:50.436030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:50.436698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:50.436984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:50.437298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] PATH_INFO: `/v3/projects/0ecce2c06c92430c960a30e339c67657` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:50.438508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ecce2c06c92430c960a30e339c67657)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:50.440473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:50.637645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ecce2c06c92430c960a30e339c67657', 'request_id': 'req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:50.646238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ecce2c06c92430c960a30e339c67657', 'request_id': 'req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:50.762310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ecce2c06c92430c960a30e339c67657', 'request_id': 'req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:50.776655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] The token cache is being invalidate because project 0ecce2c06c92430c960a30e339c67657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:04:50.780299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:50.781250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-89c47a20-d91f-4f96-a9ac-d5d0f41893c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:04:50.782959 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3778/7582] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:04:50 2022] DELETE /identity/v3/projects/0ecce2c06c92430c960a30e339c67657 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:50.788469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b17be-8595-40ec-8c4c-133ddc4ff08c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:50.788933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b17be-8595-40ec-8c4c-133ddc4ff08c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:50.789047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b17be-8595-40ec-8c4c-133ddc4ff08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:50.811112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fe1b17be-8595-40ec-8c4c-133ddc4ff08c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:50.812331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe1b17be-8595-40ec-8c4c-133ddc4ff08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:50.878403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3805/7583] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:50.886612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2a79-1de6-4432-861b-f0da7a28b347 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:50.886909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2a79-1de6-4432-861b-f0da7a28b347 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:50.887188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e2a79-1de6-4432-861b-f0da7a28b347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:50.918403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa4e2a79-1de6-4432-861b-f0da7a28b347 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:50.920025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa4e2a79-1de6-4432-861b-f0da7a28b347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:50.929540 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3779/7584] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:50.933970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b17be-8595-40ec-8c4c-133ddc4ff08c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:50.944619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b17be-8595-40ec-8c4c-133ddc4ff08c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:50.949536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:50.950257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:50.950609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:50.950944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:50.951659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:04:50.952026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:50.953774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:50.970114 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3806/7585] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:04:50.971383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2a79-1de6-4432-861b-f0da7a28b347 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:50.983623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e2a79-1de6-4432-861b-f0da7a28b347 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:50.989393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:50.990013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:50.990328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:50.990601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:50.991444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:50.993350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:51.028223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:51.179385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3780/7586] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:04:50 2022] POST /identity/v3/projects => generated 395 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:04:51.184276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:51.195725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00afc84-dc8b-49fc-aef5-52b54a23f026 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:51.262182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:51.262801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:51.263079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:51.263358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:51.263997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:51.266078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:51.346756 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3807/7587] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:04:51 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:04:51.348151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:51.362174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2febc-d8cc-4935-aee1-c091125277fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:51.368124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:51.369094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:51.369840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:51.370356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:51.372663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:51.373839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:51.410968 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3781/7588] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:04:51.412304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:51.426016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be50b6-9586-4431-ae34-4c4beb98f547 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:51.443164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479d17-fe38-417c-bd56-b6cb3cf8c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:51.443631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479d17-fe38-417c-bd56-b6cb3cf8c3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:51.443914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479d17-fe38-417c-bd56-b6cb3cf8c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:51.444250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479d17-fe38-417c-bd56-b6cb3cf8c3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:51.444822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479d17-fe38-417c-bd56-b6cb3cf8c3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:51.446476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479d17-fe38-417c-bd56-b6cb3cf8c3e4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:51.457938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:51.486374 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3808/7589] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:04:51.491187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:51.507535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4acb5-d333-4b7c-8280-56f5d5a45331 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:51.513187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:51.526451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:51.526774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:51.527065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] PATH_INFO: `/v3/projects/d997272634b942cea71aa0192c8fd6a3/users/9dad180b505844d3b17d811bc071e3e8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:51.559281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d997272634b942cea71aa0192c8fd6a3, user_id=9dad180b505844d3b17d811bc071e3e8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:51.564948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:51.711292 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3782/7590] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:04:51 2022] PUT /identity/v3/projects/d997272634b942cea71aa0192c8fd6a3/users/9dad180b505844d3b17d811bc071e3e8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:04:51.716421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bbbb4-da3e-4c89-85b2-e688b597abfa None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:51.716731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bbbb4-da3e-4c89-85b2-e688b597abfa None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:51.716983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bbbb4-da3e-4c89-85b2-e688b597abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:51.738235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5d9bbbb4-da3e-4c89-85b2-e688b597abfa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:51.739447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d9bbbb4-da3e-4c89-85b2-e688b597abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:51.805617 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3809/7591] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:51.814919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:51.817124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:51.914989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c251-038d-4431-a307-58478406f1ee admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:51.919275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0031ba-6c9b-4564-a57b-d60e35cefcab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:51.919896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0031ba-6c9b-4564-a57b-d60e35cefcab service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:51.920182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0031ba-6c9b-4564-a57b-d60e35cefcab service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:51.920458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0031ba-6c9b-4564-a57b-d60e35cefcab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:51.931305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0031ba-6c9b-4564-a57b-d60e35cefcab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:51.933183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0031ba-6c9b-4564-a57b-d60e35cefcab service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:51.945282 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3783/7592] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:53.727450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1e49-ea79-4afa-a54a-b29bf25b2993 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:53.728428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1e49-ea79-4afa-a54a-b29bf25b2993 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:53.728955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1e49-ea79-4afa-a54a-b29bf25b2993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:53.758928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5f9d1e49-ea79-4afa-a54a-b29bf25b2993 None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:53.760584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f9d1e49-ea79-4afa-a54a-b29bf25b2993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:53.853445 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3810/7593] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:59.255388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:59.256310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:59.259695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:59.318384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] MFA Rules not processed for user `9dad180b505844d3b17d811bc071e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:59.321894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:59.440268 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3784/7594] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:59.457667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:59.458805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:59.458889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:59.502393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] MFA Rules not processed for user `9dad180b505844d3b17d811bc071e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:04:59.504026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:59.514470 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3811/7595] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:04:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:04:59.527575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:59.529037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:59.696961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:59.776768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc32f-0e33-4aa1-892f-f2ca762b8a23 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:59.787346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:59.788838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:59.789298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:59.789723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:59.803004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:59.806689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:04:59.808405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:59.817662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:59.832296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac3a80-ba37-4e3e-b869-7d76bc26458f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:04:59.839526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:04:59.840522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:04:59.840968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:04:59.841416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:04:59.843469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:04:59.850602 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3785/7596] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:04:59.860691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:04:59.862905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:04:59.884145 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3812/7597] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:05:00.615197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:00.615197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:00.615197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e5383-06be-45b5-ac95-7291b6fe066c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:00.616963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5120b-7c61-4731-8479-c0bb22f6cb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:00.616963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5120b-7c61-4731-8479-c0bb22f6cb41 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:00.616963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5120b-7c61-4731-8479-c0bb22f6cb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:00.616963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5120b-7c61-4731-8479-c0bb22f6cb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:00.617424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b9a5120b-7c61-4731-8479-c0bb22f6cb41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:00.619416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5120b-7c61-4731-8479-c0bb22f6cb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:00.620746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5120b-7c61-4731-8479-c0bb22f6cb41 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:00.649204 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3786/7598] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:05:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:05:01.430421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:01.475369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73abc7b-b46e-475e-9255-1d673b0c46df service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:01.502576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a905b0c-a1fe-4cb6-930d-41433575fa9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:01.505981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905b0c-a1fe-4cb6-930d-41433575fa9d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:01.506294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905b0c-a1fe-4cb6-930d-41433575fa9d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:01.506624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a905b0c-a1fe-4cb6-930d-41433575fa9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:01.521450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8a905b0c-a1fe-4cb6-930d-41433575fa9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:01.565251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a905b0c-a1fe-4cb6-930d-41433575fa9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:01.567831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a905b0c-a1fe-4cb6-930d-41433575fa9d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:01.599900 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3813/7599] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:05:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:05:10.631960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=16 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:11.587646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=68 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:16.251382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540d2e-341b-4e3f-afa1-02041be07b77 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:16.252338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540d2e-341b-4e3f-afa1-02041be07b77 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:16.252781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540d2e-341b-4e3f-afa1-02041be07b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:16.274643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00540d2e-341b-4e3f-afa1-02041be07b77 None None] MFA Rules not processed for user `9dad180b505844d3b17d811bc071e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:16.276008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00540d2e-341b-4e3f-afa1-02041be07b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:16.283098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3787/7600] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:16.356214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78b42-0926-45c8-b29e-9fe308b1d97a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:16.356760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78b42-0926-45c8-b29e-9fe308b1d97a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:16.356760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78b42-0926-45c8-b29e-9fe308b1d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:16.378464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1dd78b42-0926-45c8-b29e-9fe308b1d97a None None] MFA Rules not processed for user `9dad180b505844d3b17d811bc071e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:16.380661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1dd78b42-0926-45c8-b29e-9fe308b1d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:16.393048 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3814/7601] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:16.423716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7705-ba7c-41df-85c6-43fbe979a0c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:16.424271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7705-ba7c-41df-85c6-43fbe979a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:16.424271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7705-ba7c-41df-85c6-43fbe979a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:16.455717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-eaad7705-ba7c-41df-85c6-43fbe979a0c7 None None] MFA Rules not processed for user `9dad180b505844d3b17d811bc071e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:16.476563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eaad7705-ba7c-41df-85c6-43fbe979a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:16.481635 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3788/7602] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:05:16.508571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44135a4-1e6a-4ae9-99a8-a3a7697fa9bb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:16.508866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44135a4-1e6a-4ae9-99a8-a3a7697fa9bb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:16.509153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44135a4-1e6a-4ae9-99a8-a3a7697fa9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:16.536669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c44135a4-1e6a-4ae9-99a8-a3a7697fa9bb None None] MFA Rules not processed for user `9dad180b505844d3b17d811bc071e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:16.537972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c44135a4-1e6a-4ae9-99a8-a3a7697fa9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:16.545353 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3815/7603] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:16.572922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acd93-bdc2-41c8-b15d-098a62df1284 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:16.573209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acd93-bdc2-41c8-b15d-098a62df1284 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:16.573489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acd93-bdc2-41c8-b15d-098a62df1284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:16.593294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7b2acd93-bdc2-41c8-b15d-098a62df1284 None None] MFA Rules not processed for user `9dad180b505844d3b17d811bc071e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:16.594548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7b2acd93-bdc2-41c8-b15d-098a62df1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:16.601618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3789/7604] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:19.819678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44135a4-1e6a-4ae9-99a8-a3a7697fa9bb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:19.833178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44135a4-1e6a-4ae9-99a8-a3a7697fa9bb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:19.836916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:19.837616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:19.837874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:19.838189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:19.839908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:19.852837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:19.854296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:19.866119 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3816/7605] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:05:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:05:22.880629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224a00-ae6e-4dc3-b74a-bdd84cd60d62 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:22.881197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224a00-ae6e-4dc3-b74a-bdd84cd60d62 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:22.881197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab224a00-ae6e-4dc3-b74a-bdd84cd60d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:22.911713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ab224a00-ae6e-4dc3-b74a-bdd84cd60d62 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:22.913736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ab224a00-ae6e-4dc3-b74a-bdd84cd60d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:23.041014 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3790/7606] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:05:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:05:23.261193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:23.263632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:23.501611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf2c2d-fde6-46a7-9d94-629585df759d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:23.521597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:23.522533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:23.523068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:23.523429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:23.539377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:23.541804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:23.565876 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3817/7607] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:05:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:05:26.370250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951a4ac-75ed-4a43-957c-1acd5af20e0b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:26.371220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951a4ac-75ed-4a43-957c-1acd5af20e0b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:26.371503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951a4ac-75ed-4a43-957c-1acd5af20e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:26.396080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8951a4ac-75ed-4a43-957c-1acd5af20e0b None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:26.397528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8951a4ac-75ed-4a43-957c-1acd5af20e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:26.407645 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3791/7608] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:27.317940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:27.338622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b0eef-9d2e-485a-bd74-76f52244f339 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:27.354491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:27.355192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:27.355478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:27.355754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:27.359967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:27.571180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:27.572975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:27.600968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3818/7609] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:05:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:05:27.909464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951a4ac-75ed-4a43-957c-1acd5af20e0b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:27.930952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951a4ac-75ed-4a43-957c-1acd5af20e0b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:27.943443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:27.945776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:27.947023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:27.948364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] PATH_INFO: `/v3/users/9dad180b505844d3b17d811bc071e3e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:27.954412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dad180b505844d3b17d811bc071e3e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:27.958617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:28.293739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dad180b505844d3b17d811bc071e3e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:28.294759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dad180b505844d3b17d811bc071e3e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:28.378026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dad180b505844d3b17d811bc071e3e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:28.378777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dad180b505844d3b17d811bc071e3e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:28.390638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2b7a0392-cdbd-4211-bee5-dd14bf9e8089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dad180b505844d3b17d811bc071e3e8'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:28.439770 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3792/7610] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:05:27 2022] DELETE /identity/v3/users/9dad180b505844d3b17d811bc071e3e8 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:05:28.859317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:28.895315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2557d2d-957a-4f0b-ba6d-ac3aabdb5801 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:28.996138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:29.002266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:29.002921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:29.003206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:29.003481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] PATH_INFO: `/v3/projects/d997272634b942cea71aa0192c8fd6a3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:29.004912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d997272634b942cea71aa0192c8fd6a3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:29.006931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:29.175478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd997272634b942cea71aa0192c8fd6a3', 'request_id': 'req-ee199e3d-b4bd-4866-9984-0f92d6146517'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:29.186737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd997272634b942cea71aa0192c8fd6a3', 'request_id': 'req-ee199e3d-b4bd-4866-9984-0f92d6146517'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:29.286993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd997272634b942cea71aa0192c8fd6a3', 'request_id': 'req-ee199e3d-b4bd-4866-9984-0f92d6146517'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:29.304997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] The token cache is being invalidate because project d997272634b942cea71aa0192c8fd6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:05:29.305530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:29.310355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ee199e3d-b4bd-4866-9984-0f92d6146517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:05:29.312522 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3819/7611] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:05:28 2022] DELETE /identity/v3/projects/d997272634b942cea71aa0192c8fd6a3 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:05:29.319793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df796-f404-49ce-a921-23c5d9805909 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:29.321429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df796-f404-49ce-a921-23c5d9805909 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:29.321748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df796-f404-49ce-a921-23c5d9805909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:29.350903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ca4df796-f404-49ce-a921-23c5d9805909 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:29.352304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca4df796-f404-49ce-a921-23c5d9805909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:29.413871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:29.438582 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3793/7612] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:29.448242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d3d2-8969-40d1-b126-4d05488bfadb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:29.448801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d3d2-8969-40d1-b126-4d05488bfadb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:29.449151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d3d2-8969-40d1-b126-4d05488bfadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:29.479587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0987d3d2-8969-40d1-b126-4d05488bfadb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:29.481853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0987d3d2-8969-40d1-b126-4d05488bfadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:29.495201 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3820/7613] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:29.499174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df796-f404-49ce-a921-23c5d9805909 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:29.513180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df796-f404-49ce-a921-23c5d9805909 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:29.520744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:29.521534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:29.522242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:29.522837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:29.523673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:05:29.524251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:29.527145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:29.559090 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3794/7614] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:05:29.563073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d3d2-8969-40d1-b126-4d05488bfadb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:29.584983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d3d2-8969-40d1-b126-4d05488bfadb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:29.592069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:29.593291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:29.594275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:29.594738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:29.595619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:29.597565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:29.703638 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3821/7615] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:05:29 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:05:29.704807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:29.735092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6222b3-0cf6-4dea-8180-6d0bc91fd88c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:29.821658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:29.822620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:29.823244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:29.824423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:29.825104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:29.827111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:29.976666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3795/7616] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:05:29 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:05:29.980525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:30.021593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2897a46-7312-4015-8cbf-accc5e6189bb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:30.049530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:30.052334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:30.069482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:30.069973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:30.070897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:30.072816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:30.090981 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3822/7617] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:05:30.095048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:30.116691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577a46-276a-466a-b5ab-955863b759ef admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:30.123785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d62bd-f6de-4150-b383-07dd04519502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:30.124731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d62bd-f6de-4150-b383-07dd04519502 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:30.125267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d62bd-f6de-4150-b383-07dd04519502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:30.125754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d62bd-f6de-4150-b383-07dd04519502 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:30.126656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d62bd-f6de-4150-b383-07dd04519502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:30.128731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d62bd-f6de-4150-b383-07dd04519502 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:30.144783 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3796/7618] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:05:30.148779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:30.165957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20875d-617d-4971-859e-75fc642ca818 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:30.177493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eda071-2175-4a17-bbda-909ac4870fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:30.177493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eda071-2175-4a17-bbda-909ac4870fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:30.177493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eda071-2175-4a17-bbda-909ac4870fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:30.177493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eda071-2175-4a17-bbda-909ac4870fb7 admin admin] PATH_INFO: `/v3/projects/a79d8bf690d04c18b05c645663c4b164/users/68bd78c89d374f0da78cd4bd72048cfd/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:30.236130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eda071-2175-4a17-bbda-909ac4870fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79d8bf690d04c18b05c645663c4b164, user_id=68bd78c89d374f0da78cd4bd72048cfd, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:30.247251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eda071-2175-4a17-bbda-909ac4870fb7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:30.387173 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3823/7619] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:05:30 2022] PUT /identity/v3/projects/a79d8bf690d04c18b05c645663c4b164/users/68bd78c89d374f0da78cd4bd72048cfd/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:05:30.397448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:30.398662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:30.398662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:30.474610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] MFA Rules not processed for user `68bd78c89d374f0da78cd4bd72048cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:30.475943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:30.646551 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3797/7620] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:05:30.651625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b7ec-bcea-4be6-ba9c-4501d5415783 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:30.659305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b7ec-bcea-4be6-ba9c-4501d5415783 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:30.659305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b7ec-bcea-4be6-ba9c-4501d5415783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:30.677136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9c91b7ec-bcea-4be6-ba9c-4501d5415783 None None] MFA Rules not processed for user `68bd78c89d374f0da78cd4bd72048cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:30.679333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c91b7ec-bcea-4be6-ba9c-4501d5415783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:30.687956 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3824/7621] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:30.701207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:05:30.706964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:30.791380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:30.834369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bbdc0-3aab-4b9b-92e8-fa3b1245d7a7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:05:30.839984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1b4bb-9a2b-49d6-bfdf-57b34c9b3a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:05:30.840606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b4bb-9a2b-49d6-bfdf-57b34c9b3a49 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:30.840884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b4bb-9a2b-49d6-bfdf-57b34c9b3a49 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:30.841154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b4bb-9a2b-49d6-bfdf-57b34c9b3a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:30.850274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1b4bb-9a2b-49d6-bfdf-57b34c9b3a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:05:30.851912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1b4bb-9a2b-49d6-bfdf-57b34c9b3a49 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:05:30.864325 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3798/7622] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:05:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:05:31.726461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:31.727007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:31.727095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:31.753484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] MFA Rules not processed for user `8e66870b1baa4c3aaebe72cf76b25453`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:31.756057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:31.844718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3825/7623] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:05:41.308845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=13 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:41.833271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:56.299355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:05:56.299927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:05:56.299927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:05:56.322890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] MFA Rules not processed for user `0b5c1ca9fe7c4461a07baa70d73f04e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:05:56.324418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:05:56.393594 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3799/7624] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:06:02.764024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:02.770192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:02.798553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469ccd7-775c-42b7-9ab1-158e1078adde None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:02.826810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:02.827467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:02.827737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:02.828038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:02.830914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:02.848453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:02.850423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:02.875587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3826/7625] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:06:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:06:06.385857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:12.438021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:12.440048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:12.542335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16086-4ff9-4cba-9c41-7ad966418b6a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:12.545919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eeb55-8f51-4717-b847-c0ecb81eaf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:12.546563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb55-8f51-4717-b847-c0ecb81eaf3f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:12.547123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb55-8f51-4717-b847-c0ecb81eaf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:12.547402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eeb55-8f51-4717-b847-c0ecb81eaf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:12.549116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d78eeb55-8f51-4717-b847-c0ecb81eaf3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:12.563672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eeb55-8f51-4717-b847-c0ecb81eaf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:12.569046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eeb55-8f51-4717-b847-c0ecb81eaf3f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:12.579863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3800/7626] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:06:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:06:12.865487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:18.526935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:18.637914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6110-53dc-427c-9cb3-dc2b4e035f54 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:18.648244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:18.648896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:18.649186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:18.649467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] PATH_INFO: `/v3/users/68bd78c89d374f0da78cd4bd72048cfd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:18.652964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68bd78c89d374f0da78cd4bd72048cfd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:18.655061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:18.888292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68bd78c89d374f0da78cd4bd72048cfd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:18.907159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68bd78c89d374f0da78cd4bd72048cfd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:18.910453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68bd78c89d374f0da78cd4bd72048cfd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:18.934316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68bd78c89d374f0da78cd4bd72048cfd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:18.993384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68bd78c89d374f0da78cd4bd72048cfd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:19.008731 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3827/7627] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:06:18 2022] DELETE /identity/v3/users/68bd78c89d374f0da78cd4bd72048cfd => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:06:19.013479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:19.013970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:19.014098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:19.035865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:06:19.040597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:19.126952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3801/7628] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:06:19.138734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:19.140596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:19.228882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beda72e-5bdd-4486-bb77-ac6f9d6f7da9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:19.235087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:19.236020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:19.236524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:19.237008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:19.250644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:19.253045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:19.267579 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3828/7629] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:06:19.968355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:19.970226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:19.991696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d868781-97d7-4b49-a575-aa4807f093dc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:20.000719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:20.000719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:20.000719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:20.001509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] PATH_INFO: `/v3/projects/a79d8bf690d04c18b05c645663c4b164` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:20.003371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79d8bf690d04c18b05c645663c4b164)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:20.010580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:20.244112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79d8bf690d04c18b05c645663c4b164', 'request_id': 'req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:20.266312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79d8bf690d04c18b05c645663c4b164', 'request_id': 'req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:20.403931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79d8bf690d04c18b05c645663c4b164', 'request_id': 'req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:20.413373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] The token cache is being invalidate because project a79d8bf690d04c18b05c645663c4b164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:06:20.413784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:20.414678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a8a5fa8f-7605-4ea5-ad03-b32c00d2d1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:06:20.416378 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3802/7630] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:06:19 2022] DELETE /identity/v3/projects/a79d8bf690d04c18b05c645663c4b164 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:06:20.424757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24810ac6-7a50-4085-b12f-f01f18aa61f9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:20.424757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24810ac6-7a50-4085-b12f-f01f18aa61f9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:20.427466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24810ac6-7a50-4085-b12f-f01f18aa61f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:20.428454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:20.430010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:20.451692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11301721-a78e-4437-8d6e-624a4fdf9673 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:20.453468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24810ac6-7a50-4085-b12f-f01f18aa61f9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:06:20.455481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24810ac6-7a50-4085-b12f-f01f18aa61f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:20.464686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:20.477513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:20.537714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:20.538576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:20.538866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:20.539331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:20.542852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:20.581613 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3803/7631] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:06:20.582610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e815f-8a42-4c52-bc43-c36850ee1327 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:20.583441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e815f-8a42-4c52-bc43-c36850ee1327 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:20.583722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e815f-8a42-4c52-bc43-c36850ee1327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:20.627327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a5e815f-8a42-4c52-bc43-c36850ee1327 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:06:20.628507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a5e815f-8a42-4c52-bc43-c36850ee1327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:20.652767 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3804/7632] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:06:20.653884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e815f-8a42-4c52-bc43-c36850ee1327 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:20.673525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e815f-8a42-4c52-bc43-c36850ee1327 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:20.686199 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:20.686836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:20.687115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:20.687381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:20.688036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:06:20.690757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:20.694711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:20.704685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:20.706253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:20.719419 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3805/7633] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:06:20.724907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:20.728386 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3829/7634] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:06:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:06:20.747438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca9616-3baf-4dbc-b445-8cce89ecd4b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:20.754213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:20.755359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:20.755731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:20.756094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:20.756842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:20.759474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:20.881602 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3806/7635] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:06:20 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:06:20.893664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:20.918464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74520437-af75-41a2-970a-de33d23b3212 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:21.002702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:21.003547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:21.003990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:21.004464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:21.006591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:21.009132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:21.120531 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3830/7636] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:06:20 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:06:21.124513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:21.136457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928aa1dc-5ccd-42fd-bb6f-5317fb1910bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:21.141703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:21.142573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:21.142928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:21.143270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:21.143999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:21.146087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:21.159586 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3807/7637] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:06:21.164034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:21.175912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31621-819f-4773-a42b-61e1ddd45206 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:21.185044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc3959-703d-432f-a157-0fabe2b800f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:21.185044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3959-703d-432f-a157-0fabe2b800f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:21.185044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3959-703d-432f-a157-0fabe2b800f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:21.185044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3959-703d-432f-a157-0fabe2b800f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:21.185598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc3959-703d-432f-a157-0fabe2b800f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:21.187529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc3959-703d-432f-a157-0fabe2b800f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:21.207091 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3831/7638] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:06:21.211594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:21.222412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c1dfd-6d65-4f98-9c21-55ace7bdffec admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:21.228258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:21.228939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:21.229222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:21.229504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] PATH_INFO: `/v3/projects/1858431337674b66a5b20c21bea03164/users/59e8ec11269d4e2f9e78e95950642232/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:21.247218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1858431337674b66a5b20c21bea03164, user_id=59e8ec11269d4e2f9e78e95950642232, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:21.250231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:21.405760 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3808/7639] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:06:21 2022] PUT /identity/v3/projects/1858431337674b66a5b20c21bea03164/users/59e8ec11269d4e2f9e78e95950642232/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:06:21.411835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e27a-5242-40a8-ae2f-196b5c017b6b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:21.412106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e27a-5242-40a8-ae2f-196b5c017b6b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:21.412473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894e27a-5242-40a8-ae2f-196b5c017b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:21.441174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a894e27a-5242-40a8-ae2f-196b5c017b6b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:06:21.443140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a894e27a-5242-40a8-ae2f-196b5c017b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:21.503369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:21.538199 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3832/7640] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:06:21.548163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:21.550321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:21.639579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33486a9-c897-4e51-ab46-5c1ea0abb5dd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:21.643799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:21.645307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:21.646542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:21.646989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:21.658020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:21.659681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:21.670899 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3809/7641] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:06:31.666346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:31.792812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:32.363373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e674f-6950-43ff-9b36-2383f23d98ce None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:32.364457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e674f-6950-43ff-9b36-2383f23d98ce None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:32.364968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e674f-6950-43ff-9b36-2383f23d98ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:32.425242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9d5e674f-6950-43ff-9b36-2383f23d98ce None None] MFA Rules not processed for user `59e8ec11269d4e2f9e78e95950642232`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:06:32.431477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d5e674f-6950-43ff-9b36-2383f23d98ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:32.509848 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3833/7642] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:06:32.525606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:06:32.527106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:32.653189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641da63-0a62-483b-9a34-b791f25c482f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:06:32.664248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0985b-f19a-44c7-96b3-b615c8ff0094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:06:32.664960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0985b-f19a-44c7-96b3-b615c8ff0094 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:32.665232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0985b-f19a-44c7-96b3-b615c8ff0094 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:32.665505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0985b-f19a-44c7-96b3-b615c8ff0094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:32.675066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0985b-f19a-44c7-96b3-b615c8ff0094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:06:32.678465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0985b-f19a-44c7-96b3-b615c8ff0094 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:06:32.694528 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3810/7643] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:06:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:06:36.296891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2171-e4df-4e58-a08e-7a8aca5d941d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:36.297440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2171-e4df-4e58-a08e-7a8aca5d941d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:36.297556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2171-e4df-4e58-a08e-7a8aca5d941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:36.333934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8a6d2171-e4df-4e58-a08e-7a8aca5d941d None None] MFA Rules not processed for user `59e8ec11269d4e2f9e78e95950642232`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:06:36.335113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8a6d2171-e4df-4e58-a08e-7a8aca5d941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:36.342107 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3834/7644] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:06:42.689642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=38 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:46.327416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=35 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:55.226408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:06:55.227381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:06:55.227823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:06:55.250149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] MFA Rules not processed for user `8e66870b1baa4c3aaebe72cf76b25453`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:06:55.251948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:06:55.374077 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3811/7645] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:06:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:05.353899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=25 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:05.402830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:05.403311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:05.403450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:05.426939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:05.428230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:05.501551 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3835/7646] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:05.722147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:05.723721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:05.809245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98bd06-fd36-4a27-8cf6-83d1c96e961f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:05.815828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551fed1-2b1a-4ec5-afa8-e43cd9fd4bfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:05.817032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551fed1-2b1a-4ec5-afa8-e43cd9fd4bfa service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:05.817315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551fed1-2b1a-4ec5-afa8-e43cd9fd4bfa service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:05.817592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551fed1-2b1a-4ec5-afa8-e43cd9fd4bfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:05.827335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551fed1-2b1a-4ec5-afa8-e43cd9fd4bfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:05.829251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551fed1-2b1a-4ec5-afa8-e43cd9fd4bfa service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:05.839679 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3812/7647] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:07:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:15.494340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=25 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:15.835781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:19.528931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:19.530527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:19.545291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd7836-cb97-4bca-91cc-d788f11a798d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:19.550311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:19.550963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:19.551249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:19.551531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] PATH_INFO: `/v3/users/7d8561ffff134236b96615cadb38e750` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:19.552699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8561ffff134236b96615cadb38e750)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:19.554890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:19.761524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8561ffff134236b96615cadb38e750'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:19.774314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8561ffff134236b96615cadb38e750'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:19.774314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8561ffff134236b96615cadb38e750'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:19.794298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8561ffff134236b96615cadb38e750'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:19.863507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8561ffff134236b96615cadb38e750'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:19.871219 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3836/7648] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:07:19 2022] DELETE /identity/v3/users/7d8561ffff134236b96615cadb38e750 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:07:19.875888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:19.876386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:19.876386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:19.907457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:19.907457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:19.978087 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3813/7649] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:07:19.989190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:19.991178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:20.070089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8426-f4f1-444c-a901-b788560d1a7f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:20.074225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:20.074856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:20.077711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:20.077711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:20.085965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:20.087781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:20.102522 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3837/7650] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:20.543236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:20.544937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:20.579978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adcd2a-40e8-4cc7-8cb3-b5e2db1011d6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:20.588025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:20.588772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:20.594943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:20.594943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] PATH_INFO: `/v3/projects/6b2d8cd32845447d9acbcaa723f34304` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:20.594943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2d8cd32845447d9acbcaa723f34304)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:20.594943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:20.709596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2d8cd32845447d9acbcaa723f34304', 'request_id': 'req-0196d037-ff18-4681-9a4d-bd84c0e3acc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:20.717979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2d8cd32845447d9acbcaa723f34304', 'request_id': 'req-0196d037-ff18-4681-9a4d-bd84c0e3acc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:20.774684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2d8cd32845447d9acbcaa723f34304', 'request_id': 'req-0196d037-ff18-4681-9a4d-bd84c0e3acc4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:20.788773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] The token cache is being invalidate because project 6b2d8cd32845447d9acbcaa723f34304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:07:20.789132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:20.789765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:20.791490 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3814/7651] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:07:20 2022] DELETE /identity/v3/projects/6b2d8cd32845447d9acbcaa723f34304 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:20.795577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:20.805919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4fb4-db8b-4324-a975-b44b4b3513ec service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:20.875773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:20.876599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:20.876893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:20.877444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] PATH_INFO: `/v3/users/d8f8908f83f9450494e2fa864020da38` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:20.879445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f8908f83f9450494e2fa864020da38)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:20.881884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:20.904401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:21.219662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f8908f83f9450494e2fa864020da38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:21.228980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f8908f83f9450494e2fa864020da38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:21.230157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f8908f83f9450494e2fa864020da38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:21.246469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f8908f83f9450494e2fa864020da38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:21.598004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-984e6d49-be13-4e63-a181-6ebe6058ca43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f8908f83f9450494e2fa864020da38'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:21.605207 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3838/7652] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:07:20 2022] DELETE /identity/v3/users/d8f8908f83f9450494e2fa864020da38 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:22.057014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:22.058681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:22.078398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196d037-ff18-4681-9a4d-bd84c0e3acc4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:22.146773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:22.147428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.147714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.148019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] PATH_INFO: `/v3/projects/24ba4e9733f24729933cb2982b43b3e1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.149166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ba4e9733f24729933cb2982b43b3e1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:22.151292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:22.256992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:22.274857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ba4e9733f24729933cb2982b43b3e1', 'request_id': 'req-6f32d9c9-2807-4766-9f88-b8458edab3b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:22.281516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ba4e9733f24729933cb2982b43b3e1', 'request_id': 'req-6f32d9c9-2807-4766-9f88-b8458edab3b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:22.357283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ba4e9733f24729933cb2982b43b3e1', 'request_id': 'req-6f32d9c9-2807-4766-9f88-b8458edab3b2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:22.369488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] The token cache is being invalidate because project 24ba4e9733f24729933cb2982b43b3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:07:22.369884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:22.370879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6f32d9c9-2807-4766-9f88-b8458edab3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:22.372606 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3815/7653] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:07:22 2022] DELETE /identity/v3/projects/24ba4e9733f24729933cb2982b43b3e1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:22.377463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f141e-1b27-444f-ad3b-5ddf088e37cb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.377971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f141e-1b27-444f-ad3b-5ddf088e37cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.378156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f141e-1b27-444f-ad3b-5ddf088e37cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.400357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3d5f141e-1b27-444f-ad3b-5ddf088e37cb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:22.401649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d5f141e-1b27-444f-ad3b-5ddf088e37cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:22.479635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3839/7654] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:22.487708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a8ec-a012-4d5f-afdf-2cb448f93885 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.487997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a8ec-a012-4d5f-afdf-2cb448f93885 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.488276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3a8ec-a012-4d5f-afdf-2cb448f93885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.509931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-84b3a8ec-a012-4d5f-afdf-2cb448f93885 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:22.513336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-84b3a8ec-a012-4d5f-afdf-2cb448f93885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:22.520165 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3816/7655] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:22.524483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f141e-1b27-444f-ad3b-5ddf088e37cb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:22.535454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f141e-1b27-444f-ad3b-5ddf088e37cb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:22.541323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:22.548043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.548043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.548043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.548043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:07:22.548043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:22.548043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:22.560901 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3840/7656] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:07:22.562220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3a8ec-a012-4d5f-afdf-2cb448f93885 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:22.573796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3a8ec-a012-4d5f-afdf-2cb448f93885 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:22.578733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:22.579435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.579723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.580000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.580639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:22.583242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:22.684241 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3817/7657] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:07:22 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:07:22.685367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:22.696914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab52ac-0fec-4e79-aac9-917a3fba1bdc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:22.770220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:22.771028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.771434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.771710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.772370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:22.774484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:22.922267 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3841/7658] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:07:22 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:07:22.926861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:22.938898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83269969-2665-47af-af2d-becfd24551b6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:22.944912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:22.947524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.947524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.947524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.947524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:22.948532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:22.959745 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3818/7659] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:22.964150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:22.975089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883f76d-8dc4-49d1-974d-f92eaf9e4091 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:22.982762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130f3e-e3cf-4176-9f06-55f458331b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:22.983402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130f3e-e3cf-4176-9f06-55f458331b03 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:22.983686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130f3e-e3cf-4176-9f06-55f458331b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:22.983967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130f3e-e3cf-4176-9f06-55f458331b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:22.984685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f130f3e-e3cf-4176-9f06-55f458331b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:22.986484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f130f3e-e3cf-4176-9f06-55f458331b03 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:22.993162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:22.999863 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3842/7660] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:23.004634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:23.018462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1205-4b6a-4e44-97db-7d23e3d619c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:23.023946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:23.024656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.025354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.025354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] PATH_INFO: `/v3/projects/88635eb6e9b4401bb772daa51dabb5c4/users/644b0d20ce654767a9511f8c34a6c356/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.046559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88635eb6e9b4401bb772daa51dabb5c4, user_id=644b0d20ce654767a9511f8c34a6c356, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:23.050926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:23.158097 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3819/7661] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:07:23 2022] PUT /identity/v3/projects/88635eb6e9b4401bb772daa51dabb5c4/users/644b0d20ce654767a9511f8c34a6c356/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:07:23.169361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125fcb-e946-49ad-99f8-7bf80062fd3e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.169670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125fcb-e946-49ad-99f8-7bf80062fd3e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.169928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125fcb-e946-49ad-99f8-7bf80062fd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.203441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-99125fcb-e946-49ad-99f8-7bf80062fd3e None None] MFA Rules not processed for user `644b0d20ce654767a9511f8c34a6c356`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:23.205897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99125fcb-e946-49ad-99f8-7bf80062fd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:23.282498 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3843/7662] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:23.287717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:23.366606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaf07-55f2-4053-8fe7-64bf726a83a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:23.372568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:23.373273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.373564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.373844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.374726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:23.376765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:23.474541 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3820/7663] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:07:23 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:07:23.476777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125fcb-e946-49ad-99f8-7bf80062fd3e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:23.488879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125fcb-e946-49ad-99f8-7bf80062fd3e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:23.558587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:23.559250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.559534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.559812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.560460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:23.562475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:23.667275 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3844/7664] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:07:23 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:07:23.671317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:23.692723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288d75-e878-46b6-abe3-b08432905ada admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:23.694164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:23.694794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.695072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.695356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.696080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:23.697675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:23.709582 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3821/7665] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:23.714181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:23.725321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffb55f-2154-4f2b-b811-ff5a7223bd7e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:23.730642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847871-c225-4127-9aa5-0e803f795e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:23.733206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847871-c225-4127-9aa5-0e803f795e87 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.733206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847871-c225-4127-9aa5-0e803f795e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.733206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847871-c225-4127-9aa5-0e803f795e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.733206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e847871-c225-4127-9aa5-0e803f795e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:23.734293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e847871-c225-4127-9aa5-0e803f795e87 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:23.745979 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3845/7666] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:23.750994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:23.763497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4c7e1-381b-4ca8-baf7-70a0811e5e27 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:23.768656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:23.770125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.770413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.770687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] PATH_INFO: `/v3/projects/2737397b739b40dc911d2001fd57a107/users/5c71ff5389e64ec3946b409391dde59b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.789004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2737397b739b40dc911d2001fd57a107, user_id=5c71ff5389e64ec3946b409391dde59b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:23.795080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:23.919464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:23.930949 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3822/7667] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:07:23 2022] PUT /identity/v3/projects/2737397b739b40dc911d2001fd57a107/users/5c71ff5389e64ec3946b409391dde59b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:07:23.936087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b26ca-6a3d-4eb0-902f-d9c1845ec372 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:23.936406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b26ca-6a3d-4eb0-902f-d9c1845ec372 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:23.936713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b26ca-6a3d-4eb0-902f-d9c1845ec372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:23.968020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0b3b26ca-6a3d-4eb0-902f-d9c1845ec372 None None] MFA Rules not processed for user `5c71ff5389e64ec3946b409391dde59b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:23.969184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0b3b26ca-6a3d-4eb0-902f-d9c1845ec372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:24.035949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:24.041569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3846/7668] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:24.046747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:24.122714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd61c47-29ba-41bb-a2e2-82668c5baf3e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:24.127895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:24.128561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:24.128851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:24.129299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:24.129974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:24.132200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:25.170354 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3823/7669] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:07:24 2022] POST /identity/v3/projects => generated 383 bytes in 1122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:07:25.172320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b26ca-6a3d-4eb0-902f-d9c1845ec372 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:25.184314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b26ca-6a3d-4eb0-902f-d9c1845ec372 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:25.256343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:25.257076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:25.257483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:25.257880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:25.259142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:25.260813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:25.388376 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3847/7670] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:07:25 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:07:25.392515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:25.404200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf962c-4dcc-4025-98c2-87d6a7442743 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:25.410248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:25.410936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:25.411221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:25.411503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:25.412180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:25.413939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:25.426348 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3824/7671] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:25.430603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:25.441493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46e7f-62a1-4986-9b6c-8f57dccc3d91 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:25.446328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:25.447004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:25.447341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:25.447621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] PATH_INFO: `/v3/projects/3190748a3a214194b9e04ee4814b3ae9/users/1c7b6999806f4680bf087d9ac1fe6bcd/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:25.467651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3190748a3a214194b9e04ee4814b3ae9, user_id=1c7b6999806f4680bf087d9ac1fe6bcd, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:25.470813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:25.549122 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3848/7672] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:07:25 2022] PUT /identity/v3/projects/3190748a3a214194b9e04ee4814b3ae9/users/1c7b6999806f4680bf087d9ac1fe6bcd/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:25.552894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:25.563480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0818b1-499c-426b-87bc-b9020cecaa2b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:25.631216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40c3b4-c9bd-4bb6-99e6-d0e691e79532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:25.634606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c3b4-c9bd-4bb6-99e6-d0e691e79532 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:25.634606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c3b4-c9bd-4bb6-99e6-d0e691e79532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:25.634606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c3b4-c9bd-4bb6-99e6-d0e691e79532 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:25.634606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40c3b4-c9bd-4bb6-99e6-d0e691e79532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:25.635045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40c3b4-c9bd-4bb6-99e6-d0e691e79532 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:25.649256 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3825/7673] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:25.650437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:25.661281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fae8a-cbc5-4930-8bdf-3d65923cf35a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:25.665964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:25.666651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:25.666929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:25.667200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] PATH_INFO: `/v3/projects/3190748a3a214194b9e04ee4814b3ae9/users/1c7b6999806f4680bf087d9ac1fe6bcd/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:25.669112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3190748a3a214194b9e04ee4814b3ae9, user_id=1c7b6999806f4680bf087d9ac1fe6bcd, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:25.671847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:25.692707 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3849/7674] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:07:25 2022] PUT /identity/v3/projects/3190748a3a214194b9e04ee4814b3ae9/users/1c7b6999806f4680bf087d9ac1fe6bcd/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:25.694811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:25.695102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:25.695383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:25.727630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] MFA Rules not processed for user `1c7b6999806f4680bf087d9ac1fe6bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:25.729133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:25.796137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:25.807440 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3826/7675] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:07:25.823303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:25.825390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:25.917425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba7d00-ddaf-4096-9689-8244a11ab464 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:25.924492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:25.925623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:25.926011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:25.926308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:26.008147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:26.010763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:26.012374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:26.022872 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3850/7676] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:28.243196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:28.244749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:28.397857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7f919-cc5a-4222-a1f0-5f2028b547f3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:28.404007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:28.408576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:28.408576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:28.408576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:28.408576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:28.425291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:28.427182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:28.442579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3827/7677] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:29.441503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:29.454219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49de83f-0295-4c88-a471-4c93a47ed159 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:29.458346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:29.458961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:29.459269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:29.459542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:29.525512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:29.527499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:29.541793 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3851/7678] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:31.457644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:31.470267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fad8-8901-4c10-83a9-d02732d6a4bd service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:31.477956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a40672-d9ad-4ce6-956b-3b4fac199555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:31.481841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a40672-d9ad-4ce6-956b-3b4fac199555 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:31.481841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a40672-d9ad-4ce6-956b-3b4fac199555 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:31.481841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a40672-d9ad-4ce6-956b-3b4fac199555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:31.494558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a40672-d9ad-4ce6-956b-3b4fac199555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:31.496018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a40672-d9ad-4ce6-956b-3b4fac199555 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:31.508302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3828/7679] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:39.533570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=30 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:41.501851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=44 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:41.999014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:42.054088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18776519-9d26-4df6-bbb3-e88f1b272af7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:42.056107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18776519-9d26-4df6-bbb3-e88f1b272af7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:42.056107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18776519-9d26-4df6-bbb3-e88f1b272af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:42.075737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5075d-95cc-401d-897f-4682b19fce4d service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:42.076225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-18776519-9d26-4df6-bbb3-e88f1b272af7 None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:42.077438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-18776519-9d26-4df6-bbb3-e88f1b272af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:42.080333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:42.081109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:42.081256 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:42.081512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] PATH_INFO: `/v3/users/644b0d20ce654767a9511f8c34a6c356` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:42.083371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=644b0d20ce654767a9511f8c34a6c356)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:42.085657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:42.139653 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3829/7680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:42.303821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644b0d20ce654767a9511f8c34a6c356'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:42.311588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644b0d20ce654767a9511f8c34a6c356'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:42.312517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644b0d20ce654767a9511f8c34a6c356'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:42.326493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644b0d20ce654767a9511f8c34a6c356'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:42.396964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644b0d20ce654767a9511f8c34a6c356'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:42.403569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3852/7681] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:07:41 2022] DELETE /identity/v3/users/644b0d20ce654767a9511f8c34a6c356 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:42.408218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:42.408508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:42.408816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:42.429701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:42.430893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:42.496173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3830/7682] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:42.506964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:42.508362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:42.569150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a9344-4f11-4451-a580-8cc665fc1d1b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:42.572942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:42.573567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:42.573847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:42.574152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:42.585188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:42.585654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:42.603601 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3853/7683] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:43.118926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:43.120400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:43.132667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904713-5e62-4317-ab84-2b11a15037c9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:43.137782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:43.138538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:43.139313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:43.139313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] PATH_INFO: `/v3/projects/88635eb6e9b4401bb772daa51dabb5c4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:43.142666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88635eb6e9b4401bb772daa51dabb5c4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:43.146883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:43.269128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88635eb6e9b4401bb772daa51dabb5c4', 'request_id': 'req-d71b0c6c-b861-4d69-8231-2b9ddbc24891'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.279137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88635eb6e9b4401bb772daa51dabb5c4', 'request_id': 'req-d71b0c6c-b861-4d69-8231-2b9ddbc24891'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.342910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88635eb6e9b4401bb772daa51dabb5c4', 'request_id': 'req-d71b0c6c-b861-4d69-8231-2b9ddbc24891'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.358550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] The token cache is being invalidate because project 88635eb6e9b4401bb772daa51dabb5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:07:43.359070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.359989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.361860 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3831/7684] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:07:43 2022] DELETE /identity/v3/projects/88635eb6e9b4401bb772daa51dabb5c4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:43.366459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:43.376802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba011a-d0f4-4b31-9a52-b2138422979b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:43.396354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:43.438135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:43.438838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:43.439258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:43.439546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] PATH_INFO: `/v3/users/5c71ff5389e64ec3946b409391dde59b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:43.440777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c71ff5389e64ec3946b409391dde59b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:43.443271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:43.594400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c71ff5389e64ec3946b409391dde59b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.602500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c71ff5389e64ec3946b409391dde59b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.603211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c71ff5389e64ec3946b409391dde59b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.617493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c71ff5389e64ec3946b409391dde59b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.682953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c71ff5389e64ec3946b409391dde59b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:43.689719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3854/7685] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:07:43 2022] DELETE /identity/v3/users/5c71ff5389e64ec3946b409391dde59b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:44.159562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:44.161798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:44.177266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0c6c-b861-4d69-8231-2b9ddbc24891 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:44.206571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:44.237643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:44.238330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:44.239166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:44.239447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] PATH_INFO: `/v3/projects/2737397b739b40dc911d2001fd57a107` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:44.240581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2737397b739b40dc911d2001fd57a107)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:44.242531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:44.337740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2737397b739b40dc911d2001fd57a107', 'request_id': 'req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.344649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2737397b739b40dc911d2001fd57a107', 'request_id': 'req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.385705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2737397b739b40dc911d2001fd57a107', 'request_id': 'req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.400173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] The token cache is being invalidate because project 2737397b739b40dc911d2001fd57a107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:07:44.400601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.401603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.403600 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3832/7686] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:07:44 2022] DELETE /identity/v3/projects/2737397b739b40dc911d2001fd57a107 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:44.407504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:44.410891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:44.425870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32b45-ea52-4a4d-9ed8-b1bace5960dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:44.498382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:44.499067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:44.499351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:44.499629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] PATH_INFO: `/v3/users/1c7b6999806f4680bf087d9ac1fe6bcd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:44.500794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7b6999806f4680bf087d9ac1fe6bcd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:44.502952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:44.711974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:44.714817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7b6999806f4680bf087d9ac1fe6bcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.722547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7b6999806f4680bf087d9ac1fe6bcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.723857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7b6999806f4680bf087d9ac1fe6bcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.736728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7b6999806f4680bf087d9ac1fe6bcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.824805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4168a433-22df-4a33-aa34-2f779d37996b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7b6999806f4680bf087d9ac1fe6bcd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:44.831417 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3855/7687] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:07:44 2022] DELETE /identity/v3/users/1c7b6999806f4680bf087d9ac1fe6bcd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:45.350689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:45.354089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:45.370852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57ff0f-44b3-458a-a5ea-9a01c3abbf11 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:45.480019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:45.480944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:45.481562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:45.481831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] PATH_INFO: `/v3/projects/3190748a3a214194b9e04ee4814b3ae9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:45.483396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3190748a3a214194b9e04ee4814b3ae9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:45.485722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:45.637590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3190748a3a214194b9e04ee4814b3ae9', 'request_id': 'req-266b78b0-e79d-4a02-b250-2a110eed3219'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:45.645228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3190748a3a214194b9e04ee4814b3ae9', 'request_id': 'req-266b78b0-e79d-4a02-b250-2a110eed3219'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:45.699845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3190748a3a214194b9e04ee4814b3ae9', 'request_id': 'req-266b78b0-e79d-4a02-b250-2a110eed3219'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:45.701411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:45.712440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] The token cache is being invalidate because project 3190748a3a214194b9e04ee4814b3ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:07:45.712875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:45.713574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-266b78b0-e79d-4a02-b250-2a110eed3219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:07:45.715608 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3833/7688] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:07:45 2022] DELETE /identity/v3/projects/3190748a3a214194b9e04ee4814b3ae9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:07:45.720641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed73e-0a7b-48b2-a46d-0b4f6cd0da85 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:45.721151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed73e-0a7b-48b2-a46d-0b4f6cd0da85 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:45.721367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed73e-0a7b-48b2-a46d-0b4f6cd0da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:45.745432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7afed73e-0a7b-48b2-a46d-0b4f6cd0da85 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:45.746864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7afed73e-0a7b-48b2-a46d-0b4f6cd0da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:45.823741 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3856/7689] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:45.832793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ccc9f-cbcb-4c75-bd57-d96bc2cd8289 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:45.833478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ccc9f-cbcb-4c75-bd57-d96bc2cd8289 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:45.833840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ccc9f-cbcb-4c75-bd57-d96bc2cd8289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:45.861547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cd7ccc9f-cbcb-4c75-bd57-d96bc2cd8289 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:45.862857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd7ccc9f-cbcb-4c75-bd57-d96bc2cd8289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:45.872449 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3834/7690] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:45.878309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed73e-0a7b-48b2-a46d-0b4f6cd0da85 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:45.890590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed73e-0a7b-48b2-a46d-0b4f6cd0da85 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:45.895666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:45.896299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:45.896612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:45.897124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:45.897790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:07:45.898136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:45.900480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:45.920323 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3857/7691] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:07:45.927171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ccc9f-cbcb-4c75-bd57-d96bc2cd8289 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:45.936176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ccc9f-cbcb-4c75-bd57-d96bc2cd8289 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:45.946278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:45.947640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:45.948448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:45.948904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:45.949813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:45.954086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:46.068960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3835/7692] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:07:45 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:07:46.073274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:46.088448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8447f21-45ac-4344-b2c2-3d76d0556365 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:46.153078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:46.153232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:46.153448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:46.153656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:46.154327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:46.156322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:46.239050 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3858/7693] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:07:46 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:07:46.240637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:46.251916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bb1df-a668-4f94-a23c-6871ec2c44d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:46.257244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:46.262644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:46.262644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:46.262644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:46.262644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:46.262644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:46.298101 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3836/7694] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:46.299456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:46.310412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e750e8-1a80-4863-84cf-475e7eeb63c2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:46.316839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3a5a4-f1b4-455e-a260-07c3a0d8621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:46.317039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a5a4-f1b4-455e-a260-07c3a0d8621d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:46.317365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a5a4-f1b4-455e-a260-07c3a0d8621d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:46.317794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3a5a4-f1b4-455e-a260-07c3a0d8621d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:46.318667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3a5a4-f1b4-455e-a260-07c3a0d8621d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:46.320570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3a5a4-f1b4-455e-a260-07c3a0d8621d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:46.337760 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3859/7695] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:07:46.339062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:46.352672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d247cf-2bad-4703-aa61-aaf07d849bc7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:46.357967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:46.358677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:46.359251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:46.359522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] PATH_INFO: `/v3/projects/96cf257d6609457989daca67db09531f/users/3c67caddb78d42468e3ef2d6e07c7989/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:46.380181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cf257d6609457989daca67db09531f, user_id=3c67caddb78d42468e3ef2d6e07c7989, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:46.383244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:46.463662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3837/7696] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:07:46 2022] PUT /identity/v3/projects/96cf257d6609457989daca67db09531f/users/3c67caddb78d42468e3ef2d6e07c7989/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:07:46.475430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ba16e-4c76-4b44-8990-6451ca839b86 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:46.475719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ba16e-4c76-4b44-8990-6451ca839b86 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:46.476002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ba16e-4c76-4b44-8990-6451ca839b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:46.518436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-0e9ba16e-4c76-4b44-8990-6451ca839b86 None None] MFA Rules not processed for user `3c67caddb78d42468e3ef2d6e07c7989`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:46.519619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0e9ba16e-4c76-4b44-8990-6451ca839b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:46.547123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:46.647990 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3860/7697] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:46.662253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:46.666767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:46.794733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591939bb-b734-4c87-a357-2cc5fcb2feba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:46.808729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:46.813152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:46.813152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:46.813152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:46.829188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:46.835777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:46.860048 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3838/7698] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:48.950602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:48.951456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:48.951456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:49.154543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:07:49.162812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:49.363781 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3861/7699] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:07:49.378582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:49.380224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:49.659829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb8c6e-5fea-40ed-854e-ca49f311534f service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:49.673864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:49.674552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:49.674838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:49.675119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:49.700965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:49.702711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:49.706779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:49.715494 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3839/7700] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:07:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:51.073290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:51.076399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:51.312135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73363d4c-0a7c-44a3-9203-666075029cdd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:51.335197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:51.335858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:51.336145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:51.336424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:51.342199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:51.446643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:51.529592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:51.531760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:51.559569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3862/7701] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:07:51.843923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:07:51.845612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:52.078099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f891f-768f-4f76-bf0e-50e4730cf14b service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:07:52.093851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abf7e3-664b-4fef-8031-8b1e0b0c6fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:07:52.097177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abf7e3-664b-4fef-8031-8b1e0b0c6fe3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:07:52.099872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abf7e3-664b-4fef-8031-8b1e0b0c6fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:07:52.100547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abf7e3-664b-4fef-8031-8b1e0b0c6fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:07:52.108466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24abf7e3-664b-4fef-8031-8b1e0b0c6fe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:07:52.148930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abf7e3-664b-4fef-8031-8b1e0b0c6fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:07:52.155613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abf7e3-664b-4fef-8031-8b1e0b0c6fe3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:07:52.188211 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3840/7702] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:07:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:01.545987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:02.174042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=35 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:03.951758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:03.953563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:04.139939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0299c69-8a1f-4a47-82b8-4f58e656d74f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:04.174444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:04.175121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:04.175405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:04.175719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] PATH_INFO: `/v3/users/8e66870b1baa4c3aaebe72cf76b25453` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:04.176904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e66870b1baa4c3aaebe72cf76b25453)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:04.180499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:04.464423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e66870b1baa4c3aaebe72cf76b25453'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:04.482278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e66870b1baa4c3aaebe72cf76b25453'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:04.483349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e66870b1baa4c3aaebe72cf76b25453'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:04.501352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e66870b1baa4c3aaebe72cf76b25453'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:04.888103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e66870b1baa4c3aaebe72cf76b25453'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:04.896624 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3863/7703] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:08:03 2022] DELETE /identity/v3/users/8e66870b1baa4c3aaebe72cf76b25453 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:04.901831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:04.902399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:04.902699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:04.923833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:04.925350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:05.040813 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3841/7704] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:08:05.041914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:05.044137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:05.185737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1da16-2f52-4837-a9e0-bd57d7e4b21c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:05.237477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:05.240429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:05.240429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:05.240429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:05.265691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:05.265691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:05.313747 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3864/7705] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:05.920568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:05.923669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:05.968680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beb116-ddd6-47e0-9491-0b727aa897a5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:05.998336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:05.999315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:05.999865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:06.000154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] PATH_INFO: `/v3/projects/ccbc15ce8ee64fa1b767c3bfb5926fee` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:06.012855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbc15ce8ee64fa1b767c3bfb5926fee)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:06.016740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:06.183403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'request_id': 'req-008bdd83-9034-4d24-80b3-d48618409977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.196534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'request_id': 'req-008bdd83-9034-4d24-80b3-d48618409977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.303292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbc15ce8ee64fa1b767c3bfb5926fee', 'request_id': 'req-008bdd83-9034-4d24-80b3-d48618409977'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.340326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] The token cache is being invalidate because project ccbc15ce8ee64fa1b767c3bfb5926fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:08:06.351133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.352608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.362166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:06.363186 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3842/7706] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:08:05 2022] DELETE /identity/v3/projects/ccbc15ce8ee64fa1b767c3bfb5926fee => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:06.389323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34eb7d-24e8-4422-90f1-57199778ac89 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:06.440120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:06.534423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:06.535997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:06.536453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:06.536899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] PATH_INFO: `/v3/users/8289c9d6d9304cdcb6b00b0b938b4d77` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:06.538517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8289c9d6d9304cdcb6b00b0b938b4d77)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:06.540707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:06.819762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8289c9d6d9304cdcb6b00b0b938b4d77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.852848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8289c9d6d9304cdcb6b00b0b938b4d77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.856471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8289c9d6d9304cdcb6b00b0b938b4d77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:06.908704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8289c9d6d9304cdcb6b00b0b938b4d77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:07.015149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-6e9ddb04-5d7b-42c2-8ccb-da5ef56171a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8289c9d6d9304cdcb6b00b0b938b4d77'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:07.048730 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3865/7707] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:08:06 2022] DELETE /identity/v3/users/8289c9d6d9304cdcb6b00b0b938b4d77 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:07.763320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:07.765359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:07.792655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bdd83-9034-4d24-80b3-d48618409977 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:07.917667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:07.918351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:07.922184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:07.922184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] PATH_INFO: `/v3/projects/fa606c38d24a471b968a27745f4ac3f7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:07.922184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa606c38d24a471b968a27745f4ac3f7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:07.922184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:08.078697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:08.111021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa606c38d24a471b968a27745f4ac3f7', 'request_id': 'req-dd338668-dd97-4755-9f85-b1ed5d214d67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:08.121856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa606c38d24a471b968a27745f4ac3f7', 'request_id': 'req-dd338668-dd97-4755-9f85-b1ed5d214d67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:08.255843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa606c38d24a471b968a27745f4ac3f7', 'request_id': 'req-dd338668-dd97-4755-9f85-b1ed5d214d67'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:08.283229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] The token cache is being invalidate because project fa606c38d24a471b968a27745f4ac3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:08:08.283904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:08.290169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dd338668-dd97-4755-9f85-b1ed5d214d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:08.292848 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3843/7708] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:08:07 2022] DELETE /identity/v3/projects/fa606c38d24a471b968a27745f4ac3f7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:08.303508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b595-fce8-4022-93eb-052d40e533a5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:08.307771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b595-fce8-4022-93eb-052d40e533a5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:08.307771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b595-fce8-4022-93eb-052d40e533a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:08.366422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3d15b595-fce8-4022-93eb-052d40e533a5 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:08.368167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d15b595-fce8-4022-93eb-052d40e533a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:08.533640 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3866/7709] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:08:08.540079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c070-a142-45e9-be7b-605c08e316d9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:08.544788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c070-a142-45e9-be7b-605c08e316d9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:08.544788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171c070-a142-45e9-be7b-605c08e316d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:08.607631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1171c070-a142-45e9-be7b-605c08e316d9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:08.608546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1171c070-a142-45e9-be7b-605c08e316d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:08.632813 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3844/7710] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:08:08.640738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15b595-fce8-4022-93eb-052d40e533a5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:08.652504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15b595-fce8-4022-93eb-052d40e533a5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:08.670489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:08.671194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:08.671410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:08.671695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:08.672509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:08:08.672825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:08.674495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:08.704054 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3867/7711] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:08:08.710041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171c070-a142-45e9-be7b-605c08e316d9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:08.720521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171c070-a142-45e9-be7b-605c08e316d9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:08.727263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:08.728294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:08.728736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:08.729215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:08.730133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:08.736010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:08.842842 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3845/7712] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:08:08 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:08:08.844029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:08.860019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded473c-eeb5-4af5-a6ce-e1b148936204 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:08.914192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:08.991615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:08.992987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:08.993843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:08.994217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:08.995130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:09.001290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:09.112399 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3868/7713] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:08:08 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:08:09.117921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:09.129765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550da10-cdfb-4c80-a14b-4ed123c65165 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:09.153970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:09.155042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:09.155681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:09.156189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:09.157841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:09.160381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:09.221786 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3846/7714] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:08:09.223355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:09.235510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96144507-c459-4ef3-a5d5-4d83bd345ca4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:09.241537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1efea-fa3e-4369-b881-3fee28ee6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:09.247601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1efea-fa3e-4369-b881-3fee28ee6aee admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:09.247601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1efea-fa3e-4369-b881-3fee28ee6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:09.247601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1efea-fa3e-4369-b881-3fee28ee6aee admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:09.247601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1efea-fa3e-4369-b881-3fee28ee6aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:09.247601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1efea-fa3e-4369-b881-3fee28ee6aee admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:09.269168 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3869/7715] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:08:09.269683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:09.284004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bf9d7-5af7-4b22-8b8e-a5e5466e2ff1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:09.299107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:09.299872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:09.300223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:09.301139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] PATH_INFO: `/v3/projects/98dbcb42beaa4345ad9a6851c067bc99/users/afb029d693404bd6bfd636535dac99ab/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:09.336136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dbcb42beaa4345ad9a6851c067bc99, user_id=afb029d693404bd6bfd636535dac99ab, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:09.336136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:09.443863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3847/7716] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:08:09 2022] PUT /identity/v3/projects/98dbcb42beaa4345ad9a6851c067bc99/users/afb029d693404bd6bfd636535dac99ab/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:08:09.445404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:09.445910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:09.446208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:09.502534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:09.504473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:09.699409 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3870/7717] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:08:09.726379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:09.729142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:09.825218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ebd45-073a-44ec-92db-7ed03435da9d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:09.829223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:09.829848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:09.830165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:09.830477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:09.847486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:09.850286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:09.864450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3848/7718] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:10.263095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:10.264659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:10.356348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13503d-be7a-40fc-a22a-836291158f9e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:10.363086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:10.363776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:10.364054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:10.364333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:10.368119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:10.500495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:10.521952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:10.523895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:10.542250 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3871/7719] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:08:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:08:11.809906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:11.811382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:11.905162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bffae7-e753-4be5-b7ff-dde15b2d0a53 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:11.905162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c43545-27de-4c54-b795-38828e3fb904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:11.906145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c43545-27de-4c54-b795-38828e3fb904 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:11.906803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c43545-27de-4c54-b795-38828e3fb904 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:11.907154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c43545-27de-4c54-b795-38828e3fb904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:11.923158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59c43545-27de-4c54-b795-38828e3fb904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:12.000065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:12.052784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c43545-27de-4c54-b795-38828e3fb904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:12.057070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c43545-27de-4c54-b795-38828e3fb904 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:12.087481 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3849/7720] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:17.540041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:17.563271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccf162-f8e2-4447-a53b-c0687308f6d3 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:17.578975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:17.579616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:17.579897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:17.580178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:17.582080 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:17.623274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:17.629036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:17.675865 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3872/7721] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:21.653057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fa804-df88-4053-a8ed-b5b2c5953e13 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:21.654086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fa804-df88-4053-a8ed-b5b2c5953e13 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:21.654664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fa804-df88-4053-a8ed-b5b2c5953e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:21.757619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7e8fa804-df88-4053-a8ed-b5b2c5953e13 None None] MFA Rules not processed for user `afb029d693404bd6bfd636535dac99ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:21.758940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e8fa804-df88-4053-a8ed-b5b2c5953e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:21.931133 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3850/7722] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:08:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:08:21.936588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:21.949788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafad754-3928-4b98-848f-d72d5311f433 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:21.955377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:21.956094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:21.957103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:21.959650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:21.959650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:21.960606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:22.148536 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3873/7723] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:08:21 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:08:22.149535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fa804-df88-4053-a8ed-b5b2c5953e13 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:22.176193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fa804-df88-4053-a8ed-b5b2c5953e13 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:22.323384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:22.324087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:22.332002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:22.332002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:22.332002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:22.332002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:22.476699 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3851/7724] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:08:22 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:08:22.481071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:22.490752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:22.492930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:22.501152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61640eff-7447-4406-8dd6-f55cc9d252e3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:22.517299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:22.518304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:22.518658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:22.518887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:22.523243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:22.529000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:22.589175 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3874/7725] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:08:22.601792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:22.622317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51ea57-eea8-4034-a033-ee230e67a111 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:22.637554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:22.642717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:22.642717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:22.642717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] PATH_INFO: `/v3/projects/7bad6280015449598fbfb806bec2cb4c/users/620fad0b9bf240c49722b0c4a8f0f6c8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:22.676028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bad6280015449598fbfb806bec2cb4c, user_id=620fad0b9bf240c49722b0c4a8f0f6c8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:22.679243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:22.724270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30379d9-9ecf-4e6f-89b1-e65231be80d0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:22.735529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:22.736618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:22.737067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:22.740514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:22.740891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:22.793437 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3875/7726] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:08:22 2022] PUT /identity/v3/projects/7bad6280015449598fbfb806bec2cb4c/users/620fad0b9bf240c49722b0c4a8f0f6c8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:22.799733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:22.877351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:23.047014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6f6f-0775-47f9-a24c-a1e33571bd10 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:23.055643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:23.060023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:23.067282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:23.067931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:23.068259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:23.068547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:23.069431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:23.071652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:23.084198 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3852/7727] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:23.110894 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3876/7728] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:08:23.116061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:23.171026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bcf96-1480-4cfa-87c1-d47800b7237f service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:23.183568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:23.193067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:23.193067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:23.193067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] PATH_INFO: `/v3/projects/7bad6280015449598fbfb806bec2cb4c/users/620fad0b9bf240c49722b0c4a8f0f6c8/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:23.193067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bad6280015449598fbfb806bec2cb4c, user_id=620fad0b9bf240c49722b0c4a8f0f6c8, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:23.195722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:23.226266 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3853/7729] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:08:23 2022] PUT /identity/v3/projects/7bad6280015449598fbfb806bec2cb4c/users/620fad0b9bf240c49722b0c4a8f0f6c8/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:23.443156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:23.559150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6d7cb-7f07-40ab-a4cd-eff1f3c2c2c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:23.621847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:23.667583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:23.668637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:23.669167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:23.669659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:23.674095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:23.698661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:23.700480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:23.718228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3877/7730] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:24.121058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:24.144581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3798f-5664-40c5-b976-04e284e3fb82 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:24.146488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:24.148129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:24.148656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:24.149403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:24.151564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:24.324253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:24.326461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:24.349882 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3854/7731] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:25.845004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:25.845004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:25.938961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3421c-718b-4506-8d8f-8a89089863f8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:25.945646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:25.946407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:25.946758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:25.947164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:25.950927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:25.981868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:25.983873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:26.014432 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3878/7732] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:29.177429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:29.179796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:29.213248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce956-19d9-49d9-9938-189660cc3956 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:29.229974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b433e-88d9-4b57-bb66-6c5144829e60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:29.233396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b433e-88d9-4b57-bb66-6c5144829e60 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:29.233396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b433e-88d9-4b57-bb66-6c5144829e60 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:29.243683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b433e-88d9-4b57-bb66-6c5144829e60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:29.246536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-532b433e-88d9-4b57-bb66-6c5144829e60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:29.294600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b433e-88d9-4b57-bb66-6c5144829e60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:29.297752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b433e-88d9-4b57-bb66-6c5144829e60 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:29.313849 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3855/7733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:34.770515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:34.773132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:34.913938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776c5af-4027-4893-81e1-2cd828997ee2 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:34.919717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:34.920454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:34.920741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:34.921019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] PATH_INFO: `/v3/users/0b5c1ca9fe7c4461a07baa70d73f04e7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:34.922576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5c1ca9fe7c4461a07baa70d73f04e7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:34.924549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:35.139559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5c1ca9fe7c4461a07baa70d73f04e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:35.154744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5c1ca9fe7c4461a07baa70d73f04e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:35.165222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5c1ca9fe7c4461a07baa70d73f04e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:35.189969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:35.206910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5c1ca9fe7c4461a07baa70d73f04e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:35.277743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5c1ca9fe7c4461a07baa70d73f04e7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:35.293096 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3879/7734] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:08:34 2022] DELETE /identity/v3/users/0b5c1ca9fe7c4461a07baa70d73f04e7 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:35.579452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:35.579988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:35.579988 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:35.629345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] MFA Rules not processed for user `620fad0b9bf240c49722b0c4a8f0f6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:35.631309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:35.724428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:35.783136 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3856/7735] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:08:35.811005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:35.812565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:35.878089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:35.881254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:35.959650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289de47-752a-4007-a33f-aa75a7ea7fea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:35.966102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:35.967464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:35.967464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:35.967734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:35.969806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:36.014597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fff8b-9dde-4ebd-8822-a872fc3023f5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:36.021975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:36.023146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:36.023553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:36.023951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] PATH_INFO: `/v3/projects/0109abe8e76e4e5e9f622e401f9921b0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:36.025682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0109abe8e76e4e5e9f622e401f9921b0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:36.028350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:36.062948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:36.064966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:36.094631 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3880/7736] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:08:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:08:36.178002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0109abe8e76e4e5e9f622e401f9921b0', 'request_id': 'req-1a84e140-ecc1-42cd-9f6d-4b7c749da785'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.185501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0109abe8e76e4e5e9f622e401f9921b0', 'request_id': 'req-1a84e140-ecc1-42cd-9f6d-4b7c749da785'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.277262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0109abe8e76e4e5e9f622e401f9921b0', 'request_id': 'req-1a84e140-ecc1-42cd-9f6d-4b7c749da785'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.294586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] The token cache is being invalidate because project 0109abe8e76e4e5e9f622e401f9921b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:08:36.295281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.295966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.297938 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3857/7737] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:08:35 2022] DELETE /identity/v3/projects/0109abe8e76e4e5e9f622e401f9921b0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:08:36.302752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:36.323964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867fa1-8aa1-46fe-895b-fb688f031c76 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:36.384709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:36.385511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:36.385791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:36.386077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] PATH_INFO: `/v3/users/8949c98943fb412cb1c1aef01e6d1dac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:36.387327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8949c98943fb412cb1c1aef01e6d1dac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:36.389306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:36.416926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:36.713834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8949c98943fb412cb1c1aef01e6d1dac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.722499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8949c98943fb412cb1c1aef01e6d1dac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.723208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8949c98943fb412cb1c1aef01e6d1dac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.759265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8949c98943fb412cb1c1aef01e6d1dac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.888048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-906d3c8c-aa06-412f-8123-5e84b767063a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8949c98943fb412cb1c1aef01e6d1dac'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:36.894635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3881/7738] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:08:36 2022] DELETE /identity/v3/users/8949c98943fb412cb1c1aef01e6d1dac => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:37.270978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:37.272492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:37.292001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84e140-ecc1-42cd-9f6d-4b7c749da785 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:37.417566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:37.418316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:37.418597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:37.419961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] PATH_INFO: `/v3/projects/529ab297422e4846942fc9a3f99d2f24` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:37.421206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=529ab297422e4846942fc9a3f99d2f24)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:37.423530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:37.472470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:37.624108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529ab297422e4846942fc9a3f99d2f24', 'request_id': 'req-cad8e0b6-a008-4244-b284-cf60fb35cf6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:37.627051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529ab297422e4846942fc9a3f99d2f24', 'request_id': 'req-cad8e0b6-a008-4244-b284-cf60fb35cf6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:37.734390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529ab297422e4846942fc9a3f99d2f24', 'request_id': 'req-cad8e0b6-a008-4244-b284-cf60fb35cf6a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:37.747268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] The token cache is being invalidate because project 529ab297422e4846942fc9a3f99d2f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:08:37.747973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:37.749015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:08:37.750869 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3858/7739] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:08:37 2022] DELETE /identity/v3/projects/529ab297422e4846942fc9a3f99d2f24 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:08:39.879729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2f73a-267e-4319-bf3a-a1707cbf75fc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:39.880319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2f73a-267e-4319-bf3a-a1707cbf75fc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:39.880454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2f73a-267e-4319-bf3a-a1707cbf75fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:39.913323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-61e2f73a-267e-4319-bf3a-a1707cbf75fc None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:39.915255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-61e2f73a-267e-4319-bf3a-a1707cbf75fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:40.009978 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3882/7740] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:08:40.028842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:08:40.030270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:40.089035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2561-956c-4d29-810c-82b9c76d5315 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:40.089310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2561-956c-4d29-810c-82b9c76d5315 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:40.090839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2561-956c-4d29-810c-82b9c76d5315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:40.111735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-035c2561-956c-4d29-810c-82b9c76d5315 None None] MFA Rules not processed for user `afb029d693404bd6bfd636535dac99ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:08:40.113255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-035c2561-956c-4d29-810c-82b9c76d5315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:08:40.131872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8e0b6-a008-4244-b284-cf60fb35cf6a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:08:40.137487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:08:40.138270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:08:40.138696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:08:40.138976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:08:40.154191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:08:40.157425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:08:40.171173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3859/7741] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 14:08:40.194111 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3883/7742] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:08:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:08:50.165229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=47,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:50.176631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=7,keystone:SELECT=70,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:00.170474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:00.172876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:00.249123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb91d6-7a32-40cb-9145-a9e09ad4735e service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:00.254615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:00.255236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:00.255523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:00.256071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:00.257854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:00.399333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:00.401804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:00.416682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3860/7743] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:02.401009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:02.401750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:02.401750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:02.426891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:02.428153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:02.436172 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3884/7744] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:09:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:02.448807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:02.464659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f170bc8-5c5f-4f13-9651-63fe78d02ff7 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:02.470528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:02.471718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:02.471995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:02.472263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:02.481076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:02.482708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:02.492917 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3861/7745] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:09:06.075460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:06.077119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:06.097646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cdf1d-92dd-4cbe-909c-bdf60e93b360 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:06.106950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56486f5-da20-4204-b711-c7c30d1158fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:06.108288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56486f5-da20-4204-b711-c7c30d1158fc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:06.108754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56486f5-da20-4204-b711-c7c30d1158fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:06.109199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56486f5-da20-4204-b711-c7c30d1158fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:06.111875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b56486f5-da20-4204-b711-c7c30d1158fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:06.185890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56486f5-da20-4204-b711-c7c30d1158fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:06.187451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56486f5-da20-4204-b711-c7c30d1158fc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:06.197886 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3885/7746] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:12.488705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=71 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:16.192904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=33 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:32.098275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:32.098275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:32.187065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7f43b-8759-4d88-b164-46036839e16d service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:32.192120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:32.198950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:32.198950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:32.198950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] PATH_INFO: `/v3/users/3c67caddb78d42468e3ef2d6e07c7989` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:32.198950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c67caddb78d42468e3ef2d6e07c7989)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:32.198950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:32.462885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c67caddb78d42468e3ef2d6e07c7989'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:32.468532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c67caddb78d42468e3ef2d6e07c7989'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:32.538574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c67caddb78d42468e3ef2d6e07c7989'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:32.549223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c67caddb78d42468e3ef2d6e07c7989'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:32.559284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c67caddb78d42468e3ef2d6e07c7989'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:32.580162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3862/7747] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:09:32 2022] DELETE /identity/v3/users/3c67caddb78d42468e3ef2d6e07c7989 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:09:32.584774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:32.585267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:32.585395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:32.604970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:32.606246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:32.669837 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3886/7748] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:32.680653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:32.682232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:32.749623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf6f23-9ff6-4f14-9120-81a6b0aaaa3b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:32.753182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5df97-0fdd-485b-bc38-27197464d290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:32.753827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5df97-0fdd-485b-bc38-27197464d290 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:32.754135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5df97-0fdd-485b-bc38-27197464d290 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:32.754414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5df97-0fdd-485b-bc38-27197464d290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:32.764460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5df97-0fdd-485b-bc38-27197464d290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:32.765891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5df97-0fdd-485b-bc38-27197464d290 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:32.775794 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3863/7749] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:33.207995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:33.210104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:33.222590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f950ef-6b18-4353-a7e7-4bad11ee92d0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:33.227948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:33.228590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.232437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.232437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] PATH_INFO: `/v3/projects/96cf257d6609457989daca67db09531f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.232437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96cf257d6609457989daca67db09531f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:33.232437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:33.359946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cf257d6609457989daca67db09531f', 'request_id': 'req-ef6ebefa-9dde-4af9-b335-2638a844c354'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:33.366593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cf257d6609457989daca67db09531f', 'request_id': 'req-ef6ebefa-9dde-4af9-b335-2638a844c354'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:33.446621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cf257d6609457989daca67db09531f', 'request_id': 'req-ef6ebefa-9dde-4af9-b335-2638a844c354'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:33.460258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] The token cache is being invalidate because project 96cf257d6609457989daca67db09531f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:09:33.460552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:33.461208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ef6ebefa-9dde-4af9-b335-2638a844c354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:33.462771 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3887/7750] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:09:33 2022] DELETE /identity/v3/projects/96cf257d6609457989daca67db09531f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:09:33.468228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a427d-7fb3-461c-ac68-f81392810d19 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.468734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a427d-7fb3-461c-ac68-f81392810d19 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.468852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a427d-7fb3-461c-ac68-f81392810d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.477269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:33.489713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-959a427d-7fb3-461c-ac68-f81392810d19 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:33.491044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-959a427d-7fb3-461c-ac68-f81392810d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:33.552562 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3864/7751] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:09:33.560443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6cc8-e53e-4df4-81ba-40281d5988c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.560731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6cc8-e53e-4df4-81ba-40281d5988c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.561006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6cc8-e53e-4df4-81ba-40281d5988c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.581996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ba8f6cc8-e53e-4df4-81ba-40281d5988c9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:33.583276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ba8f6cc8-e53e-4df4-81ba-40281d5988c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:33.591506 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3888/7752] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:33.595861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a427d-7fb3-461c-ac68-f81392810d19 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:33.606556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a427d-7fb3-461c-ac68-f81392810d19 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:33.611847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:33.612583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.612867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.613146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.613804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:09:33.614151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:33.616776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:33.629420 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3865/7753] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:09:33.634303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6cc8-e53e-4df4-81ba-40281d5988c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:33.643758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6cc8-e53e-4df4-81ba-40281d5988c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:33.648624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:33.649039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.649318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.649592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.650255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:33.652170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:33.729650 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3889/7754] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:09:33 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:09:33.730760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:33.741572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd057e3-4b7a-4593-a153-b9f48253f738 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:33.800319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:33.800856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.801136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.801407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.802041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:33.804554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:33.901760 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3866/7755] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:09:33 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:09:33.905857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:33.916890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83674d99-8920-4e05-b5a3-7856d5bb3824 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:33.921589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:33.922950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.922950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.922950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.923468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:33.925219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:33.935789 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3890/7756] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:09:33.939782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:33.951006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2030-5a95-4431-a43d-957e0008368b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:33.955885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d729fb-6347-4bd1-815e-256d78e1715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:33.956504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d729fb-6347-4bd1-815e-256d78e1715d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.956784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d729fb-6347-4bd1-815e-256d78e1715d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.957058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d729fb-6347-4bd1-815e-256d78e1715d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:33.957706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d729fb-6347-4bd1-815e-256d78e1715d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:33.959869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d729fb-6347-4bd1-815e-256d78e1715d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:33.971258 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3867/7757] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:09:33.977501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:33.989737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2e629-79c2-44f1-bdd6-eb40ab5bbfeb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:33.994560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:33.995220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:33.995503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:33.995787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] PATH_INFO: `/v3/projects/7308d5e191e54f64be26b1acb90836b6/users/768e33c63ed046d8bfcd7f9f1e352846/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:34.013509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7308d5e191e54f64be26b1acb90836b6, user_id=768e33c63ed046d8bfcd7f9f1e352846, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:34.017234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:34.075303 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3891/7758] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:09:33 2022] PUT /identity/v3/projects/7308d5e191e54f64be26b1acb90836b6/users/768e33c63ed046d8bfcd7f9f1e352846/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:09:34.087363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77676754-957d-4f9b-9116-6b70c9229e8a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:34.087645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77676754-957d-4f9b-9116-6b70c9229e8a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:34.087918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77676754-957d-4f9b-9116-6b70c9229e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:34.116062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-77676754-957d-4f9b-9116-6b70c9229e8a None None] MFA Rules not processed for user `768e33c63ed046d8bfcd7f9f1e352846`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:34.117261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-77676754-957d-4f9b-9116-6b70c9229e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:34.178341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:34.183783 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3868/7759] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:34.195321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:34.197354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:34.220477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:34.260826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4064c57-538c-4df4-881f-842902628966 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:34.264651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2915a4-27f5-46c9-b380-95ea7ad8fe8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:34.266377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2915a4-27f5-46c9-b380-95ea7ad8fe8b service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:34.266377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2915a4-27f5-46c9-b380-95ea7ad8fe8b service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:34.266377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2915a4-27f5-46c9-b380-95ea7ad8fe8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:34.275128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2915a4-27f5-46c9-b380-95ea7ad8fe8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:34.276576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2915a4-27f5-46c9-b380-95ea7ad8fe8b service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:34.285624 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3892/7760] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:34.311720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77676754-957d-4f9b-9116-6b70c9229e8a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:34.374668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77676754-957d-4f9b-9116-6b70c9229e8a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:34.379447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:34.380087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:34.380370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:34.380654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] PATH_INFO: `/v3/users/768e33c63ed046d8bfcd7f9f1e352846` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:34.382367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=768e33c63ed046d8bfcd7f9f1e352846)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:34.387399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:34.564377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768e33c63ed046d8bfcd7f9f1e352846'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:34.565472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768e33c63ed046d8bfcd7f9f1e352846'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:34.661818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768e33c63ed046d8bfcd7f9f1e352846'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:34.662966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768e33c63ed046d8bfcd7f9f1e352846'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:34.670579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768e33c63ed046d8bfcd7f9f1e352846'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:34.688638 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3869/7761] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:09:34 2022] DELETE /identity/v3/users/768e33c63ed046d8bfcd7f9f1e352846 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:09:34.693119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:34.693621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:34.693737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:34.713776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:34.721815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:34.773876 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3893/7762] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:34.783682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:34.785123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:34.846805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8b688-b61f-468f-925b-7de55e9cacfe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:34.851077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0949a8f-c845-49be-86d5-295ac2990ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:34.851687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0949a8f-c845-49be-86d5-295ac2990ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:34.852018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0949a8f-c845-49be-86d5-295ac2990ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:34.852278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0949a8f-c845-49be-86d5-295ac2990ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:34.861378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0949a8f-c845-49be-86d5-295ac2990ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:34.862832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0949a8f-c845-49be-86d5-295ac2990ee5 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:34.872590 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3870/7763] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:35.308461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:35.309911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:35.322810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15541c-b9f7-4b1c-8960-31e3d6a4568d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:35.327890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:35.334750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:35.334750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:35.334750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] PATH_INFO: `/v3/projects/7308d5e191e54f64be26b1acb90836b6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:35.334750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7308d5e191e54f64be26b1acb90836b6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:35.334750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:35.459675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7308d5e191e54f64be26b1acb90836b6', 'request_id': 'req-855ba21f-4000-4f67-b0ff-5551cd46decb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:35.466214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7308d5e191e54f64be26b1acb90836b6', 'request_id': 'req-855ba21f-4000-4f67-b0ff-5551cd46decb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:35.553700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7308d5e191e54f64be26b1acb90836b6', 'request_id': 'req-855ba21f-4000-4f67-b0ff-5551cd46decb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:35.564833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] The token cache is being invalidate because project 7308d5e191e54f64be26b1acb90836b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:09:35.565124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:35.565772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-855ba21f-4000-4f67-b0ff-5551cd46decb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:09:35.567309 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3894/7764] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:09:35 2022] DELETE /identity/v3/projects/7308d5e191e54f64be26b1acb90836b6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:09:35.572760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07416-4f8e-4497-b66c-8bc4ba77957f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:35.573257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07416-4f8e-4497-b66c-8bc4ba77957f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:35.573363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07416-4f8e-4497-b66c-8bc4ba77957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:35.593370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0e07416-4f8e-4497-b66c-8bc4ba77957f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:35.594606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0e07416-4f8e-4497-b66c-8bc4ba77957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:35.607718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:35.654878 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3871/7765] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:35.664483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db781f17-e180-42cf-be1d-28dc1a0e4400 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:35.664779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db781f17-e180-42cf-be1d-28dc1a0e4400 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:35.665083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db781f17-e180-42cf-be1d-28dc1a0e4400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:35.688805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-db781f17-e180-42cf-be1d-28dc1a0e4400 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:35.690044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db781f17-e180-42cf-be1d-28dc1a0e4400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:35.698956 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3895/7766] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:35.703147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e07416-4f8e-4497-b66c-8bc4ba77957f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:35.712924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e07416-4f8e-4497-b66c-8bc4ba77957f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:35.717599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:35.718239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:35.718538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:35.718795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:35.719471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:09:35.719775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:35.721522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:35.733750 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3872/7767] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:09:35.738020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db781f17-e180-42cf-be1d-28dc1a0e4400 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:35.748569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db781f17-e180-42cf-be1d-28dc1a0e4400 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:35.753450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:35.754081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:35.754362 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:35.754640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:35.755280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:35.757833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:35.845452 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3896/7768] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:09:35 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:09:35.850331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:35.860987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0e1dd-3298-4d99-b18c-3e81d3242a13 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:35.919434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:35.920044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:35.920325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:35.920600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:35.921232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:35.923223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:36.041597 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3873/7769] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:09:35 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:09:36.045713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:36.056724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dca61-1e61-4c21-8b46-c0a7eb7c0d4b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:36.061351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:36.064137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:36.064137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:36.064137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:36.064137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:36.064765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:36.075671 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3897/7770] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:09:36.079592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:36.089810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196f82d-01be-4ce3-8c05-d93c2d0cfac5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:36.094478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbba8f1-75ee-432f-938c-3df357003994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:36.095078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbba8f1-75ee-432f-938c-3df357003994 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:36.095364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbba8f1-75ee-432f-938c-3df357003994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:36.095689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbba8f1-75ee-432f-938c-3df357003994 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:36.096276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbba8f1-75ee-432f-938c-3df357003994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:36.097893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbba8f1-75ee-432f-938c-3df357003994 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:36.109418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3874/7771] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:09:36.113660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:36.124413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0dcc4-45fd-4f4a-bfaa-bb6f9815f767 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:36.128956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:36.129602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:36.129946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:36.130254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] PATH_INFO: `/v3/projects/1a8c4e9a4615417cb58a66de310680ac/users/4baf8112fb494a5c8cffd2874ce56795/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:36.132720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:36.145618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8c4e9a4615417cb58a66de310680ac, user_id=4baf8112fb494a5c8cffd2874ce56795, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:36.148304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:36.234927 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3898/7772] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:09:36 2022] PUT /identity/v3/projects/1a8c4e9a4615417cb58a66de310680ac/users/4baf8112fb494a5c8cffd2874ce56795/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:09:36.239819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee549016-411a-4421-8323-1f8909a3fdb6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:36.240155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee549016-411a-4421-8323-1f8909a3fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:36.240438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee549016-411a-4421-8323-1f8909a3fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:36.260416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ee549016-411a-4421-8323-1f8909a3fdb6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:36.261619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ee549016-411a-4421-8323-1f8909a3fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:36.320935 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3875/7773] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:36.330671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:36.332355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:36.393057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcfab9-539c-4139-8e9e-32d709b62772 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:36.397312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:36.397913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:36.398231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:36.398511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:36.407511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:36.408949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:36.420531 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3899/7774] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:37.773966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d8d3b-6abf-4943-b9e5-05e0991cdfa0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:37.774588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d8d3b-6abf-4943-b9e5-05e0991cdfa0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:37.774588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d8d3b-6abf-4943-b9e5-05e0991cdfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:37.804027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c15d8d3b-6abf-4943-b9e5-05e0991cdfa0 None None] MFA Rules not processed for user `4baf8112fb494a5c8cffd2874ce56795`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:37.805282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c15d8d3b-6abf-4943-b9e5-05e0991cdfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:37.819303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:37.875909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3876/7775] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:37.880658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:37.891321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a41f95-0520-4926-82a1-da6b8bedc1cb service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:37.895891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:37.896489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:37.896772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:37.897129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:37.897746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:37.899697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:37.973480 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3900/7776] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:09:37 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:09:37.977680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d8d3b-6abf-4943-b9e5-05e0991cdfa0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:37.988630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d8d3b-6abf-4943-b9e5-05e0991cdfa0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:38.045402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:38.046040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:38.046355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:38.046714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:38.047349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:38.049354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:38.157837 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3877/7777] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:09:37 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:09:38.159083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:38.170078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842a8f2-de28-4262-8ce0-9ad160fcfff0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:38.175212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:38.175810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:38.176087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:38.176359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:38.176996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:38.179330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:38.190901 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3901/7778] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:09:38.194891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:38.205047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741bb1-c7f7-4e99-b55f-e23efd1190e7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:38.209744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:38.210445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:38.210731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:38.213540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] PATH_INFO: `/v3/projects/5ef567f9be60464eacdc9119f5925f2a/users/3bb7987959cf40b88a09d416e8e85f5c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:38.226753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef567f9be60464eacdc9119f5925f2a, user_id=3bb7987959cf40b88a09d416e8e85f5c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:38.229395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:38.335818 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3878/7779] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:09:38 2022] PUT /identity/v3/projects/5ef567f9be60464eacdc9119f5925f2a/users/3bb7987959cf40b88a09d416e8e85f5c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:09:38.339859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:38.350554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deb942-0058-493f-aadb-d907f5f4bdfc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:38.407374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff770-6a67-4e90-80d3-144198fd7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:38.408033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff770-6a67-4e90-80d3-144198fd7a7b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:38.408273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff770-6a67-4e90-80d3-144198fd7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:38.408552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff770-6a67-4e90-80d3-144198fd7a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:38.409188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff770-6a67-4e90-80d3-144198fd7a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:38.410958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff770-6a67-4e90-80d3-144198fd7a7b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:38.421523 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3902/7780] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:09:38.425697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:38.437695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cd7a4-31c2-43fb-ba34-f45ec7cd924f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:38.442584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15169cad-77a4-4df4-9e4f-9e340838d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:38.443306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169cad-77a4-4df4-9e4f-9e340838d591 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:38.443591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169cad-77a4-4df4-9e4f-9e340838d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:38.443876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169cad-77a4-4df4-9e4f-9e340838d591 admin admin] PATH_INFO: `/v3/projects/5ef567f9be60464eacdc9119f5925f2a/users/3bb7987959cf40b88a09d416e8e85f5c/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:38.445862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169cad-77a4-4df4-9e4f-9e340838d591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef567f9be60464eacdc9119f5925f2a, user_id=3bb7987959cf40b88a09d416e8e85f5c, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:38.448601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169cad-77a4-4df4-9e4f-9e340838d591 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:38.460293 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3879/7781] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:09:38 2022] PUT /identity/v3/projects/5ef567f9be60464eacdc9119f5925f2a/users/3bb7987959cf40b88a09d416e8e85f5c/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:09:39.798927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:39.799488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:39.799488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:39.829154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] MFA Rules not processed for user `3bb7987959cf40b88a09d416e8e85f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:39.830398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:39.869510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:39.899390 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3903/7782] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:39.909695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:39.910264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:39.910264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:39.932309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] MFA Rules not processed for user `4baf8112fb494a5c8cffd2874ce56795`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:39.933541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:39.993290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3880/7783] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:40.004057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:40.005459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:40.086940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0f715-6a32-4d90-87ae-3946a457cac1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:40.092403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:40.093024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:40.093307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:40.093585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:40.102661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:40.105300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:40.115195 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3904/7784] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:40.350936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:40.352340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:40.366529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:40.414229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131d4b1-21e4-4bcd-a2d2-ef2631e3cfc0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:40.417898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:40.419161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:40.419556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:40.419841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:40.421558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:40.435902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:40.437767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:40.453208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3881/7785] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:40.862613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:40.864223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:40.874397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:40.888930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85de716-5c9c-4303-b923-3feec6c384e2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:40.892790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:40.893874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:40.894210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:40.894499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:40.897033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:40.915913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:40.917547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:40.941062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f328fb-0427-46cb-84a7-e0c8a87066a1 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:40.941510 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3882/7786] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:40.947447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921308a5-fab7-4285-bd08-17e8bedfbba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:40.950120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921308a5-fab7-4285-bd08-17e8bedfbba2 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:40.950120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921308a5-fab7-4285-bd08-17e8bedfbba2 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:40.950120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921308a5-fab7-4285-bd08-17e8bedfbba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:40.950570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-921308a5-fab7-4285-bd08-17e8bedfbba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:40.965334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921308a5-fab7-4285-bd08-17e8bedfbba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:40.966986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921308a5-fab7-4285-bd08-17e8bedfbba2 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:40.981708 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3905/7787] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:44.218953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:09:44.232081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeaadc-2bb4-4b9e-a56d-e1c9bce59a21 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:09:44.236123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:09:44.236964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:44.237250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:44.237560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:44.239323 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:44.252209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:09:44.264831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:09:44.268381 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3883/7788] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:09:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:09:50.976023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=78 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:53.331873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9dde-5e90-4d3d-be33-d8c256c4d68a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:09:53.332510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9dde-5e90-4d3d-be33-d8c256c4d68a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:09:53.332510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9dde-5e90-4d3d-be33-d8c256c4d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:09:53.352203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-14ba9dde-5e90-4d3d-be33-d8c256c4d68a None None] MFA Rules not processed for user `59e8ec11269d4e2f9e78e95950642232`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:09:53.353435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14ba9dde-5e90-4d3d-be33-d8c256c4d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:09:53.409317 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3906/7789] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:09:54.260895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:03.402642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=25 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:06.258570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:06.275138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e66e-20db-44fd-ab41-d8e455437e5f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:06.281469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:06.282298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:06.282583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:06.282852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:06.284633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:06.301041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:06.303384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:06.317020 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3884/7790] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:10:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:10:09.781935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba9dde-5e90-4d3d-be33-d8c256c4d68a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:09.800484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba9dde-5e90-4d3d-be33-d8c256c4d68a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:09.806465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:09.807100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:09.807587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:09.807872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:09.809673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:09.825886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:09.827669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:09.841662 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3907/7791] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:10:09.903229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:09.977902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98d1d5-05a3-40bf-8f0c-13bb912ca7c0 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:09.982508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:09.983153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:09.983436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:09.983713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] PATH_INFO: `/v3/users/4baf8112fb494a5c8cffd2874ce56795` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:09.984876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4baf8112fb494a5c8cffd2874ce56795)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:09.986889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:10.149224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4baf8112fb494a5c8cffd2874ce56795'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.149882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4baf8112fb494a5c8cffd2874ce56795'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.232167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4baf8112fb494a5c8cffd2874ce56795'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.232708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4baf8112fb494a5c8cffd2874ce56795'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.240979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4baf8112fb494a5c8cffd2874ce56795'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.259938 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3885/7792] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:10:09 2022] DELETE /identity/v3/users/4baf8112fb494a5c8cffd2874ce56795 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:10:10.531322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:10.544520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794cf00-96aa-437d-aa29-7b67cd5dcc9d service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:10.603352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:10.604029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:10.604311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:10.604582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] PATH_INFO: `/v3/projects/1a8c4e9a4615417cb58a66de310680ac` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:10.605757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8c4e9a4615417cb58a66de310680ac)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:10.607699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:10.723635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8c4e9a4615417cb58a66de310680ac', 'request_id': 'req-2f772a33-05bb-4d22-ac2a-061a29e64cfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.729944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8c4e9a4615417cb58a66de310680ac', 'request_id': 'req-2f772a33-05bb-4d22-ac2a-061a29e64cfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.800346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8c4e9a4615417cb58a66de310680ac', 'request_id': 'req-2f772a33-05bb-4d22-ac2a-061a29e64cfc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.811280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] The token cache is being invalidate because project 1a8c4e9a4615417cb58a66de310680ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:10:10.811569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.812193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:10.813696 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3908/7793] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:10:10 2022] DELETE /identity/v3/projects/1a8c4e9a4615417cb58a66de310680ac => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:10:10.822573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:10.823947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:10.837625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a075c-b152-4ab1-8b62-4f6703e52878 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:10.894344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:10.894986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:10.895271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:10.895568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] PATH_INFO: `/v3/users/3bb7987959cf40b88a09d416e8e85f5c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:10.897191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb7987959cf40b88a09d416e8e85f5c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:10.899156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:10.904463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:11.065167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb7987959cf40b88a09d416e8e85f5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.065777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb7987959cf40b88a09d416e8e85f5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.134370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb7987959cf40b88a09d416e8e85f5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.134998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb7987959cf40b88a09d416e8e85f5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.142441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb7987959cf40b88a09d416e8e85f5c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.159873 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3886/7794] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:10:10 2022] DELETE /identity/v3/users/3bb7987959cf40b88a09d416e8e85f5c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:10:11.407644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:11.409113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:11.425141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772a33-05bb-4d22-ac2a-061a29e64cfc admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:11.485243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:11.485884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:11.486207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:11.486487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] PATH_INFO: `/v3/projects/5ef567f9be60464eacdc9119f5925f2a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:11.487621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef567f9be60464eacdc9119f5925f2a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:11.489567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:11.512332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:11.587234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef567f9be60464eacdc9119f5925f2a', 'request_id': 'req-eba83f29-5489-4e4b-b4d5-e9e9361ed789'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.594347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef567f9be60464eacdc9119f5925f2a', 'request_id': 'req-eba83f29-5489-4e4b-b4d5-e9e9361ed789'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.660152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef567f9be60464eacdc9119f5925f2a', 'request_id': 'req-eba83f29-5489-4e4b-b4d5-e9e9361ed789'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.671738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] The token cache is being invalidate because project 5ef567f9be60464eacdc9119f5925f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:10:11.672028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.672651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:10:11.674170 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3909/7795] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:10:11 2022] DELETE /identity/v3/projects/5ef567f9be60464eacdc9119f5925f2a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:10:21.156201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:21.668728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:24.754350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:24.755910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:24.815495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9e506-657c-40c3-b355-76d80aaed40d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:24.864237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca692e-ba9c-413e-b366-c5b2a3823bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:24.864876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca692e-ba9c-413e-b366-c5b2a3823bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:24.865155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca692e-ba9c-413e-b366-c5b2a3823bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:24.865426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca692e-ba9c-413e-b366-c5b2a3823bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:24.867790 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bca692e-ba9c-413e-b366-c5b2a3823bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:24.879680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca692e-ba9c-413e-b366-c5b2a3823bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:24.881789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca692e-ba9c-413e-b366-c5b2a3823bf9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:24.893072 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3887/7796] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:10:34.886992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=46 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:10:53.195125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:10:53.196652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:53.273479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83f29-5489-4e4b-b4d5-e9e9361ed789 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:10:53.279184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634a1a5-c63b-4776-8eec-ae808312d1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:10:53.279786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a1a5-c63b-4776-8eec-ae808312d1b6 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:10:53.280069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a1a5-c63b-4776-8eec-ae808312d1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:10:53.280346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a1a5-c63b-4776-8eec-ae808312d1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:10:53.282116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5634a1a5-c63b-4776-8eec-ae808312d1b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:10:53.366328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634a1a5-c63b-4776-8eec-ae808312d1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:10:53.367944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634a1a5-c63b-4776-8eec-ae808312d1b6 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:10:53.388261 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3910/7797] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:10:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:11:02.859447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:02.859927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:02.860042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:02.889106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:11:02.890372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:02.898475 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3888/7798] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:11:03.386176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=69 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:07.119033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:07.120141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:07.120619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:07.146073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:11:07.148035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:07.230163 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3911/7799] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:11:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:11:07.382383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:07.382383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:07.511169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fce14b-c87a-4112-b721-ce6c90f71ad0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:07.516240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:07.516887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:07.517166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:07.517625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:07.534823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:07.536583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:07.548584 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3889/7800] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:11:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:17.222381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=25 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:17.543148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=38 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:22.529883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:22.531817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:22.552628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f5268-5f0a-4eb9-9cf3-623ef5397347 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:22.562118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:22.562118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:22.562118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:22.562118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:22.562480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:22.580222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:22.581857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:22.594285 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3912/7801] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:11:25.587735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:25.600466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c42cf-ad7e-472f-ae75-486c55ef9ec2 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:25.604289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:25.604887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:25.605165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:25.605437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:25.607328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:25.620125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:25.621567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:25.634694 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3890/7802] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:11:26.190172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:26.191609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:26.253512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf1e03-4795-4f9e-b62c-2e6bad149594 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:26.257599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:26.258361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:26.258641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:26.258916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:26.260659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:26.277024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:26.278544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:26.293306 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3913/7803] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:11:26.481343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:26.493382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc695235-db88-43e2-8a71-29cba08ae5e9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:26.497178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:26.497880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:26.498264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:26.498541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:26.500315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:26.513015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:26.514480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:26.525399 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3891/7804] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:11:26.615945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:26.628017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c10a36-3606-4bb0-84b8-1ef155620118 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:26.633006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcbf1a-2f62-4e9c-acdb-53ace5730260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:26.633724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbf1a-2f62-4e9c-acdb-53ace5730260 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:26.634145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbf1a-2f62-4e9c-acdb-53ace5730260 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:26.634542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcbf1a-2f62-4e9c-acdb-53ace5730260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:26.637258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1dcbf1a-2f62-4e9c-acdb-53ace5730260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:26.653397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcbf1a-2f62-4e9c-acdb-53ace5730260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:26.654959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcbf1a-2f62-4e9c-acdb-53ace5730260 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:26.669225 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3914/7805] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:11:26.791646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:26.794159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:26.830621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff3714-6435-4fc1-a210-aa701c757da4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:26.837808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:26.838694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:26.839195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:26.839698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:26.842748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:26.861821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:26.864062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:26.878858 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3892/7806] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:11:29.253482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9366-ebad-4eeb-9ba2-4aa803c49501 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:29.253924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9366-ebad-4eeb-9ba2-4aa803c49501 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:29.254046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9366-ebad-4eeb-9ba2-4aa803c49501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:29.273601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-367b9366-ebad-4eeb-9ba2-4aa803c49501 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:11:29.274855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-367b9366-ebad-4eeb-9ba2-4aa803c49501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:29.282013 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3915/7807] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:11:29.293776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:29.307896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69633b-e453-47df-90fd-9bc8c8e05234 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:29.312827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c13bf-fa81-4c0c-9ccc-7279e46ad59c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:29.313417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c13bf-fa81-4c0c-9ccc-7279e46ad59c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:29.313745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c13bf-fa81-4c0c-9ccc-7279e46ad59c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:29.314150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c13bf-fa81-4c0c-9ccc-7279e46ad59c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:29.322709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c13bf-fa81-4c0c-9ccc-7279e46ad59c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:29.324260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c13bf-fa81-4c0c-9ccc-7279e46ad59c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:29.332450 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3893/7808] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:33.475471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9366-ebad-4eeb-9ba2-4aa803c49501 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:33.494517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9366-ebad-4eeb-9ba2-4aa803c49501 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:33.502347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:33.503190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:33.503527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:33.504147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:33.506412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:33.573205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:33.574947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:33.585755 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3916/7809] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:11:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:11:39.328914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=24 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:43.580765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=69 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:44.876463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:44.876966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:44.877059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:44.906580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:11:44.907785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:11:44.915662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3894/7810] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:11:44.928569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:11:44.943410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd20c-4dfe-44ec-a893-15ea96101aa4 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:11:44.948404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7b3c7-80a7-4d69-87af-71fcd5e7937f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:11:44.949000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b3c7-80a7-4d69-87af-71fcd5e7937f service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:11:44.949277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b3c7-80a7-4d69-87af-71fcd5e7937f service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:11:44.949549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7b3c7-80a7-4d69-87af-71fcd5e7937f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:11:44.958040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b3c7-80a7-4d69-87af-71fcd5e7937f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:11:44.959635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7b3c7-80a7-4d69-87af-71fcd5e7937f service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:11:44.967917 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3917/7811] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:11:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:54.901620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:54.964502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:31.279083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:31.284515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:31.392989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a86850-4fb8-498f-a871-1288768cec5f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:31.398089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:31.400255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:31.400255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:31.400255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:31.401333 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:31.416062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:31.417638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:31.430996 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3895/7812] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:12:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:12:33.099642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:33.100161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:33.100260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:33.152828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:33.154189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:33.161701 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3918/7813] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Oct 18 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:33.168020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:33.178302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455d09a-6c1a-4587-bfa7-f78ee68eec79 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:33.181925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:33.182567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:33.187038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:33.187038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:33.187038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:33.269289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:33.270836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:33.281537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3896/7814] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:12:37.246705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:37.248197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:37.270126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49eac6-2006-442d-8925-6c1eced5df78 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:37.278345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:37.279690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:37.284485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:37.284485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] PATH_INFO: `/v3/users/59e8ec11269d4e2f9e78e95950642232` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:37.284485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e8ec11269d4e2f9e78e95950642232)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:37.286742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:37.465064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e8ec11269d4e2f9e78e95950642232'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:37.472489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e8ec11269d4e2f9e78e95950642232'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:37.480025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e8ec11269d4e2f9e78e95950642232'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:37.485781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e8ec11269d4e2f9e78e95950642232'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:37.542666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-27af525b-332d-4e6d-ae2d-7d9d2c3d1be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e8ec11269d4e2f9e78e95950642232'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:37.550612 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3919/7815] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:12:37 2022] DELETE /identity/v3/users/59e8ec11269d4e2f9e78e95950642232 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:12:37.830673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:37.842478 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ef9a8-ef71-438b-bc9e-01236faf92f4 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:37.899622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:37.905430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:37.906943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:37.906943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:37.906943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] PATH_INFO: `/v3/projects/1858431337674b66a5b20c21bea03164` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:37.907785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1858431337674b66a5b20c21bea03164)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:37.909682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:38.023236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1858431337674b66a5b20c21bea03164', 'request_id': 'req-d517ad50-cb27-4aa9-b768-9827c8787fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:38.029452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1858431337674b66a5b20c21bea03164', 'request_id': 'req-d517ad50-cb27-4aa9-b768-9827c8787fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:38.101663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1858431337674b66a5b20c21bea03164', 'request_id': 'req-d517ad50-cb27-4aa9-b768-9827c8787fed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:38.113063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] The token cache is being invalidate because project 1858431337674b66a5b20c21bea03164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:12:38.113341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:38.113993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d517ad50-cb27-4aa9-b768-9827c8787fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:12:38.115532 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3897/7816] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:12:37 2022] DELETE /identity/v3/projects/1858431337674b66a5b20c21bea03164 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:12:38.120924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94d1c-c89d-4b7e-a60a-49d5978dca66 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.121220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94d1c-c89d-4b7e-a60a-49d5978dca66 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.121502 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c94d1c-c89d-4b7e-a60a-49d5978dca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.150297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d0c94d1c-c89d-4b7e-a60a-49d5978dca66 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:38.151513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0c94d1c-c89d-4b7e-a60a-49d5978dca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:38.211457 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3920/7817] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:38.219102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a16565-c4b4-45f2-a964-a9ff7c76573f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.219386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a16565-c4b4-45f2-a964-a9ff7c76573f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.219659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a16565-c4b4-45f2-a964-a9ff7c76573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.239811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12a16565-c4b4-45f2-a964-a9ff7c76573f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:38.241000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12a16565-c4b4-45f2-a964-a9ff7c76573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:38.249193 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3898/7818] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:38.253954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94d1c-c89d-4b7e-a60a-49d5978dca66 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:38.264023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c94d1c-c89d-4b7e-a60a-49d5978dca66 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:38.268626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:38.269228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.269516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.269792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.270470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:12:38.270775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:38.272437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:38.284128 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3921/7819] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:12:38.288362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a16565-c4b4-45f2-a964-a9ff7c76573f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:38.298370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a16565-c4b4-45f2-a964-a9ff7c76573f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:38.303012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:38.303633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.303912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.304182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.304807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:38.306727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:38.433599 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3899/7820] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:12:38 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:12:38.438379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:38.448326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bfdc8-4373-49c7-9e51-e7d7bd8e7a07 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:38.469973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:38.506838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:38.507758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.508040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.508318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.508955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:38.510934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:38.622624 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3922/7821] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:12:38 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:12:38.626570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:38.637307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccc9d-7859-4aca-826c-1f84be367070 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:38.642138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:38.642767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.643046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.643317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.643959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:38.645531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:38.655551 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3900/7822] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:12:38.659958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:38.670247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef0c74-ed7a-4fd5-bcdb-750582d65f9f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:38.675672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41189515-24d2-4078-a432-5d7a0dbf7fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:38.676276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41189515-24d2-4078-a432-5d7a0dbf7fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.676562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41189515-24d2-4078-a432-5d7a0dbf7fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.676842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41189515-24d2-4078-a432-5d7a0dbf7fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.677488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41189515-24d2-4078-a432-5d7a0dbf7fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:38.679160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41189515-24d2-4078-a432-5d7a0dbf7fe9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:38.689055 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3923/7823] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:12:38.693159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:38.703129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10cbb1-7ad4-4836-8bfa-f0cbdf3106d6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:38.707698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0182bfc-0b0b-415b-8a24-a8ca02511e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:38.708345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182bfc-0b0b-415b-8a24-a8ca02511e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.708627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182bfc-0b0b-415b-8a24-a8ca02511e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.708901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182bfc-0b0b-415b-8a24-a8ca02511e92 admin admin] PATH_INFO: `/v3/projects/6d7ca279292a4614b7314c4546e24680/users/3707d5fd73034aefaa470c08814a0809/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.723920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0182bfc-0b0b-415b-8a24-a8ca02511e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7ca279292a4614b7314c4546e24680, user_id=3707d5fd73034aefaa470c08814a0809, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:38.726596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0182bfc-0b0b-415b-8a24-a8ca02511e92 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:38.799539 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3901/7824] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:12:38 2022] PUT /identity/v3/projects/6d7ca279292a4614b7314c4546e24680/users/3707d5fd73034aefaa470c08814a0809/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:12:38.804707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987c894-a79f-4525-866a-73c5f8a7d196 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.808009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987c894-a79f-4525-866a-73c5f8a7d196 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.808009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987c894-a79f-4525-866a-73c5f8a7d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.824373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e987c894-a79f-4525-866a-73c5f8a7d196 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:38.825568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e987c894-a79f-4525-866a-73c5f8a7d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:38.884680 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3924/7825] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:38.894516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce55b8-6cc0-4509-8a48-51c5a4dde129 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.894938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce55b8-6cc0-4509-8a48-51c5a4dde129 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.895074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce55b8-6cc0-4509-8a48-51c5a4dde129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.915363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-37ce55b8-6cc0-4509-8a48-51c5a4dde129 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:38.916572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-37ce55b8-6cc0-4509-8a48-51c5a4dde129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:38.967001 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3902/7826] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Oct 18 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:38.973585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987c894-a79f-4525-866a-73c5f8a7d196 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:38.983085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987c894-a79f-4525-866a-73c5f8a7d196 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:38.986804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:38.987402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:38.987686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:38.987962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:38.996848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:38.998314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:39.007959 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3925/7827] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:12:44.397373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388248-0ffa-4554-bb61-afafe68c9c3e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:44.398308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388248-0ffa-4554-bb61-afafe68c9c3e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:44.398795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388248-0ffa-4554-bb61-afafe68c9c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:44.434288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-82388248-0ffa-4554-bb61-afafe68c9c3e None None] MFA Rules not processed for user `3707d5fd73034aefaa470c08814a0809`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:44.435524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82388248-0ffa-4554-bb61-afafe68c9c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:44.460175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:44.513350 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3903/7828] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:44.530739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:44.532167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:44.617328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f78875-0e13-4cfb-b9ee-83194a756246 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:44.623710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68179a1c-8dbf-4e1c-bd23-627304f2886b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:44.624327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179a1c-8dbf-4e1c-bd23-627304f2886b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:44.624631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179a1c-8dbf-4e1c-bd23-627304f2886b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:44.625211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179a1c-8dbf-4e1c-bd23-627304f2886b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:44.635824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68179a1c-8dbf-4e1c-bd23-627304f2886b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:44.637492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68179a1c-8dbf-4e1c-bd23-627304f2886b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:44.649297 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3926/7829] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:12:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:12:47.109603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:47.110118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:47.110572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:47.132702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] MFA Rules not processed for user `3707d5fd73034aefaa470c08814a0809`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:47.133937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:47.141346 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3904/7830] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:47.959972 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:47.962928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:47.962928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:48.000709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:48.011284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:12:48.012843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:48.089968 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3927/7831] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:12:48.103715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:48.105218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:48.123814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b87198-d2ef-4811-9e61-b77f4db4c02f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:48.129538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:48.131396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:48.131931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:48.132611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:48.143493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:48.145108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:48.160565 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3905/7832] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:12:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:12:58.151724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=26 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:58.180919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=28 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:58.786960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:12:58.788521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:58.806148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5f4e-2ba8-4451-ade8-9cc9df8d2adc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:12:58.811608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:12:58.812211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:12:58.812491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:12:58.812766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:12:58.815162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:12:58.829868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:12:58.831588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:12:58.845425 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3928/7833] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:12:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:13:08.838515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:33.069684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:13:33.071216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:33.089328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bbf8f-5987-4f52-9c21-1e713cf58aab service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:13:33.100900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43176d-0184-4cc8-afdc-0ffcc5921763 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:13:33.100900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43176d-0184-4cc8-afdc-0ffcc5921763 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:33.100900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43176d-0184-4cc8-afdc-0ffcc5921763 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:33.100900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43176d-0184-4cc8-afdc-0ffcc5921763 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:33.101214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc43176d-0184-4cc8-afdc-0ffcc5921763 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:33.115139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43176d-0184-4cc8-afdc-0ffcc5921763 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:13:33.116730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43176d-0184-4cc8-afdc-0ffcc5921763 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:13:33.130075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3906/7834] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:13:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:13:43.122534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:49.215183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:13:49.239341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c006a1-fe14-4abf-a62d-952b89ce6d9b service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:13:49.245545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd8503-5dfa-4ed0-9114-4457ea746878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:13:49.246174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8503-5dfa-4ed0-9114-4457ea746878 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:49.246457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8503-5dfa-4ed0-9114-4457ea746878 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:49.246734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8503-5dfa-4ed0-9114-4457ea746878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:49.248427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2bdd8503-5dfa-4ed0-9114-4457ea746878 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:49.313091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd8503-5dfa-4ed0-9114-4457ea746878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:13:49.315100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd8503-5dfa-4ed0-9114-4457ea746878 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:13:49.324486 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3929/7835] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:13:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:13:51.941329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb5c8-1575-4416-95f3-28db5d5ec7b3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:51.941813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb5c8-1575-4416-95f3-28db5d5ec7b3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:51.941813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb5c8-1575-4416-95f3-28db5d5ec7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:51.961649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-09cfb5c8-1575-4416-95f3-28db5d5ec7b3 None None] MFA Rules not processed for user `c0fc58ba6c524ee79755a72aa1f7ce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:13:51.962882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09cfb5c8-1575-4416-95f3-28db5d5ec7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:52.022723 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3907/7836] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:13:53.218786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:53.219265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:53.219353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:53.241718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:13:53.243142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:53.253556 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3930/7837] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:13:53.275197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfb5c8-1575-4416-95f3-28db5d5ec7b3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:13:53.303542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfb5c8-1575-4416-95f3-28db5d5ec7b3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:13:53.310715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fc758-61ea-4be7-afb1-1bc11f5df732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:13:53.320660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fc758-61ea-4be7-afb1-1bc11f5df732 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:53.320660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fc758-61ea-4be7-afb1-1bc11f5df732 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:53.320660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fc758-61ea-4be7-afb1-1bc11f5df732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:53.322206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fc758-61ea-4be7-afb1-1bc11f5df732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:13:53.324683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fc758-61ea-4be7-afb1-1bc11f5df732 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:13:53.338377 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3908/7838] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:13:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:13:55.731198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:13:55.732665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:55.759537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba65cd-1019-46c4-ab7f-ae25cb72a8c9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:13:55.764963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:13:55.765591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:55.765874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:55.766251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:55.768259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:55.782390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:13:55.783819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:13:55.816494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3931/7839] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:13:56.658278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d83ad6-d458-489f-b318-c513e481e80d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:56.658716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d83ad6-d458-489f-b318-c513e481e80d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:56.658819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d83ad6-d458-489f-b318-c513e481e80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:56.680077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-52d83ad6-d458-489f-b318-c513e481e80d None None] MFA Rules not processed for user `3707d5fd73034aefaa470c08814a0809`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:13:56.681331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-52d83ad6-d458-489f-b318-c513e481e80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:56.711249 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3909/7840] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:13:59.278847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:13:59.289569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d436-148b-4f46-a46d-ec2bfb8a0dcb service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:13:59.296594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:13:59.296594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:13:59.296594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:13:59.296594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:13:59.307750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:13:59.344981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:13:59.351267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:13:59.383530 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3932/7841] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:13:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:14:01.080489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d83ad6-d458-489f-b318-c513e481e80d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:14:01.099725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d83ad6-d458-489f-b318-c513e481e80d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:14:01.106184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:14:01.106969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:14:01.107365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:14:01.107738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:14:01.111040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:01.129062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:14:01.131078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:14:01.158756 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3910/7842] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:14:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:14:06.391853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:14:06.393439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:06.407383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d969-1dc2-45a3-9313-706d6d16fe66 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:14:06.411900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:14:06.412586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:14:06.412879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:14:06.413161 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] PATH_INFO: `/v3/users/afb029d693404bd6bfd636535dac99ab` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:14:06.414334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb029d693404bd6bfd636535dac99ab)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:14:06.416933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:14:06.674491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb029d693404bd6bfd636535dac99ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:06.682149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb029d693404bd6bfd636535dac99ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:06.682928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb029d693404bd6bfd636535dac99ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:06.696977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb029d693404bd6bfd636535dac99ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:06.757243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb029d693404bd6bfd636535dac99ab'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:06.764564 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3933/7843] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:14:06 2022] DELETE /identity/v3/users/afb029d693404bd6bfd636535dac99ab => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:14:07.027557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:14:07.039909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82b101-6116-4c4a-b593-57ccb2653f81 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:14:07.115720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:14:07.116641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:14:07.117082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:14:07.117378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] PATH_INFO: `/v3/projects/98dbcb42beaa4345ad9a6851c067bc99` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:14:07.118604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=98dbcb42beaa4345ad9a6851c067bc99)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:14:07.121228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:14:07.238324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98dbcb42beaa4345ad9a6851c067bc99', 'request_id': 'req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.245189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98dbcb42beaa4345ad9a6851c067bc99', 'request_id': 'req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.293972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98dbcb42beaa4345ad9a6851c067bc99', 'request_id': 'req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.305308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] The token cache is being invalidate because project 98dbcb42beaa4345ad9a6851c067bc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:14:07.305595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.306256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.308267 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3911/7844] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:14:07 2022] DELETE /identity/v3/projects/98dbcb42beaa4345ad9a6851c067bc99 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:14:07.312454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:14:07.313865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:07.327680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd77ab6-8b80-43d0-a100-5359043bbf15 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:14:07.343913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:07.383617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:14:07.384254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:14:07.384537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:14:07.384815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] PATH_INFO: `/v3/users/620fad0b9bf240c49722b0c4a8f0f6c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:14:07.386564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] RBAC: Authorizing `identity:delete_user(user_id=620fad0b9bf240c49722b0c4a8f0f6c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:14:07.388572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:14:07.589836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620fad0b9bf240c49722b0c4a8f0f6c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.597396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620fad0b9bf240c49722b0c4a8f0f6c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.598138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620fad0b9bf240c49722b0c4a8f0f6c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.611788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620fad0b9bf240c49722b0c4a8f0f6c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.694019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620fad0b9bf240c49722b0c4a8f0f6c8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:07.700286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3934/7845] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:14:07 2022] DELETE /identity/v3/users/620fad0b9bf240c49722b0c4a8f0f6c8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:14:07.958507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:14:07.959637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:07.968849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:07.974684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7bd76-2e60-47c5-816d-8e3d54adfbfe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:14:08.042916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:14:08.043602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:14:08.044189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:14:08.044509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] PATH_INFO: `/v3/projects/7bad6280015449598fbfb806bec2cb4c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:14:08.045628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bad6280015449598fbfb806bec2cb4c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:14:08.047580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:14:08.134422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bad6280015449598fbfb806bec2cb4c', 'request_id': 'req-6cac6830-c153-48dd-aeb4-613e2471d427'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:08.140603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bad6280015449598fbfb806bec2cb4c', 'request_id': 'req-6cac6830-c153-48dd-aeb4-613e2471d427'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:08.185058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bad6280015449598fbfb806bec2cb4c', 'request_id': 'req-6cac6830-c153-48dd-aeb4-613e2471d427'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:08.197260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] The token cache is being invalidate because project 7bad6280015449598fbfb806bec2cb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:14:08.198046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:08.198709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:14:08.200224 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3912/7846] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:14:07 2022] DELETE /identity/v3/projects/7bad6280015449598fbfb806bec2cb4c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:14:16.944416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:14:16.945835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:17.003453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5f67-7ba6-43ca-a321-ef82853905de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:14:17.052113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe268888-8f06-4548-a0c0-d5be46ae24db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:14:17.052693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268888-8f06-4548-a0c0-d5be46ae24db service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:14:17.052978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268888-8f06-4548-a0c0-d5be46ae24db service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:14:17.053247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe268888-8f06-4548-a0c0-d5be46ae24db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:14:17.054945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fe268888-8f06-4548-a0c0-d5be46ae24db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:17.062847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:17.141782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe268888-8f06-4548-a0c0-d5be46ae24db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:14:17.143266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe268888-8f06-4548-a0c0-d5be46ae24db service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:14:17.162460 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3935/7847] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:14:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:14:18.194191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:27.185331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=38 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:48.848628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:14:48.850131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:48.922620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6830-c153-48dd-aeb4-613e2471d427 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:14:48.926288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:14:48.926894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:14:48.927172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:14:48.927441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:14:48.929178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:14:49.014754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:14:49.016120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:14:49.030183 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3913/7848] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:14:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:14:59.022735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=64 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:07.499588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3e66-8a11-4488-b8ad-95c39d9f1efb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:15:07.500071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3e66-8a11-4488-b8ad-95c39d9f1efb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:15:07.500195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af3e66-8a11-4488-b8ad-95c39d9f1efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:15:07.521124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-56af3e66-8a11-4488-b8ad-95c39d9f1efb None None] MFA Rules not processed for user `3707d5fd73034aefaa470c08814a0809`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:15:07.522381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56af3e66-8a11-4488-b8ad-95c39d9f1efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:15:07.576363 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3936/7849] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:15:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:15:17.569709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=25 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:31.745847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:15:31.747254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:15:31.758801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98e7a-3021-4664-adbf-2250051cc3d2 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:15:31.762554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:15:31.763146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:15:31.763421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:15:31.767082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:15:31.767082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:15:31.777201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:15:31.778715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:15:31.789154 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3914/7850] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:15:41.783170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:27.275494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd89b45-7cc3-4ffd-9688-1882b307d00a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:16:27.276009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd89b45-7cc3-4ffd-9688-1882b307d00a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:16:27.276119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd89b45-7cc3-4ffd-9688-1882b307d00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:16:27.296116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1dd89b45-7cc3-4ffd-9688-1882b307d00a None None] MFA Rules not processed for user `3707d5fd73034aefaa470c08814a0809`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:16:27.297338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1dd89b45-7cc3-4ffd-9688-1882b307d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:27.304198 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3937/7851] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:16:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:16:27.617350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:16:27.618833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:27.639647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e932594-d90a-466a-be75-e8b33144a0f9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:16:27.643308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:16:27.643905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:16:27.644182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:16:27.644461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:16:27.646167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:27.657777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:16:27.659226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:16:27.669969 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3915/7852] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:16:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:16:31.072624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd89b45-7cc3-4ffd-9688-1882b307d00a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:16:31.082934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd89b45-7cc3-4ffd-9688-1882b307d00a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:16:31.086481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:16:31.087078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:16:31.087354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:16:31.087730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:16:31.089328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:31.103294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:16:31.104741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:16:31.117416 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3938/7853] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:16:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:16:32.017246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:16:32.018765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:32.040983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba8446-7931-4736-9c49-90a5b9225a8f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:16:32.047238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:16:32.047870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:16:32.048147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:16:32.048423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:16:32.050189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:32.066269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:16:32.070807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:16:32.082166 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3916/7854] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:16:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:16:36.109668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:16:36.118440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b49e-dc5d-45b5-9428-021e63fba92c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:16:36.121996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:16:36.122619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:16:36.123007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:16:36.123293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:16:36.125013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:36.185231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:16:36.186713 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:16:36.195911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3939/7855] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:16:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:16:40.454151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:16:40.454151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:40.473387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cfb36-eaa8-4074-aa6c-68e2c4dcf4a5 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:16:40.480287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:16:40.481096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:16:40.481513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:16:40.482438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:16:40.484350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:16:40.500999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:16:40.502813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:16:40.517290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3917/7856] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:16:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:16:46.191496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=37 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:50.509818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=26 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:05.373561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:05.382295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e4c0c-22f3-428f-8383-ff579425ec3d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:05.386515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:05.387128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:05.387911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:05.388188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:05.389996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:05.460765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:05.462272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:05.485446 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3940/7857] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:17:08.796541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:08.797941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:08.871918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e73a-d18e-44ad-b0bc-12d83f1c892c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:08.876945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:08.877547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:08.877826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:08.878126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:08.879840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:08.894301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:08.897503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:08.908845 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3918/7858] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:17:12.644328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:12.645804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:12.659376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42e26d-43e9-483e-8289-bf64af38f93c service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:12.663951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:12.664582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:12.664860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:12.665133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] PATH_INFO: `/v3/users/c0fc58ba6c524ee79755a72aa1f7ce1d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:12.666404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fc58ba6c524ee79755a72aa1f7ce1d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:12.668330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:12.856439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fc58ba6c524ee79755a72aa1f7ce1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:12.863570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fc58ba6c524ee79755a72aa1f7ce1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:12.864243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fc58ba6c524ee79755a72aa1f7ce1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:12.877001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fc58ba6c524ee79755a72aa1f7ce1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:12.941739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fc58ba6c524ee79755a72aa1f7ce1d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:12.948110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3941/7859] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:17:12 2022] DELETE /identity/v3/users/c0fc58ba6c524ee79755a72aa1f7ce1d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:17:13.221180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:13.233546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdc930-3809-447d-b5df-8e82cef39645 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:13.291047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:13.291679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:13.291959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:13.292234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] PATH_INFO: `/v3/projects/b10dd8d3e1be4c6e9ceea751db7a775e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:13.293343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10dd8d3e1be4c6e9ceea751db7a775e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:13.295777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:13.397406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'request_id': 'req-62c32e4f-e9be-4592-a057-d866a0b2edd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.404100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'request_id': 'req-62c32e4f-e9be-4592-a057-d866a0b2edd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.450457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10dd8d3e1be4c6e9ceea751db7a775e', 'request_id': 'req-62c32e4f-e9be-4592-a057-d866a0b2edd5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.461623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] The token cache is being invalidate because project b10dd8d3e1be4c6e9ceea751db7a775e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:17:13.461909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.462581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.464196 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3919/7860] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:17:13 2022] DELETE /identity/v3/projects/b10dd8d3e1be4c6e9ceea751db7a775e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:17:13.468883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:13.470657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:13.484828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae32f40-4181-4981-a441-eb9cb845d5c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:13.536414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:13.542169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:13.542800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:13.543118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:13.543394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] PATH_INFO: `/v3/users/40d59a3675a946b2a1467112fc5975a9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:13.545131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d59a3675a946b2a1467112fc5975a9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:13.547124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:13.841754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d59a3675a946b2a1467112fc5975a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.849526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d59a3675a946b2a1467112fc5975a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.850241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d59a3675a946b2a1467112fc5975a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.862366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d59a3675a946b2a1467112fc5975a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.928634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d59a3675a946b2a1467112fc5975a9'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:13.935301 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3942/7861] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:17:13 2022] DELETE /identity/v3/users/40d59a3675a946b2a1467112fc5975a9 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:17:14.187577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:14.189308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:14.204276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c32e4f-e9be-4592-a057-d866a0b2edd5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:14.222663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:14.263437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:14.264087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:14.264370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:14.264644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] PATH_INFO: `/v3/projects/85d046f954fa4d939a022e17c5b0b56a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:14.265775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d046f954fa4d939a022e17c5b0b56a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:14.267714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:14.364385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d046f954fa4d939a022e17c5b0b56a', 'request_id': 'req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:14.370405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d046f954fa4d939a022e17c5b0b56a', 'request_id': 'req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:14.427338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d046f954fa4d939a022e17c5b0b56a', 'request_id': 'req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:14.438744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] The token cache is being invalidate because project 85d046f954fa4d939a022e17c5b0b56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:17:14.438965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:14.439598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:17:14.441084 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3920/7862] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:17:14 2022] DELETE /identity/v3/projects/85d046f954fa4d939a022e17c5b0b56a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:17:23.952232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:24.434934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:34.334481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:34.335881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:34.416509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b46be9-69d4-48ef-bfce-c5206d9dd95b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:34.475541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:34.476158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:34.476441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:34.476710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:34.478439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:34.492118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:34.493674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:34.506399 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3943/7863] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:17:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:17:43.379720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:43.381255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:43.465794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8dc53-c57c-4806-80ef-d9faab7e6fba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:43.472597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:43.473262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:43.473564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:43.473839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:43.475623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:43.542896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:43.544495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:43.553643 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3921/7864] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:17:44.499264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=62 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:53.549325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=56 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:57.170525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:17:57.171944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:57.229154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29745-9135-4878-a559-888c8883a5d3 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:17:57.232643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:17:57.233247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:17:57.233525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:17:57.233798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:17:57.235584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:17:57.301100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:17:57.302591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:17:57.312220 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3944/7865] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:01.145973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:01.147486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:01.162276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5babda8b-23ae-4a42-b178-4f4beea29ad1 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:01.166956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:01.167592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:01.167876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:01.168153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] PATH_INFO: `/v3/users/3707d5fd73034aefaa470c08814a0809` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:01.169277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3707d5fd73034aefaa470c08814a0809)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:01.171237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:01.358248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3707d5fd73034aefaa470c08814a0809'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:01.358842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3707d5fd73034aefaa470c08814a0809'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:01.412815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3707d5fd73034aefaa470c08814a0809'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:01.413457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3707d5fd73034aefaa470c08814a0809'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:01.420661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-faf14163-ce00-4395-a6eb-aa6ad3a38a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3707d5fd73034aefaa470c08814a0809'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:01.438926 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3922/7866] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:01 2022] DELETE /identity/v3/users/3707d5fd73034aefaa470c08814a0809 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:01.734651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:01.745887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651226f7-131d-46a0-8ebf-a146d2b52ab7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:01.803681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:01.804320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:01.804599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:01.804874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] PATH_INFO: `/v3/projects/6d7ca279292a4614b7314c4546e24680` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:01.805979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d7ca279292a4614b7314c4546e24680)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:01.807932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:01.933014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d7ca279292a4614b7314c4546e24680', 'request_id': 'req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:01.934888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:01.940228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d7ca279292a4614b7314c4546e24680', 'request_id': 'req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:02.013396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d7ca279292a4614b7314c4546e24680', 'request_id': 'req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:02.025709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] The token cache is being invalidate because project 6d7ca279292a4614b7314c4546e24680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:02.026003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:02.026727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fdc60068-7b1a-462f-a9b4-7df1d27dcde6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:02.028224 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3945/7867] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:01 2022] DELETE /identity/v3/projects/6d7ca279292a4614b7314c4546e24680 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:02.034372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfddb4-6793-4a96-a9d0-6df79c057e94 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.034803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfddb4-6793-4a96-a9d0-6df79c057e94 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.035200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfddb4-6793-4a96-a9d0-6df79c057e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.076909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d5bfddb4-6793-4a96-a9d0-6df79c057e94 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:02.078140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5bfddb4-6793-4a96-a9d0-6df79c057e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:02.139796 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3923/7868] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:02.149666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890852f-c13d-4e0f-97d6-1f01737365bf None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.149955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890852f-c13d-4e0f-97d6-1f01737365bf None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.150329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890852f-c13d-4e0f-97d6-1f01737365bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.170616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e890852f-c13d-4e0f-97d6-1f01737365bf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:02.171842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e890852f-c13d-4e0f-97d6-1f01737365bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:02.182718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3946/7869] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:02.185466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfddb4-6793-4a96-a9d0-6df79c057e94 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.195948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfddb4-6793-4a96-a9d0-6df79c057e94 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:02.200613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:02.201217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.201501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.201782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.202480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:02.202788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:02.205162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:02.216769 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3924/7870] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:02.221199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890852f-c13d-4e0f-97d6-1f01737365bf None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.230433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890852f-c13d-4e0f-97d6-1f01737365bf None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:02.235300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:02.236011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.236241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.236518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.237155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:02.239150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:02.330375 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3947/7871] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:02 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:02.334691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.344869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c1b4-4b6b-4f85-81fb-d2a052e4b54e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:02.387325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:02.403184 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:02.403794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.404076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.404351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.404985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:02.406930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:02.507959 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3925/7872] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:02 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:02.512308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.522958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b857947-a64d-4267-bf79-50bd578bfe2e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:02.527584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:02.528193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.528477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.528753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.529396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:02.531071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:02.540935 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3948/7873] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:02.544844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.555919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18fc11-2e38-4aff-aa11-3b01dd24ca99 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:02.560844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555dbf-8e9d-4ca4-b064-c0c55a1ad23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:02.561517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555dbf-8e9d-4ca4-b064-c0c55a1ad23a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.561794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555dbf-8e9d-4ca4-b064-c0c55a1ad23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.562096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555dbf-8e9d-4ca4-b064-c0c55a1ad23a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.562751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555dbf-8e9d-4ca4-b064-c0c55a1ad23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:02.564986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555dbf-8e9d-4ca4-b064-c0c55a1ad23a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:02.576102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3926/7874] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:02.580340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.590500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2565fa7-d5f5-477f-8e9e-2206b0df18b4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:02.595188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:02.595835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.596119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.596393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] PATH_INFO: `/v3/projects/53fba77dfd034bab96cee84797e51ab2/users/7650487c0f9d45999308d496beec7606/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.612200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fba77dfd034bab96cee84797e51ab2, user_id=7650487c0f9d45999308d496beec7606, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:02.615067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:02.687132 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3949/7875] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:02 2022] PUT /identity/v3/projects/53fba77dfd034bab96cee84797e51ab2/users/7650487c0f9d45999308d496beec7606/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:02.698382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d4537-b3b5-4a29-b7db-0c6cba7a2087 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.698664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d4537-b3b5-4a29-b7db-0c6cba7a2087 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.698936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d4537-b3b5-4a29-b7db-0c6cba7a2087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.728163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d26d4537-b3b5-4a29-b7db-0c6cba7a2087 None None] MFA Rules not processed for user `7650487c0f9d45999308d496beec7606`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:02.729386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d26d4537-b3b5-4a29-b7db-0c6cba7a2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:02.794635 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3927/7876] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:02.799706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.861283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241a875-4a9a-45e8-8e3c-c0a2c8f9c2b5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:02.865855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:02.866491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:02.866767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:02.867041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:02.867672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:02.869594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:02.980077 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3950/7877] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:02 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:02.984159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d4537-b3b5-4a29-b7db-0c6cba7a2087 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:02.995993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d4537-b3b5-4a29-b7db-0c6cba7a2087 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.051787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.052317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.052592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.052862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.053479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.055403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.138359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3928/7878] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:02 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:03.142818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.153129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2443146-7cb8-47c6-aee4-b8b23ff598f0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.158683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.159287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.159570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.159846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.160492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.162197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.172863 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3951/7879] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:03.177037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.187064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a02c-2c67-43de-b432-288cec8c907a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.191754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.192418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.192696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.192968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] PATH_INFO: `/v3/projects/ec18608da785428c89096f1305e700e2/users/18cdfa7980384061954f58f4473a741e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.208311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec18608da785428c89096f1305e700e2, user_id=18cdfa7980384061954f58f4473a741e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.211087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.269990 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3929/7880] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:03 2022] PUT /identity/v3/projects/ec18608da785428c89096f1305e700e2/users/18cdfa7980384061954f58f4473a741e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:03.274135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.284757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfc735-2fb5-46dd-a149-329a83ed694d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.324252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:03.340610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522ce7d-7cf6-4b4c-ac68-a67f1d7b403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.341214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ce7d-7cf6-4b4c-ac68-a67f1d7b403a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.341491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ce7d-7cf6-4b4c-ac68-a67f1d7b403a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.341769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522ce7d-7cf6-4b4c-ac68-a67f1d7b403a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.342437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522ce7d-7cf6-4b4c-ac68-a67f1d7b403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.344022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522ce7d-7cf6-4b4c-ac68-a67f1d7b403a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.354808 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3952/7881] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:03.358935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.369156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea1377-e418-46d0-b26d-9eac768e22b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.373866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.374549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.374828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.375099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] PATH_INFO: `/v3/projects/ec18608da785428c89096f1305e700e2/users/18cdfa7980384061954f58f4473a741e/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.377043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec18608da785428c89096f1305e700e2, user_id=18cdfa7980384061954f58f4473a741e, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.379743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.390355 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3930/7882] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:03 2022] PUT /identity/v3/projects/ec18608da785428c89096f1305e700e2/users/18cdfa7980384061954f58f4473a741e/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:03.401127 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cb27-9a48-4403-b161-fed6cf179040 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.401409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cb27-9a48-4403-b161-fed6cf179040 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.401680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cb27-9a48-4403-b161-fed6cf179040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.430655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3d16cb27-9a48-4403-b161-fed6cf179040 None None] MFA Rules not processed for user `18cdfa7980384061954f58f4473a741e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:03.431863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3d16cb27-9a48-4403-b161-fed6cf179040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:03.504534 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3953/7883] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:03.509640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.516347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:03.521480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e354806-02a0-4e12-ae22-49ee8710cb6e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.527103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.527771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.528046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.528326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.528962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.530886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.644372 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3931/7884] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:03 2022] POST /identity/v3/projects => generated 350 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:03.648295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16cb27-9a48-4403-b161-fed6cf179040 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.657756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16cb27-9a48-4403-b161-fed6cf179040 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.725885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.726517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.726800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.727079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.727705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.729580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.818219 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3954/7885] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:03 2022] POST /identity/v3/projects => generated 350 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:03.822635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.835269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43441369-6fb6-41e3-8aed-b9ef8d99d601 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.900475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.901033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.901316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.901589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/users/7650487c0f9d45999308d496beec7606` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.902803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:get_user(user_id=7650487c0f9d45999308d496beec7606)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.905072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:03.906723 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3932/7886] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 14:18:03 2022] GET /identity/v3/users/7650487c0f9d45999308d496beec7606 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:03.912520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:03.923370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3a9f-482f-417f-8348-320831cf95fb tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:03.928059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:03.928665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:03.928946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:03.929226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:03.929874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:03.931764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.043086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3955/7887] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Oct 18 14:18:03 2022] POST /identity/v3/credentials => generated 430 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:04.047188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.061402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ef8f-0ca6-48de-8bd2-3a2791ae9406 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.066223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.066862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.067147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.067422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials/3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.069732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.071607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.074636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.076232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.146374 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3933/7888] 10.222.0.27 () {60 vars in 1358 bytes} [Tue Oct 18 14:18:04 2022] PATCH /identity/v3/credentials/3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970 => generated 436 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:04.150603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.164452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea5a2-426c-4d8c-9749-1f3fd2555f37 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.169359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.170023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.170341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.170616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials/3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.172710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.174488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.176661 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3956/7889] 10.222.0.27 () {58 vars in 1335 bytes} [Tue Oct 18 14:18:04 2022] GET /identity/v3/credentials/3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970 => generated 436 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:04.180873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.195452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c29fe9-56bc-4538-b5f5-c47d6716c839 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.200299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.200945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.201235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.201520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials/3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.203919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.205877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.302829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3934/7890] 10.222.0.27 () {58 vars in 1338 bytes} [Tue Oct 18 14:18:04 2022] DELETE /identity/v3/credentials/3391b6395b61ce352c2a83f8a2083f192ef51fb80f2bf195bb44b753f2dd1970 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:04.308357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.323660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0294d8-eaf6-40dd-b2ed-98d63ffe85f2 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.328837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.328997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.329875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.330188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.330830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.333513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.446029 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3957/7891] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Oct 18 14:18:04 2022] POST /identity/v3/credentials => generated 430 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:04.449982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.461106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d4d6a-2158-43eb-ade3-cd239ae034f3 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.465860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.466512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.466792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.467070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.467726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.469468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.561730 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3935/7892] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Oct 18 14:18:04 2022] POST /identity/v3/credentials => generated 430 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:04.564069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.574854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f346-e6f9-4f85-9d61-57c81e8a36ca tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.580215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.580820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.581099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.581370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.581971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.583550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.590645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.592231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.593726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.596186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.597967 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3958/7893] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 18 14:18:04 2022] GET /identity/v3/credentials => generated 945 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:04.602202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.612805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c07c-3b6d-49d0-b402-938ce36c1154 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.617494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.618151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.618440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.618721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials/79e6bcb9738d6b42bd75d049108a40f55d2213f66f72a284e700e2de1cdc2202` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.620612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=79e6bcb9738d6b42bd75d049108a40f55d2213f66f72a284e700e2de1cdc2202)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.622482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.695969 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3936/7894] 10.222.0.27 () {58 vars in 1338 bytes} [Tue Oct 18 14:18:04 2022] DELETE /identity/v3/credentials/79e6bcb9738d6b42bd75d049108a40f55d2213f66f72a284e700e2de1cdc2202 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:04.700352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.711106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2105-eb48-4b7f-b804-4cc80fd9c585 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.716031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.716668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.716956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.717238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/credentials/51d9141e558ab266b7f7e8e07ec79676b147cfa299379b4bd913d078e1b73aa9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.719203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=51d9141e558ab266b7f7e8e07ec79676b147cfa299379b4bd913d078e1b73aa9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.721589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.725918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:04.785749 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3959/7895] 10.222.0.27 () {58 vars in 1338 bytes} [Tue Oct 18 14:18:04 2022] DELETE /identity/v3/credentials/51d9141e558ab266b7f7e8e07ec79676b147cfa299379b4bd913d078e1b73aa9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:04.790710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:04.801702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc88a20-baaf-4ef7-9efa-e10e43040ed9 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:04.806548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:04.807178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:04.807465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:04.807743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/projects/2c7a07a4974c461bba5751debdea5cd0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:04.808888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c7a07a4974c461bba5751debdea5cd0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:04.810927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:04.916094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7a07a4974c461bba5751debdea5cd0', 'request_id': 'req-607c38c2-c0bd-4c79-a62a-b44ee75e291f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:04.922799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7a07a4974c461bba5751debdea5cd0', 'request_id': 'req-607c38c2-c0bd-4c79-a62a-b44ee75e291f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:04.989946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7a07a4974c461bba5751debdea5cd0', 'request_id': 'req-607c38c2-c0bd-4c79-a62a-b44ee75e291f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.000805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] The token cache is being invalidate because project 2c7a07a4974c461bba5751debdea5cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:05.001096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.001850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.003474 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3937/7896] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:04 2022] DELETE /identity/v3/projects/2c7a07a4974c461bba5751debdea5cd0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:05.007750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:05.009969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:05.022851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805f95f-cffb-4f11-acfc-e46a7bf99c25 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:05.078567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cdfa7980384061954f58f4473a741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec18608da785428c89096f1305e700e2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:05.079195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:05.079496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:05.079773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] PATH_INFO: `/v3/projects/9cd59830b9854364a8e418eb13335cf5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:05.080886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9cd59830b9854364a8e418eb13335cf5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:05.082901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:05.195725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd59830b9854364a8e418eb13335cf5', 'request_id': 'req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.201844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd59830b9854364a8e418eb13335cf5', 'request_id': 'req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.260882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd59830b9854364a8e418eb13335cf5', 'request_id': 'req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.272464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] The token cache is being invalidate because project 9cd59830b9854364a8e418eb13335cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:05.272762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.273484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53d4a8b7-3dcd-4e6d-875f-20a9a6255037 tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.275080 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3960/7897] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:05 2022] DELETE /identity/v3/projects/9cd59830b9854364a8e418eb13335cf5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:05.279240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:05.280754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:05.295117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:05.344995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c38c2-c0bd-4c79-a62a-b44ee75e291f tempest-CredentialsTestJSON-1255883007 tempest-CredentialsTestJSON-1255883007-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:05.401056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:05.401685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:05.401967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:05.402270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] PATH_INFO: `/v3/users/7650487c0f9d45999308d496beec7606` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:05.403559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7650487c0f9d45999308d496beec7606)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:05.405784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:05.583362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7650487c0f9d45999308d496beec7606'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.583944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7650487c0f9d45999308d496beec7606'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.671997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7650487c0f9d45999308d496beec7606'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.672695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7650487c0f9d45999308d496beec7606'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.680626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7650487c0f9d45999308d496beec7606'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:05.698909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3938/7898] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:05 2022] DELETE /identity/v3/users/7650487c0f9d45999308d496beec7606 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:05.703633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:05.703912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:05.704188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:05.724334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:05.725534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:05.785209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3961/7899] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:05.799223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:05.800658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:05.843849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:05.857771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a93245-949c-4f44-bd69-6c73cdb6a818 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:05.862183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:05.862793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:05.863084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:05.863348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:05.872395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:05.873828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:05.883651 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3939/7900] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:06.260172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:06.261697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:06.276548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31398e-b66a-4a8f-a207-de2a5d46ffc4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:06.281864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:06.283551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:06.283833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:06.284110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] PATH_INFO: `/v3/projects/53fba77dfd034bab96cee84797e51ab2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:06.285257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fba77dfd034bab96cee84797e51ab2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:06.287263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:06.308945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:06.387415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fba77dfd034bab96cee84797e51ab2', 'request_id': 'req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.393995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fba77dfd034bab96cee84797e51ab2', 'request_id': 'req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.466444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fba77dfd034bab96cee84797e51ab2', 'request_id': 'req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.477833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] The token cache is being invalidate because project 53fba77dfd034bab96cee84797e51ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:06.478157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.478793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.480286 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3962/7901] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:06 2022] DELETE /identity/v3/projects/53fba77dfd034bab96cee84797e51ab2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:06.490181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:06.500034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d6ad1-c951-463c-a942-20fcd119b981 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:06.564166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:06.564802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:06.565083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:06.565356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] PATH_INFO: `/v3/users/18cdfa7980384061954f58f4473a741e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:06.566515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cdfa7980384061954f58f4473a741e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:06.568431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:06.728346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cdfa7980384061954f58f4473a741e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.728926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cdfa7980384061954f58f4473a741e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.800846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cdfa7980384061954f58f4473a741e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.801462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cdfa7980384061954f58f4473a741e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.809008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1555c5c9-bf9d-448d-bdec-41f45effa981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cdfa7980384061954f58f4473a741e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:06.827553 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3940/7902] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:06 2022] DELETE /identity/v3/users/18cdfa7980384061954f58f4473a741e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:07.222991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:07.224489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:07.239087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1e6d-af2e-4e67-be4f-30d5fde67149 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:07.296851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:07.297498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:07.297759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:07.298071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] PATH_INFO: `/v3/projects/ec18608da785428c89096f1305e700e2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:07.299223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec18608da785428c89096f1305e700e2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:07.301178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:07.409788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec18608da785428c89096f1305e700e2', 'request_id': 'req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:07.416001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec18608da785428c89096f1305e700e2', 'request_id': 'req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:07.472149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec18608da785428c89096f1305e700e2', 'request_id': 'req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:07.482981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] The token cache is being invalidate because project ec18608da785428c89096f1305e700e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:07.485637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:07.485637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-23aa4d87-3f45-46d2-8175-4ffeadd53e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:07.485637 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3963/7903] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:07 2022] DELETE /identity/v3/projects/ec18608da785428c89096f1305e700e2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:07.490380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04011-4354-4c26-91b7-79f8b27f0e67 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:07.490829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04011-4354-4c26-91b7-79f8b27f0e67 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:07.490937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04011-4354-4c26-91b7-79f8b27f0e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:07.511559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-14f04011-4354-4c26-91b7-79f8b27f0e67 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:07.512701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-14f04011-4354-4c26-91b7-79f8b27f0e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:07.571375 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3941/7904] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:07.580287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e084c8-86de-45b5-9c45-e60a6cb62cb3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:07.580575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e084c8-86de-45b5-9c45-e60a6cb62cb3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:07.580883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e084c8-86de-45b5-9c45-e60a6cb62cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:07.600898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b5e084c8-86de-45b5-9c45-e60a6cb62cb3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:07.602136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5e084c8-86de-45b5-9c45-e60a6cb62cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:07.610244 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3964/7905] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:07.614794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f04011-4354-4c26-91b7-79f8b27f0e67 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:07.619689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:07.625001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f04011-4354-4c26-91b7-79f8b27f0e67 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:07.630259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:07.630868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:07.631181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:07.631457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:07.632108 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:07.632414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:07.634274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:07.645920 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3942/7906] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:07.650176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e084c8-86de-45b5-9c45-e60a6cb62cb3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:07.659596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e084c8-86de-45b5-9c45-e60a6cb62cb3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:07.664269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:07.664864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:07.665145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:07.665419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:07.666047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:07.667979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:07.762899 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3965/7907] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:07 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:07.766756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:07.777541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7bdb-80ea-4695-935e-dd99fc99341f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:07.835010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:07.835620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:07.835902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:07.836178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:07.836840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:07.838793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:07.958517 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3943/7908] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:07 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:07.962542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:07.973545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411db7e4-a061-4e28-9fb3-9921f9fdeb67 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:07.978271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:07.978870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:07.979151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:07.979539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:07.980179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:07.981776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:07.984008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:07.992858 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3966/7909] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:07.996864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.007181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08173d11-dedb-4fad-8318-b598c1aef11a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.012197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fce05-189e-4576-a62f-1b1ded688d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.012797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fce05-189e-4576-a62f-1b1ded688d41 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.013135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fce05-189e-4576-a62f-1b1ded688d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.013421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fce05-189e-4576-a62f-1b1ded688d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.014078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fce05-189e-4576-a62f-1b1ded688d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.015680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fce05-189e-4576-a62f-1b1ded688d41 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.026950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3944/7910] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:08.031117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.042513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2e56f-2b09-48e1-8b85-8dc71c86915c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.047210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.047895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.048740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.049020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] PATH_INFO: `/v3/projects/7552b98bdabd413fa84e19cf032743bb/users/5ce8285606594c12981510d4a6e2fc4c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.063622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7552b98bdabd413fa84e19cf032743bb, user_id=5ce8285606594c12981510d4a6e2fc4c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.066302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.132435 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3967/7911] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:08 2022] PUT /identity/v3/projects/7552b98bdabd413fa84e19cf032743bb/users/5ce8285606594c12981510d4a6e2fc4c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:08.143158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc4a8-7aae-41ea-b190-3cf985f677ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.143511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc4a8-7aae-41ea-b190-3cf985f677ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.143788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc4a8-7aae-41ea-b190-3cf985f677ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.171580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-42ffc4a8-7aae-41ea-b190-3cf985f677ae None None] MFA Rules not processed for user `5ce8285606594c12981510d4a6e2fc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:08.172783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-42ffc4a8-7aae-41ea-b190-3cf985f677ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:08.236735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3945/7912] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:08.241244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.305393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472511-b8bb-4388-b5c4-9a17544907e0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.310008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.310651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.310939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.311212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.311834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.314352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.419274 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3968/7913] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:08 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:08.424064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc4a8-7aae-41ea-b190-3cf985f677ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.434877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc4a8-7aae-41ea-b190-3cf985f677ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.488814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:08.494939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.495572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.495856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.496134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.496782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.498772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.586914 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3946/7914] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:08 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:08.590938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.601373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e5e54-cd83-4bb7-ae9f-890e5715dd70 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.605988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.611470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.611470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.611470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.611470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.611470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.620921 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3969/7915] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:08.625006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.635877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29be04-f191-49ce-820d-88413140b163 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.640393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.641021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.641307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.641578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] PATH_INFO: `/v3/projects/e672e953bc184c568cc1d690cf901771/users/14e072fced664676b58531d3855b5408/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.656154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e672e953bc184c568cc1d690cf901771, user_id=14e072fced664676b58531d3855b5408, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.658813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.721017 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3947/7916] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:08 2022] PUT /identity/v3/projects/e672e953bc184c568cc1d690cf901771/users/14e072fced664676b58531d3855b5408/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:08.724994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.735135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf61d5-b375-4f11-a384-979d78360e30 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.792046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578f176-37c5-45ed-8783-ded9201808c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.792653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f176-37c5-45ed-8783-ded9201808c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.792942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f176-37c5-45ed-8783-ded9201808c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.793220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f176-37c5-45ed-8783-ded9201808c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.793855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578f176-37c5-45ed-8783-ded9201808c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.795525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578f176-37c5-45ed-8783-ded9201808c8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.805884 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3970/7917] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:08.810048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.821229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75acb735-b21f-45f2-8b48-399ec829cd86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.826071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.826770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.827051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.827327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] PATH_INFO: `/v3/projects/e672e953bc184c568cc1d690cf901771/users/14e072fced664676b58531d3855b5408/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.829916 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e672e953bc184c568cc1d690cf901771, user_id=14e072fced664676b58531d3855b5408, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.832631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:08.843001 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3948/7918] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:08 2022] PUT /identity/v3/projects/e672e953bc184c568cc1d690cf901771/users/14e072fced664676b58531d3855b5408/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:08.853965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860fd0-2d75-433a-bc6a-0eeb0764988b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.854283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860fd0-2d75-433a-bc6a-0eeb0764988b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.854563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860fd0-2d75-433a-bc6a-0eeb0764988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.882714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e8860fd0-2d75-433a-bc6a-0eeb0764988b None None] MFA Rules not processed for user `14e072fced664676b58531d3855b5408`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:08.883942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8860fd0-2d75-433a-bc6a-0eeb0764988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:08.916764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:08.952775 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3971/7919] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:08.957865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:08.968738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e18b-c620-45f5-bdab-184da0ee4ad1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:08.973395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:08.974000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:08.974319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:08.974602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:08.975279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:08.976876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:09.044824 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3949/7920] 10.222.0.27 () {60 vars in 1150 bytes} [Tue Oct 18 14:18:08 2022] POST /identity/v3/domains => generated 274 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:09.049352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860fd0-2d75-433a-bc6a-0eeb0764988b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:09.058807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860fd0-2d75-433a-bc6a-0eeb0764988b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:09.115236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:09.115849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:09.116130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:09.116403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:09.117084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:09.118741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:09.190635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3972/7921] 10.222.0.27 () {60 vars in 1150 bytes} [Tue Oct 18 14:18:09 2022] POST /identity/v3/domains => generated 277 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:09.192237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:09.202578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec6917-8ef4-491d-b776-a15c98c5b1f9 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:09.257723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:09.258432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:09.258716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:09.258992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:09.259888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:09.261466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:09.359328 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3950/7922] 10.222.0.27 () {60 vars in 1150 bytes} [Tue Oct 18 14:18:09 2022] POST /identity/v3/domains => generated 278 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:09.364324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:09.374917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6d677-2420-404b-8bb2-4b623f8c338e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:09.431427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:09.432032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:09.432316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:09.432589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:09.433245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:09.434868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:09.560194 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3973/7923] 10.222.0.27 () {60 vars in 1150 bytes} [Tue Oct 18 14:18:09 2022] POST /identity/v3/domains => generated 279 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:09.564807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:09.575116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb6e1d-f078-4b29-97a4-777bfd44f40c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:09.633466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:09.633979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:09.634551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:09.634833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/59d2cfc2936e4584aa7062466827191c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:09.645966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=59d2cfc2936e4584aa7062466827191c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:09.647600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:09.669531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '59d2cfc2936e4584aa7062466827191c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.671518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:09.679940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '59d2cfc2936e4584aa7062466827191c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.798388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d2cfc2936e4584aa7062466827191c', 'request_id': 'req-2145e876-046c-4baf-a192-33149c96059f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.804913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d2cfc2936e4584aa7062466827191c', 'request_id': 'req-2145e876-046c-4baf-a192-33149c96059f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.883260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d2cfc2936e4584aa7062466827191c', 'request_id': 'req-2145e876-046c-4baf-a192-33149c96059f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.894947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] The token cache is being invalidate because project 59d2cfc2936e4584aa7062466827191c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:09.895172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.895799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.903685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '59d2cfc2936e4584aa7062466827191c', 'request_id': 'req-2145e876-046c-4baf-a192-33149c96059f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.904335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '59d2cfc2936e4584aa7062466827191c', 'request_id': 'req-2145e876-046c-4baf-a192-33149c96059f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.904972 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '59d2cfc2936e4584aa7062466827191c', 'request_id': 'req-2145e876-046c-4baf-a192-33149c96059f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:09.913827 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3951/7924] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:09 2022] DELETE /identity/v3/domains/59d2cfc2936e4584aa7062466827191c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:09.918755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:09.920476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:09.932921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b691832-96ff-4229-9900-96ff77042da8 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:09.984522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:09.990297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:09.991029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:09.991317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:09.991596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:09.992253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:09.993858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:10.094091 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3974/7925] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 14:18:09 2022] POST /identity/v3/domains => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:10.098694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:10.108668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145e876-046c-4baf-a192-33149c96059f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:10.167404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:10.167957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:10.168239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:10.168510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/a2e5e7b2965e4dbba63ece62a3a1a6aa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:10.179328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a2e5e7b2965e4dbba63ece62a3a1a6aa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:10.180915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:10.201668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.202357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.287469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.288101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.290543 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3952/7926] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:10 2022] PATCH /identity/v3/domains/a2e5e7b2965e4dbba63ece62a3a1a6aa => generated 249 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:10.294897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:10.296551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:10.310099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cdf2f-3693-44ba-92d0-cbdcb17c8d4c tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:10.365621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:10.366280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:10.366567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:10.366842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/a2e5e7b2965e4dbba63ece62a3a1a6aa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:10.377780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a2e5e7b2965e4dbba63ece62a3a1a6aa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:10.379451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:10.402283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.411849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.516393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa', 'request_id': 'req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.523850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa', 'request_id': 'req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.609416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa', 'request_id': 'req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.620552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] The token cache is being invalidate because project a2e5e7b2965e4dbba63ece62a3a1a6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:10.621980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.621980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.629192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa', 'request_id': 'req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.629829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa', 'request_id': 'req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.633175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a2e5e7b2965e4dbba63ece62a3a1a6aa', 'request_id': 'req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.638971 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3975/7927] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:10 2022] DELETE /identity/v3/domains/a2e5e7b2965e4dbba63ece62a3a1a6aa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:10.644559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:10.654873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b7446-f20f-45e8-aaf9-6bd7ed9bbb91 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:10.676148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:10.711665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:10.712210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:10.712494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:10.712772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:10.713419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:10.715077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:10.787780 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3953/7928] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 14:18:10 2022] POST /identity/v3/domains => generated 278 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:10.792184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:10.793592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:10.806698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c804b-dc6c-4daf-b0a0-ee87cc28a4dd tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:10.834573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:10.864751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:10.865437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:10.865723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:10.865998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/2c9379328fad430dbd4e619684c8c346` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:10.877097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2c9379328fad430dbd4e619684c8c346)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:10.878789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:10.899873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2c9379328fad430dbd4e619684c8c346'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:10.900777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2c9379328fad430dbd4e619684c8c346'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.002842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2c9379328fad430dbd4e619684c8c346'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.003944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2c9379328fad430dbd4e619684c8c346'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.006362 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3976/7929] 10.222.0.27 () {60 vars in 1250 bytes} [Tue Oct 18 14:18:10 2022] PATCH /identity/v3/domains/2c9379328fad430dbd4e619684c8c346 => generated 277 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:11.011441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.013383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:11.026573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb128af-c6b4-462b-9985-494e936ea2ad tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.083757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.084392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.084682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.084959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/2c9379328fad430dbd4e619684c8c346` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.095537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=2c9379328fad430dbd4e619684c8c346)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:11.097501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:11.099172 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3954/7930] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 14:18:11 2022] GET /identity/v3/domains/2c9379328fad430dbd4e619684c8c346 => generated 277 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:11.103447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.113718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a685fb-f800-45e1-9fe4-b6be677b6528 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.118402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.119032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.119366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.119648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/2c9379328fad430dbd4e619684c8c346` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.120816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2c9379328fad430dbd4e619684c8c346)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:11.122515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:11.146335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2c9379328fad430dbd4e619684c8c346'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.155971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2c9379328fad430dbd4e619684c8c346'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.258935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9379328fad430dbd4e619684c8c346', 'request_id': 'req-98a2a004-d001-43de-8f32-fb17920a9387'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.265697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9379328fad430dbd4e619684c8c346', 'request_id': 'req-98a2a004-d001-43de-8f32-fb17920a9387'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.332427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9379328fad430dbd4e619684c8c346', 'request_id': 'req-98a2a004-d001-43de-8f32-fb17920a9387'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.343566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] The token cache is being invalidate because project 2c9379328fad430dbd4e619684c8c346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:11.343852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.344498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.352811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2c9379328fad430dbd4e619684c8c346', 'request_id': 'req-98a2a004-d001-43de-8f32-fb17920a9387'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.353456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2c9379328fad430dbd4e619684c8c346', 'request_id': 'req-98a2a004-d001-43de-8f32-fb17920a9387'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.356909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2c9379328fad430dbd4e619684c8c346', 'request_id': 'req-98a2a004-d001-43de-8f32-fb17920a9387'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.362556 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3977/7931] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:11 2022] DELETE /identity/v3/domains/2c9379328fad430dbd4e619684c8c346 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:11.366679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.368350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:11.380780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b831c-733c-4272-bb98-9e91ccb36627 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.436467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.437100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.437386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.437664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.438309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:11.439904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:11.453371 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3955/7932] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 14:18:11 2022] GET /identity/v3/domains => generated 1347 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:11.458277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.468488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2a004-d001-43de-8f32-fb17920a9387 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.473910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.474854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.474854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.475109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/2c9379328fad430dbd4e619684c8c346` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.482243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find domain: 2c9379328fad430dbd4e619684c8c346.: keystone.exception.DomainNotFound: Could not find domain: 2c9379328fad430dbd4e619684c8c346. Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2c9379328fad430dbd4e619684c8c346. Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:11.487231 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:11.488398 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2c9379328fad430dbd4e619684c8c346. Oct 18 14:18:11.489360 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:11.490494 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3978/7933] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:11 2022] PATCH /identity/v3/domains/2c9379328fad430dbd4e619684c8c346 => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:11.493267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.503480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e5704-2f5a-4dd7-a8eb-3cff90aa9ca2 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.508319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.509019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.509509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.509781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.510487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:11.512121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:11.588203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3956/7934] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 14:18:11 2022] POST /identity/v3/domains => generated 276 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:11.592329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.603691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b2721-a1e2-40e0-b4e4-51e5667f58eb tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.615047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:11.660191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.660809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.661094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.661371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.662012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:11.663982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:11.734905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3979/7935] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:11 2022] POST /identity/v3/users => generated 348 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:11.739246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.749720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2be63-51bf-4375-ab1d-025711c1f04e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.754861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.755456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.755740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.756015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.756673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:11.758603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:11.803089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3957/7936] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:18:11 2022] POST /identity/v3/groups => generated 324 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:11.807250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.817881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf78a7a-9617-49a4-86b4-037a162b0dab tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.822818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.823452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.823735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.824012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/b3e23552e0554b54b928edd7cf6fa434` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.825254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b3e23552e0554b54b928edd7cf6fa434)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:11.827208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:11.849060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.849849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.907610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.908226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:11.910652 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3980/7937] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:11 2022] PATCH /identity/v3/domains/b3e23552e0554b54b928edd7cf6fa434 => generated 277 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:11.914915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:11.916596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:11.929314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d517-733a-44c8-a4d8-6c7d3483b41f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:11.947550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:11.986585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:11.987223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:11.987507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:11.987783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/b3e23552e0554b54b928edd7cf6fa434` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:11.998341 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b3e23552e0554b54b928edd7cf6fa434)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:12.000012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:12.023993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.282438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a851daf3a8314eb698319588b44c2475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.283118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a851daf3a8314eb698319588b44c2475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.357738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a851daf3a8314eb698319588b44c2475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.358384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a851daf3a8314eb698319588b44c2475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.366348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a851daf3a8314eb698319588b44c2475'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.383339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.385631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:12.499552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434', 'request_id': 'req-fcfacd6d-026e-4317-b05a-28d649ec509e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.505671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434', 'request_id': 'req-fcfacd6d-026e-4317-b05a-28d649ec509e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.580954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434', 'request_id': 'req-fcfacd6d-026e-4317-b05a-28d649ec509e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.592112 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] The token cache is being invalidate because project b3e23552e0554b54b928edd7cf6fa434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:12.592402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.593039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.601515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434', 'request_id': 'req-fcfacd6d-026e-4317-b05a-28d649ec509e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.602201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434', 'request_id': 'req-fcfacd6d-026e-4317-b05a-28d649ec509e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.602834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b3e23552e0554b54b928edd7cf6fa434', 'request_id': 'req-fcfacd6d-026e-4317-b05a-28d649ec509e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:12.611239 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3958/7938] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:11 2022] DELETE /identity/v3/domains/b3e23552e0554b54b928edd7cf6fa434 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:12.616039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.626315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aa388-5c72-41fd-bd79-0be8417ffd1f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.681709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.682366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.682650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.682924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/b3e23552e0554b54b928edd7cf6fa434` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.689530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=b3e23552e0554b54b928edd7cf6fa434)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:12.691400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find domain: b3e23552e0554b54b928edd7cf6fa434.: keystone.exception.DomainNotFound: Could not find domain: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:12.702934 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:12.703990 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:12.704979 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3981/7939] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 14:18:12 2022] GET /identity/v3/domains/b3e23552e0554b54b928edd7cf6fa434 => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:12.708213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.709606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:12.722826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfacd6d-026e-4317-b05a-28d649ec509e tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.727390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.728011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.728296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.728572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/users/a851daf3a8314eb698319588b44c2475` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.736538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:get_user(user_id=a851daf3a8314eb698319588b44c2475)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:12.739164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find user: a851daf3a8314eb698319588b44c2475.: keystone.exception.UserNotFound: Could not find user: a851daf3a8314eb698319588b44c2475. Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 14:18:12.750437 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:12.752092 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a851daf3a8314eb698319588b44c2475. Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:12.753270 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3959/7940] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 14:18:12 2022] GET /identity/v3/users/a851daf3a8314eb698319588b44c2475 => generated 110 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:12.755523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.765765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccba4ef-ac1f-46d1-933b-e7f96b5263a5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.770916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.771537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.771821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.772097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/groups/e18882fd849c4ca097121c2e7b54dddd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.776559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:get_group(group_id=e18882fd849c4ca097121c2e7b54dddd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:12.778455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find group: e18882fd849c4ca097121c2e7b54dddd.: keystone.exception.GroupNotFound: Could not find group: e18882fd849c4ca097121c2e7b54dddd. Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 18 14:18:12.794023 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:12.795178 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: e18882fd849c4ca097121c2e7b54dddd. Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:12.796332 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3982/7941] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:12 2022] GET /identity/v3/groups/e18882fd849c4ca097121c2e7b54dddd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:12.799192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.809185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fb50-dd96-4c45-90a7-0e65fcaa02c5 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.813931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.814592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.815612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.815612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/groups/e18882fd849c4ca097121c2e7b54dddd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.821935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find group: e18882fd849c4ca097121c2e7b54dddd.: keystone.exception.GroupNotFound: Could not find group: e18882fd849c4ca097121c2e7b54dddd. Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 18 14:18:12.827175 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:12.827983 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: e18882fd849c4ca097121c2e7b54dddd. Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:12.829034 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3960/7942] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 14:18:12 2022] DELETE /identity/v3/groups/e18882fd849c4ca097121c2e7b54dddd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:12.832777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.843296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19794f35-0a65-41ed-9862-84deb0b93f5f tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.848514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.849126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.849415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.849698 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/users/a851daf3a8314eb698319588b44c2475` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.857143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a851daf3a8314eb698319588b44c2475)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:12.859045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find user: a851daf3a8314eb698319588b44c2475.: keystone.exception.UserNotFound: Could not find user: a851daf3a8314eb698319588b44c2475. Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 18 14:18:12.870319 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:12.871171 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a851daf3a8314eb698319588b44c2475. Oct 18 14:18:12.872315 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:12.873461 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3983/7943] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:12 2022] DELETE /identity/v3/users/a851daf3a8314eb698319588b44c2475 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:12.875272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.885699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4e580-b0c9-42cd-ad10-ce208ddf8124 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.890664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.891338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.891641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.891919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/b3e23552e0554b54b928edd7cf6fa434` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.900274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find domain: b3e23552e0554b54b928edd7cf6fa434.: keystone.exception.DomainNotFound: Could not find domain: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:12.905379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:12.909447 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:12.910355 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:12.911423 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3961/7944] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:12 2022] PATCH /identity/v3/domains/b3e23552e0554b54b928edd7cf6fa434 => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:12.912011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.928392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb0326-2334-45db-9c32-87d19b7ede22 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.933165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.933764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.934116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.934359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.934980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:12.936589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:12.949824 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3984/7945] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Oct 18 14:18:12 2022] GET /identity/v3/domains => generated 1347 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:12.954919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:12.965852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef4a35-dee3-4e39-a4b4-67909c83acd7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:12.971481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:12.972102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:12.972416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:12.972786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:12.973436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:12.973744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:12.975383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:12.994128 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3962/7946] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:12 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:12.999201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:13.009640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f66d-f56a-4ce2-8646-fb5f50d858d7 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:13.014451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:13.015063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:13.015348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:13.015630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:13.016279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-432566096) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:13.016588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:13.018734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:13.021105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:13.031006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3985/7947] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Oct 18 14:18:12 2022] GET /identity/v3/domains?name=tempest-test_domain-432566096 => generated 405 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:13.036454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:13.046993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd451b8-31fa-4c7a-859d-482614934023 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:13.051768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:13.052411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:13.052682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:13.052963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/b3e23552e0554b54b928edd7cf6fa434` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:13.060260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Could not find domain: b3e23552e0554b54b928edd7cf6fa434.: keystone.exception.DomainNotFound: Could not find domain: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:13.065378 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:13.066458 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b3e23552e0554b54b928edd7cf6fa434. Oct 18 14:18:13.067306 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:13.068162 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3963/7948] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:13 2022] PATCH /identity/v3/domains/b3e23552e0554b54b928edd7cf6fa434 => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:13.070401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:13.081446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d955e-8b0a-4742-8947-b42d2ebd32ee tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:13.087954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:13.087954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:13.087954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:13.088239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/4cfb342181694197815942c0616d8e2e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:13.099818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4cfb342181694197815942c0616d8e2e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:13.101454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:13.143800 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3986/7949] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:13 2022] PATCH /identity/v3/domains/4cfb342181694197815942c0616d8e2e => generated 278 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:18:13.147672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:13.159074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8548760-c211-4555-9924-25b98ece7cfa tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:13.163621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:13.164229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:13.164509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:13.164783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/4cfb342181694197815942c0616d8e2e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:13.175433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4cfb342181694197815942c0616d8e2e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:13.177014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:13.199218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4cfb342181694197815942c0616d8e2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.208917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4cfb342181694197815942c0616d8e2e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.309180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:13.311986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfb342181694197815942c0616d8e2e', 'request_id': 'req-baff12aa-294f-4fbb-b3e1-90a6087f9543'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.318524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfb342181694197815942c0616d8e2e', 'request_id': 'req-baff12aa-294f-4fbb-b3e1-90a6087f9543'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.403346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfb342181694197815942c0616d8e2e', 'request_id': 'req-baff12aa-294f-4fbb-b3e1-90a6087f9543'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.414252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] The token cache is being invalidate because project 4cfb342181694197815942c0616d8e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:13.414540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.415169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.422520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4cfb342181694197815942c0616d8e2e', 'request_id': 'req-baff12aa-294f-4fbb-b3e1-90a6087f9543'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.423165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4cfb342181694197815942c0616d8e2e', 'request_id': 'req-baff12aa-294f-4fbb-b3e1-90a6087f9543'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.423842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4cfb342181694197815942c0616d8e2e', 'request_id': 'req-baff12aa-294f-4fbb-b3e1-90a6087f9543'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.432460 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3964/7950] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:13 2022] DELETE /identity/v3/domains/4cfb342181694197815942c0616d8e2e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:13.436616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:13.438177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:13.452030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035c8c9-ced0-49c5-99da-fdcbfc798778 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:13.510263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:13.510898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:13.511271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:13.511548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/b9250e4956a54df3abbb0c8fad6b2f56` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:13.523097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b9250e4956a54df3abbb0c8fad6b2f56)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:13.524739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:13.546408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.547111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.601965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.602635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.605082 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3987/7951] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:13 2022] PATCH /identity/v3/domains/b9250e4956a54df3abbb0c8fad6b2f56 => generated 278 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:13.609133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:13.620068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff12aa-294f-4fbb-b3e1-90a6087f9543 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:13.676695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:13.677256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:13.677540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:13.677817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/b9250e4956a54df3abbb0c8fad6b2f56` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:13.688727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b9250e4956a54df3abbb0c8fad6b2f56)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:13.690940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:13.712786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.722506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.818437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56', 'request_id': 'req-8004344d-aff4-4a44-9b9e-6e3022b552ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.825070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56', 'request_id': 'req-8004344d-aff4-4a44-9b9e-6e3022b552ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.889485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56', 'request_id': 'req-8004344d-aff4-4a44-9b9e-6e3022b552ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.900142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] The token cache is being invalidate because project b9250e4956a54df3abbb0c8fad6b2f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:13.900426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.901061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.907696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:13.909524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56', 'request_id': 'req-8004344d-aff4-4a44-9b9e-6e3022b552ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.910210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56', 'request_id': 'req-8004344d-aff4-4a44-9b9e-6e3022b552ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.910861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b9250e4956a54df3abbb0c8fad6b2f56', 'request_id': 'req-8004344d-aff4-4a44-9b9e-6e3022b552ed'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:13.919062 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3965/7952] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:13 2022] DELETE /identity/v3/domains/b9250e4956a54df3abbb0c8fad6b2f56 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:13.923159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:13.925162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:13.937637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93725381-e935-492a-815c-6671146f2883 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:13.993889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:13.994548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:13.994830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:13.995104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/7ecd9aeb4d034ed19bcdb5a58e86f5b1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:14.001942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:14.006690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7ecd9aeb4d034ed19bcdb5a58e86f5b1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:14.008466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:14.028066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.028758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.114320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.114982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.117369 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3988/7953] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:13 2022] PATCH /identity/v3/domains/7ecd9aeb4d034ed19bcdb5a58e86f5b1 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:18:14.121757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:14.123223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:14.136000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004344d-aff4-4a44-9b9e-6e3022b552ed tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:14.192392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e072fced664676b58531d3855b5408', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e672e953bc184c568cc1d690cf901771', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:14.192960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:14.193249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:14.193530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] PATH_INFO: `/v3/domains/7ecd9aeb4d034ed19bcdb5a58e86f5b1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:14.204378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7ecd9aeb4d034ed19bcdb5a58e86f5b1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:14.206010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:14.229027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.240599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.335298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1', 'request_id': 'req-03374edd-bee6-4e63-af99-bd55460dcb02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.341786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1', 'request_id': 'req-03374edd-bee6-4e63-af99-bd55460dcb02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.414743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1', 'request_id': 'req-03374edd-bee6-4e63-af99-bd55460dcb02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.425518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] The token cache is being invalidate because project 7ecd9aeb4d034ed19bcdb5a58e86f5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:14.425807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.426444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.433866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1', 'request_id': 'req-03374edd-bee6-4e63-af99-bd55460dcb02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.434525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1', 'request_id': 'req-03374edd-bee6-4e63-af99-bd55460dcb02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.435136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-03374edd-bee6-4e63-af99-bd55460dcb02 tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7ecd9aeb4d034ed19bcdb5a58e86f5b1', 'request_id': 'req-03374edd-bee6-4e63-af99-bd55460dcb02'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.443364 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3966/7954] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:14 2022] DELETE /identity/v3/domains/7ecd9aeb4d034ed19bcdb5a58e86f5b1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:14.447346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:14.448734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:14.514623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd77fd-668d-4319-be2b-feb283da6ade tempest-DomainsTestJSON-783388931 tempest-DomainsTestJSON-783388931-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:14.575339 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:14.575982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:14.576261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:14.576533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] PATH_INFO: `/v3/users/5ce8285606594c12981510d4a6e2fc4c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:14.577665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce8285606594c12981510d4a6e2fc4c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:14.579629 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:14.739734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce8285606594c12981510d4a6e2fc4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.746631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce8285606594c12981510d4a6e2fc4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.747310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce8285606594c12981510d4a6e2fc4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.758072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:14.760684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce8285606594c12981510d4a6e2fc4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.852248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce8285606594c12981510d4a6e2fc4c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:14.858589 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3989/7955] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:14 2022] DELETE /identity/v3/users/5ce8285606594c12981510d4a6e2fc4c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:14.863185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:14.863696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:14.863786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:14.883027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:14.884480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:14.908978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:14.943892 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3967/7956] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:14.953990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:14.956250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:15.013541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9383faf-0f50-42af-b3b3-dd330b9c6435 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:15.017110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:15.017775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:15.018568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:15.018838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:15.027736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:15.029168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:15.038490 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3990/7957] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:15.380766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:15.382336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:15.406029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eb298-2f6a-4a9a-a5d2-19f0d258a698 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:15.406029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:15.406029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:15.406029 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:15.406437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] PATH_INFO: `/v3/projects/7552b98bdabd413fa84e19cf032743bb` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:15.406437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7552b98bdabd413fa84e19cf032743bb)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:15.406437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:15.553345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7552b98bdabd413fa84e19cf032743bb', 'request_id': 'req-acba032b-ccd0-4b65-9b66-c92b00068b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.559775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7552b98bdabd413fa84e19cf032743bb', 'request_id': 'req-acba032b-ccd0-4b65-9b66-c92b00068b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.632062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7552b98bdabd413fa84e19cf032743bb', 'request_id': 'req-acba032b-ccd0-4b65-9b66-c92b00068b0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.643527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] The token cache is being invalidate because project 7552b98bdabd413fa84e19cf032743bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:15.646376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.646376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.646376 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3968/7958] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:15 2022] DELETE /identity/v3/projects/7552b98bdabd413fa84e19cf032743bb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:15.650381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:15.660618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9cf2d-148f-44ab-aef2-efea47656e47 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:15.717304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:15.717939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:15.718255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:15.718530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] PATH_INFO: `/v3/users/14e072fced664676b58531d3855b5408` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:15.720010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e072fced664676b58531d3855b5408)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:15.722521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:15.897365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e072fced664676b58531d3855b5408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.904363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e072fced664676b58531d3855b5408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.905015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e072fced664676b58531d3855b5408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.917761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e072fced664676b58531d3855b5408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.980507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4a5fb90d-28bd-46bb-81ea-c95e69725bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e072fced664676b58531d3855b5408'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:15.986862 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3991/7959] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:15 2022] DELETE /identity/v3/users/14e072fced664676b58531d3855b5408 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:16.386377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:16.389369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:16.403315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba032b-ccd0-4b65-9b66-c92b00068b0b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:16.462009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:16.462829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:16.463114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:16.463391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] PATH_INFO: `/v3/projects/e672e953bc184c568cc1d690cf901771` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:16.464528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e672e953bc184c568cc1d690cf901771)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:16.466475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:16.564272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e672e953bc184c568cc1d690cf901771', 'request_id': 'req-75cca1fd-820a-47f3-91cf-e2574b6f06c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:16.571067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e672e953bc184c568cc1d690cf901771', 'request_id': 'req-75cca1fd-820a-47f3-91cf-e2574b6f06c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:16.572734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:16.652541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e672e953bc184c568cc1d690cf901771', 'request_id': 'req-75cca1fd-820a-47f3-91cf-e2574b6f06c3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:16.663576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] The token cache is being invalidate because project e672e953bc184c568cc1d690cf901771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:16.663803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:16.664443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-75cca1fd-820a-47f3-91cf-e2574b6f06c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:16.666105 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3969/7960] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:16 2022] DELETE /identity/v3/projects/e672e953bc184c568cc1d690cf901771 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:16.670882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1796-b8cd-4d1d-832f-b50294430acb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:16.671165 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1796-b8cd-4d1d-832f-b50294430acb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:16.671432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1796-b8cd-4d1d-832f-b50294430acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:16.691971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f9aa1796-b8cd-4d1d-832f-b50294430acb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:16.693154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9aa1796-b8cd-4d1d-832f-b50294430acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:16.697278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:16.751135 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3992/7961] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:16.759825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75425-97b8-4280-a0b8-b052ecdd3efa None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:16.760109 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75425-97b8-4280-a0b8-b052ecdd3efa None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:16.760384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75425-97b8-4280-a0b8-b052ecdd3efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:16.780082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-71d75425-97b8-4280-a0b8-b052ecdd3efa None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:16.781271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-71d75425-97b8-4280-a0b8-b052ecdd3efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:16.790086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3970/7962] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:16.794160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1796-b8cd-4d1d-832f-b50294430acb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:16.804145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1796-b8cd-4d1d-832f-b50294430acb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:16.808678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:16.809274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:16.809550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:16.809819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:16.810499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:16.810800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:16.812388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:16.824972 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3993/7963] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:16.829457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75425-97b8-4280-a0b8-b052ecdd3efa None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:16.838813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75425-97b8-4280-a0b8-b052ecdd3efa None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:16.843701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:16.844329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:16.844611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:16.844886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:16.845509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:16.847464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:16.959425 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3971/7964] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:16 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:16.963733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:16.974340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7111-1bae-4764-bf90-b5f85792f42c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.029991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.030667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.030898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.031173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.031805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.034281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.109361 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3994/7965] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:16 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:17.110719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.121825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3d2d-d104-4845-8b40-bf39b73ad8d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.126522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.127161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.127450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.127715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.128355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.129936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.140364 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3972/7966] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:17.144260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.154291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683cd8-6aad-4eaf-9006-50f50107ae98 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.159493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23e33-6eac-46d5-8167-8e7c1794a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.160084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23e33-6eac-46d5-8167-8e7c1794a98b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.160366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23e33-6eac-46d5-8167-8e7c1794a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.160640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23e33-6eac-46d5-8167-8e7c1794a98b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.161302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a23e33-6eac-46d5-8167-8e7c1794a98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.162931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a23e33-6eac-46d5-8167-8e7c1794a98b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.173426 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3995/7967] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:17.177926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.188237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf8aa2-e32d-428f-a15e-e04782519dbc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.192743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.193381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.193658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.193929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] PATH_INFO: `/v3/projects/0604fba7165a44ec8e26308d00429f6c/users/5b8e41b8b7b7408d90145065a2413224/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.208337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0604fba7165a44ec8e26308d00429f6c, user_id=5b8e41b8b7b7408d90145065a2413224, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.211086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.275065 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3973/7968] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:17 2022] PUT /identity/v3/projects/0604fba7165a44ec8e26308d00429f6c/users/5b8e41b8b7b7408d90145065a2413224/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:17.285980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997478-51c8-4df0-973c-ccf2e5b2f614 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.286506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997478-51c8-4df0-973c-ccf2e5b2f614 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.286623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997478-51c8-4df0-973c-ccf2e5b2f614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.313882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ee997478-51c8-4df0-973c-ccf2e5b2f614 None None] MFA Rules not processed for user `5b8e41b8b7b7408d90145065a2413224`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:17.315160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ee997478-51c8-4df0-973c-ccf2e5b2f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:17.378570 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3996/7969] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:17.383241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.446321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f2aa0-647c-425e-8315-33840491ef0f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.451209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.451824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.452103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.452382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.453066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.454996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.547683 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3974/7970] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:17 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:17.551763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997478-51c8-4df0-973c-ccf2e5b2f614 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.559667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:17.563439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997478-51c8-4df0-973c-ccf2e5b2f614 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.620984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.621598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.621882 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.622196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.622821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.624777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.715128 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3997/7971] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:17 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:17.719328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.729697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314dad7-8f07-4a75-ba93-9cecdb000470 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.734395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.734998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.735280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.735555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.736195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.737799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.748725 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3975/7972] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:17.753437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.763836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63174f77-d9eb-49da-806d-1d49d0623557 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.769239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.769891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.770211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.770489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] PATH_INFO: `/v3/projects/4bf8efda3e934738b8298190fa6a6ebd/users/3546d463b1b04db8a21430be0a23bcc7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.785752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf8efda3e934738b8298190fa6a6ebd, user_id=3546d463b1b04db8a21430be0a23bcc7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.788503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.872188 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3998/7973] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:17 2022] PUT /identity/v3/projects/4bf8efda3e934738b8298190fa6a6ebd/users/3546d463b1b04db8a21430be0a23bcc7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:17.876154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.886941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66123d-5888-471b-9921-13cfc4eec388 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.936897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:17.946260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55740-2148-476a-9ede-3c335ff0fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.950190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55740-2148-476a-9ede-3c335ff0fd5e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.950190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55740-2148-476a-9ede-3c335ff0fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.950190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55740-2148-476a-9ede-3c335ff0fd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.950190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55740-2148-476a-9ede-3c335ff0fd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.950190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55740-2148-476a-9ede-3c335ff0fd5e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.960240 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3976/7974] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:17.964363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:17.974768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcfc6b-27e4-4ea7-801b-a4ae8b30f5c2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:17.979425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:17.980894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:17.980894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:17.980894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] PATH_INFO: `/v3/projects/4bf8efda3e934738b8298190fa6a6ebd/users/3546d463b1b04db8a21430be0a23bcc7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:17.982547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf8efda3e934738b8298190fa6a6ebd, user_id=3546d463b1b04db8a21430be0a23bcc7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:17.985276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:17.995553 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 3999/7975] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:17 2022] PUT /identity/v3/projects/4bf8efda3e934738b8298190fa6a6ebd/users/3546d463b1b04db8a21430be0a23bcc7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:18.007468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95e55-799e-4e96-99c8-7bc99a8aef94 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.009606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95e55-799e-4e96-99c8-7bc99a8aef94 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.009606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95e55-799e-4e96-99c8-7bc99a8aef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.036514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e8a95e55-799e-4e96-99c8-7bc99a8aef94 None None] MFA Rules not processed for user `3546d463b1b04db8a21430be0a23bcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:18.037733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e8a95e55-799e-4e96-99c8-7bc99a8aef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:18.106949 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3977/7976] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:18.112019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.122742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6d32-4b2a-43dd-be60-52fba644bcf5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.128894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.129498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.129784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.130090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.130797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.132419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.227333 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4000/7977] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:18 2022] POST /identity/v3/services => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:18.231721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a95e55-799e-4e96-99c8-7bc99a8aef94 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.241399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a95e55-799e-4e96-99c8-7bc99a8aef94 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.256368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.256974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.257260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.257536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.258225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.259484 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:18.259484 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:18.259484 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:18.260368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.321508 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3978/7978] 10.222.0.27 () {60 vars in 1213 bytes} [Tue Oct 18 14:18:18 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:18.325777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.336601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e88d7-5f1c-40b5-93c6-b02ff3438398 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.341274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.341865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.342178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.342456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.343137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.344734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.415417 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4001/7979] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:18 2022] POST /identity/v3/services => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:18.419384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.430227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cef14d-848c-40ae-b173-fae2c503957e tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.445376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.445979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.446295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.446591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.447228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.448868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.570076 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3979/7980] 10.222.0.27 () {60 vars in 1213 bytes} [Tue Oct 18 14:18:18 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:18.574002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.586145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ba9cf-c9ed-47c9-855f-59b496836f6c tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.591120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.591736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.592020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.592295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.592913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.593932 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:18.593932 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:18.593932 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:18.594853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.601805 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4002/7981] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 18 14:18:18 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:18.607626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.618097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a425e9-57a4-472a-b5df-87522a60d004 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.622743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.623789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.624309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.624969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.625783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=9129ef90a9804a90b9e50278e6d48708)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.626821 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:18.626821 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:18.626821 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:18.628272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.635127 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3980/7982] 10.222.0.27 () {58 vars in 1290 bytes} [Tue Oct 18 14:18:18 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708 => generated 333 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:18:18.639156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.649988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38cae8-865f-4e4b-8116-357af6516a54 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.654763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.655392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.655682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.655970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.656614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=9129ef90a9804a90b9e50278e6d48708)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.657626 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:18.657626 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:18.657626 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:18.658554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.664236 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4003/7983] 10.222.0.27 () {58 vars in 1291 bytes} [Tue Oct 18 14:18:18 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 18 14:18:18.668093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.677991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e13159-65b7-4722-bb57-3d00e077c26a tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.682607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.683230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.683513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.683793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.684376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9129ef90a9804a90b9e50278e6d48708)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.685372 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:18.685372 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:18.685372 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:18.686293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.752782 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3981/7984] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 14:18:18 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:18.756738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.767094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d6da-07d3-4f91-b43e-4cd618dbc685 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.772507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.773113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.773401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.773680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.774336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.775929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.780450 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4004/7985] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Oct 18 14:18:18 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:18.784211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.794360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7cd49-e9ca-4513-92a8-6fa9ec2d8572 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.799506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.800134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.800419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.800694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.801278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=9129ef90a9804a90b9e50278e6d48708)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.802897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Could not find Endpoint Group: 9129ef90a9804a90b9e50278e6d48708.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 9129ef90a9804a90b9e50278e6d48708. Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 18 14:18:18.811885 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 18 14:18:18.813001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 18 14:18:18.813001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 18 14:18:18.813001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 18 14:18:18.813001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 18 14:18:18.813001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 9129ef90a9804a90b9e50278e6d48708. Oct 18 14:18:18.813001 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:18.813001 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3982/7986] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 14:18:18 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/9129ef90a9804a90b9e50278e6d48708 => generated 120 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:18.817569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.827625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd951ffb-19e7-452a-af02-023053367551 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.832470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.833152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.833436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.833716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services/9b1db68f7e064d5e8f66fabb663d602e` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.834333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9b1db68f7e064d5e8f66fabb663d602e)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.835927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:18.924395 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4005/7987] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:18 2022] DELETE /identity/v3/services/9b1db68f7e064d5e8f66fabb663d602e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:18.929569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:18.940124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f8a97-ce00-4e6b-8fc3-4d8faefa7e71 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:18.954458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:18.955059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:18.955349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:18.955626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:18.956259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:18.957835 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.026404 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3983/7988] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:18 2022] POST /identity/v3/services => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:19.030454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.040952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720f06-e212-46ea-a48c-66568088a1db tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.055840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.056439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.056723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.056996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.057631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.058660 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:19.058660 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:19.058660 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:19.059540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.152513 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4006/7989] 10.222.0.27 () {60 vars in 1213 bytes} [Tue Oct 18 14:18:19 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:19.156504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.167613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9039a2e-f21a-40d1-bbba-ac1989ef42b3 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.172339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.172942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.173228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.173510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.179443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.179443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.259059 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3984/7990] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:19 2022] POST /identity/v3/services => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:19.263617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.273530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3e409-8f00-4c5d-85fd-8e77564628b4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.290151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.290780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.291129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.291433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/be4a91ce9eea40e4a3cfba7632291357` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.292087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=be4a91ce9eea40e4a3cfba7632291357)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.293090 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:19.293090 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:19.293090 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:19.293969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.355748 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4007/7991] 10.222.0.27 () {60 vars in 1313 bytes} [Tue Oct 18 14:18:19 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/be4a91ce9eea40e4a3cfba7632291357 => generated 336 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:19.359827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.370974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a05e2f-4118-4ce5-ab8e-ea5e30ac4e10 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.378113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.378113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.378113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.378543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services/6136ba526b3345f08280ef2186be7fac` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.378543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6136ba526b3345f08280ef2186be7fac)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.379069 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:19.379069 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:19.379069 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:19.379985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.467175 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3985/7992] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:19 2022] DELETE /identity/v3/services/6136ba526b3345f08280ef2186be7fac => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:19.471548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.476791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=8,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:19.482316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7a59-012c-47cb-a090-5f68a37a9412 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.497196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.498423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.498423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.498423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/be4a91ce9eea40e4a3cfba7632291357` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.499079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=be4a91ce9eea40e4a3cfba7632291357)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.500115 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:19.500115 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:19.500115 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:19.501007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.575229 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4008/7993] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 14:18:19 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/be4a91ce9eea40e4a3cfba7632291357 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:19.579519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.590586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de801d7-dcf2-452e-b1ca-041db07e48e4 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.597001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.597659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.597939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.598293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services/822efd5d3f67423aa9333acf8788d24c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.598882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_service(service_id=822efd5d3f67423aa9333acf8788d24c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.600476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.602729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:19.689645 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3986/7994] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:19 2022] DELETE /identity/v3/services/822efd5d3f67423aa9333acf8788d24c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:19.695404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.705490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0398b9-6835-4eb4-9544-951b59240947 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.720065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.720708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.720989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.721296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/b3775d6522d94c35a9ff10318aeef458` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.721907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=b3775d6522d94c35a9ff10318aeef458)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.723564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.809707 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4009/7995] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Oct 18 14:18:19 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/b3775d6522d94c35a9ff10318aeef458 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:19.814024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:19.825256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882d22-1c26-43a9-8b9e-359e8025caef tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:19.829836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4457e2-6478-4d3b-ac64-f931569e0c34 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3546d463b1b04db8a21430be0a23bcc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf8efda3e934738b8298190fa6a6ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:19.830496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4457e2-6478-4d3b-ac64-f931569e0c34 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:19.830923 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4457e2-6478-4d3b-ac64-f931569e0c34 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:19.831367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4457e2-6478-4d3b-ac64-f931569e0c34 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] PATH_INFO: `/v3/services/f652278e74554767824398f1d5226dea` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:19.832246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4457e2-6478-4d3b-ac64-f931569e0c34 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f652278e74554767824398f1d5226dea)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:19.834349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4457e2-6478-4d3b-ac64-f931569e0c34 tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:19.923889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3987/7996] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:19 2022] DELETE /identity/v3/services/f652278e74554767824398f1d5226dea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:19.928518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:20.000933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baba21-d91d-425b-abdb-8dd6130f95cc tempest-EndPointGroupsTest-331510979 tempest-EndPointGroupsTest-331510979-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:20.014919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:20.015550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:20.015830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:20.016105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] PATH_INFO: `/v3/users/5b8e41b8b7b7408d90145065a2413224` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:20.017226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8e41b8b7b7408d90145065a2413224)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:20.019232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:20.178190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8e41b8b7b7408d90145065a2413224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:20.185416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8e41b8b7b7408d90145065a2413224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:20.186156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8e41b8b7b7408d90145065a2413224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:20.198432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8e41b8b7b7408d90145065a2413224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:20.263482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8e41b8b7b7408d90145065a2413224'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:20.269956 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4010/7997] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:19 2022] DELETE /identity/v3/users/5b8e41b8b7b7408d90145065a2413224 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:20.274467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:20.274754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:20.275059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:20.294206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:20.295400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:20.353118 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3988/7998] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:20.362986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:20.364356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:20.386309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:20.431609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d9988-6217-486c-82f9-a44a4cfe9661 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:20.435445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:20.436102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:20.436440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:20.436724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:20.446109 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:20.447594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:20.458007 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4011/7999] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:20.893982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:20.896014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:20.908198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ed583-05d4-4f52-a5f3-a92ced2306f8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:20.912979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:20.913617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:20.913900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:20.914220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] PATH_INFO: `/v3/projects/0604fba7165a44ec8e26308d00429f6c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:20.915356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0604fba7165a44ec8e26308d00429f6c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:20.917317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:21.054949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0604fba7165a44ec8e26308d00429f6c', 'request_id': 'req-d36553e7-98ce-4066-b8fd-e6b4332c9c86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.061039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0604fba7165a44ec8e26308d00429f6c', 'request_id': 'req-d36553e7-98ce-4066-b8fd-e6b4332c9c86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.140198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0604fba7165a44ec8e26308d00429f6c', 'request_id': 'req-d36553e7-98ce-4066-b8fd-e6b4332c9c86'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.151218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] The token cache is being invalidate because project 0604fba7165a44ec8e26308d00429f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:21.157241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.157241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.157241 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3989/8000] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:20 2022] DELETE /identity/v3/projects/0604fba7165a44ec8e26308d00429f6c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:21.157730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:21.168283 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387eacb-f6b1-41fd-98fa-ef7fbf1f529e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:21.225097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:21.225763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:21.225993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:21.226298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] PATH_INFO: `/v3/users/3546d463b1b04db8a21430be0a23bcc7` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:21.227415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3546d463b1b04db8a21430be0a23bcc7)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:21.229366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:21.416646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3546d463b1b04db8a21430be0a23bcc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.424108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3546d463b1b04db8a21430be0a23bcc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.424808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3546d463b1b04db8a21430be0a23bcc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.436979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3546d463b1b04db8a21430be0a23bcc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.506367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec4becbd-d1c3-4bcd-bf67-d87eb6995ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3546d463b1b04db8a21430be0a23bcc7'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:21.513110 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4012/8001] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:21 2022] DELETE /identity/v3/users/3546d463b1b04db8a21430be0a23bcc7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:21.910628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:21.912052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:21.928153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36553e7-98ce-4066-b8fd-e6b4332c9c86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:21.971381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:21.986338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:21.986976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:21.987270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:21.988036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] PATH_INFO: `/v3/projects/4bf8efda3e934738b8298190fa6a6ebd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:21.989164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf8efda3e934738b8298190fa6a6ebd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:21.991179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:22.091966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf8efda3e934738b8298190fa6a6ebd', 'request_id': 'req-e8a02364-9bc4-40ca-ace8-3c217dbb7163'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:22.098081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf8efda3e934738b8298190fa6a6ebd', 'request_id': 'req-e8a02364-9bc4-40ca-ace8-3c217dbb7163'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:22.166188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf8efda3e934738b8298190fa6a6ebd', 'request_id': 'req-e8a02364-9bc4-40ca-ace8-3c217dbb7163'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:22.177361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] The token cache is being invalidate because project 4bf8efda3e934738b8298190fa6a6ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:22.177644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:22.178284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e8a02364-9bc4-40ca-ace8-3c217dbb7163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:22.179775 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3990/8002] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:21 2022] DELETE /identity/v3/projects/4bf8efda3e934738b8298190fa6a6ebd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:22.184685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5aaca-ced1-4ed8-a3d0-ccafd73ba1be None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.188233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5aaca-ced1-4ed8-a3d0-ccafd73ba1be None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.188233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5aaca-ced1-4ed8-a3d0-ccafd73ba1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.205220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-78d5aaca-ced1-4ed8-a3d0-ccafd73ba1be None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:22.206458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78d5aaca-ced1-4ed8-a3d0-ccafd73ba1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:22.235104 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:22.265683 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4013/8003] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:22.274265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551247-3121-40f1-be35-b200f8ef1796 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.274553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551247-3121-40f1-be35-b200f8ef1796 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.274830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e551247-3121-40f1-be35-b200f8ef1796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.294363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0e551247-3121-40f1-be35-b200f8ef1796 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:22.295562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e551247-3121-40f1-be35-b200f8ef1796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:22.303877 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3991/8004] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:22.307967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5aaca-ced1-4ed8-a3d0-ccafd73ba1be None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:22.318112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5aaca-ced1-4ed8-a3d0-ccafd73ba1be None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:22.322693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:22.323286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.323565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.323833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.324469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:22.324768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:22.326394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:22.339433 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4014/8005] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:22.343756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e551247-3121-40f1-be35-b200f8ef1796 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:22.352966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e551247-3121-40f1-be35-b200f8ef1796 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:22.357641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:22.358272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.358558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.358833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.359456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:22.361374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:22.474568 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3992/8006] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:22 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:22.479078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:22.490012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab86b7-f859-4d53-b26b-531b0f9baceb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:22.546486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:22.547094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.547377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.547651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.548282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:22.550245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:22.636364 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4015/8007] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:22 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:22.640148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:22.651831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28490068-3e81-4906-a1c1-0af1ccd725fe admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:22.656431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:22.657019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.657295 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.657565 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.658242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:22.660452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:22.670226 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3993/8008] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:22.674303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:22.684447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acbbe3-ef7e-46bb-81f4-75484a0c784b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:22.688968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794c584-a837-41e7-bda4-41f83e064a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:22.689556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794c584-a837-41e7-bda4-41f83e064a81 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.689833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794c584-a837-41e7-bda4-41f83e064a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.690137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794c584-a837-41e7-bda4-41f83e064a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.690831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794c584-a837-41e7-bda4-41f83e064a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:22.692417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794c584-a837-41e7-bda4-41f83e064a81 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:22.703351 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4016/8009] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:22.707973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:22.717808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063768b-ac4d-482d-bc00-940b937bb268 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:22.723046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:22.723687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.723966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.724241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] PATH_INFO: `/v3/projects/728deb841a7344178917ff6ca2f1059c/users/7f8579c2c7f34b639206e93da0d90e97/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.738615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=728deb841a7344178917ff6ca2f1059c, user_id=7f8579c2c7f34b639206e93da0d90e97, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:22.741305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:22.806608 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3994/8010] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:22 2022] PUT /identity/v3/projects/728deb841a7344178917ff6ca2f1059c/users/7f8579c2c7f34b639206e93da0d90e97/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:22.817090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1e38f-ff57-4fba-970e-616cd2c3724a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.817376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1e38f-ff57-4fba-970e-616cd2c3724a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.817684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1e38f-ff57-4fba-970e-616cd2c3724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.846419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9bd1e38f-ff57-4fba-970e-616cd2c3724a None None] MFA Rules not processed for user `7f8579c2c7f34b639206e93da0d90e97`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:22.848291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9bd1e38f-ff57-4fba-970e-616cd2c3724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:22.911804 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4017/8011] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:22.916332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:22.979851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9aac-339c-45f3-847a-2b461103bd8a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:22.984548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:22.985158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:22.985440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:22.985716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:22.986399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:22.988426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.003974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:23.099167 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3995/8012] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:22 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:23.103247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1e38f-ff57-4fba-970e-616cd2c3724a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.114125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1e38f-ff57-4fba-970e-616cd2c3724a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.141483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:23.172007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.172615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.172902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.173177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.173798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.176360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.263436 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4018/8013] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:23 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:23.267350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.278212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d2089-9b02-40ab-96fc-caadcb2d29b4 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.282934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.283532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.283811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.284083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.285372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.286981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.297484 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3996/8014] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:23.301663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.311616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc2ee-e64e-4140-b950-ce03f92377b9 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.316200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.316846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.317129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.317403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] PATH_INFO: `/v3/projects/7a78dd2f62f2493db57c01edc7ccedcc/users/658523aaa466431690c89093955a44a4/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.332624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a78dd2f62f2493db57c01edc7ccedcc, user_id=658523aaa466431690c89093955a44a4, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.335313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.400694 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4019/8015] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:23 2022] PUT /identity/v3/projects/7a78dd2f62f2493db57c01edc7ccedcc/users/658523aaa466431690c89093955a44a4/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:23.407574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.418277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d680b4e-1e51-4c55-83fc-1f2e2ddcd168 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.481212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ae51-6697-4405-9355-5905c699e212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.481857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ae51-6697-4405-9355-5905c699e212 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.482173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ae51-6697-4405-9355-5905c699e212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.482444 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ae51-6697-4405-9355-5905c699e212 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.483083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ae51-6697-4405-9355-5905c699e212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.484664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ae51-6697-4405-9355-5905c699e212 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.494482 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3997/8016] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:23.498757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.509591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d66b7-7bec-4268-bdd2-c72674c0ebe4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.514357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.514952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.515235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.515513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] PATH_INFO: `/v3/projects/7a78dd2f62f2493db57c01edc7ccedcc/users/658523aaa466431690c89093955a44a4/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.517412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a78dd2f62f2493db57c01edc7ccedcc, user_id=658523aaa466431690c89093955a44a4, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.520673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.531137 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4020/8017] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:23 2022] PUT /identity/v3/projects/7a78dd2f62f2493db57c01edc7ccedcc/users/658523aaa466431690c89093955a44a4/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:23.547035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c526f-431f-4bb9-8640-1dd64d2cbde1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.547321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c526f-431f-4bb9-8640-1dd64d2cbde1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.547599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c526f-431f-4bb9-8640-1dd64d2cbde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.575150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6f7c526f-431f-4bb9-8640-1dd64d2cbde1 None None] MFA Rules not processed for user `658523aaa466431690c89093955a44a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:23.576356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6f7c526f-431f-4bb9-8640-1dd64d2cbde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:23.644632 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3998/8018] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:23.649738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.660456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb5ee8-461f-4a8b-9b24-034e1647fbde admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.665050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.665649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.665942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.666250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.666948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.668552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.735364 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4021/8019] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:23 2022] POST /identity/v3/roles => generated 234 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:23.739206 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c526f-431f-4bb9-8640-1dd64d2cbde1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.748499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c526f-431f-4bb9-8640-1dd64d2cbde1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.753340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.753982 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.754303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.755089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.755766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.757434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.844158 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 3999/8020] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:23 2022] POST /identity/v3/roles => generated 235 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:23.847767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.857913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b62a-55d5-4da1-86a8-f7d0ab124624 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.862514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.863112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.863393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.863668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.864324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.865911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:23.953560 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4022/8021] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:23 2022] POST /identity/v3/roles => generated 234 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:23.954686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:23.965545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef3cad-d689-4388-b0eb-bf09c2334153 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:23.970219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:23.970848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:23.971130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:23.971402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:23.972052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:23.973619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.039234 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4000/8022] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 14:18:23 2022] POST /identity/v3/domains => generated 276 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:24.043184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.053922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adb6a-bb8b-4190-9b90-744ade1a65df tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.109851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.110418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.110704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.110980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.111616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.113519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.214445 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4023/8023] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:24 2022] POST /identity/v3/projects => generated 400 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:24.218725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.229877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7fcd8-5e6e-421e-ad44-1ff93ec47fe6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.267886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:24.287789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.288400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.288685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.288960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/groups` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.289586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.291512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.377555 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4001/8024] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 18 14:18:24 2022] POST /identity/v3/groups => generated 301 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:24.382182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.392835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dd5c1-3587-4e2d-855c-da264ed081bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.398235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.398838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.399123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.399403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.400060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.401661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.473121 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4024/8025] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:24 2022] POST /identity/v3/roles => generated 234 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:24.477186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.487367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7782-11c0-49f8-aaae-ed4ecf06fe11 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.491957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.492580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.492863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.493136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.493929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.495864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.587652 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4002/8026] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:24 2022] POST /identity/v3/users => generated 442 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:24.592132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.602507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3017-e890-415b-a865-c61850836608 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.607245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.607849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.608139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.608417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.609081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.610133 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:24.610133 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:24.610133 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:24.611028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.695958 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4025/8027] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:24 2022] POST /identity/v3/roles => generated 269 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:24.700068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.710879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02400e-7928-4e18-8b3e-a4b26856e529 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.715614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.716279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.716588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.716870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/9187465b11c64ec7b53bde6205aaebfd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.732079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112, role_id=9187465b11c64ec7b53bde6205aaebfd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.734776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.803779 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4003/8028] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:24 2022] PUT /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/9187465b11c64ec7b53bde6205aaebfd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:24.808106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.814577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:24.819034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fc502-e4ef-411f-8595-5322f03d186e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.875033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.875645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.875933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.876262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.877007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Adding query filter params (scope.project.id=1614750bceed4fd392d1fce1faa390d1, user.id=9824a07b9f54407786ef765e8e81c112) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:24.877319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.879232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.925848 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4026/8029] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 14:18:24 2022] GET /identity/v3/role_assignments?scope.project.id=1614750bceed4fd392d1fce1faa390d1&user.id=9824a07b9f54407786ef765e8e81c112&effective => generated 228 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:24.930171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:24.940696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55746f-8efd-493d-981e-3cb7c8de1635 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:24.945402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:24.946130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:24.946366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:24.946643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/9187465b11c64ec7b53bde6205aaebfd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:24.948896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112, role_id=9187465b11c64ec7b53bde6205aaebfd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:24.951662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:24.956935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 9187465b11c64ec7b53bde6205aaebfd was removed from user 9824a07b9f54407786ef765e8e81c112 on project 1614750bceed4fd392d1fce1faa390d1. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:24.957504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:24.958476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:25.027002 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4004/8030] 10.222.0.27 () {58 vars in 1467 bytes} [Tue Oct 18 14:18:24 2022] DELETE /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/9187465b11c64ec7b53bde6205aaebfd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:25.031231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.032951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:25.045855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2a11b-a4ca-4a37-b6ed-2071328d9630 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.103248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.103937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.104222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.104503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/9187465b11c64ec7b53bde6205aaebfd` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.105696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9187465b11c64ec7b53bde6205aaebfd)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.106760 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:25.106760 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:25.106760 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:25.107660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.199661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 9187465b11c64ec7b53bde6205aaebfd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:25.199895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:25.200606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:25.202443 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4027/8031] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:25 2022] DELETE /identity/v3/roles/9187465b11c64ec7b53bde6205aaebfd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:25.208366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.218578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13de7-e2f2-403f-8b46-b0b41f2ed400 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.275183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.275873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.276161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.276440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/bf1f44406f2f436fb23440080adb99a5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.278681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112, role_id=bf1f44406f2f436fb23440080adb99a5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.281307 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.348747 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4005/8032] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:25 2022] PUT /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/bf1f44406f2f436fb23440080adb99a5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:25.353134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.354679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:25.367279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b8a5f-bf1b-42b8-a0fd-db35612fd9eb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.393635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:25.424555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.425301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.425594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.425877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.427607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.428639 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:25.428639 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:25.428639 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:25.433673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.516475 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4028/8033] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:25 2022] PUT /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 520 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:25.520736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.531370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec223681-0a2c-456a-be73-b134747ffebb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.588026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.588640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.588919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.589191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.589909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Adding query filter params (scope.project.id=1614750bceed4fd392d1fce1faa390d1, user.id=9824a07b9f54407786ef765e8e81c112) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:25.590260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.592120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.602299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:25.646430 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4006/8034] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 14:18:25 2022] GET /identity/v3/role_assignments?scope.project.id=1614750bceed4fd392d1fce1faa390d1&user.id=9824a07b9f54407786ef765e8e81c112&effective => generated 1061 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:25.650531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.661609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376f0cb-f587-4285-9dc3-b1d9353df3e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.666347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.666988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.667605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.667605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.669093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.670147 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:25.670147 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:25.670147 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:25.671033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.764170 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4029/8035] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:25 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:25.768298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.778452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf596c89-58c0-43df-95ea-dac7c5656a15 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.834536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.835169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.835453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.835728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.836445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Adding query filter params (scope.project.id=1614750bceed4fd392d1fce1faa390d1, user.id=9824a07b9f54407786ef765e8e81c112) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:25.836754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.838624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.883757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4007/8036] 10.222.0.27 () {58 vars in 1356 bytes} [Tue Oct 18 14:18:25 2022] GET /identity/v3/role_assignments?scope.project.id=1614750bceed4fd392d1fce1faa390d1&user.id=9824a07b9f54407786ef765e8e81c112&effective => generated 577 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:18:25.888211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.898438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c7482-80d8-4dbf-a03d-46a971a69ba0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.903085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.903714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.903994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.904268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.906377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.908035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5.: keystone.exception.ImpliedRoleNotFound: bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5. Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = query.one() Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:25.925589 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 18 14:18:25.931438 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 18 14:18:25.932492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 18 14:18:25.932492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 18 14:18:25.932492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 18 14:18:25.932492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5. Oct 18 14:18:25.932492 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:25.932492 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4030/8037] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:25 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 137 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:25.932937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:25.941356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09983f-1eb5-4515-b304-21ceb2020297 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:25.945992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:25.946670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:25.946953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:25.947227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/bf1f44406f2f436fb23440080adb99a5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:25.949428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112, role_id=bf1f44406f2f436fb23440080adb99a5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:25.952150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:25.957463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role bf1f44406f2f436fb23440080adb99a5 was removed from user 9824a07b9f54407786ef765e8e81c112 on project 1614750bceed4fd392d1fce1faa390d1. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:25.957998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:25.958470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:26.023526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4008/8038] 10.222.0.27 () {58 vars in 1467 bytes} [Tue Oct 18 14:18:25 2022] DELETE /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/bf1f44406f2f436fb23440080adb99a5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:26.028548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.030287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:26.044284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4ca8-e5cf-4141-92fa-99e4edfcedd0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.100462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.101069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.101352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.101624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.102334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.103942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.218405 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4031/8039] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:26 2022] POST /identity/v3/roles => generated 271 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:26.222535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.233166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725549e-c086-46c0-81a6-957dcc55bbda tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.237744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.238381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.240180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.240180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.240180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Adding query filter params (domain_id=a348ccb5afc6403081aa0d8537508bfa) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:26.240180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.240842 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:26.240842 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:26.240842 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:26.241720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.249828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4009/8040] 10.222.0.27 () {58 vars in 1207 bytes} [Tue Oct 18 14:18:26 2022] GET /identity/v3/roles?domain_id=a348ccb5afc6403081aa0d8537508bfa => generated 408 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:18:26.253602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.263944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a548ee-3238-4406-8cad-b1776e70bacf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.268538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.269152 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.269433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.269707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/d45c8127508e4877bf20c5ec48cd159a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.271381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=d45c8127508e4877bf20c5ec48cd159a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.273121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.397016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role d45c8127508e4877bf20c5ec48cd159a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:26.401917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:26.401917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:26.401917 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4032/8041] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:26 2022] DELETE /identity/v3/roles/d45c8127508e4877bf20c5ec48cd159a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:26.403869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.405582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:26.419058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14475-a04d-4cd3-8fcf-27a2cace66e2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.467172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:26.476545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.477165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.477602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.477754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.478495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Adding query filter params (domain_id=a348ccb5afc6403081aa0d8537508bfa) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:26.478802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.480424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.486285 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4010/8042] 10.222.0.27 () {58 vars in 1207 bytes} [Tue Oct 18 14:18:26 2022] GET /identity/v3/roles?domain_id=a348ccb5afc6403081aa0d8537508bfa => generated 148 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:26.490396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.500337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40349ae-efdd-4661-a07c-ec3ad2e8efe9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.504937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.506361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.506361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.506361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/d45c8127508e4877bf20c5ec48cd159a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.518577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Could not find role: d45c8127508e4877bf20c5ec48cd159a.: keystone.exception.RoleNotFound: Could not find role: d45c8127508e4877bf20c5ec48cd159a. Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 18 14:18:26.523791 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:26.524684 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d45c8127508e4877bf20c5ec48cd159a. Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:26.525524 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4033/8043] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:26 2022] DELETE /identity/v3/roles/d45c8127508e4877bf20c5ec48cd159a => generated 110 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:26.529951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.540653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a6c67-f8af-4768-ab48-a5b4afc23b0e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.545253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.545901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.546216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.546527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.552624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a348ccb5afc6403081aa0d8537508bfa, group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.556115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.620764 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4011/8044] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:26 2022] PUT /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:26.624917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.635819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e9a8-b9d6-4b54-963f-e79d68e737f6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.665475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:26.696989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.697904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.698392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.699032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.700765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a348ccb5afc6403081aa0d8537508bfa, group_id=4ed430d3175948dfbf48d936a9f28a5d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.701801 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:26.701801 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:26.701801 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:26.703675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.716314 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4034/8045] 10.222.0.27 () {58 vars in 1365 bytes} [Tue Oct 18 14:18:26 2022] GET /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles => generated 409 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:26.720495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.730760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a381f-ac28-4393-9ce9-f03abb7beb2e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.735415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.736077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.736363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.736645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.738868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a348ccb5afc6403081aa0d8537508bfa, group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.741532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.747464 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4012/8046] 10.222.0.27 () {58 vars in 1465 bytes} [Tue Oct 18 14:18:26 2022] HEAD /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:26.751444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.762785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa8312-e0ce-4959-9f46-9311fc409a2a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.767396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.768044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.768331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.768611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.770816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a348ccb5afc6403081aa0d8537508bfa, group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.774128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.779388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 12a3779ce2f840bbbeaf216c2cfe4700 was removed from group 4ed430d3175948dfbf48d936a9f28a5d on domain a348ccb5afc6403081aa0d8537508bfa. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:26.779679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:26.780371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:26.849719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4035/8047] 10.222.0.27 () {58 vars in 1467 bytes} [Tue Oct 18 14:18:26 2022] DELETE /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:26.854924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:26.858920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:26.869388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddecc30-27a7-416b-8f41-311123d6214b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:26.925985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:26.926598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:26.926882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:26.927697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:26.929883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1614750bceed4fd392d1fce1faa390d1, group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:26.932558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:26.995144 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4013/8048] 10.222.0.27 () {60 vars in 1486 bytes} [Tue Oct 18 14:18:26 2022] PUT /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:26.999386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:27.010748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ba84a-788e-4d68-a9df-85d5ba8b2059 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:27.065295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256234-1f20-405f-ba4c-080139f0963a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:27.065945 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256234-1f20-405f-ba4c-080139f0963a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:27.066263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256234-1f20-405f-ba4c-080139f0963a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:27.066544 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256234-1f20-405f-ba4c-080139f0963a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:27.068822 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b256234-1f20-405f-ba4c-080139f0963a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_grants(project_id=1614750bceed4fd392d1fce1faa390d1, group_id=4ed430d3175948dfbf48d936a9f28a5d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:27.071389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b256234-1f20-405f-ba4c-080139f0963a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:27.082419 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4036/8049] 10.222.0.27 () {58 vars in 1368 bytes} [Tue Oct 18 14:18:26 2022] GET /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles => generated 410 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:27.086600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:27.097058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad107fe9-9c1c-4bba-a993-102c86071530 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:27.101732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:27.102409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:27.102697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:27.102977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/groups/4ed430d3175948dfbf48d936a9f28a5d/users/9824a07b9f54407786ef765e8e81c112` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:27.104701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4ed430d3175948dfbf48d936a9f28a5d, user_id=9824a07b9f54407786ef765e8e81c112)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:27.106624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:27.189260 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4014/8050] 10.222.0.27 () {60 vars in 1360 bytes} [Tue Oct 18 14:18:27 2022] PUT /identity/v3/groups/4ed430d3175948dfbf48d936a9f28a5d/users/9824a07b9f54407786ef765e8e81c112 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:27.194135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82741-84b7-43fa-915a-d4dd637bd6bd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:27.194448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82741-84b7-43fa-915a-d4dd637bd6bd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:27.194748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82741-84b7-43fa-915a-d4dd637bd6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:27.232214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2ca82741-84b7-43fa-915a-d4dd637bd6bd None None] MFA Rules not processed for user `9824a07b9f54407786ef765e8e81c112`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:27.233423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ca82741-84b7-43fa-915a-d4dd637bd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:27.307000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:27.322924 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4037/8051] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:27.327282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:27.389160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af8f19-eb56-4512-85a0-e59ce2ad020d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:27.393816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:27.394508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:27.394792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:27.395068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:27.397219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1614750bceed4fd392d1fce1faa390d1, group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:27.399949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:27.405552 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4015/8052] 10.222.0.27 () {58 vars in 1468 bytes} [Tue Oct 18 14:18:27 2022] HEAD /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:27.409590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82741-84b7-43fa-915a-d4dd637bd6bd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:27.421134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82741-84b7-43fa-915a-d4dd637bd6bd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:27.425658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:27.426699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:27.426977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:27.427824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:27.430167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1614750bceed4fd392d1fce1faa390d1, group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:27.432863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:27.438239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 12a3779ce2f840bbbeaf216c2cfe4700 was removed from group 4ed430d3175948dfbf48d936a9f28a5d on project 1614750bceed4fd392d1fce1faa390d1. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:27.438534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:27.439204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:27.535181 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4038/8053] 10.222.0.27 () {58 vars in 1470 bytes} [Tue Oct 18 14:18:27 2022] DELETE /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:27.539557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:27.541253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:27.554147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3818cc-b16d-4f5f-afe7-e4f2043d956b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:27.587872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:27.612221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:27.612880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:27.613159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:27.613434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/groups/4ed430d3175948dfbf48d936a9f28a5d/users/9824a07b9f54407786ef765e8e81c112` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:27.615163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4ed430d3175948dfbf48d936a9f28a5d, user_id=9824a07b9f54407786ef765e8e81c112)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:27.617045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:27.705794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9824a07b9f54407786ef765e8e81c112'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:27.807534 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4016/8054] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 14:18:27 2022] DELETE /identity/v3/groups/4ed430d3175948dfbf48d936a9f28a5d/users/9824a07b9f54407786ef765e8e81c112 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:27.812633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:27.823653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34133571-0c5a-4007-8e0a-e67b18dac274 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:27.878277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:27.878923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:27.879204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:27.879481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:27.881817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:27.882890 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:27.882890 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:27.882890 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:27.883774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.015010 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4039/8055] 10.222.0.27 () {60 vars in 1381 bytes} [Tue Oct 18 14:18:27 2022] PUT /identity/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:28.019036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.029544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696acfb-39e7-4ff5-8530-4f335830e8f9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.034217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.034856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.035140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.035416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.036544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=4ed430d3175948dfbf48d936a9f28a5d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.037556 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:28.037556 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:28.037556 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:28.038484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.050865 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4017/8056] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Oct 18 14:18:28 2022] GET /identity/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles => generated 375 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:28.055816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.065823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713c166-eab7-4aff-9df6-41fcec383040 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.071258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.071898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.072181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.072457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.074118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.075136 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:28.075136 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:28.075136 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:28.076022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.082228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4040/8057] 10.222.0.27 () {58 vars in 1363 bytes} [Tue Oct 18 14:18:28 2022] HEAD /identity/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.086595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.096738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33426d4-74d7-4759-9ccd-a0b6299b9a91 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.102806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.103445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.103727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.104005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.105733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=4ed430d3175948dfbf48d936a9f28a5d, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.106770 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:28.106770 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:28.106770 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:28.107785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.198040 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4018/8058] 10.222.0.27 () {58 vars in 1365 bytes} [Tue Oct 18 14:18:28 2022] DELETE /identity/v3/system/groups/4ed430d3175948dfbf48d936a9f28a5d/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.203015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.213218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe64d-704c-4342-a8d5-b085cb4eeb0d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.217772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.218452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.218739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.219013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.221263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a348ccb5afc6403081aa0d8537508bfa, user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.223931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.294421 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4041/8059] 10.222.0.27 () {60 vars in 1480 bytes} [Tue Oct 18 14:18:28 2022] PUT /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.298503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.309151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a8d2c-f94a-4c9b-b99e-b98d2430b1ea tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.363690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.364336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.364618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.365589 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.367266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a348ccb5afc6403081aa0d8537508bfa, user_id=9824a07b9f54407786ef765e8e81c112)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.369752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.381761 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4019/8060] 10.222.0.27 () {58 vars in 1362 bytes} [Tue Oct 18 14:18:28 2022] GET /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles => generated 408 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:28.386278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.396435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9946eb-9c68-49cc-bacc-5f93be37649e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.400961 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.401605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.401885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.402198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.404318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a348ccb5afc6403081aa0d8537508bfa, user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.406982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.413379 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4042/8061] 10.222.0.27 () {58 vars in 1462 bytes} [Tue Oct 18 14:18:28 2022] HEAD /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.417190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.427356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310408b3-dd73-4678-8a52-d26f8d8d2536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.432732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.433374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.433655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.433931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.436151 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a348ccb5afc6403081aa0d8537508bfa, user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.438799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.444433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 12a3779ce2f840bbbeaf216c2cfe4700 was removed from user 9824a07b9f54407786ef765e8e81c112 on domain a348ccb5afc6403081aa0d8537508bfa. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:28.444722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:28.445395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:28.510901 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4020/8062] 10.222.0.27 () {58 vars in 1464 bytes} [Tue Oct 18 14:18:28 2022] DELETE /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.516227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.517918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:28.531547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b76d6-cbc3-494d-adbe-829b3cbb3e07 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.588940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.589525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.589814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.590123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.592373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.595035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.649635 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4043/8063] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:28 2022] PUT /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.653701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.664425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2458c-6fd1-4db5-b6bc-894ee56682bc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.729218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.729934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.730253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.730538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.732204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_grants(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.734741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.746066 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4021/8064] 10.222.0.27 () {58 vars in 1365 bytes} [Tue Oct 18 14:18:28 2022] GET /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles => generated 409 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:28.750243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.760737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8de6-b0b6-41dc-b914-4abb4152fc16 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.765334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.765977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.766290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.766566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.768750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.772056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.777617 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4044/8065] 10.222.0.27 () {58 vars in 1465 bytes} [Tue Oct 18 14:18:28 2022] HEAD /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.781327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.786410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:28.792225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9a87-5af7-4607-917a-0e0d172adc26 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.796824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.797499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.799820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.799820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.800247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1614750bceed4fd392d1fce1faa390d1, user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.802926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:28.808096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 12a3779ce2f840bbbeaf216c2cfe4700 was removed from user 9824a07b9f54407786ef765e8e81c112 on project 1614750bceed4fd392d1fce1faa390d1. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:28.808386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:28.809050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:28.872038 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4022/8066] 10.222.0.27 () {58 vars in 1467 bytes} [Tue Oct 18 14:18:28 2022] DELETE /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:28.877255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:28.879197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:28.892633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8054-c217-4e35-a719-93d060055bc3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:28.917174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:28.950003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:28.950674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:28.950956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:28.951232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:28.952904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:28.954630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.029318 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4045/8067] 10.222.0.27 () {60 vars in 1378 bytes} [Tue Oct 18 14:18:28 2022] PUT /identity/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:29.033344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.044085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17da0-66ec-488c-9b33-56b7ff1b1282 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.048792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.049418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.049702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.050391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.051539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=9824a07b9f54407786ef765e8e81c112)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.053191 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:29.053191 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:29.053191 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:29.054115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.066475 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4023/8068] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 18 14:18:29 2022] GET /identity/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles => generated 374 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:29.070372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.080214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fbe49-0cf1-4505-8aaf-1dd06e1c29c4 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.084828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.085491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.090216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.090216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.090216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.090216 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:29.090216 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:29.090216 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:29.090682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.094492 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4046/8069] 10.222.0.27 () {58 vars in 1360 bytes} [Tue Oct 18 14:18:29 2022] HEAD /identity/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:29.098313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.109453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392a7eb-970a-4667-98d6-937135c7be50 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.114379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.115660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.115943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.116221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.117914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=9824a07b9f54407786ef765e8e81c112, role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.118951 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:29.118951 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:29.118951 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:29.119829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.180689 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4024/8070] 10.222.0.27 () {58 vars in 1362 bytes} [Tue Oct 18 14:18:29 2022] DELETE /identity/v3/system/users/9824a07b9f54407786ef765e8e81c112/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:29.185374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.195338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57467-eb12-41d5-a25b-c4667325cf3f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.200034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.200625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.200907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.201182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.201854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.203570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.277711 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4047/8071] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:29 2022] POST /identity/v3/roles => generated 270 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:29.281505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.291895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf97b5-8460-46b6-851d-292bdfcbbb18 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.296472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.297069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.297383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.297624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.298322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.299451 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:29.299451 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:29.299451 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:29.300334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.374853 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4025/8072] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:29 2022] POST /identity/v3/roles => generated 270 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:29.379007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.389845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c67b-d95b-41ab-92be-6b20f140d5e1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.394538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.395167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.395453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.396223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/f2ef441788de49dfa957e0968b380153/implies/340c36b159724285877d1a5a073dd4d3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.397642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f2ef441788de49dfa957e0968b380153, implied_role_id=340c36b159724285877d1a5a073dd4d3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.399326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.490098 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4048/8073] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:29 2022] PUT /identity/v3/roles/f2ef441788de49dfa957e0968b380153/implies/340c36b159724285877d1a5a073dd4d3 => generated 531 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:29.493892 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.503995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed742-87df-44fe-8607-2612f2cb6aaa tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.562300 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.562911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.563209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.563465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.564126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.566038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.624871 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4026/8074] 10.222.0.27 () {60 vars in 1149 bytes} [Tue Oct 18 14:18:29 2022] POST /identity/v3/domains => generated 275 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:29.629142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.639880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398c6a-9d0f-46f0-b67f-34b91f5f1ae3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.696724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.697330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.697611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.697885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.698573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.700162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.777600 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4049/8075] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:29 2022] POST /identity/v3/roles => generated 270 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:29.781824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.792665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7d7a-e54d-489f-ba48-3ef7278f93e3 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.797277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.797917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.798240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.798520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/f2ef441788de49dfa957e0968b380153/implies/084dc746a4fb462f8d9ecf360b45ae0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.800816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f2ef441788de49dfa957e0968b380153, implied_role_id=084dc746a4fb462f8d9ecf360b45ae0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.801865 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:29.801865 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:29.801865 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:29.803351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.892255 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4027/8076] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:29 2022] PUT /identity/v3/roles/f2ef441788de49dfa957e0968b380153/implies/084dc746a4fb462f8d9ecf360b45ae0b => generated 531 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:29.905843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:29.916628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176e10d-de46-42a6-8df3-fec35f289114 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:29.975318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:29.975966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:29.976249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:29.976526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/f2ef441788de49dfa957e0968b380153/implies/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:29.978223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f2ef441788de49dfa957e0968b380153, implied_role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:29.979833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:29.990504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:30.094439 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4050/8077] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:29 2022] PUT /identity/v3/roles/f2ef441788de49dfa957e0968b380153/implies/12a3779ce2f840bbbeaf216c2cfe4700 => generated 525 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:30.098583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:30.109296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df8d0e-4fe5-4faf-9aa7-92e997b900a0 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:30.166216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:30.166872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:30.167159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:30.167434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/12a3779ce2f840bbbeaf216c2cfe4700/implies/f2ef441788de49dfa957e0968b380153` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:30.169076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=12a3779ce2f840bbbeaf216c2cfe4700, implied_role_id=f2ef441788de49dfa957e0968b380153)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:30.170705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] f2ef441788de49dfa957e0968b380153 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: f2ef441788de49dfa957e0968b380153 cannot be an implied roles. Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 18 14:18:30.187999 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 18 14:18:30.189006 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:30.189006 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:30.189006 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 18 14:18:30.189006 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 18 14:18:30.189006 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: f2ef441788de49dfa957e0968b380153 cannot be an implied roles. Oct 18 14:18:30.189006 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:30.189349 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4028/8078] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:30 2022] PUT /identity/v3/roles/12a3779ce2f840bbbeaf216c2cfe4700/implies/f2ef441788de49dfa957e0968b380153 => generated 116 bytes in 91 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:30.193357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:30.203497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb65c2-6d2f-4912-a3cd-a9db69501f75 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:30.208049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:30.209300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:30.209575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:30.209852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/f2ef441788de49dfa957e0968b380153/implies/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:30.211662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f2ef441788de49dfa957e0968b380153, implied_role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:30.213329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:30.283796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4051/8079] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:30 2022] DELETE /identity/v3/roles/f2ef441788de49dfa957e0968b380153/implies/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:30.288366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:30.295640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:30.299426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cee906-5dab-4d4d-87f4-b91a760b4c0c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:30.357026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:30.357610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:30.357896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:30.358222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/f2ef441788de49dfa957e0968b380153/implies/084dc746a4fb462f8d9ecf360b45ae0b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:30.359900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f2ef441788de49dfa957e0968b380153, implied_role_id=084dc746a4fb462f8d9ecf360b45ae0b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:30.360923 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:30.360923 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:30.360923 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:30.361839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:30.441889 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4029/8080] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:30 2022] DELETE /identity/v3/roles/f2ef441788de49dfa957e0968b380153/implies/084dc746a4fb462f8d9ecf360b45ae0b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:30.446667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:30.457317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52b2ab-7521-49a7-82ea-97c2fbb3faa8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:30.516554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:30.517248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:30.517479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:30.517780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/084dc746a4fb462f8d9ecf360b45ae0b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:30.518942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=084dc746a4fb462f8d9ecf360b45ae0b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:30.520534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:30.602802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 084dc746a4fb462f8d9ecf360b45ae0b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:30.603098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.603759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.605568 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4052/8081] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:30 2022] DELETE /identity/v3/roles/084dc746a4fb462f8d9ecf360b45ae0b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:30.611749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:30.611749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:30.625486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0666e-48a8-4e7e-86e8-b122cf6722e8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:30.682639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:30.683273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:30.683560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:30.683839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/56bdca5e9a334f3987ef8acb8f70ca70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:30.695143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=56bdca5e9a334f3987ef8acb8f70ca70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:30.700580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:30.725479 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.726287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.804831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.805471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.808037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4030/8082] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:30 2022] PATCH /identity/v3/domains/56bdca5e9a334f3987ef8acb8f70ca70 => generated 276 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:30.812332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:30.823269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f021-d85d-4ec3-8b32-50bbeb6f11d2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:30.879241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:30.879906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:30.880196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:30.881053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/56bdca5e9a334f3987ef8acb8f70ca70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:30.891866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=56bdca5e9a334f3987ef8acb8f70ca70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:30.893518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:30.915581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.925654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:30.935469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:31.041497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70', 'request_id': 'req-b5630d51-297a-463d-90e7-5bcddd1f8c9a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.047995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70', 'request_id': 'req-b5630d51-297a-463d-90e7-5bcddd1f8c9a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.131759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70', 'request_id': 'req-b5630d51-297a-463d-90e7-5bcddd1f8c9a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.142288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] The token cache is being invalidate because project 56bdca5e9a334f3987ef8acb8f70ca70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:31.142574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.143188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.150518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70', 'request_id': 'req-b5630d51-297a-463d-90e7-5bcddd1f8c9a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.151142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70', 'request_id': 'req-b5630d51-297a-463d-90e7-5bcddd1f8c9a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.154380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '56bdca5e9a334f3987ef8acb8f70ca70', 'request_id': 'req-b5630d51-297a-463d-90e7-5bcddd1f8c9a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.159773 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4053/8083] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:30 2022] DELETE /identity/v3/domains/56bdca5e9a334f3987ef8acb8f70ca70 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:31.164658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:31.166149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:31.179585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb2802-f894-426d-b04d-48df7d984a9b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:31.229251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:31.235161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:31.235816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:31.236100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:31.236379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/f2ef441788de49dfa957e0968b380153/implies/340c36b159724285877d1a5a073dd4d3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:31.238024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f2ef441788de49dfa957e0968b380153, implied_role_id=340c36b159724285877d1a5a073dd4d3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.239692 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:31.297941 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4031/8084] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:31 2022] DELETE /identity/v3/roles/f2ef441788de49dfa957e0968b380153/implies/340c36b159724285877d1a5a073dd4d3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:31.302031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:31.304096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:31.316617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5630d51-297a-463d-90e7-5bcddd1f8c9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:31.373470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:31.374146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:31.374438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:31.374718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/340c36b159724285877d1a5a073dd4d3` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:31.375862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=340c36b159724285877d1a5a073dd4d3)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.377475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:31.468774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 340c36b159724285877d1a5a073dd4d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:31.469065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.469731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.471617 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4054/8085] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:31 2022] DELETE /identity/v3/roles/340c36b159724285877d1a5a073dd4d3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:31.477684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:31.479439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:31.492148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba41a3-da26-41a1-9c13-46daadb01536 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:31.548677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:31.549322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:31.549606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:31.549885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/f2ef441788de49dfa957e0968b380153` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:31.551035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f2ef441788de49dfa957e0968b380153)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.552075 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:31.552075 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:31.552075 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:31.552955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:31.643215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role f2ef441788de49dfa957e0968b380153 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:31.643506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.644168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:31.646013 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4032/8086] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:31 2022] DELETE /identity/v3/roles/f2ef441788de49dfa957e0968b380153 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:31.651779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:31.662078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc9680-653a-490e-bb71-86a8f0b8aabd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:31.706887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:31.718919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:31.719578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:31.719863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:31.720158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:31.721793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.723438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:31.792500 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4055/8087] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:31 2022] PUT /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 520 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:31.796486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:31.798048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:31.810638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fedb3-c245-4b2b-912a-c4c87447bdb6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:31.868813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:31.869505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:31.869784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:31.870074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:31.871876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.872942 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:31.872942 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:31.872942 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:31.873856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:31.874804 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.875687 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:31.875687 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:31.875687 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:31.876527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:31.882589 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4033/8088] 10.222.0.27 () {58 vars in 1345 bytes} [Tue Oct 18 14:18:31 2022] HEAD /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:31.886903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:31.897769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27edf39-f5fe-4ff9-a756-9854f369a47a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:31.902514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:31.903168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:31.905811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:31.905811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:31.905811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.906354 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:31.906354 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:31.906354 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:31.907245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:31.912841 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4056/8089] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 14:18:31 2022] GET /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 520 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:18:31.916738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:31.926781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a9f2-d5e4-4ccf-b218-2c4a7ee6d897 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:31.931464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:31.935575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:31.935575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:31.935575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:31.935575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:31.935987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.035715 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4034/8090] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:31 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:32.039943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.049895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46341633-114f-4c85-aa36-58f24ef23bcb tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.105833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.106536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.106819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.107095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.108724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.110370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5.: keystone.exception.ImpliedRoleNotFound: bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5. Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = query.one() Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:32.118822 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 18 14:18:32.119970 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 18 14:18:32.120998 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 18 14:18:32.120998 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5. Oct 18 14:18:32.120998 n-d-858383-13 devstack@keystone.service[82160]: ERROR keystone.server.flask.application Oct 18 14:18:32.120998 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4057/8091] 10.222.0.27 () {58 vars in 1344 bytes} [Tue Oct 18 14:18:32 2022] GET /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 137 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 14:18:32.124312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.135469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7289d-4274-4197-8085-8729166b69ec tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.140030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.140665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.140948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.141225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.142890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.144485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5.: keystone.exception.ImpliedRoleNotFound: bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5. Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = query.one() Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:32.155379 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 18 14:18:32.156490 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 18 14:18:32.157526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 18 14:18:32.157526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 18 14:18:32.157526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 18 14:18:32.157526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: bf1f44406f2f436fb23440080adb99a5 does not imply fd216cc61f214e30bdf346b6e97678d5. Oct 18 14:18:32.157526 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:32.157526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4035/8092] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:32 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 137 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:32.161722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.172865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5180520-7596-49d9-899a-fb27377c9102 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.177478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.178141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.179043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.179198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.180854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.182495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.263921 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4058/8093] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:32 2022] PUT /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 520 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:32.267991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.278877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a984d-d8d0-4fda-b9aa-983ec78d3765 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.314350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:32.337956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.338627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.338914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.339194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.341784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=5289d802c758445094eca214e23d75e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.342516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.429280 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4036/8094] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:32 2022] PUT /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8 => generated 519 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:32.433530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.444614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099a60-b23f-4284-9360-093352d44cee tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.504319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.505041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.505321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.505599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.507833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5289d802c758445094eca214e23d75e8, implied_role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.509690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.614960 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4059/8095] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:32 2022] PUT /identity/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700 => generated 519 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:32.619506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.629660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21857-eef5-4a80-96d3-2f341aa2c2bf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.685789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.686446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.686729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.687006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.687574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.688578 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:32.688578 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:32.688578 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:32.689462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.705608 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4037/8096] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Oct 18 14:18:32 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:32.710003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.720913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd7747-1451-43bf-a9f1-83f9e57f546c tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.726005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.728046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.728046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.728046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.729409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5289d802c758445094eca214e23d75e8, implied_role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.731045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.798251 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4060/8097] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:32 2022] DELETE /identity/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:32.802598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.812801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851bb3a-c200-466b-9617-df7a8df7b895 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:32.870190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:32.870805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:32.871093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:32.871371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:32.873040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=5289d802c758445094eca214e23d75e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:32.874663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:32.941360 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4038/8098] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:32 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:32.946194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:32.951838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:32.957113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1d1e-5567-49d5-aee3-a34af37b2961 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.015481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.016134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.016421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.016703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.018364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.020024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.089475 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4061/8099] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:32 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:33.094515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.105170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f5df-8a4b-477f-84f5-6b2d106172fc tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.149906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:33.162613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.163308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.168794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.168794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.168794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.168794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.177442 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4039/8100] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:33 2022] GET /identity/v3/roles => generated 2321 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:33.182993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.193409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8178506-a906-41bd-ae20-3d4058c197c8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.198952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.203230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.203230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.203230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.203230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.203230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.277881 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4062/8101] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Oct 18 14:18:33 2022] POST /identity/v3/roles => generated 235 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:33.281937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.292825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aedcde-2c55-4dfa-aaaa-d4136cc2a7b9 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.297457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.298096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.298380 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.298650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/9bddde43ffc3447e94e3d0888b35d5c8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.300128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:update_role(role_id=9bddde43ffc3447e94e3d0888b35d5c8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.301130 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:33.301130 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:33.301130 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:33.302005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.394880 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4040/8102] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Oct 18 14:18:33 2022] PATCH /identity/v3/roles/9bddde43ffc3447e94e3d0888b35d5c8 => generated 238 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:33.398681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.409639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9a05-40b2-4916-84c6-2c3cf028aa7d tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.413989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.414645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.414937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.415213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/9bddde43ffc3447e94e3d0888b35d5c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.423671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:get_role(role_id=9bddde43ffc3447e94e3d0888b35d5c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.425287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.426634 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4063/8103] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 18 14:18:33 2022] GET /identity/v3/roles/9bddde43ffc3447e94e3d0888b35d5c8 => generated 238 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:33.431272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.441513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf1a2-2b4b-4f79-ac52-a9a151a1fff6 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.446552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.447165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.447510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.447795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.448475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.450185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.462429 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4041/8104] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:33 2022] GET /identity/v3/roles => generated 2550 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:33.466234 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.476889 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59a38-ba28-4e86-8bf7-eb480c830e02 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.481474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.482131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.482418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.482695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/9bddde43ffc3447e94e3d0888b35d5c8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.484071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9bddde43ffc3447e94e3d0888b35d5c8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.485660 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.623513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 9bddde43ffc3447e94e3d0888b35d5c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:33.623804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:33.624475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:33.626294 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4064/8105] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:33 2022] DELETE /identity/v3/roles/9bddde43ffc3447e94e3d0888b35d5c8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:33.631546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.633249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:33.646726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e19f85-5790-4a88-91b7-70a41724e894 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.703915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.704487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.704769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.705043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.706715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.708308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:33.808527 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4042/8106] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:33 2022] PUT /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 520 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:33.812661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:33.822811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56d13d-44c1-44c5-a841-06ff775b71c1 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:33.878148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:33.878792 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:33.879074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:33.879348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:33.880996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=5289d802c758445094eca214e23d75e8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:33.882643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.003213 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4065/8107] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:33 2022] PUT /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8 => generated 519 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:34.007250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.018009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ffa2-4b45-4017-817c-dff6f6378dce tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.074245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.074886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.075167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.075466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.077088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5289d802c758445094eca214e23d75e8, implied_role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:34.078704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.154553 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4043/8108] 10.222.0.27 () {60 vars in 1363 bytes} [Tue Oct 18 14:18:34 2022] PUT /identity/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700 => generated 519 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:34.158564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.169432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea8311-b0b3-43ae-8448-21c2b1887c67 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.178107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:34.228627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.229271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.229696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.229986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/5289d802c758445094eca214e23d75e8/implies` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.231367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=5289d802c758445094eca214e23d75e8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:34.232570 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:34.232570 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:34.232570 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:34.233638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.239986 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4066/8109] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 14:18:34 2022] GET /identity/v3/roles/5289d802c758445094eca214e23d75e8/implies => generated 488 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:34.244747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.256062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52b3d-f1a9-4053-8a61-20badaf68a53 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.261208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.261858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.262228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.262554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.263730 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=bf1f44406f2f436fb23440080adb99a5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:34.264731 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:34.264731 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:34.264731 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:34.265622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.267930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:34.272759 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4044/8110] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 18 14:18:34 2022] GET /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies => generated 659 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:34.276941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.286871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b4b44-bdc6-46b0-9566-54e02d5022fe tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.292213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.292868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.293524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.293853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.295550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5289d802c758445094eca214e23d75e8, implied_role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:34.297150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.349850 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4067/8111] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:34 2022] DELETE /identity/v3/roles/5289d802c758445094eca214e23d75e8/implies/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:34.354779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.364636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c06360-6822-42d5-b52e-2ff80765e99e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.424339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.428648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.428648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.428648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.428648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=5289d802c758445094eca214e23d75e8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:34.428961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.507209 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4045/8112] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:34 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/5289d802c758445094eca214e23d75e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:34.511565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.522674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27703057-47db-43b0-9f86-31aeeb46d94b tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.579267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.579923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.580209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.580484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.582146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf1f44406f2f436fb23440080adb99a5, implied_role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:34.583762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.672659 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4068/8113] 10.222.0.27 () {58 vars in 1347 bytes} [Tue Oct 18 14:18:34 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5/implies/fd216cc61f214e30bdf346b6e97678d5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:34.677371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.687667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6908e-e1b2-4e2b-ba24-41899faef9d7 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.751733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.752283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.752586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.752859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/56bdca5e9a334f3987ef8acb8f70ca70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.761016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Could not find domain: 56bdca5e9a334f3987ef8acb8f70ca70.: keystone.exception.DomainNotFound: Could not find domain: 56bdca5e9a334f3987ef8acb8f70ca70. Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 56bdca5e9a334f3987ef8acb8f70ca70. Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:34.765992 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:34.767097 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 56bdca5e9a334f3987ef8acb8f70ca70. Oct 18 14:18:34.767977 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:34.768911 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4046/8114] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:34 2022] PATCH /identity/v3/domains/56bdca5e9a334f3987ef8acb8f70ca70 => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:34.771098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:34.782139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922065-bcf1-4733-89a5-a874dc13836e tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:34.786749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:34.787383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:34.787663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:34.788528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/users/9824a07b9f54407786ef765e8e81c112` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:34.789690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9824a07b9f54407786ef765e8e81c112)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:34.791648 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:34.889473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9824a07b9f54407786ef765e8e81c112'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:34.896455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9824a07b9f54407786ef765e8e81c112'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:34.897135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9824a07b9f54407786ef765e8e81c112'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:34.909717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9824a07b9f54407786ef765e8e81c112'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:34.991635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9824a07b9f54407786ef765e8e81c112'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:34.997800 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4069/8115] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:34 2022] DELETE /identity/v3/users/9824a07b9f54407786ef765e8e81c112 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:35.001976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:35.003657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:35.017599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee980b-49e4-4a61-88f8-70e2261b0a9a tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:35.072470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:35.073093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:35.073374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:35.073648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/12a3779ce2f840bbbeaf216c2cfe4700` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:35.075036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12a3779ce2f840bbbeaf216c2cfe4700)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:35.076617 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:35.147408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:35.152143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 12a3779ce2f840bbbeaf216c2cfe4700 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:35.152432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.153100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.154886 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4047/8116] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:35 2022] DELETE /identity/v3/roles/12a3779ce2f840bbbeaf216c2cfe4700 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:35.159056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:35.169363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987c3ee-2ee8-4ac8-8ebe-e2789a544b64 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:35.174153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:35.226178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:35.226809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:35.227093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:35.227371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/groups/4ed430d3175948dfbf48d936a9f28a5d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:35.228531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4ed430d3175948dfbf48d936a9f28a5d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:35.230485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:35.317471 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4070/8117] 10.222.0.27 () {58 vars in 1227 bytes} [Tue Oct 18 14:18:35 2022] DELETE /identity/v3/groups/4ed430d3175948dfbf48d936a9f28a5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:35.322389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:35.323789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:35.336436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51eab6-50e6-41b0-8598-5d23726b5653 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:35.393779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:35.394459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:35.394707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:35.394978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/projects/1614750bceed4fd392d1fce1faa390d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:35.396093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1614750bceed4fd392d1fce1faa390d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:35.398026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:35.515765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614750bceed4fd392d1fce1faa390d1', 'request_id': 'req-e9cb20a3-371d-4472-bda1-1d29bf763aaf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.522098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614750bceed4fd392d1fce1faa390d1', 'request_id': 'req-e9cb20a3-371d-4472-bda1-1d29bf763aaf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.583011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614750bceed4fd392d1fce1faa390d1', 'request_id': 'req-e9cb20a3-371d-4472-bda1-1d29bf763aaf'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.593932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] The token cache is being invalidate because project 1614750bceed4fd392d1fce1faa390d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:35.594254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.594927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.596515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4048/8118] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:35 2022] DELETE /identity/v3/projects/1614750bceed4fd392d1fce1faa390d1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:35.602670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:35.604358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:35.617566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147994e-97f4-4fe5-931a-22ac86ce42b8 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:35.673071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:35.673703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:35.673990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:35.674302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:35.675525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a348ccb5afc6403081aa0d8537508bfa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:35.677131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:35.698318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.699005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.778662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.779289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.782833 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4071/8119] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Oct 18 14:18:35 2022] PATCH /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa => generated 277 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:35.785983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:35.798259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb20a3-371d-4472-bda1-1d29bf763aaf tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:35.858396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:35.859051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:35.859337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:35.859612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/domains/a348ccb5afc6403081aa0d8537508bfa` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:35.871127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a348ccb5afc6403081aa0d8537508bfa)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:35.876303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:35.896187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:35.898801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:35.907056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.010304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa', 'request_id': 'req-f743bd56-3edd-401c-b7ff-c0ea2331927f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.017065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa', 'request_id': 'req-f743bd56-3edd-401c-b7ff-c0ea2331927f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.077696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa', 'request_id': 'req-f743bd56-3edd-401c-b7ff-c0ea2331927f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.089497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] The token cache is being invalidate because project a348ccb5afc6403081aa0d8537508bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:36.089783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.090443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.098332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa', 'request_id': 'req-f743bd56-3edd-401c-b7ff-c0ea2331927f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.098977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa', 'request_id': 'req-f743bd56-3edd-401c-b7ff-c0ea2331927f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.099595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a348ccb5afc6403081aa0d8537508bfa', 'request_id': 'req-f743bd56-3edd-401c-b7ff-c0ea2331927f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.109282 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4049/8120] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:35 2022] DELETE /identity/v3/domains/a348ccb5afc6403081aa0d8537508bfa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:36.113441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:36.114932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:36.127420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46122dbf-88e4-405d-821e-1696cf726871 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:36.157493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:36.184953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:36.185619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:36.185906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:36.186217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/5289d802c758445094eca214e23d75e8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:36.187602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5289d802c758445094eca214e23d75e8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:36.189211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:36.291507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role 5289d802c758445094eca214e23d75e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:36.291797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.292450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.294328 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4072/8121] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:36 2022] DELETE /identity/v3/roles/5289d802c758445094eca214e23d75e8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:36.298486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:36.299900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:36.312594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743bd56-3edd-401c-b7ff-c0ea2331927f tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:36.369035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:36.369665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:36.369943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:36.370246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/fd216cc61f214e30bdf346b6e97678d5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:36.371628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fd216cc61f214e30bdf346b6e97678d5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:36.373211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:36.448697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role fd216cc61f214e30bdf346b6e97678d5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:36.449332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.449671 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.451511 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4050/8122] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:36 2022] DELETE /identity/v3/roles/fd216cc61f214e30bdf346b6e97678d5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:36.455746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:36.457141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:36.470593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2235c-74a1-4573-8d51-78fbe1ed7dbd tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:36.526030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '658523aaa466431690c89093955a44a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a78dd2f62f2493db57c01edc7ccedcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:36.526684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:36.526991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:36.527272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] PATH_INFO: `/v3/roles/bf1f44406f2f436fb23440080adb99a5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:36.528657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bf1f44406f2f436fb23440080adb99a5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:36.530281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:36.631192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invalidating the token cache because role bf1f44406f2f436fb23440080adb99a5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:36.631399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.632664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.634857 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4073/8123] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:36 2022] DELETE /identity/v3/roles/bf1f44406f2f436fb23440080adb99a5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:36.638915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:36.640281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:36.675991 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:36.706530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c29df-3357-476f-b4c0-46260a83a9f2 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:36.770755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:36.771398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:36.771699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:36.771953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] PATH_INFO: `/v3/users/7f8579c2c7f34b639206e93da0d90e97` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:36.773729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8579c2c7f34b639206e93da0d90e97)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:36.777250 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:36.933811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8579c2c7f34b639206e93da0d90e97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:36.934392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8579c2c7f34b639206e93da0d90e97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.034898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8579c2c7f34b639206e93da0d90e97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.035696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8579c2c7f34b639206e93da0d90e97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.044394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-07afd9ed-bd98-431b-8e70-76ffa0f0d3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8579c2c7f34b639206e93da0d90e97'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.045706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:37.047181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:37.062208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4051/8124] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:36 2022] DELETE /identity/v3/users/7f8579c2c7f34b639206e93da0d90e97 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:37.066684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:37.066974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:37.067252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:37.088099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:37.089309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:37.124828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:37.134584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299a13c-bfeb-4c4a-be6c-103906968914 tempest-RolesV3TestJSON-1498631212 tempest-RolesV3TestJSON-1498631212-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:37.142348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:37.151686 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4052/8125] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:37.161965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:37.163501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:37.201969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:37.202541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:37.202824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:37.203124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:37.204842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:37.219988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:37.220926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1f7ec-8cfc-4dd4-b1ed-23bde14ecf92 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:37.221797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:37.224743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:37.225383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:37.225742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:37.226015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:37.234612 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4074/8126] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:18:37.235137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:37.236556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:37.246388 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4053/8127] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:18:37.668157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:37.669583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:37.683815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39dd16-bf55-40dd-b6ab-45e228f69644 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:37.688352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:37.688981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:37.689260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:37.689534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] PATH_INFO: `/v3/projects/728deb841a7344178917ff6ca2f1059c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:37.690673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=728deb841a7344178917ff6ca2f1059c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:37.692578 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:37.829924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728deb841a7344178917ff6ca2f1059c', 'request_id': 'req-75af1d16-c369-4311-8174-e70311c69f2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.836391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728deb841a7344178917ff6ca2f1059c', 'request_id': 'req-75af1d16-c369-4311-8174-e70311c69f2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.914790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728deb841a7344178917ff6ca2f1059c', 'request_id': 'req-75af1d16-c369-4311-8174-e70311c69f2d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.925917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] The token cache is being invalidate because project 728deb841a7344178917ff6ca2f1059c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:37.926242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.926886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:37.929221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4075/8128] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:37 2022] DELETE /identity/v3/projects/728deb841a7344178917ff6ca2f1059c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:37.933138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:37.943026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943be41-5c78-4275-afa4-0a0f00e3c109 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:38.000100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:38.000732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:38.001015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:38.001292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] PATH_INFO: `/v3/users/658523aaa466431690c89093955a44a4` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:38.002446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658523aaa466431690c89093955a44a4)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:38.004360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:38.196349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658523aaa466431690c89093955a44a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.197020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658523aaa466431690c89093955a44a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.251348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658523aaa466431690c89093955a44a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.251966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658523aaa466431690c89093955a44a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.259474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-31e2afd5-b2d9-426a-8954-4020c3ed4f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658523aaa466431690c89093955a44a4'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.277880 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4054/8129] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:37 2022] DELETE /identity/v3/users/658523aaa466431690c89093955a44a4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:38.653988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:38.655453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:38.668498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af1d16-c369-4311-8174-e70311c69f2d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:38.724686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:38.725247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:38.725524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:38.725796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] PATH_INFO: `/v3/projects/7a78dd2f62f2493db57c01edc7ccedcc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:38.727043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a78dd2f62f2493db57c01edc7ccedcc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:38.728958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:38.740441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:38.833282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a78dd2f62f2493db57c01edc7ccedcc', 'request_id': 'req-9781697b-ea7e-4a04-a922-5f071cd8ef01'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.840123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a78dd2f62f2493db57c01edc7ccedcc', 'request_id': 'req-9781697b-ea7e-4a04-a922-5f071cd8ef01'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.903261 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a78dd2f62f2493db57c01edc7ccedcc', 'request_id': 'req-9781697b-ea7e-4a04-a922-5f071cd8ef01'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.914224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] The token cache is being invalidate because project 7a78dd2f62f2493db57c01edc7ccedcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:38.914513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.915133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9781697b-ea7e-4a04-a922-5f071cd8ef01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:38.916618 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4076/8130] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:38 2022] DELETE /identity/v3/projects/7a78dd2f62f2493db57c01edc7ccedcc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:38.921412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c393-3174-4b64-8968-7d0cb6ee147e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:38.921700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c393-3174-4b64-8968-7d0cb6ee147e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:38.921978 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4c393-3174-4b64-8968-7d0cb6ee147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:38.941987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-daf4c393-3174-4b64-8968-7d0cb6ee147e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:38.943266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-daf4c393-3174-4b64-8968-7d0cb6ee147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:38.960765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:39.003336 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4055/8131] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:39.012084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e8ef4-1cdd-47dd-9275-fc74378b57cd None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.012365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e8ef4-1cdd-47dd-9275-fc74378b57cd None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.012639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e8ef4-1cdd-47dd-9275-fc74378b57cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.033037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e59e8ef4-1cdd-47dd-9275-fc74378b57cd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:39.034265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e59e8ef4-1cdd-47dd-9275-fc74378b57cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:39.042310 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4077/8132] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:39.046724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4c393-3174-4b64-8968-7d0cb6ee147e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.057017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4c393-3174-4b64-8968-7d0cb6ee147e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.061604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.062235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.062512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.062802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.063445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:39.063748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.065320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.077304 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4056/8133] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:39.081492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e8ef4-1cdd-47dd-9275-fc74378b57cd None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.090715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e8ef4-1cdd-47dd-9275-fc74378b57cd None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.095487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.096199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.096530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.096804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.097435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.099444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.178717 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4078/8134] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:39 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:39.186306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.197128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdc907-c831-42c4-8e61-564346293a81 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.251900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.252503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.252782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.253053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.253745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.255620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.334519 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4057/8135] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:39 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:39.338666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.348959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2958ac-990d-4651-8ed3-5fc131aa8e1a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.354187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.354788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.355094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.355483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.356139 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.357738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.368344 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4079/8136] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:39.372239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.382146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf83e3-5f99-4f11-a1f4-551d825b79df admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.387160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b09bc-c762-474b-b6db-c8a8d8fdab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.387773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b09bc-c762-474b-b6db-c8a8d8fdab9d admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.388027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b09bc-c762-474b-b6db-c8a8d8fdab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.388319 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b09bc-c762-474b-b6db-c8a8d8fdab9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.388980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b09bc-c762-474b-b6db-c8a8d8fdab9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.390583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b09bc-c762-474b-b6db-c8a8d8fdab9d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.401173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4058/8137] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:39.405204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.415546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7d517-05ab-431e-bab1-1d881bff4438 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.420218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.420864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.421149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.421538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] PATH_INFO: `/v3/projects/7bb8e00af64241ea8cc8a40054810a2b/users/df93ac905ef247618da8e2b16e8f6395/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.436344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb8e00af64241ea8cc8a40054810a2b, user_id=df93ac905ef247618da8e2b16e8f6395, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.439043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.500670 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4080/8138] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:39 2022] PUT /identity/v3/projects/7bb8e00af64241ea8cc8a40054810a2b/users/df93ac905ef247618da8e2b16e8f6395/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:39.512338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c634e-6342-4cd9-b563-df10813289d2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.512557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c634e-6342-4cd9-b563-df10813289d2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.512831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c634e-6342-4cd9-b563-df10813289d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.540890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-679c634e-6342-4cd9-b563-df10813289d2 None None] MFA Rules not processed for user `df93ac905ef247618da8e2b16e8f6395`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:39.542105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-679c634e-6342-4cd9-b563-df10813289d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:39.605049 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4059/8139] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:39.609565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.673056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844283dc-987a-4520-a1ad-9c8967321b1d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.677716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.678350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.678633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.678905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.679706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.681604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.770275 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4081/8140] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:39 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:39.774759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c634e-6342-4cd9-b563-df10813289d2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.785735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c634e-6342-4cd9-b563-df10813289d2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.798590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:39.841644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.842336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.842586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.842858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.843484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.845424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.937449 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4060/8141] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:39 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:39.941606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.951819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae940d98-a50c-47e0-ac7c-bd46a4fc681a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.957013 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.958431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.958431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.958431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:39.958920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:39.960995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:39.971582 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4082/8142] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:39.975654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:39.986561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a43bf3-79b8-400c-ab16-86bf7bb44c39 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:39.991285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:39.991943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:39.992232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:39.992509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] PATH_INFO: `/v3/projects/bfca9ce2250f4d9baf1dc393ae80035a/users/9f581b795a48455aa50e41c968cec8f0/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.007881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfca9ce2250f4d9baf1dc393ae80035a, user_id=9f581b795a48455aa50e41c968cec8f0, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.010849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.080227 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4061/8143] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:39 2022] PUT /identity/v3/projects/bfca9ce2250f4d9baf1dc393ae80035a/users/9f581b795a48455aa50e41c968cec8f0/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:40.084089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.094969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be63a8-8a58-4392-96de-f010f98680f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.102737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:40.151610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd29778-161f-46e8-841b-d2e4698c8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.152215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd29778-161f-46e8-841b-d2e4698c8499 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.152494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd29778-161f-46e8-841b-d2e4698c8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.152766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd29778-161f-46e8-841b-d2e4698c8499 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.153401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd29778-161f-46e8-841b-d2e4698c8499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.155017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd29778-161f-46e8-841b-d2e4698c8499 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.164578 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4083/8144] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:40.168864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.179357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a72dc-02de-40db-b7e5-b6c7f0160618 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.183973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.184666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.184960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.185221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] PATH_INFO: `/v3/projects/bfca9ce2250f4d9baf1dc393ae80035a/users/9f581b795a48455aa50e41c968cec8f0/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.187156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfca9ce2250f4d9baf1dc393ae80035a, user_id=9f581b795a48455aa50e41c968cec8f0, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.189752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.200712 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4062/8145] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:40 2022] PUT /identity/v3/projects/bfca9ce2250f4d9baf1dc393ae80035a/users/9f581b795a48455aa50e41c968cec8f0/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:40.211413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ff19-a797-4f93-b859-ffaa71c44673 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.211693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ff19-a797-4f93-b859-ffaa71c44673 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.211962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ff19-a797-4f93-b859-ffaa71c44673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.238910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8417ff19-a797-4f93-b859-ffaa71c44673 None None] MFA Rules not processed for user `9f581b795a48455aa50e41c968cec8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:40.240105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8417ff19-a797-4f93-b859-ffaa71c44673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:40.307495 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4084/8146] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:40.312464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.323726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73677-bff9-417d-ab39-86f6bfeb40cf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.328282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.328879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.329162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.329440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.330118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.331743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.397576 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4063/8147] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Oct 18 14:18:40 2022] POST /identity/v3/services => generated 240 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:40.402329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ff19-a797-4f93-b859-ffaa71c44673 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.411542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ff19-a797-4f93-b859-ffaa71c44673 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.425603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.426244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.426527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.426804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/67fa403d48fc43e7b1aa5f56a60692db` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.427378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=67fa403d48fc43e7b1aa5f56a60692db)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.429459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.507245 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4085/8148] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:40 2022] DELETE /identity/v3/services/67fa403d48fc43e7b1aa5f56a60692db => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:40.513093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.523951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ce922-80db-40f3-ad36-27cd3df0cb25 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.538305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.542353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.542353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.542353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.542353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.542353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.621293 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4064/8149] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:40 2022] POST /identity/v3/services => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:40.625387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.636748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec598-1c77-4b6b-97bc-3c4f8cda7cb5 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.651545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.652175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.652455 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.652726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.653375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:update_service(service_id=ffd603a0213a4c73b05cbc3ae96dc1c2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.654423 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:40.654423 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:40.654423 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:40.655308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.744358 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4086/8150] 10.222.0.27 () {60 vars in 1252 bytes} [Tue Oct 18 14:18:40 2022] PATCH /identity/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2 => generated 282 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:40.748085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.759572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a0b45-e957-4eeb-82a3-644b881f8d95 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.774049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.774628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.774909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.775196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.775765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:get_service(service_id=ffd603a0213a4c73b05cbc3ae96dc1c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.776810 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:40.776810 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:40.776810 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:40.777688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.783472 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4065/8151] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:40 2022] GET /identity/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2 => generated 282 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:40.787615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.798579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54453da4-7ae1-4b4d-b9e8-b8fd764fe5ce tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.803141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.803955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.805081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.805686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.805938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ffd603a0213a4c73b05cbc3ae96dc1c2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.807588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.890039 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4087/8152] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:40 2022] DELETE /identity/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:40.894179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.904135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289f482-069f-4741-afd4-0db4da482efa tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.919466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.920089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.920370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.920643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.921225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:get_service(service_id=ffd603a0213a4c73b05cbc3ae96dc1c2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.922840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Could not find service: ffd603a0213a4c73b05cbc3ae96dc1c2.: keystone.exception.ServiceNotFound: Could not find service: ffd603a0213a4c73b05cbc3ae96dc1c2. Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: ffd603a0213a4c73b05cbc3ae96dc1c2. Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:40.932604 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:40.933669 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: ffd603a0213a4c73b05cbc3ae96dc1c2. Oct 18 14:18:40.934989 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:40.936076 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4066/8153] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Oct 18 14:18:40 2022] GET /identity/v3/services/ffd603a0213a4c73b05cbc3ae96dc1c2 => generated 113 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:40.938727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:40.949273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184af8-b67c-4d5e-a4f6-6233f25e8d49 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:40.954099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:40.954735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:40.955044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:40.955326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:40.956015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:40.957664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.074939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:41.081738 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4088/8154] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:40 2022] POST /identity/v3/services => generated 272 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:41.085732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.096452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a546cb-fb41-45c6-86b9-12f509800377 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.111614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.112398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.112806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.117496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.117496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.117496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.203831 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4067/8155] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:41 2022] POST /identity/v3/services => generated 275 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:41.207915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.218855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ba71-76a9-45f9-a8b9-2e443bf61c2f tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.234985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.238186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.238186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.238186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.238186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.238515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.326333 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4089/8156] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:41 2022] POST /identity/v3/services => generated 275 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:41.330157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.341230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75720fe-8d76-4602-ad64-79b41a6b5070 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.356369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.356970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.357257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.357536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.358163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.359164 n-d-858383-13 devstack@keystone.service[82161]: WARNING py.warnings [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:41.359164 n-d-858383-13 devstack@keystone.service[82161]: warnings.warn(msg) Oct 18 14:18:41.359164 n-d-858383-13 devstack@keystone.service[82161]: Oct 18 14:18:41.360051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.367735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4068/8157] 10.222.0.27 () {58 vars in 1131 bytes} [Tue Oct 18 14:18:41 2022] GET /identity/v3/services => generated 2977 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:41.371843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.382293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693779-b4c6-4495-89c3-f06e197b978a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.387282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.387879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.388163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.388469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.389097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-72257366) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:41.389401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.390448 n-d-858383-13 devstack@keystone.service[82160]: WARNING py.warnings [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 14:18:41.390448 n-d-858383-13 devstack@keystone.service[82160]: warnings.warn(msg) Oct 18 14:18:41.390448 n-d-858383-13 devstack@keystone.service[82160]: Oct 18 14:18:41.391327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.396160 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4090/8158] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 18 14:18:41 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-72257366 => generated 413 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:41.400473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.410283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5ae86-3a87-4b3a-868b-fc7e205744e9 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.415503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.416089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.416373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.416648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.417266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1546229617) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:41.417575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.419153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.423888 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4069/8159] 10.222.0.27 () {58 vars in 1222 bytes} [Tue Oct 18 14:18:41 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1546229617 => generated 418 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:41.427794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.437394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d868aee-a885-4d66-944f-99e774124cd6 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.441973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.442591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.442874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.443151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.443771 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1711850113) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:41.444072 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.445652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.450671 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4091/8160] 10.222.0.27 () {58 vars in 1222 bytes} [Tue Oct 18 14:18:41 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1711850113 => generated 418 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:18:41.454769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.465272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e93f4-936f-40e0-a6cc-6ba5fc5af172 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.470248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.470891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.471179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.471461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/73c6e575daa34804b37a96621f4b7513` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.472069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=73c6e575daa34804b37a96621f4b7513)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.473670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.479951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:41.557432 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4070/8161] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:41 2022] DELETE /identity/v3/services/73c6e575daa34804b37a96621f4b7513 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:41.561666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.572893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcfdd-ad40-44c2-a807-650406ab6b1a tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.588475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.589112 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.589395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.589670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/2a2a3879c2634d08a641600b09f075e4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.590317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2a2a3879c2634d08a641600b09f075e4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.591926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.666015 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4092/8162] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:41 2022] DELETE /identity/v3/services/2a2a3879c2634d08a641600b09f075e4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:41.670177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.680731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b810-6ea9-4cd7-abb1-c41d06ced2c2 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.696045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df3b67-40d8-4b0b-9150-5b0238b54419 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f581b795a48455aa50e41c968cec8f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfca9ce2250f4d9baf1dc393ae80035a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.696672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3b67-40d8-4b0b-9150-5b0238b54419 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.696954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3b67-40d8-4b0b-9150-5b0238b54419 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.697225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df3b67-40d8-4b0b-9150-5b0238b54419 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] PATH_INFO: `/v3/services/b583975a28644db2bb92c9f9bd07b65b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.697825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df3b67-40d8-4b0b-9150-5b0238b54419 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b583975a28644db2bb92c9f9bd07b65b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.699453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df3b67-40d8-4b0b-9150-5b0238b54419 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:41.798024 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4071/8163] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:41 2022] DELETE /identity/v3/services/b583975a28644db2bb92c9f9bd07b65b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:41.803115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:41.874374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e47a7-63a2-4b9a-9525-d22a161ef099 tempest-ServicesTestJSON-2097590734 tempest-ServicesTestJSON-2097590734-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:41.888791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:41.889451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:41.889728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:41.890029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] PATH_INFO: `/v3/users/df93ac905ef247618da8e2b16e8f6395` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:41.891202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df93ac905ef247618da8e2b16e8f6395)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:41.893129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:42.057159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df93ac905ef247618da8e2b16e8f6395'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.064099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df93ac905ef247618da8e2b16e8f6395'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.064838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df93ac905ef247618da8e2b16e8f6395'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.075763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:42.078069 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df93ac905ef247618da8e2b16e8f6395'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.140038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df93ac905ef247618da8e2b16e8f6395'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.146159 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4093/8164] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:41 2022] DELETE /identity/v3/users/df93ac905ef247618da8e2b16e8f6395 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:42.150798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:42.151321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:42.151321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:42.169936 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:42.171172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:42.228988 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4072/8165] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:42.238708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:42.240166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:42.307953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcae8f-543c-4f7e-9fe5-90f7c88e8a65 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:42.312584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:42.313194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:42.313480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:42.313765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:42.322877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:42.324309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:42.333803 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4094/8166] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:42.750411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:42.751837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:42.764888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ad824-8242-4f6b-97b2-1318fb583038 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:42.769838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:42.770514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:42.770793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:42.771063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] PATH_INFO: `/v3/projects/7bb8e00af64241ea8cc8a40054810a2b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:42.772296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb8e00af64241ea8cc8a40054810a2b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:42.774679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:42.902404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb8e00af64241ea8cc8a40054810a2b', 'request_id': 'req-efa35d47-c332-44fe-94ad-616099e3e4f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.908827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb8e00af64241ea8cc8a40054810a2b', 'request_id': 'req-efa35d47-c332-44fe-94ad-616099e3e4f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.963186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb8e00af64241ea8cc8a40054810a2b', 'request_id': 'req-efa35d47-c332-44fe-94ad-616099e3e4f0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.974512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] The token cache is being invalidate because project 7bb8e00af64241ea8cc8a40054810a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:42.974798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.975417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:42.977609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4073/8167] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:42 2022] DELETE /identity/v3/projects/7bb8e00af64241ea8cc8a40054810a2b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:42.981590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:42.991382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a40cc-fa31-482b-a79d-559eca15967b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:43.047722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:43.048351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:43.048632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:43.048908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] PATH_INFO: `/v3/users/9f581b795a48455aa50e41c968cec8f0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:43.050025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f581b795a48455aa50e41c968cec8f0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:43.051984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:43.222576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f581b795a48455aa50e41c968cec8f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:43.229431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f581b795a48455aa50e41c968cec8f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:43.230128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f581b795a48455aa50e41c968cec8f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:43.242114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f581b795a48455aa50e41c968cec8f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:43.302770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e11871a7-6b85-404b-b5ca-dcde12a6887a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f581b795a48455aa50e41c968cec8f0'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:43.304986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:43.309297 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4095/8168] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:42 2022] DELETE /identity/v3/users/9f581b795a48455aa50e41c968cec8f0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:43.733215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:43.734840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:43.751712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa35d47-c332-44fe-94ad-616099e3e4f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:43.786581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:43.810009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:43.810680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:43.810964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:43.811240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] PATH_INFO: `/v3/projects/bfca9ce2250f4d9baf1dc393ae80035a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:43.812383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfca9ce2250f4d9baf1dc393ae80035a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:43.814320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:43.912604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfca9ce2250f4d9baf1dc393ae80035a', 'request_id': 'req-c2011be7-186d-40cb-b0ee-3a583dee1623'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:43.919615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfca9ce2250f4d9baf1dc393ae80035a', 'request_id': 'req-c2011be7-186d-40cb-b0ee-3a583dee1623'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:44.009032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfca9ce2250f4d9baf1dc393ae80035a', 'request_id': 'req-c2011be7-186d-40cb-b0ee-3a583dee1623'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:44.019903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] The token cache is being invalidate because project bfca9ce2250f4d9baf1dc393ae80035a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:44.020195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:44.020831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c2011be7-186d-40cb-b0ee-3a583dee1623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:44.024341 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4074/8169] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:43 2022] DELETE /identity/v3/projects/bfca9ce2250f4d9baf1dc393ae80035a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:44.027610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9d4b3-237e-4c51-890c-fdb9d3ef468d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.028059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9d4b3-237e-4c51-890c-fdb9d3ef468d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.028262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9d4b3-237e-4c51-890c-fdb9d3ef468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.048376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-caf9d4b3-237e-4c51-890c-fdb9d3ef468d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:44.049590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-caf9d4b3-237e-4c51-890c-fdb9d3ef468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:44.108411 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4096/8170] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:44.116056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea21c43-89de-4aeb-8e4c-d3dfc428a90f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.116336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea21c43-89de-4aeb-8e4c-d3dfc428a90f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.117258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea21c43-89de-4aeb-8e4c-d3dfc428a90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.137233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ea21c43-89de-4aeb-8e4c-d3dfc428a90f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:44.138480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ea21c43-89de-4aeb-8e4c-d3dfc428a90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:44.146561 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4075/8171] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:44.151459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9d4b3-237e-4c51-890c-fdb9d3ef468d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:44.161248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9d4b3-237e-4c51-890c-fdb9d3ef468d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:44.166558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:44.167153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.167434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.167724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.168344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:44.168646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:44.170290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:44.182170 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4097/8172] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:44.186426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea21c43-89de-4aeb-8e4c-d3dfc428a90f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:44.195727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea21c43-89de-4aeb-8e4c-d3dfc428a90f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:44.200484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:44.201084 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.201365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.201640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.202328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:44.204219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:44.324873 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4076/8173] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:44 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:44.330202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:44.340794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876818d8-f531-4f05-926d-e6cd0de7122f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:44.396447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:44.397046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.397328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.398126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.398753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:44.400676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:44.478691 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4098/8174] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:44 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:44.482911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:44.493544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304313-4b47-4ab1-a0a9-aa67ac8919fb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:44.499473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:44.500083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.500363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.500663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.501327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:44.502933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:44.514434 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4077/8175] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:44.518751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:44.529911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b380f06-df7b-4498-bbec-6761cad477d4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:44.534839 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3166a60-0f09-4cce-91d2-a8ef7f2d63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:44.535441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3166a60-0f09-4cce-91d2-a8ef7f2d63ca admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.535716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3166a60-0f09-4cce-91d2-a8ef7f2d63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.536617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3166a60-0f09-4cce-91d2-a8ef7f2d63ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.537262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3166a60-0f09-4cce-91d2-a8ef7f2d63ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:44.538959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3166a60-0f09-4cce-91d2-a8ef7f2d63ca admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:44.550155 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4099/8176] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:44.554200 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:44.564226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd93cf-da73-49e8-99c7-2a7e6ced661f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:44.568880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:44.570088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.570374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.570649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] PATH_INFO: `/v3/projects/558417d8507d49f7b1427ee00d54e0d1/users/07310703370a4f9f8c78fa83b28d3fbf/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.586909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558417d8507d49f7b1427ee00d54e0d1, user_id=07310703370a4f9f8c78fa83b28d3fbf, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:44.589454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:44.698203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4078/8177] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:44 2022] PUT /identity/v3/projects/558417d8507d49f7b1427ee00d54e0d1/users/07310703370a4f9f8c78fa83b28d3fbf/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:44.792738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8297-c6ae-48a9-935a-5255748f2912 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.793021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8297-c6ae-48a9-935a-5255748f2912 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.793298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8297-c6ae-48a9-935a-5255748f2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.820841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-762a8297-c6ae-48a9-935a-5255748f2912 None None] MFA Rules not processed for user `07310703370a4f9f8c78fa83b28d3fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:44.822038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-762a8297-c6ae-48a9-935a-5255748f2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:44.883429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:44.892682 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4100/8178] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:44.898837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:44.909058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290aa435-e97d-4165-abc0-8deaf56d6dd9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:44.913283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:44.913997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:44.914286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:44.914560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:44.915210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:44.916688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.009566 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4079/8179] 10.222.0.27 () {60 vars in 1299 bytes} [Tue Oct 18 14:18:44 2022] POST /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2 => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:45.013748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8297-c6ae-48a9-935a-5255748f2912 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.022472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8297-c6ae-48a9-935a-5255748f2912 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.026785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.027430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.027714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.028243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/2ac57cede1a24b22a85f04fe4d367cf2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.029935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf, credential_id=2ac57cede1a24b22a85f04fe4d367cf2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.031425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.111387 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4101/8180] 10.222.0.27 () {58 vars in 1380 bytes} [Tue Oct 18 14:18:45 2022] DELETE /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/2ac57cede1a24b22a85f04fe4d367cf2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:45.116975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.126521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f20d-2a38-48c0-937d-6a27dfbf3c43 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.130685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.131327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.131611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.131889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.133153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.134998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.203709 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4080/8181] 10.222.0.27 () {60 vars in 1299 bytes} [Tue Oct 18 14:18:45 2022] POST /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2 => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:45.207951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.217335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ca77c-0cba-45ba-8eaa-81933abc0638 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.221492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.222200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.222484 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.222757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/9cd4123761c544beaa2c12e06b197eba` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.224649 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf, credential_id=9cd4123761c544beaa2c12e06b197eba)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.226083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.317140 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4102/8182] 10.222.0.27 () {58 vars in 1380 bytes} [Tue Oct 18 14:18:45 2022] DELETE /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/9cd4123761c544beaa2c12e06b197eba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:45.321263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.330599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80a4e-50d3-4eb1-abe2-6526832fec62 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.335193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada584ef-8473-4e56-903b-236f33d96c5e tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.335831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada584ef-8473-4e56-903b-236f33d96c5e tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.336113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada584ef-8473-4e56-903b-236f33d96c5e tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.336395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada584ef-8473-4e56-903b-236f33d96c5e tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/9cd4123761c544beaa2c12e06b197eba` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application [None req-ada584ef-8473-4e56-903b-236f33d96c5e tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Could not find credential: ba0802bf634ab3164311108dc9b4a21e9f1d7f775ba361249705d177ba6d80d8.: keystone.exception.CredentialNotFound: Could not find credential: ba0802bf634ab3164311108dc9b4a21e9f1d7f775ba361249705d177ba6d80d8. Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 18 14:18:45.356553 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application with Lock( Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 14:18:45.357605 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._enter() Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.creator() Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application created_value = creator( Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: ba0802bf634ab3164311108dc9b4a21e9f1d7f775ba361249705d177ba6d80d8. Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: ERROR keystone.server.flask.application Oct 18 14:18:45.358655 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4081/8183] 10.222.0.27 () {58 vars in 1377 bytes} [Tue Oct 18 14:18:45 2022] GET /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/9cd4123761c544beaa2c12e06b197eba => generated 148 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 14:18:45.362469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.372564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f7656-bed8-404f-a846-c7e136f90d35 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.376711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.377397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.377677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.377948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.378595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.380078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.455316 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4103/8184] 10.222.0.27 () {60 vars in 1299 bytes} [Tue Oct 18 14:18:45 2022] POST /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2 => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:45.459032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada584ef-8473-4e56-903b-236f33d96c5e tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.469442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada584ef-8473-4e56-903b-236f33d96c5e tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.473655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.474314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.474604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.474879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.475505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.477500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.523302 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4082/8185] 10.222.0.27 () {60 vars in 1299 bytes} [Tue Oct 18 14:18:45 2022] POST /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2 => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:45.527518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.537029 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6a8b1-0f59-4ee1-96d7-4712fbbd9cca tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.541916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.542579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.542867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.543148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.543733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=07310703370a4f9f8c78fa83b28d3fbf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.545434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.556765 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4104/8186] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Oct 18 14:18:45 2022] GET /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2 => generated 865 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:45.561020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.570406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002672-0a58-4807-85c9-b4dad8f924c9 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.574648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.575289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.575579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.575858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/c9dd7637f808465f9105b1b18276fc38` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.577748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf, credential_id=c9dd7637f808465f9105b1b18276fc38)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.579192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.639788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:45.643785 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4083/8187] 10.222.0.27 () {58 vars in 1380 bytes} [Tue Oct 18 14:18:45 2022] DELETE /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/c9dd7637f808465f9105b1b18276fc38 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:45.648525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.658044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aff87-b1d0-4b4a-a047-b5d5f13f6e4f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.662269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.666292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.666292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.666292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/14ac652f211a4ce0a258d065c641df24` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.666292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf, credential_id=14ac652f211a4ce0a258d065c641df24)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.667418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.745577 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4105/8188] 10.222.0.27 () {58 vars in 1380 bytes} [Tue Oct 18 14:18:45 2022] DELETE /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/14ac652f211a4ce0a258d065c641df24 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:45.750705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.760507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276902-afe5-46a8-a0ea-84f606a91875 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.764811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.765472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.765757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.766034 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.766822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.772460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.843279 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4084/8189] 10.222.0.27 () {60 vars in 1299 bytes} [Tue Oct 18 14:18:45 2022] POST /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2 => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:45.847418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.857397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec19d-a162-49e6-9917-2bd624192fd6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.861608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.862286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.862569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.862842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/527638cf26144cea9782df415fcf46bf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.864778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf, credential_id=527638cf26144cea9782df415fcf46bf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.869993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.869993 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4106/8190] 10.222.0.27 () {58 vars in 1377 bytes} [Tue Oct 18 14:18:45 2022] GET /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/527638cf26144cea9782df415fcf46bf => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:45.873828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:45.883957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e8db9-8ec3-41c5-b0ef-bbebf2d83c42 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:45.888427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688023-6e8a-4301-abfc-187f60b753b6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07310703370a4f9f8c78fa83b28d3fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '558417d8507d49f7b1427ee00d54e0d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:45.889071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688023-6e8a-4301-abfc-187f60b753b6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:45.889358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688023-6e8a-4301-abfc-187f60b753b6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:45.889668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688023-6e8a-4301-abfc-187f60b753b6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/527638cf26144cea9782df415fcf46bf` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:45.891633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3688023-6e8a-4301-abfc-187f60b753b6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=07310703370a4f9f8c78fa83b28d3fbf, credential_id=527638cf26144cea9782df415fcf46bf)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:45.893048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3688023-6e8a-4301-abfc-187f60b753b6 tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:45.994771 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4085/8191] 10.222.0.27 () {58 vars in 1380 bytes} [Tue Oct 18 14:18:45 2022] DELETE /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf/credentials/OS-EC2/527638cf26144cea9782df415fcf46bf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:45.999618 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:46.063504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7e028-58f9-46c4-8d18-f765ec11ab5f tempest-EC2CredentialsTest-2566495 tempest-EC2CredentialsTest-2566495-project] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:46.068280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:46.068918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:46.069201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:46.069474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] PATH_INFO: `/v3/users/07310703370a4f9f8c78fa83b28d3fbf` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:46.070679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07310703370a4f9f8c78fa83b28d3fbf)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:46.072606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:46.371657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07310703370a4f9f8c78fa83b28d3fbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:46.378606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07310703370a4f9f8c78fa83b28d3fbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:46.379326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07310703370a4f9f8c78fa83b28d3fbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:46.391824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07310703370a4f9f8c78fa83b28d3fbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:46.471806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07310703370a4f9f8c78fa83b28d3fbf'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:46.478867 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4107/8192] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:45 2022] DELETE /identity/v3/users/07310703370a4f9f8c78fa83b28d3fbf => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:46.487668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:46.487959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:46.488239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:46.507157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:46.508360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:46.567798 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4086/8193] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:46.577669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:46.579117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:46.584508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:46.638275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912e082-721d-42ae-952e-3da599521061 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:46.641824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d2f9e-aec1-4706-b16f-bfd82896ae26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:46.642457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d2f9e-aec1-4706-b16f-bfd82896ae26 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:46.642735 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d2f9e-aec1-4706-b16f-bfd82896ae26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:46.643022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d2f9e-aec1-4706-b16f-bfd82896ae26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:46.652877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d2f9e-aec1-4706-b16f-bfd82896ae26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:46.656246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d2f9e-aec1-4706-b16f-bfd82896ae26 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:46.664228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4108/8194] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:47.119006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:47.120586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:47.133026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e366f43-6a46-4d51-b48c-348265f1123b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:47.137833 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:47.138505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.138784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.139053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] PATH_INFO: `/v3/projects/558417d8507d49f7b1427ee00d54e0d1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.140162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=558417d8507d49f7b1427ee00d54e0d1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:47.142074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:47.255275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558417d8507d49f7b1427ee00d54e0d1', 'request_id': 'req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:47.262389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558417d8507d49f7b1427ee00d54e0d1', 'request_id': 'req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:47.342927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558417d8507d49f7b1427ee00d54e0d1', 'request_id': 'req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:47.353722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] The token cache is being invalidate because project 558417d8507d49f7b1427ee00d54e0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:47.354011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:47.354667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-0ee14a71-3308-4885-be4f-fcfb8e31c0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:47.356161 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4087/8195] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:47 2022] DELETE /identity/v3/projects/558417d8507d49f7b1427ee00d54e0d1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:47.361991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25b3f-9a0d-42b2-b3a6-9c7c49896889 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.362483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25b3f-9a0d-42b2-b3a6-9c7c49896889 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.362607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25b3f-9a0d-42b2-b3a6-9c7c49896889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.382931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-48a25b3f-9a0d-42b2-b3a6-9c7c49896889 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:47.384137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-48a25b3f-9a0d-42b2-b3a6-9c7c49896889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:47.442905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4109/8196] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:47.451370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65542e87-2ac0-400f-9af7-153847e48dbb None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.451661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65542e87-2ac0-400f-9af7-153847e48dbb None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.451939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65542e87-2ac0-400f-9af7-153847e48dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.472050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-65542e87-2ac0-400f-9af7-153847e48dbb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:47.473256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-65542e87-2ac0-400f-9af7-153847e48dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:47.481344 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4088/8197] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:47.485559 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a25b3f-9a0d-42b2-b3a6-9c7c49896889 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:47.495837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a25b3f-9a0d-42b2-b3a6-9c7c49896889 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:47.500528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:47.501128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.501413 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.501689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.502407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:47.502710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:47.504333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:47.516667 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4110/8198] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:47.520729 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65542e87-2ac0-400f-9af7-153847e48dbb None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:47.530122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65542e87-2ac0-400f-9af7-153847e48dbb None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:47.534882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:47.538722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.538722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.538722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.538722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:47.539132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:47.625478 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4089/8199] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:47 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:47.629482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:47.639733 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ccf47-9900-4b00-8a11-68fc2bf42248 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:47.696091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:47.696626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.696910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.697184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.697802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:47.699760 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:47.811910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4111/8200] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:47 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:47.815895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:47.826376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce568f59-c45f-4b01-9cdc-b53af4f2fe79 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:47.830919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:47.833027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.833027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.833027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.833027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:47.834238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:47.843950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4090/8201] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:47.847965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:47.858487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba3690-5c3c-44ad-8dba-6f0e6075db3c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:47.863132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:47.863779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:47.864062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:47.864340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] PATH_INFO: `/v3/projects/c10582d887914fabaf6be286e02b5d08/users/7132e34e23bb4edc83b4e9745501e2da/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:47.879874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10582d887914fabaf6be286e02b5d08, user_id=7132e34e23bb4edc83b4e9745501e2da, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:47.883162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:47.986849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:47.992411 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4112/8202] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:47 2022] PUT /identity/v3/projects/c10582d887914fabaf6be286e02b5d08/users/7132e34e23bb4edc83b4e9745501e2da/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:47.996402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.006298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4caec-257f-4dcc-aa14-07b5535d3504 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.018637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:48.064208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706761-dfa6-49d3-b1a9-986069feb8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.064819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706761-dfa6-49d3-b1a9-986069feb8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.065103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706761-dfa6-49d3-b1a9-986069feb8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.065378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706761-dfa6-49d3-b1a9-986069feb8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.066017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79706761-dfa6-49d3-b1a9-986069feb8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:48.067689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79706761-dfa6-49d3-b1a9-986069feb8f2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:48.077631 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4091/8203] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:48.081830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.093222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cef4c-07e0-491e-9b81-32f014149449 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.099404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.099404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.099404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.099404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] PATH_INFO: `/v3/projects/c10582d887914fabaf6be286e02b5d08/users/7132e34e23bb4edc83b4e9745501e2da/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.101773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10582d887914fabaf6be286e02b5d08, user_id=7132e34e23bb4edc83b4e9745501e2da, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:48.104533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:48.114883 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4113/8204] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:48 2022] PUT /identity/v3/projects/c10582d887914fabaf6be286e02b5d08/users/7132e34e23bb4edc83b4e9745501e2da/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:48.125135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9912a31-019d-4405-900d-7c52e9523ae2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.125648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9912a31-019d-4405-900d-7c52e9523ae2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.125758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9912a31-019d-4405-900d-7c52e9523ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.156142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f9912a31-019d-4405-900d-7c52e9523ae2 None None] MFA Rules not processed for user `7132e34e23bb4edc83b4e9745501e2da`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:48.157469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9912a31-019d-4405-900d-7c52e9523ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:48.224826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4092/8205] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:48.229823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.291980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7428a-08ee-478e-b9e0-c22eaaaf038d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.296654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.297253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.297533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.297809 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.298468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:48.300370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:48.378251 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4114/8206] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:48 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:48.382812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9912a31-019d-4405-900d-7c52e9523ae2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.393526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9912a31-019d-4405-900d-7c52e9523ae2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.450022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.450672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.450957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.451233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.451881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:48.453844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:48.541542 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4093/8207] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:48 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:48.544897 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.555759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081d228-d2bf-405e-a8f9-18b6600b4691 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.560426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.561033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.561314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.561594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.562278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:48.563943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:48.575086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4115/8208] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:48.578998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.589534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317b486-1e06-495b-83d6-9e9b1af5aa44 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.594211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edb12d-cf20-4551-b01e-2311b83cd207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.594813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb12d-cf20-4551-b01e-2311b83cd207 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.595095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb12d-cf20-4551-b01e-2311b83cd207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.595370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb12d-cf20-4551-b01e-2311b83cd207 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.596010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edb12d-cf20-4551-b01e-2311b83cd207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:48.597578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edb12d-cf20-4551-b01e-2311b83cd207 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:48.607461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4094/8209] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:48.611531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.621610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4db2b2-39be-4c70-b6fe-6a2fe6495dc6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.626233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e14b3-c8cd-4527-aec3-adfe575ac3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.626883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e14b3-c8cd-4527-aec3-adfe575ac3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.627160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e14b3-c8cd-4527-aec3-adfe575ac3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.627433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e14b3-c8cd-4527-aec3-adfe575ac3e5 admin admin] PATH_INFO: `/v3/projects/0a94c819b0c849608fa115fc89c06e06/users/c11abadee6c24d5face8da8c5b22f2a1/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.642436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e14b3-c8cd-4527-aec3-adfe575ac3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a94c819b0c849608fa115fc89c06e06, user_id=c11abadee6c24d5face8da8c5b22f2a1, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:48.645073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e14b3-c8cd-4527-aec3-adfe575ac3e5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:48.710914 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4116/8210] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:48 2022] PUT /identity/v3/projects/0a94c819b0c849608fa115fc89c06e06/users/c11abadee6c24d5face8da8c5b22f2a1/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:48.722549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dffd8-224c-4675-a2fa-8a3c63319425 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.722862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dffd8-224c-4675-a2fa-8a3c63319425 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.723139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dffd8-224c-4675-a2fa-8a3c63319425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.751586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5a2dffd8-224c-4675-a2fa-8a3c63319425 None None] MFA Rules not processed for user `c11abadee6c24d5face8da8c5b22f2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:48.752806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5a2dffd8-224c-4675-a2fa-8a3c63319425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:48.756797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:48.817181 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4095/8211] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:48.829030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ce80-fdc3-4fd7-8b35-f6f7af2528d3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.829322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ce80-fdc3-4fd7-8b35-f6f7af2528d3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.829601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ce80-fdc3-4fd7-8b35-f6f7af2528d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:48.890584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-41d0ce80-fdc3-4fd7-8b35-f6f7af2528d3 None None] MFA Rules not processed for user `562e50f34bb54c68b428d077efeaca70`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:48.891794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-41d0ce80-fdc3-4fd7-8b35-f6f7af2528d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:48.955556 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4117/8212] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Oct 18 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:48.961953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dffd8-224c-4675-a2fa-8a3c63319425 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:48.972106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dffd8-224c-4675-a2fa-8a3c63319425 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:48.975882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a670c-681e-4377-8173-fe4986b1b76a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:48.976483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a670c-681e-4377-8173-fe4986b1b76a service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:48.976768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a670c-681e-4377-8173-fe4986b1b76a service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:48.977044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a670c-681e-4377-8173-fe4986b1b76a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:49.037731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a670c-681e-4377-8173-fe4986b1b76a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:49.039728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a670c-681e-4377-8173-fe4986b1b76a service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:49.049134 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4096/8213] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:50.760848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ce80-fdc3-4fd7-8b35-f6f7af2528d3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:50.766308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:50.824937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ce80-fdc3-4fd7-8b35-f6f7af2528d3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:50.829580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:50.830305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:50.830612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:50.830906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] PATH_INFO: `/v3/users/7132e34e23bb4edc83b4e9745501e2da` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:50.832042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7132e34e23bb4edc83b4e9745501e2da)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:50.833953 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:51.011280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7132e34e23bb4edc83b4e9745501e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.018328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7132e34e23bb4edc83b4e9745501e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.018992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7132e34e23bb4edc83b4e9745501e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.031452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7132e34e23bb4edc83b4e9745501e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.102739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7132e34e23bb4edc83b4e9745501e2da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.108768 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4118/8214] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:50 2022] DELETE /identity/v3/users/7132e34e23bb4edc83b4e9745501e2da => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:51.113283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:51.113774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:51.113870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:51.132767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:51.133967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:51.193698 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4097/8215] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:51.203377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:51.204756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:51.262626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51260-7a8d-4495-be16-ce6fd3cc4130 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:51.266209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:51.266818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:51.267100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:51.267372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:51.276856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:51.278324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:51.287646 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4119/8216] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:18:51.727241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:51.728676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:51.742311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ae782-c51a-431a-bbeb-e6e1474f8cb1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:51.747015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:51.747699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:51.747980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:51.748255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] PATH_INFO: `/v3/projects/c10582d887914fabaf6be286e02b5d08` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:51.750423 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10582d887914fabaf6be286e02b5d08)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:51.752377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:51.842440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:51.851665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10582d887914fabaf6be286e02b5d08', 'request_id': 'req-38ea749e-f6e0-436b-aabc-8465ed6c7656'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.857746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10582d887914fabaf6be286e02b5d08', 'request_id': 'req-38ea749e-f6e0-436b-aabc-8465ed6c7656'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.925312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10582d887914fabaf6be286e02b5d08', 'request_id': 'req-38ea749e-f6e0-436b-aabc-8465ed6c7656'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.936467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] The token cache is being invalidate because project c10582d887914fabaf6be286e02b5d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:51.936783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.937411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:51.938973 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4098/8217] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:51 2022] DELETE /identity/v3/projects/c10582d887914fabaf6be286e02b5d08 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:18:51.943149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:51.955194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90fceb-fbb3-4eb1-b062-b112d2e99554 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:51.975191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:52.012102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:52.012734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:52.013019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:52.013300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] PATH_INFO: `/v3/users/c11abadee6c24d5face8da8c5b22f2a1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:52.014451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11abadee6c24d5face8da8c5b22f2a1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:52.016375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:52.219090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11abadee6c24d5face8da8c5b22f2a1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:52.226079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11abadee6c24d5face8da8c5b22f2a1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:52.227262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11abadee6c24d5face8da8c5b22f2a1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:52.239118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11abadee6c24d5face8da8c5b22f2a1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:52.325625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-c7a14ba5-c8dc-40b8-bc33-da7467fbfe34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11abadee6c24d5face8da8c5b22f2a1'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:52.331805 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4120/8218] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:18:51 2022] DELETE /identity/v3/users/c11abadee6c24d5face8da8c5b22f2a1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:52.801082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:52.802596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:52.818628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea749e-f6e0-436b-aabc-8465ed6c7656 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:52.876511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:52.877171 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:52.877447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:52.877717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] PATH_INFO: `/v3/projects/0a94c819b0c849608fa115fc89c06e06` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:52.878854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a94c819b0c849608fa115fc89c06e06)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:52.880823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:53.043631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a94c819b0c849608fa115fc89c06e06', 'request_id': 'req-52abe543-4dae-46c0-ac88-1033b6591e0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:53.053811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a94c819b0c849608fa115fc89c06e06', 'request_id': 'req-52abe543-4dae-46c0-ac88-1033b6591e0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:53.125535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a94c819b0c849608fa115fc89c06e06', 'request_id': 'req-52abe543-4dae-46c0-ac88-1033b6591e0b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:53.137126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] The token cache is being invalidate because project 0a94c819b0c849608fa115fc89c06e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:18:53.137413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:53.138031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-52abe543-4dae-46c0-ac88-1033b6591e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:18:53.139553 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4099/8219] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:18:52 2022] DELETE /identity/v3/projects/0a94c819b0c849608fa115fc89c06e06 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:53.144601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9147ce-d409-41f4-bb15-39d74f53d3f3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.145054 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9147ce-d409-41f4-bb15-39d74f53d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.145137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9147ce-d409-41f4-bb15-39d74f53d3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.165708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a9147ce-d409-41f4-bb15-39d74f53d3f3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:53.166948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a9147ce-d409-41f4-bb15-39d74f53d3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:53.225031 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4121/8220] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:53.233338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53595d-df4a-4821-b5cd-719aabf7cc49 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.233632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53595d-df4a-4821-b5cd-719aabf7cc49 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.233915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53595d-df4a-4821-b5cd-719aabf7cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.253546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4d53595d-df4a-4821-b5cd-719aabf7cc49 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:53.254808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d53595d-df4a-4821-b5cd-719aabf7cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:53.263125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4100/8221] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:53.267236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9147ce-d409-41f4-bb15-39d74f53d3f3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:53.277483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9147ce-d409-41f4-bb15-39d74f53d3f3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:53.282223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:53.282855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.283148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.283406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.284046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:18:53.284373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:53.285984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:53.301736 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4122/8222] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:18:53.302883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53595d-df4a-4821-b5cd-719aabf7cc49 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:53.315883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53595d-df4a-4821-b5cd-719aabf7cc49 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:53.320621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:53.321267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.321549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.321826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.322544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:53.324451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:53.417102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4101/8223] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:18:53 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:18:53.421158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:53.431155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbfb99-5b5e-4011-8738-f7793e236c8a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:53.460026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:53.489628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:53.490288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.490600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.490879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.491506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:53.493473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:53.611779 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4123/8224] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:18:53 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:18:53.615821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:53.625970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295bba0-0cad-4ec3-8714-779e4a983a42 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:53.630674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:53.631275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.631554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.631842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.632476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:53.634868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:53.644695 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4102/8225] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:53.649956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:53.659270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586051c-c3c6-44ff-88b8-eb0def951b88 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:53.663975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d310f6-35cc-4be0-b552-4921c9a6a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:53.664581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d310f6-35cc-4be0-b552-4921c9a6a47a admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.664864 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d310f6-35cc-4be0-b552-4921c9a6a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.665140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d310f6-35cc-4be0-b552-4921c9a6a47a admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.665855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d310f6-35cc-4be0-b552-4921c9a6a47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:53.667560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d310f6-35cc-4be0-b552-4921c9a6a47a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:53.677567 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4124/8226] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:18:53.681513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:53.691524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c11665-e6e5-447c-b3dc-716101aff0d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:53.697072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1848d-bd89-465e-95fc-4f05e235417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:53.697716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1848d-bd89-465e-95fc-4f05e235417b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.697996 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1848d-bd89-465e-95fc-4f05e235417b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.698312 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1848d-bd89-465e-95fc-4f05e235417b admin admin] PATH_INFO: `/v3/projects/b31baa2f1dd5404886b2044feaaf834d/users/5fa80ad9d93c41ac9f58bc3a217eb670/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.709278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:53.714129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1848d-bd89-465e-95fc-4f05e235417b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31baa2f1dd5404886b2044feaaf834d, user_id=5fa80ad9d93c41ac9f58bc3a217eb670, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:53.716756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1848d-bd89-465e-95fc-4f05e235417b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:53.780145 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4103/8227] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:18:53 2022] PUT /identity/v3/projects/b31baa2f1dd5404886b2044feaaf834d/users/5fa80ad9d93c41ac9f58bc3a217eb670/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:18:53.790778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4e84-752b-4e7a-a9b5-9540f23d6cc4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.791064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4e84-752b-4e7a-a9b5-9540f23d6cc4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.791345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4e84-752b-4e7a-a9b5-9540f23d6cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.821201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d72f4e84-752b-4e7a-a9b5-9540f23d6cc4 None None] MFA Rules not processed for user `5fa80ad9d93c41ac9f58bc3a217eb670`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:53.822451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d72f4e84-752b-4e7a-a9b5-9540f23d6cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:53.887112 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4125/8228] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:53.905681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463933ee-4ae8-464f-b1b9-b3484edeaec4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:53.906125 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463933ee-4ae8-464f-b1b9-b3484edeaec4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:53.906252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463933ee-4ae8-464f-b1b9-b3484edeaec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:53.926070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-463933ee-4ae8-464f-b1b9-b3484edeaec4 None None] MFA Rules not processed for user `562e50f34bb54c68b428d077efeaca70`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:53.927282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-463933ee-4ae8-464f-b1b9-b3484edeaec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:53.979826 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4104/8229] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Oct 18 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:53.986248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4e84-752b-4e7a-a9b5-9540f23d6cc4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:53.996240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4e84-752b-4e7a-a9b5-9540f23d6cc4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:53.999858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc0ed-8880-457d-9745-71e80e9dcf31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:54.000453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc0ed-8880-457d-9745-71e80e9dcf31 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:54.000732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc0ed-8880-457d-9745-71e80e9dcf31 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:54.001002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc0ed-8880-457d-9745-71e80e9dcf31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:54.010320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fc0ed-8880-457d-9745-71e80e9dcf31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:54.011900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fc0ed-8880-457d-9745-71e80e9dcf31 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:54.020803 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4126/8230] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:18:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:18:54.381669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6f66b-a42a-494f-b50a-c3cf263e5512 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:54.381958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6f66b-a42a-494f-b50a-c3cf263e5512 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:54.382289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6f66b-a42a-494f-b50a-c3cf263e5512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:54.432626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1ba6f66b-a42a-494f-b50a-c3cf263e5512 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:54.433824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ba6f66b-a42a-494f-b50a-c3cf263e5512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:54.497190 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4105/8231] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:54.643457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bea13-a71e-4a63-9260-63d5cfe82af5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:54.643879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bea13-a71e-4a63-9260-63d5cfe82af5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:54.644009 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bea13-a71e-4a63-9260-63d5cfe82af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:54.692852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a40bea13-a71e-4a63-9260-63d5cfe82af5 None None] MFA Rules not processed for user `025cbd75396f4aa09e2fc5c6c77be077`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:54.694037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a40bea13-a71e-4a63-9260-63d5cfe82af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:54.745798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:54.765086 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4127/8232] 10.222.0.27 () {58 vars in 1040 bytes} [Tue Oct 18 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:54.771249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6f66b-a42a-494f-b50a-c3cf263e5512 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:54.783469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6f66b-a42a-494f-b50a-c3cf263e5512 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:54.788573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:54.789742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:54.790023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:54.790322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:54.798599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:54.800182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:54.808554 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4106/8233] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:18:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:18:55.467913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fcd38-5c2d-46e2-8d72-6d710aa08017 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:55.468198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fcd38-5c2d-46e2-8d72-6d710aa08017 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:55.468473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fcd38-5c2d-46e2-8d72-6d710aa08017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:55.487842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-980fcd38-5c2d-46e2-8d72-6d710aa08017 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:55.489027 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-980fcd38-5c2d-46e2-8d72-6d710aa08017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:55.496775 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4128/8234] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:55.509158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:55.519844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f6ba-23c4-47e7-843a-692146b7c5e6 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:55.524877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:55.525470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:55.525753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:55.526030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:55.534148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:55.535713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:55.543609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4107/8235] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 14:18:56.307861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868956-12ed-44f6-8c11-846ea6f4595b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:56.308345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868956-12ed-44f6-8c11-846ea6f4595b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:56.308444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868956-12ed-44f6-8c11-846ea6f4595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:56.327811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ed868956-12ed-44f6-8c11-846ea6f4595b None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:56.328985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed868956-12ed-44f6-8c11-846ea6f4595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:56.336373 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4129/8236] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:18:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:56.348145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:56.358962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533fd91-4518-4e6b-a1f6-62f8152dc035 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:56.364026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:56.364657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:56.365059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:56.365344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:56.373834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:56.375422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:56.383965 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4108/8237] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:18:57.116753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0abd29-a78b-4eb9-a964-e8872015acf6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:57.117122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0abd29-a78b-4eb9-a964-e8872015acf6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:57.117450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0abd29-a78b-4eb9-a964-e8872015acf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:57.136744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-da0abd29-a78b-4eb9-a964-e8872015acf6 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:57.137930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-da0abd29-a78b-4eb9-a964-e8872015acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:57.145065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4130/8238] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:57.157603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:57.168440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c3bcf-8cce-4172-b90d-53a98a113537 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:57.173398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:57.173993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:57.174297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:57.174567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:57.182369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:57.183922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:57.191734 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4109/8239] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:18:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:18:58.025111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063e34-022e-4869-81ac-b38bcbdcc38c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:58.025558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063e34-022e-4869-81ac-b38bcbdcc38c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:58.025645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063e34-022e-4869-81ac-b38bcbdcc38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:58.045621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-35063e34-022e-4869-81ac-b38bcbdcc38c None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:58.052966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-35063e34-022e-4869-81ac-b38bcbdcc38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:58.054174 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4131/8240] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:18:58.066591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:58.076967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d738f1-6aad-4beb-8e72-3ce6026c1595 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:58.082641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:58.083239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:58.083522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:58.083796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:58.092100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:58.093738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:58.103021 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4110/8241] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:18:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 14:18:58.881392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905f74-905f-45c9-9de3-2879c63e14d7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:58.881673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905f74-905f-45c9-9de3-2879c63e14d7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:58.881950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905f74-905f-45c9-9de3-2879c63e14d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:58.902263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-06905f74-905f-45c9-9de3-2879c63e14d7 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:18:58.903471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-06905f74-905f-45c9-9de3-2879c63e14d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:18:58.910587 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4132/8242] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:18:58.922610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:18:58.929072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:58.932980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c0d61-7ada-4299-9606-3736a5d2fea9 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:18:58.937943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:18:58.938572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:18:58.938848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:18:58.939119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:18:58.947486 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:18:58.949041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:18:58.957160 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4111/8243] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:18:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:19:00.234963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb5d3-cefc-4af7-9b75-7f69163d8b67 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:00.235433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb5d3-cefc-4af7-9b75-7f69163d8b67 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:00.235523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afb5d3-cefc-4af7-9b75-7f69163d8b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:00.255384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-94afb5d3-cefc-4af7-9b75-7f69163d8b67 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:00.256584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-94afb5d3-cefc-4af7-9b75-7f69163d8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:00.267499 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4133/8244] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:00.280350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:00.294500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32595b41-47f5-4c7d-bcf7-91fe5f2aa275 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:00.299770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:00.300605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:00.300891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:00.301216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:00.310451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:00.312024 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:00.320156 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4112/8245] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:19:00.825282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2b42-cc1c-494f-a916-893c97052fbe None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:00.825576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2b42-cc1c-494f-a916-893c97052fbe None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:00.825854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a2b42-cc1c-494f-a916-893c97052fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:00.848175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-eb9a2b42-cc1c-494f-a916-893c97052fbe None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:00.848175 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eb9a2b42-cc1c-494f-a916-893c97052fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:00.855352 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4134/8246] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:00.867434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:00.900639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b5ea-23ad-4988-888e-c6bb3cc469ac service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:00.905758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:00.906404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:00.906693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:00.906970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:00.915697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:00.917269 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:00.925284 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4113/8247] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:19:01.337431 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bc600-91db-4e89-8d02-0b1d82a0811b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:01.337916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bc600-91db-4e89-8d02-0b1d82a0811b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:01.338018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bc600-91db-4e89-8d02-0b1d82a0811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:01.358354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e76bc600-91db-4e89-8d02-0b1d82a0811b None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:01.359690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e76bc600-91db-4e89-8d02-0b1d82a0811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:01.366728 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4135/8248] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:01.379952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:01.391095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9935b8-38e2-4f59-bf14-53c214ca37b4 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:01.396079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:01.396668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:01.396948 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:01.397220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:01.405037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:01.406634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:01.414427 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4114/8249] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:19:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:19:01.873884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e50b-27c3-433a-afba-ae7210051c9b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:01.874213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e50b-27c3-433a-afba-ae7210051c9b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:01.874513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e50b-27c3-433a-afba-ae7210051c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:01.893727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8d49e50b-27c3-433a-afba-ae7210051c9b None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:01.894948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8d49e50b-27c3-433a-afba-ae7210051c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:01.902146 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4136/8250] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:01.914158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:01.925359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfbcc-0c7f-473c-b65d-f136c800824e service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:01.931091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:01.931723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:01.932001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:01.932284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:01.940523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:01.942179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:01.950148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4115/8251] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:19:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:19:02.410448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cc5a-bdb1-4b82-9684-a9d0304578e8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:02.410908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cc5a-bdb1-4b82-9684-a9d0304578e8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:02.411010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cc5a-bdb1-4b82-9684-a9d0304578e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:02.430467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-81b4cc5a-bdb1-4b82-9684-a9d0304578e8 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:02.431584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-81b4cc5a-bdb1-4b82-9684-a9d0304578e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:02.438802 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4137/8252] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:02.451122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:02.462202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3156-2fb0-4cd7-a9d8-8d616fdc696a service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:02.467251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:02.467857 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:02.468135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:02.468409 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:02.477612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:02.479196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:02.487489 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4116/8253] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:19:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:19:02.874290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8603fd-384f-40e1-918d-1eca6c957ad3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:02.874604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8603fd-384f-40e1-918d-1eca6c957ad3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:02.874883 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8603fd-384f-40e1-918d-1eca6c957ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:02.895262 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3c8603fd-384f-40e1-918d-1eca6c957ad3 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:02.896479 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3c8603fd-384f-40e1-918d-1eca6c957ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:02.903905 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4138/8254] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:02.916387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:02.926497 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2de969-006a-4be7-b058-aacd3e9e5b2c service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:02.932060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe0de3-222f-4546-864e-1800ccee81a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:02.933393 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0de3-222f-4546-864e-1800ccee81a9 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:02.933750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0de3-222f-4546-864e-1800ccee81a9 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:02.934124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe0de3-222f-4546-864e-1800ccee81a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:02.943075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe0de3-222f-4546-864e-1800ccee81a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:02.944688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe0de3-222f-4546-864e-1800ccee81a9 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:02.953964 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4117/8255] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:19:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:19:03.327727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8603fd-384f-40e1-918d-1eca6c957ad3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:03.391216 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8603fd-384f-40e1-918d-1eca6c957ad3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:03.395749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:03.396382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:03.396671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:03.396950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] PATH_INFO: `/v3/users/5fa80ad9d93c41ac9f58bc3a217eb670` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:03.398281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa80ad9d93c41ac9f58bc3a217eb670)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:03.400055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:03.600807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa80ad9d93c41ac9f58bc3a217eb670'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:03.608469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa80ad9d93c41ac9f58bc3a217eb670'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:03.609134 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa80ad9d93c41ac9f58bc3a217eb670'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:03.622642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa80ad9d93c41ac9f58bc3a217eb670'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:03.624478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:03.682731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa80ad9d93c41ac9f58bc3a217eb670'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:03.688911 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4139/8256] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:03 2022] DELETE /identity/v3/users/5fa80ad9d93c41ac9f58bc3a217eb670 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:03.693465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:03.693944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:03.694042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:03.713727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:03.714990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:03.774912 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4118/8257] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:03.785473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:03.786975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:03.844332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ea7d5-7975-4d29-8df3-6564f61d8f72 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:03.848035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f71e15-ee81-4327-9412-ef13880355bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:03.850592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71e15-ee81-4327-9412-ef13880355bb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:03.850592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71e15-ee81-4327-9412-ef13880355bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:03.850592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71e15-ee81-4327-9412-ef13880355bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:03.858925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f71e15-ee81-4327-9412-ef13880355bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:03.860442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f71e15-ee81-4327-9412-ef13880355bb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:03.869765 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4140/8258] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:04.258335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:04.261094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:04.274798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ab96-00e7-4ca8-8b1a-2160c43b65a9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:04.280314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:04.280962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.281247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.281523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] PATH_INFO: `/v3/projects/b31baa2f1dd5404886b2044feaaf834d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.282690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31baa2f1dd5404886b2044feaaf834d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:04.284606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:04.377095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:04.381020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31baa2f1dd5404886b2044feaaf834d', 'request_id': 'req-a5da7bed-9be1-4996-bbcb-9933945e9bc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:04.387968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31baa2f1dd5404886b2044feaaf834d', 'request_id': 'req-a5da7bed-9be1-4996-bbcb-9933945e9bc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:04.437364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31baa2f1dd5404886b2044feaaf834d', 'request_id': 'req-a5da7bed-9be1-4996-bbcb-9933945e9bc2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:04.449079 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] The token cache is being invalidate because project b31baa2f1dd5404886b2044feaaf834d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:04.449559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:04.450241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-a5da7bed-9be1-4996-bbcb-9933945e9bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:04.452026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4119/8259] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:04 2022] DELETE /identity/v3/projects/b31baa2f1dd5404886b2044feaaf834d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:04.456776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c25bd-08ee-4c72-a67b-6cc9f84e59fc None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.457067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c25bd-08ee-4c72-a67b-6cc9f84e59fc None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.457351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c25bd-08ee-4c72-a67b-6cc9f84e59fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.477651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-479c25bd-08ee-4c72-a67b-6cc9f84e59fc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:04.478877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-479c25bd-08ee-4c72-a67b-6cc9f84e59fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:04.539241 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4141/8260] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:19:04.546766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b878c-3f61-429f-aa39-5d33a83a7d21 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.547058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b878c-3f61-429f-aa39-5d33a83a7d21 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.547367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b878c-3f61-429f-aa39-5d33a83a7d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.567626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dc0b878c-3f61-429f-aa39-5d33a83a7d21 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:04.568831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dc0b878c-3f61-429f-aa39-5d33a83a7d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:04.577466 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4120/8261] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:19:04.581653 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c25bd-08ee-4c72-a67b-6cc9f84e59fc None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:04.591553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c25bd-08ee-4c72-a67b-6cc9f84e59fc None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:04.596386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:04.596985 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.597265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.597538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.598239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:19:04.598540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:04.600130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:04.611658 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4142/8262] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:19:04.615825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b878c-3f61-429f-aa39-5d33a83a7d21 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:04.625664 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b878c-3f61-429f-aa39-5d33a83a7d21 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:04.630349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:04.630947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.631230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.631503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.632138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:04.634026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:04.720579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4121/8263] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:04 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:04.724696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:04.735119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e85a7-d79f-47bc-b212-aafdf89af24b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:04.790527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:04.791063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.791849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.792123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.792744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:04.794687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:04.868040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4143/8264] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:04 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:04.872710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:04.883105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adc3c8-23f8-482b-8ca7-0fc335dd9df8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:04.887976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:04.888584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.888866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.889139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.889779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:04.891395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:04.901236 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4122/8265] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:04.905129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:04.915278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a1c13-ee78-4b03-a3c3-b5bf9e5dfa06 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:04.920398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449e9a9-7ec5-42ff-ab40-ac253ad45ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:04.920986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449e9a9-7ec5-42ff-ab40-ac253ad45ced admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.921267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449e9a9-7ec5-42ff-ab40-ac253ad45ced admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.921536 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449e9a9-7ec5-42ff-ab40-ac253ad45ced admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.922203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449e9a9-7ec5-42ff-ab40-ac253ad45ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:04.923794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449e9a9-7ec5-42ff-ab40-ac253ad45ced admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:04.929190 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:04.935422 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4144/8266] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:04.939677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:04.949764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fbb5-4247-4666-b58e-9ff92bb31cdb admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:04.954434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:04.955085 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:04.955374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:04.955651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] PATH_INFO: `/v3/projects/8443901e3486433da4362ee8d3810212/users/78b5e67cbc254f92aaf6630985d38a93/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:04.970275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8443901e3486433da4362ee8d3810212, user_id=78b5e67cbc254f92aaf6630985d38a93, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:04.972915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:05.054690 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4123/8267] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:04 2022] PUT /identity/v3/projects/8443901e3486433da4362ee8d3810212/users/78b5e67cbc254f92aaf6630985d38a93/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:05.065763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89a720-a1f3-4cdd-a86a-0946ee2d180b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:05.066075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89a720-a1f3-4cdd-a86a-0946ee2d180b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:05.066353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89a720-a1f3-4cdd-a86a-0946ee2d180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:05.096020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-3a89a720-a1f3-4cdd-a86a-0946ee2d180b None None] MFA Rules not processed for user `78b5e67cbc254f92aaf6630985d38a93`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:05.097248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-3a89a720-a1f3-4cdd-a86a-0946ee2d180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:05.163739 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4145/8268] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:05.174817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:05.176522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:05.233043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3556-064d-4d0c-b933-a3aa0bb7cfac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:05.236693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab70df0-eff3-490a-909d-d8df03638fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:05.237297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70df0-eff3-490a-909d-d8df03638fbf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:05.237579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70df0-eff3-490a-909d-d8df03638fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:05.237853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab70df0-eff3-490a-909d-d8df03638fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:05.246608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70df0-eff3-490a-909d-d8df03638fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:05.248039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab70df0-eff3-490a-909d-d8df03638fbf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:05.256926 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4124/8269] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:05.271683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89a720-a1f3-4cdd-a86a-0946ee2d180b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:05.334457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89a720-a1f3-4cdd-a86a-0946ee2d180b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:05.339420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:05.340044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:05.340319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:05.340589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] PATH_INFO: `/v3/users/78b5e67cbc254f92aaf6630985d38a93` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:05.341700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b5e67cbc254f92aaf6630985d38a93)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:05.343638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:05.532793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b5e67cbc254f92aaf6630985d38a93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:05.542461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b5e67cbc254f92aaf6630985d38a93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:05.543199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b5e67cbc254f92aaf6630985d38a93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:05.556327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b5e67cbc254f92aaf6630985d38a93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:05.637074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b5e67cbc254f92aaf6630985d38a93'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:05.643603 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4146/8270] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:05 2022] DELETE /identity/v3/users/78b5e67cbc254f92aaf6630985d38a93 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:05.649350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:05.649350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:05.649350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:05.668279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:05.669876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:05.745083 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4125/8271] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:05.755387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:05.756796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:05.774288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:05.824014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec852751-269f-4322-8750-7c47abb00bea admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:05.827587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4efad-a363-4530-ad04-2b770fb9f855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:05.828200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4efad-a363-4530-ad04-2b770fb9f855 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:05.828475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4efad-a363-4530-ad04-2b770fb9f855 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:05.828748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4efad-a363-4530-ad04-2b770fb9f855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:05.838585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4efad-a363-4530-ad04-2b770fb9f855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:05.840021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4efad-a363-4530-ad04-2b770fb9f855 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:05.849633 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4147/8272] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:06.281960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:06.283426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:06.295819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f3c7-f78b-4b98-9ff1-508e43ea9843 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:06.300516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:06.301162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.301439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.301710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] PATH_INFO: `/v3/projects/8443901e3486433da4362ee8d3810212` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.302879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8443901e3486433da4362ee8d3810212)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:06.304962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:06.312227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:06.406551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8443901e3486433da4362ee8d3810212', 'request_id': 'req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:06.414275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8443901e3486433da4362ee8d3810212', 'request_id': 'req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:06.471383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8443901e3486433da4362ee8d3810212', 'request_id': 'req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:06.483937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] The token cache is being invalidate because project 8443901e3486433da4362ee8d3810212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:06.484220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:06.484852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d9198ef6-26ae-4ce4-a3c3-daa42953dcb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:06.486373 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4126/8273] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:06 2022] DELETE /identity/v3/projects/8443901e3486433da4362ee8d3810212 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:06.491372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95d11-fb16-49f3-897c-c3053eda0c83 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.491663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95d11-fb16-49f3-897c-c3053eda0c83 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.491940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f95d11-fb16-49f3-897c-c3053eda0c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.512333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-54f95d11-fb16-49f3-897c-c3053eda0c83 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:06.513534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-54f95d11-fb16-49f3-897c-c3053eda0c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:06.573040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4148/8274] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:06.580968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecb96f-8a41-48f7-b46e-56f748b15172 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.581292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecb96f-8a41-48f7-b46e-56f748b15172 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.581578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecb96f-8a41-48f7-b46e-56f748b15172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.601778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-deecb96f-8a41-48f7-b46e-56f748b15172 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:06.603037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-deecb96f-8a41-48f7-b46e-56f748b15172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:06.611711 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4127/8275] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:06.615933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95d11-fb16-49f3-897c-c3053eda0c83 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:06.625741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f95d11-fb16-49f3-897c-c3053eda0c83 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:06.630372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:06.630971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.631253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.631530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.632176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:19:06.632481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:06.634106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:06.645752 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4149/8276] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:19:06.650129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecb96f-8a41-48f7-b46e-56f748b15172 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:06.659981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecb96f-8a41-48f7-b46e-56f748b15172 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:06.664772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:06.665377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.665662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.665937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.667211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:06.669113 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:06.757909 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4128/8277] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:06 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:06.764063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:06.774209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de04ae-057f-4100-8cde-f8237e7c9d1f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:06.830386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:06.830921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.831198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.831471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.832096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:06.833993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:06.914259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4150/8278] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:06 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:19:06.918965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:06.929421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0dfe5-9a56-4d01-9e4b-bc78d6d1c0d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:06.934089 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:06.940827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.940827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.940827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.940827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:06.940827 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:06.947934 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4129/8279] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:06.951779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:06.961803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07f09c-7a55-4036-a747-48767c0f6ef5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:06.967343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded07073-53fa-43c0-bd31-501c8e5f98bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:06.967943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded07073-53fa-43c0-bd31-501c8e5f98bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:06.968221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded07073-53fa-43c0-bd31-501c8e5f98bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:06.968607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded07073-53fa-43c0-bd31-501c8e5f98bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:06.969246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded07073-53fa-43c0-bd31-501c8e5f98bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:06.970865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded07073-53fa-43c0-bd31-501c8e5f98bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:06.981577 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4151/8280] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:06.985897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:06.995951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274b221-8218-4b40-9a8d-457a145a64b7 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:07.000676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:07.001332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:07.001608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:07.001877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] PATH_INFO: `/v3/projects/28c50c9ebd2b492983c7bbb5e09813c3/users/d580bcb68e1c45b090f49e27545b358b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:07.017261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c50c9ebd2b492983c7bbb5e09813c3, user_id=d580bcb68e1c45b090f49e27545b358b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:07.020004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:07.085488 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4130/8281] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:06 2022] PUT /identity/v3/projects/28c50c9ebd2b492983c7bbb5e09813c3/users/d580bcb68e1c45b090f49e27545b358b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:07.096332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb475-78cb-4e7d-8f1f-5c4200ae9d72 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:07.096652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb475-78cb-4e7d-8f1f-5c4200ae9d72 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:07.096930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccb475-78cb-4e7d-8f1f-5c4200ae9d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:07.128554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-95ccb475-78cb-4e7d-8f1f-5c4200ae9d72 None None] MFA Rules not processed for user `d580bcb68e1c45b090f49e27545b358b`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:07.129766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-95ccb475-78cb-4e7d-8f1f-5c4200ae9d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:07.135611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:07.194746 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4152/8282] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:07.205924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:07.207648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:07.263865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c0783-4a15-4e17-9488-e3e4fea7363a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:07.267554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e9097-ed99-41de-beb0-d5a625205b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:07.268152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e9097-ed99-41de-beb0-d5a625205b76 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:07.268431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e9097-ed99-41de-beb0-d5a625205b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:07.268699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e9097-ed99-41de-beb0-d5a625205b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:07.277653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e9097-ed99-41de-beb0-d5a625205b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:07.279098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e9097-ed99-41de-beb0-d5a625205b76 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:07.287628 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4131/8283] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:07.917685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccb475-78cb-4e7d-8f1f-5c4200ae9d72 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:07.981767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccb475-78cb-4e7d-8f1f-5c4200ae9d72 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:07.986383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:07.987017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:07.987293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:07.987562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] PATH_INFO: `/v3/users/d580bcb68e1c45b090f49e27545b358b` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:07.988666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d580bcb68e1c45b090f49e27545b358b)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:07.990665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:08.191073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd580bcb68e1c45b090f49e27545b358b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:08.198740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd580bcb68e1c45b090f49e27545b358b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:08.199468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd580bcb68e1c45b090f49e27545b358b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:08.212336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd580bcb68e1c45b090f49e27545b358b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:08.277128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd580bcb68e1c45b090f49e27545b358b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:08.283129 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4153/8284] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:07 2022] DELETE /identity/v3/users/d580bcb68e1c45b090f49e27545b358b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:08.287886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:08.288359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:08.290083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:08.307211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:08.308917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:08.337766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:08.367485 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4132/8285] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:08.377716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:08.379131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:08.412526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:08.439712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73e3d-e2d5-4a93-954c-ae8b397465c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:08.443499 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b25a59-b93e-4ba3-947e-b39f7a97b2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:08.444108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b25a59-b93e-4ba3-947e-b39f7a97b2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:08.444390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b25a59-b93e-4ba3-947e-b39f7a97b2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:08.444665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b25a59-b93e-4ba3-947e-b39f7a97b2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:08.457451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b25a59-b93e-4ba3-947e-b39f7a97b2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:08.459142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b25a59-b93e-4ba3-947e-b39f7a97b2a7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:08.471492 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4154/8286] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:08.855283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:08.856760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:08.870685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494cf7a-d650-4fc8-9e88-53a2988e3f5c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:08.875682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:08.876877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:08.877458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:08.877745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] PATH_INFO: `/v3/projects/28c50c9ebd2b492983c7bbb5e09813c3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:08.878997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c50c9ebd2b492983c7bbb5e09813c3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:08.881183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.008703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c50c9ebd2b492983c7bbb5e09813c3', 'request_id': 'req-74607896-4a48-4782-9276-46df621dbfad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:09.015180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c50c9ebd2b492983c7bbb5e09813c3', 'request_id': 'req-74607896-4a48-4782-9276-46df621dbfad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:09.125292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c50c9ebd2b492983c7bbb5e09813c3', 'request_id': 'req-74607896-4a48-4782-9276-46df621dbfad'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:09.139566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] The token cache is being invalidate because project 28c50c9ebd2b492983c7bbb5e09813c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:09.139856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:09.140559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-74607896-4a48-4782-9276-46df621dbfad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:09.142125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4133/8287] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:08 2022] DELETE /identity/v3/projects/28c50c9ebd2b492983c7bbb5e09813c3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:09.146963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173b75-8fe1-4994-b4e1-8063dbddefe7 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.147432 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173b75-8fe1-4994-b4e1-8063dbddefe7 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.147524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59173b75-8fe1-4994-b4e1-8063dbddefe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.167753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59173b75-8fe1-4994-b4e1-8063dbddefe7 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:09.168980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59173b75-8fe1-4994-b4e1-8063dbddefe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:09.226513 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4155/8288] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:09.234407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b7fd2-0c92-47b0-946a-5adf3f4f0b0f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.234694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b7fd2-0c92-47b0-946a-5adf3f4f0b0f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.234971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b7fd2-0c92-47b0-946a-5adf3f4f0b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.254506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-197b7fd2-0c92-47b0-946a-5adf3f4f0b0f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:09.255703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-197b7fd2-0c92-47b0-946a-5adf3f4f0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:09.264674 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4134/8289] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:09.268685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173b75-8fe1-4994-b4e1-8063dbddefe7 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:09.278960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59173b75-8fe1-4994-b4e1-8063dbddefe7 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:09.283542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:09.284140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.284419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.284691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.285325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:19:09.285625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:09.287247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.298626 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4156/8290] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:19:09.303010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b7fd2-0c92-47b0-946a-5adf3f4f0b0f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:09.312229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b7fd2-0c92-47b0-946a-5adf3f4f0b0f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:09.316870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:09.317467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.317754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.318027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.318724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:09.320610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.400435 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4135/8291] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:09 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:19:09.405032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:09.414913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90db5fb-7a3a-45a8-82c0-7ad1789fb8f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:09.471826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:09.472438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.472715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.472987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.473609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:09.475551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.560221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4157/8292] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:09 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:09.564367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:09.575502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df1065-3a07-4af2-84cd-2ee0a7128ec2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:09.580286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:09.580924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.581210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.581488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.582168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:09.583760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.593801 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4136/8293] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:09.597848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:09.608293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f00519-66cf-419c-bb5f-7028e3dc6b78 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:09.612998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa29fba-69ab-4daf-b0ee-bfc3e054eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:09.613599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa29fba-69ab-4daf-b0ee-bfc3e054eafe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.613885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa29fba-69ab-4daf-b0ee-bfc3e054eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.614209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa29fba-69ab-4daf-b0ee-bfc3e054eafe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.614861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa29fba-69ab-4daf-b0ee-bfc3e054eafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:09.616458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa29fba-69ab-4daf-b0ee-bfc3e054eafe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.627776 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4158/8294] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:09.632068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:09.643064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907aa8-89c4-4d06-bf40-02c7f121b504 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:09.647854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:09.649186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.649186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.649186 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] PATH_INFO: `/v3/projects/36530adfe0554855a6daa8e987f63fa0/users/11908dfa381742a48706f654083744e7/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.663686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36530adfe0554855a6daa8e987f63fa0, user_id=11908dfa381742a48706f654083744e7, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:09.666321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.745500 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4137/8295] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:09 2022] PUT /identity/v3/projects/36530adfe0554855a6daa8e987f63fa0/users/11908dfa381742a48706f654083744e7/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:09.751235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea68f-4d7c-498b-9cd4-c6eccdd1ded0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.752982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea68f-4d7c-498b-9cd4-c6eccdd1ded0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.752982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea68f-4d7c-498b-9cd4-c6eccdd1ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.771784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-065ea68f-4d7c-498b-9cd4-c6eccdd1ded0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:09.773055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-065ea68f-4d7c-498b-9cd4-c6eccdd1ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:09.802635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:09.831220 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4159/8296] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:09.841710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:09.843614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:09.900983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7958b-36c9-47ac-b294-c1e05a944162 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:09.904811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:09.905440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:09.905707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:09.905981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:09.913035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:09.915468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:09.916838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:09.927070 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4138/8297] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:11.175808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f856c2-c5b1-4f8d-8fc7-392c41097496 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:11.176343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f856c2-c5b1-4f8d-8fc7-392c41097496 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:11.176343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f856c2-c5b1-4f8d-8fc7-392c41097496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:11.205402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e3f856c2-c5b1-4f8d-8fc7-392c41097496 None None] MFA Rules not processed for user `11908dfa381742a48706f654083744e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:11.206659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e3f856c2-c5b1-4f8d-8fc7-392c41097496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:11.274463 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4160/8298] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:11.279813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:11.289501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c909e94-b943-4a12-ab29-059651a2b296 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:11.294458 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:11.295033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:11.295311 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:11.295579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:11.296226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:11.298162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:11.381715 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4139/8299] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:11 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:11.386742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f856c2-c5b1-4f8d-8fc7-392c41097496 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:11.397318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f856c2-c5b1-4f8d-8fc7-392c41097496 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:11.453936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:11.454572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:11.454859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:11.455230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:11.455750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:11.457722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:11.555788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4161/8300] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:11 2022] POST /identity/v3/users => generated 309 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:11.557760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:11.568296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858e60-82f8-4033-837d-c47dfebbdd32 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:11.572927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:11.573534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:11.575124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:11.575355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:11.576040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:11.577679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:11.588920 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4140/8301] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:11.593794 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:11.603929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd74a76-39d3-44b5-a9fa-a22f420a6409 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:11.608483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:11.609136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:11.609419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:11.609692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] PATH_INFO: `/v3/projects/00d0ad90ecc043ebb2f6bfa71f79b8e4/users/bd856feff986489bac2fb6dcc241cfb3/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:11.624557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d0ad90ecc043ebb2f6bfa71f79b8e4, user_id=bd856feff986489bac2fb6dcc241cfb3, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:11.627277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:11.734382 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4162/8302] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:11 2022] PUT /identity/v3/projects/00d0ad90ecc043ebb2f6bfa71f79b8e4/users/bd856feff986489bac2fb6dcc241cfb3/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:11.738398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:11.749597 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795fff7-5358-47f5-ae29-3efae2351fe0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:11.806004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4f0d8-24a0-404d-8e33-c8bc3367ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:11.806568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4f0d8-24a0-404d-8e33-c8bc3367ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:11.806848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4f0d8-24a0-404d-8e33-c8bc3367ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:11.807120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4f0d8-24a0-404d-8e33-c8bc3367ecdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:11.807750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4f0d8-24a0-404d-8e33-c8bc3367ecdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:11.809834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4f0d8-24a0-404d-8e33-c8bc3367ecdf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:11.819458 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4141/8303] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:11.824250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:11.834384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab0082-8416-46c4-b37a-6755474de824 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:11.838960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:11.839707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:11.839982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:11.840250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] PATH_INFO: `/v3/projects/00d0ad90ecc043ebb2f6bfa71f79b8e4/users/bd856feff986489bac2fb6dcc241cfb3/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:11.842173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d0ad90ecc043ebb2f6bfa71f79b8e4, user_id=bd856feff986489bac2fb6dcc241cfb3, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:11.845000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:11.855487 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4163/8304] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:11 2022] PUT /identity/v3/projects/00d0ad90ecc043ebb2f6bfa71f79b8e4/users/bd856feff986489bac2fb6dcc241cfb3/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:13.132000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be5ae9-32cb-4600-890a-571dff69d8c7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:13.132495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be5ae9-32cb-4600-890a-571dff69d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:13.132614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be5ae9-32cb-4600-890a-571dff69d8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:13.168752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-50be5ae9-32cb-4600-890a-571dff69d8c7 None None] MFA Rules not processed for user `bd856feff986489bac2fb6dcc241cfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:13.170028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-50be5ae9-32cb-4600-890a-571dff69d8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:13.237641 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4142/8305] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:13.744795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:13.747236 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:13.768667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:13.832549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dcff2-b21b-4a35-8142-5f21b83902c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:13.837783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:13.838434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:13.838754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:13.839082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:13.841503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:13.855623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:13.857244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:13.878151 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4164/8306] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:14.530882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be5ae9-32cb-4600-890a-571dff69d8c7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:14.577421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:14.593696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be5ae9-32cb-4600-890a-571dff69d8c7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:14.598248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:14.598877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:14.599155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:14.599425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] PATH_INFO: `/v3/users/11908dfa381742a48706f654083744e7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:14.600531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11908dfa381742a48706f654083744e7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:14.602564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:14.767745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11908dfa381742a48706f654083744e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:14.768340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11908dfa381742a48706f654083744e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:14.831324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11908dfa381742a48706f654083744e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:14.832078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11908dfa381742a48706f654083744e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:14.839924 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11908dfa381742a48706f654083744e7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:14.857658 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4143/8307] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:14 2022] DELETE /identity/v3/users/11908dfa381742a48706f654083744e7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:15.081133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:15.091696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5104-53f4-4089-b549-19d846dcb28a service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:15.149379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:15.150043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:15.150333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:15.150613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] PATH_INFO: `/v3/projects/36530adfe0554855a6daa8e987f63fa0` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:15.151797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36530adfe0554855a6daa8e987f63fa0)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:15.153756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:15.257265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36530adfe0554855a6daa8e987f63fa0', 'request_id': 'req-bf341eda-7749-4f4e-98ab-9e48f66306c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.263750 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36530adfe0554855a6daa8e987f63fa0', 'request_id': 'req-bf341eda-7749-4f4e-98ab-9e48f66306c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.324930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36530adfe0554855a6daa8e987f63fa0', 'request_id': 'req-bf341eda-7749-4f4e-98ab-9e48f66306c6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.336077 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] The token cache is being invalidate because project 36530adfe0554855a6daa8e987f63fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:15.336371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.337005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.338619 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4165/8308] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:15 2022] DELETE /identity/v3/projects/36530adfe0554855a6daa8e987f63fa0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:15.342667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:15.344195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:15.357879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a8f0-d1d8-43aa-8391-9ec4fa17ddd1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:15.413900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:15.414560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:15.414846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:15.415127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] PATH_INFO: `/v3/users/bd856feff986489bac2fb6dcc241cfb3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:15.416273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd856feff986489bac2fb6dcc241cfb3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:15.418749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:15.587590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd856feff986489bac2fb6dcc241cfb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.588249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd856feff986489bac2fb6dcc241cfb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.645046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd856feff986489bac2fb6dcc241cfb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.645673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd856feff986489bac2fb6dcc241cfb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.653601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9a129851-e5b1-4ee2-b2a4-cf5d49965a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd856feff986489bac2fb6dcc241cfb3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:15.655528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:15.671863 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4144/8309] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:15 2022] DELETE /identity/v3/users/bd856feff986489bac2fb6dcc241cfb3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:16.238813 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:16.240275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:16.255211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf341eda-7749-4f4e-98ab-9e48f66306c6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:16.284107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:16.313736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:16.314418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:16.314700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:16.314973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] PATH_INFO: `/v3/projects/00d0ad90ecc043ebb2f6bfa71f79b8e4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:16.316076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d0ad90ecc043ebb2f6bfa71f79b8e4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:16.317983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:16.427306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d0ad90ecc043ebb2f6bfa71f79b8e4', 'request_id': 'req-5bc9c17f-0fed-49f7-938a-192654f95ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:16.433488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d0ad90ecc043ebb2f6bfa71f79b8e4', 'request_id': 'req-5bc9c17f-0fed-49f7-938a-192654f95ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:16.502292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d0ad90ecc043ebb2f6bfa71f79b8e4', 'request_id': 'req-5bc9c17f-0fed-49f7-938a-192654f95ee4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:16.514038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] The token cache is being invalidate because project 00d0ad90ecc043ebb2f6bfa71f79b8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:16.514363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:16.514990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5bc9c17f-0fed-49f7-938a-192654f95ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:16.516488 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4166/8310] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:16 2022] DELETE /identity/v3/projects/00d0ad90ecc043ebb2f6bfa71f79b8e4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:16.521582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112b54d-d69e-4cd6-91b3-fe59080a4dfd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:16.521872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112b54d-d69e-4cd6-91b3-fe59080a4dfd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:16.522191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112b54d-d69e-4cd6-91b3-fe59080a4dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:16.541381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5112b54d-d69e-4cd6-91b3-fe59080a4dfd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:16.542737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5112b54d-d69e-4cd6-91b3-fe59080a4dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:16.602836 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4145/8311] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:16.610827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5797e1-b618-4e68-91ef-cadf7b5000f0 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:16.611119 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5797e1-b618-4e68-91ef-cadf7b5000f0 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:16.611401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5797e1-b618-4e68-91ef-cadf7b5000f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:16.631642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd5797e1-b618-4e68-91ef-cadf7b5000f0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:16.632858 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd5797e1-b618-4e68-91ef-cadf7b5000f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:16.641700 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4167/8312] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:16.646164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112b54d-d69e-4cd6-91b3-fe59080a4dfd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:16.656021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112b54d-d69e-4cd6-91b3-fe59080a4dfd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:16.660571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:16.661383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:16.661663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:16.661935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:16.662657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:19:16.662960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:16.664529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:16.676867 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4146/8313] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:19:16.681178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5797e1-b618-4e68-91ef-cadf7b5000f0 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:16.691064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5797e1-b618-4e68-91ef-cadf7b5000f0 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:16.695820 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:16.696418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:16.696701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:16.696977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:16.697614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:16.699579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:16.778335 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4168/8314] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:16 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:16.782660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:16.792679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2c646-100c-430a-b4c9-225e97e70e2f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:16.856435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:16.857141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:16.857540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:16.857854 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:16.858689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:16.860910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:16.947596 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4147/8315] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:16 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:19:16.952349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:16.962845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c321d2c-5975-4b80-ae0e-0b58dd3b293a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:16.968205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:16.968808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:16.969091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:16.969401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:16.970042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:16.975150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:16.982105 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4169/8316] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:16.986074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:16.996377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0581ceb-7d9a-411d-a67c-8f9dfae77e18 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.001631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65842e69-14c0-452e-83c5-9043dc0b5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.002283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65842e69-14c0-452e-83c5-9043dc0b5597 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.002588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65842e69-14c0-452e-83c5-9043dc0b5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.002861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65842e69-14c0-452e-83c5-9043dc0b5597 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.003509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65842e69-14c0-452e-83c5-9043dc0b5597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.005081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65842e69-14c0-452e-83c5-9043dc0b5597 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.016514 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4148/8317] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:17.020571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:17.031095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637cffe-ab2b-435f-a7fc-4237e9ac057b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.035646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.036298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.036579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.036854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] PATH_INFO: `/v3/projects/f54be2a47cac4d93a7ec63e2db15a7fa/users/a77ee5fab3454697ad274fc7183fbd1f/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.051849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54be2a47cac4d93a7ec63e2db15a7fa, user_id=a77ee5fab3454697ad274fc7183fbd1f, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.054542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.124660 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4170/8318] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:17 2022] PUT /identity/v3/projects/f54be2a47cac4d93a7ec63e2db15a7fa/users/a77ee5fab3454697ad274fc7183fbd1f/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:17.136465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0b9d-2f1e-4c25-860d-147a8e874ce3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.136752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0b9d-2f1e-4c25-860d-147a8e874ce3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.137031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0b9d-2f1e-4c25-860d-147a8e874ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.164724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa2b0b9d-2f1e-4c25-860d-147a8e874ce3 None None] MFA Rules not processed for user `a77ee5fab3454697ad274fc7183fbd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:17.165933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa2b0b9d-2f1e-4c25-860d-147a8e874ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:17.211828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:17.238583 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4149/8319] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:17.243076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:17.301160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:17.306831 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03220131-6f7b-4674-ac5e-803aa2d9ebb7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.311906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.312956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.312956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.313140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.313694 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.315645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.417399 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4171/8320] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:17 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:17.421865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b0b9d-2f1e-4c25-860d-147a8e874ce3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:17.432975 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b0b9d-2f1e-4c25-860d-147a8e874ce3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.491484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442601-7105-405b-b007-9da439a766bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.492091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442601-7105-405b-b007-9da439a766bd admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.492369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442601-7105-405b-b007-9da439a766bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.492636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442601-7105-405b-b007-9da439a766bd admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.493258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442601-7105-405b-b007-9da439a766bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.495202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442601-7105-405b-b007-9da439a766bd admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.577471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4150/8321] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:17 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:17.581409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:17.592741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7a5d6-4716-4a5f-9385-451366a6e566 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.597433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.598076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.598376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.598665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.599293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.600881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.610879 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4172/8322] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:17.614970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442601-7105-405b-b007-9da439a766bd admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:17.625155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442601-7105-405b-b007-9da439a766bd admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.629883 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.630459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.630736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.631004 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] PATH_INFO: `/v3/projects/9b97501cbc41440385d5223f03010fc1/users/f3a920bd332d4efaa622cb19fee7190f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.646679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b97501cbc41440385d5223f03010fc1, user_id=f3a920bd332d4efaa622cb19fee7190f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.649355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.702260 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4151/8323] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:17 2022] PUT /identity/v3/projects/9b97501cbc41440385d5223f03010fc1/users/f3a920bd332d4efaa622cb19fee7190f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:17.706289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:17.717271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d65d-7e9a-4cb0-a8ec-40fd27091a1c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.773410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc62e4-5fc3-44e2-a58a-f8c2bb7e07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.774016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc62e4-5fc3-44e2-a58a-f8c2bb7e07f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.774330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc62e4-5fc3-44e2-a58a-f8c2bb7e07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.774605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc62e4-5fc3-44e2-a58a-f8c2bb7e07f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.775274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc62e4-5fc3-44e2-a58a-f8c2bb7e07f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.776955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc62e4-5fc3-44e2-a58a-f8c2bb7e07f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.786495 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4173/8324] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:17.790661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:17.801001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5359b-6249-434b-a3ce-adafde5ae7a3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:17.805578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e9e1-f708-445b-a5f0-04fdbddf1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:17.806283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9e1-f708-445b-a5f0-04fdbddf1fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.806564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9e1-f708-445b-a5f0-04fdbddf1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.806838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e9e1-f708-445b-a5f0-04fdbddf1fbf admin admin] PATH_INFO: `/v3/projects/9b97501cbc41440385d5223f03010fc1/users/f3a920bd332d4efaa622cb19fee7190f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.808774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e9e1-f708-445b-a5f0-04fdbddf1fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b97501cbc41440385d5223f03010fc1, user_id=f3a920bd332d4efaa622cb19fee7190f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:17.811952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e9e1-f708-445b-a5f0-04fdbddf1fbf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:17.821924 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4152/8325] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:17 2022] PUT /identity/v3/projects/9b97501cbc41440385d5223f03010fc1/users/f3a920bd332d4efaa622cb19fee7190f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:17.832720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5b008-0f67-41b9-a187-a77620f9e3c8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.832938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5b008-0f67-41b9-a187-a77620f9e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.833212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5b008-0f67-41b9-a187-a77620f9e3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.861070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-30f5b008-0f67-41b9-a187-a77620f9e3c8 None None] MFA Rules not processed for user `f3a920bd332d4efaa622cb19fee7190f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:17.862360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-30f5b008-0f67-41b9-a187-a77620f9e3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:17.932221 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4174/8326] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:17.943353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01cc9c-0183-43fe-b838-b2cbd92b20db None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:17.943673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01cc9c-0183-43fe-b838-b2cbd92b20db None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:17.943959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01cc9c-0183-43fe-b838-b2cbd92b20db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:17.982074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b01cc9c-0183-43fe-b838-b2cbd92b20db None None] MFA Rules not processed for user `b6c94378d347410c944afe6fe9a55584`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:17.983294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b01cc9c-0183-43fe-b838-b2cbd92b20db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:18.043173 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4153/8327] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Oct 18 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:18.049192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5b008-0f67-41b9-a187-a77620f9e3c8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:18.058579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5b008-0f67-41b9-a187-a77620f9e3c8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:18.062699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf339-d06a-46da-a384-e064c25006f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:18.063294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf339-d06a-46da-a384-e064c25006f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:18.063571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf339-d06a-46da-a384-e064c25006f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:18.063841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf339-d06a-46da-a384-e064c25006f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:18.072915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf339-d06a-46da-a384-e064c25006f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:18.074503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf339-d06a-46da-a384-e064c25006f0 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:18.084714 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4175/8328] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:20.709686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01cc9c-0183-43fe-b838-b2cbd92b20db None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:20.728847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:20.772146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01cc9c-0183-43fe-b838-b2cbd92b20db None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:20.776818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:20.777503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:20.777807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:20.778129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] PATH_INFO: `/v3/users/a77ee5fab3454697ad274fc7183fbd1f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:20.779841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77ee5fab3454697ad274fc7183fbd1f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:20.781751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:20.921642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77ee5fab3454697ad274fc7183fbd1f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:20.922313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77ee5fab3454697ad274fc7183fbd1f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:20.981765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77ee5fab3454697ad274fc7183fbd1f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:20.982917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77ee5fab3454697ad274fc7183fbd1f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:20.990304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77ee5fab3454697ad274fc7183fbd1f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:21.007487 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4154/8329] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:20 2022] DELETE /identity/v3/users/a77ee5fab3454697ad274fc7183fbd1f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:21.012290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:21.012748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:21.012857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:21.031907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:21.033095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:21.064964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:21.090507 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4176/8330] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:21.100927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:21.102509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:21.159556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82a56-1f89-4af2-9f30-edbe7f5873cc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:21.163290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:21.163895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:21.164177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:21.164453 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:21.173538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:21.174941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:21.184332 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4155/8331] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:21.552795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:21.554263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:21.567172 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91ade5-3253-4336-b06a-22bae75ec5f3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:21.571894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:21.572535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:21.572816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:21.573089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] PATH_INFO: `/v3/projects/f54be2a47cac4d93a7ec63e2db15a7fa` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:21.574329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54be2a47cac4d93a7ec63e2db15a7fa)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:21.576824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:21.714556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54be2a47cac4d93a7ec63e2db15a7fa', 'request_id': 'req-78bb4019-5e53-434f-a0a2-1ab337aa915f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:21.720613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54be2a47cac4d93a7ec63e2db15a7fa', 'request_id': 'req-78bb4019-5e53-434f-a0a2-1ab337aa915f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:21.793113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54be2a47cac4d93a7ec63e2db15a7fa', 'request_id': 'req-78bb4019-5e53-434f-a0a2-1ab337aa915f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:21.803992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] The token cache is being invalidate because project f54be2a47cac4d93a7ec63e2db15a7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:21.809625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:21.809625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:21.809625 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4177/8332] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:21 2022] DELETE /identity/v3/projects/f54be2a47cac4d93a7ec63e2db15a7fa => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:21.811238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:21.821018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205d9cb-fc28-4583-a3fc-d1c73feb00cf service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:21.859174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:21.877928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:21.878598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:21.878881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:21.879159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] PATH_INFO: `/v3/users/f3a920bd332d4efaa622cb19fee7190f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:21.880366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a920bd332d4efaa622cb19fee7190f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:21.882330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:22.092220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a920bd332d4efaa622cb19fee7190f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.092875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a920bd332d4efaa622cb19fee7190f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.150999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a920bd332d4efaa622cb19fee7190f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.151700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a920bd332d4efaa622cb19fee7190f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.159599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1503824e-a0d5-4187-88b6-3a8cdc64c116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a920bd332d4efaa622cb19fee7190f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.177368 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4156/8333] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:21 2022] DELETE /identity/v3/users/f3a920bd332d4efaa622cb19fee7190f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:22.593186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:22.594817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:22.608224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb4019-5e53-434f-a0a2-1ab337aa915f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:22.666108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:22.666877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:22.667162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:22.667441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] PATH_INFO: `/v3/projects/9b97501cbc41440385d5223f03010fc1` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:22.668571 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b97501cbc41440385d5223f03010fc1)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:22.670527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:22.762719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b97501cbc41440385d5223f03010fc1', 'request_id': 'req-0b9cca50-d6c9-4be4-bd20-372dac4ec200'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.769392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b97501cbc41440385d5223f03010fc1', 'request_id': 'req-0b9cca50-d6c9-4be4-bd20-372dac4ec200'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.843263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b97501cbc41440385d5223f03010fc1', 'request_id': 'req-0b9cca50-d6c9-4be4-bd20-372dac4ec200'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.845314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:22.854307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] The token cache is being invalidate because project 9b97501cbc41440385d5223f03010fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:22.854593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.855243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0b9cca50-d6c9-4be4-bd20-372dac4ec200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:22.856718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4178/8334] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:22 2022] DELETE /identity/v3/projects/9b97501cbc41440385d5223f03010fc1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:22.861905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78bdd4-ae1b-4663-a784-b6731cc03248 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:22.862406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78bdd4-ae1b-4663-a784-b6731cc03248 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:22.862502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78bdd4-ae1b-4663-a784-b6731cc03248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:22.882807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4d78bdd4-ae1b-4663-a784-b6731cc03248 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:22.884093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4d78bdd4-ae1b-4663-a784-b6731cc03248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:22.944003 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4157/8335] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:22.952220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7b1a-c1a7-4eb5-83e0-84f1eb37ac8f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:22.952509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7b1a-c1a7-4eb5-83e0-84f1eb37ac8f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:22.952787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7b1a-c1a7-4eb5-83e0-84f1eb37ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:22.973232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-cd9a7b1a-c1a7-4eb5-83e0-84f1eb37ac8f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:22.974521 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd9a7b1a-c1a7-4eb5-83e0-84f1eb37ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:22.982663 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4179/8336] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:22.987787 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78bdd4-ae1b-4663-a784-b6731cc03248 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:22.997552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78bdd4-ae1b-4663-a784-b6731cc03248 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.002649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.003245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.003525 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.003795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.004475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:19:23.004794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.006772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.019896 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4158/8337] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:19:23.024358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7b1a-c1a7-4eb5-83e0-84f1eb37ac8f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.033909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7b1a-c1a7-4eb5-83e0-84f1eb37ac8f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.039918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.039918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.039918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.039918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.040382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.042342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.137403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4180/8338] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:23 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:23.142314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.152485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860899d1-e2fb-4b6b-a53f-f85753fdd825 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.195539 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:23.208580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.209187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.209468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.209745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.210406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.212309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.305126 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4159/8339] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:23 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:23.309303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.320699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f092c6-996f-4686-bc8a-84035037ecd2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.325322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.328281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.328281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.328281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.328281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.329135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.339722 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4181/8340] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:23.343620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.353612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935483a-ede5-4913-8bfc-1d8a5079be55 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.358761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fbf8f-975f-45f6-a6a5-a4ae8903c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.359357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fbf8f-975f-45f6-a6a5-a4ae8903c249 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.359640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fbf8f-975f-45f6-a6a5-a4ae8903c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.359913 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fbf8f-975f-45f6-a6a5-a4ae8903c249 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.360543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fbf8f-975f-45f6-a6a5-a4ae8903c249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.362154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fbf8f-975f-45f6-a6a5-a4ae8903c249 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.373897 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4160/8341] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:23.378515 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.388952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1787c0d-8015-4dd4-8063-6cc5af9e3e53 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.393540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.394221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.394509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.394793 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] PATH_INFO: `/v3/projects/db5721a8af5d4fbeb7c1f6a748d47c4c/users/9c5459aae5f440c994759c07bc43dd69/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.409227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5721a8af5d4fbeb7c1f6a748d47c4c, user_id=9c5459aae5f440c994759c07bc43dd69, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.411930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.482768 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4182/8342] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:23 2022] PUT /identity/v3/projects/db5721a8af5d4fbeb7c1f6a748d47c4c/users/9c5459aae5f440c994759c07bc43dd69/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:23.494979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45fcc-74e8-4a63-9d60-2502e204ef02 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.495282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45fcc-74e8-4a63-9d60-2502e204ef02 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.495558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b45fcc-74e8-4a63-9d60-2502e204ef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.523547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a6b45fcc-74e8-4a63-9d60-2502e204ef02 None None] MFA Rules not processed for user `9c5459aae5f440c994759c07bc43dd69`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:23.524744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a6b45fcc-74e8-4a63-9d60-2502e204ef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:23.588421 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4161/8343] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:23.592954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.655004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e95f-d2d6-4137-adc4-8b5232f096f5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.659611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.660247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.660534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.660802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.661426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.663389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.763528 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4183/8344] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:23 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:19:23.767543 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45fcc-74e8-4a63-9d60-2502e204ef02 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.778328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b45fcc-74e8-4a63-9d60-2502e204ef02 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.834667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.835274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.835558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.835831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.836465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.838400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.940145 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4162/8345] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:23 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:23.944121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.955390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3646-0569-48d1-b1b8-5e117e251604 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.960143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.960764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.961043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.961378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:23.962022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:23.963632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:23.974390 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4184/8346] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:23.979154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:23.988901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a922e-b80b-4592-8dec-9e8aa968f5ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:23.993522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:23.994201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:23.994485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:23.994758 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] PATH_INFO: `/v3/projects/f2eb430e18b74dd9a34a7b3e761d51dd/users/ca604cbb37264a24ba3bb9a6e64e13d6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:24.009925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2eb430e18b74dd9a34a7b3e761d51dd, user_id=ca604cbb37264a24ba3bb9a6e64e13d6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:24.012588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:24.084579 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4163/8347] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:23 2022] PUT /identity/v3/projects/f2eb430e18b74dd9a34a7b3e761d51dd/users/ca604cbb37264a24ba3bb9a6e64e13d6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:24.088736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:24.099400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa0dc1-ed8e-4b32-b61a-f6ae16cb35c1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:24.156932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fba9f7-3d6e-45bd-bf32-60d41fedb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:24.157532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fba9f7-3d6e-45bd-bf32-60d41fedb0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:24.157812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fba9f7-3d6e-45bd-bf32-60d41fedb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:24.158110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fba9f7-3d6e-45bd-bf32-60d41fedb0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:24.158741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fba9f7-3d6e-45bd-bf32-60d41fedb0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:24.160332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fba9f7-3d6e-45bd-bf32-60d41fedb0d0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:24.162353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:24.170259 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4185/8348] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:24.175075 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:24.185246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2e888-50b1-44d2-8404-c8468181d4c3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:24.191202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2447a79-daa4-426e-b528-f8bded880530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:24.191786 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447a79-daa4-426e-b528-f8bded880530 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:24.192064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447a79-daa4-426e-b528-f8bded880530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:24.192334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2447a79-daa4-426e-b528-f8bded880530 admin admin] PATH_INFO: `/v3/projects/f2eb430e18b74dd9a34a7b3e761d51dd/users/ca604cbb37264a24ba3bb9a6e64e13d6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:24.194256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2447a79-daa4-426e-b528-f8bded880530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2eb430e18b74dd9a34a7b3e761d51dd, user_id=ca604cbb37264a24ba3bb9a6e64e13d6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:24.196899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2447a79-daa4-426e-b528-f8bded880530 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:24.206960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4164/8349] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:24 2022] PUT /identity/v3/projects/f2eb430e18b74dd9a34a7b3e761d51dd/users/ca604cbb37264a24ba3bb9a6e64e13d6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:24.217905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500230be-be8b-47c7-8093-db936b58157c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:24.218237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500230be-be8b-47c7-8093-db936b58157c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:24.218518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500230be-be8b-47c7-8093-db936b58157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:24.248102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-500230be-be8b-47c7-8093-db936b58157c None None] MFA Rules not processed for user `ca604cbb37264a24ba3bb9a6e64e13d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:24.249317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-500230be-be8b-47c7-8093-db936b58157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:24.317799 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4186/8350] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:24.328087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db83102-75cd-41ef-8106-18a065dc20b8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:24.328373 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db83102-75cd-41ef-8106-18a065dc20b8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:24.328648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db83102-75cd-41ef-8106-18a065dc20b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:24.343469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:24.349154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4db83102-75cd-41ef-8106-18a065dc20b8 None None] MFA Rules not processed for user `b6c94378d347410c944afe6fe9a55584`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:24.350385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4db83102-75cd-41ef-8106-18a065dc20b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:24.401324 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4165/8351] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Oct 18 14:19:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:24.407753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500230be-be8b-47c7-8093-db936b58157c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:24.417254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500230be-be8b-47c7-8093-db936b58157c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:24.421210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285a7a2-32ce-470f-a307-947c38f4fd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:24.422452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a7a2-32ce-470f-a307-947c38f4fd10 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:24.422736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a7a2-32ce-470f-a307-947c38f4fd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:24.423383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a7a2-32ce-470f-a307-947c38f4fd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:24.480378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285a7a2-32ce-470f-a307-947c38f4fd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:24.481821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285a7a2-32ce-470f-a307-947c38f4fd10 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:24.491425 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4187/8352] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:29.753064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db83102-75cd-41ef-8106-18a065dc20b8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:29.761490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db83102-75cd-41ef-8106-18a065dc20b8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:29.765214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:29.765813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:29.766121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:29.766395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:29.775403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:29.779568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:29.786697 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4166/8353] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:34.487408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=63 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:39.062422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8fe38-8240-42f4-a2e0-7a7013737154 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:39.063563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8fe38-8240-42f4-a2e0-7a7013737154 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:39.063563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8fe38-8240-42f4-a2e0-7a7013737154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:39.083702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-99c8fe38-8240-42f4-a2e0-7a7013737154 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:39.084902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-99c8fe38-8240-42f4-a2e0-7a7013737154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:39.149472 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4188/8354] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Oct 18 14:19:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:39.177591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:39.179292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:39.196778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03ebe-7a5b-421b-acf4-770f1b6c1e81 service cinder] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:39.201914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedb294-fdb9-4873-8fb2-96c4cc8e5679 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:39.202552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedb294-fdb9-4873-8fb2-96c4cc8e5679 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:39.202836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedb294-fdb9-4873-8fb2-96c4cc8e5679 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:39.203180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedb294-fdb9-4873-8fb2-96c4cc8e5679 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:39.212314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedb294-fdb9-4873-8fb2-96c4cc8e5679 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:39.213886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedb294-fdb9-4873-8fb2-96c4cc8e5679 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:39.223882 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4167/8355] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:49.140555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=29 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:49.220017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:55.931076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8fe38-8240-42f4-a2e0-7a7013737154 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:56.006671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8fe38-8240-42f4-a2e0-7a7013737154 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:56.011751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:56.012397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:56.012675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:56.012948 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] PATH_INFO: `/v3/users/9c5459aae5f440c994759c07bc43dd69` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:56.014100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5459aae5f440c994759c07bc43dd69)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:56.016062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:56.207295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5459aae5f440c994759c07bc43dd69'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:56.215064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5459aae5f440c994759c07bc43dd69'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:56.215795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5459aae5f440c994759c07bc43dd69'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:56.229418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5459aae5f440c994759c07bc43dd69'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:56.272356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5459aae5f440c994759c07bc43dd69'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:56.278880 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4189/8356] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:55 2022] DELETE /identity/v3/users/9c5459aae5f440c994759c07bc43dd69 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:56.283743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:56.285041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:56.285277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:56.318704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:56.319942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:56.377383 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4168/8357] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:56.387844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:56.389318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:56.446349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40420aa0-8f55-4fb7-8095-75db81ef2566 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:56.450002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:56.450650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:56.450934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:56.451208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:56.461020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:56.462458 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:56.472931 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4190/8358] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:19:56.872502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:56.873987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:56.887340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4756-14eb-452f-b963-2c9708be7c42 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:56.892619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:56.894960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:56.895243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:56.895514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] PATH_INFO: `/v3/projects/db5721a8af5d4fbeb7c1f6a748d47c4c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:56.896974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5721a8af5d4fbeb7c1f6a748d47c4c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:56.900185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:56.993349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5721a8af5d4fbeb7c1f6a748d47c4c', 'request_id': 'req-dabdeea5-70b6-45d8-9942-70ba5295e5aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:56.999480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5721a8af5d4fbeb7c1f6a748d47c4c', 'request_id': 'req-dabdeea5-70b6-45d8-9942-70ba5295e5aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.055258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5721a8af5d4fbeb7c1f6a748d47c4c', 'request_id': 'req-dabdeea5-70b6-45d8-9942-70ba5295e5aa'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.066501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] The token cache is being invalidate because project db5721a8af5d4fbeb7c1f6a748d47c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:57.067651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.067651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.069016 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4169/8359] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:56 2022] DELETE /identity/v3/projects/db5721a8af5d4fbeb7c1f6a748d47c4c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:57.073095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:57.082770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5516db-c975-48bb-95b8-6ba186ca0b5b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:57.091304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:57.138712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:57.139336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:57.139617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:57.139892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] PATH_INFO: `/v3/users/ca604cbb37264a24ba3bb9a6e64e13d6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:57.140993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca604cbb37264a24ba3bb9a6e64e13d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:57.142956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:57.340723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca604cbb37264a24ba3bb9a6e64e13d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.348144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca604cbb37264a24ba3bb9a6e64e13d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.348814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca604cbb37264a24ba3bb9a6e64e13d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.360767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca604cbb37264a24ba3bb9a6e64e13d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.426567 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ec897f30-fbc0-441d-b302-cab0b3788170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca604cbb37264a24ba3bb9a6e64e13d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:57.432842 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4191/8360] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:19:57 2022] DELETE /identity/v3/users/ca604cbb37264a24ba3bb9a6e64e13d6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:57.864894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:57.864894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:57.877441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdeea5-70b6-45d8-9942-70ba5295e5aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:57.935992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:57.936628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:57.936911 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:57.937187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] PATH_INFO: `/v3/projects/f2eb430e18b74dd9a34a7b3e761d51dd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:57.938362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2eb430e18b74dd9a34a7b3e761d51dd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:57.940322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:57.956403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:58.059370 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2eb430e18b74dd9a34a7b3e761d51dd', 'request_id': 'req-62f2ed59-365f-4985-960f-3d61be414c1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:58.066031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2eb430e18b74dd9a34a7b3e761d51dd', 'request_id': 'req-62f2ed59-365f-4985-960f-3d61be414c1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:58.202252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2eb430e18b74dd9a34a7b3e761d51dd', 'request_id': 'req-62f2ed59-365f-4985-960f-3d61be414c1e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:58.213622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] The token cache is being invalidate because project f2eb430e18b74dd9a34a7b3e761d51dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:19:58.213940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:58.214608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-62f2ed59-365f-4985-960f-3d61be414c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:19:58.216093 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4170/8361] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:19:57 2022] DELETE /identity/v3/projects/f2eb430e18b74dd9a34a7b3e761d51dd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:58.221002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af8547-97d6-422e-b37d-c1c54a60183b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.221964 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af8547-97d6-422e-b37d-c1c54a60183b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.222093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af8547-97d6-422e-b37d-c1c54a60183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.243854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-58af8547-97d6-422e-b37d-c1c54a60183b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:58.245048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-58af8547-97d6-422e-b37d-c1c54a60183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:58.302912 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4192/8362] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:58.312134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291aba-fcd3-4242-bcf0-ad20ea429206 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.312417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291aba-fcd3-4242-bcf0-ad20ea429206 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.312689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291aba-fcd3-4242-bcf0-ad20ea429206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.333828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c4291aba-fcd3-4242-bcf0-ad20ea429206 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:58.335087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c4291aba-fcd3-4242-bcf0-ad20ea429206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:58.343189 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4171/8363] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:58.348067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af8547-97d6-422e-b37d-c1c54a60183b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:58.357847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af8547-97d6-422e-b37d-c1c54a60183b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:58.363110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:58.363704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.363984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.364257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.364902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:19:58.365204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:58.366833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:58.378403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4193/8364] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:19:58.382512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4291aba-fcd3-4242-bcf0-ad20ea429206 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:58.391845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4291aba-fcd3-4242-bcf0-ad20ea429206 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:58.396807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:58.397412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.397688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.398018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.398687 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:58.400600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:58.485897 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4172/8365] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:58 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:58.489870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:58.499982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d5c83-17d9-4608-a41e-ade254e9afbb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:58.519130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:58.558373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:58.558992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.559274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.559555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.560191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:58.562173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:58.676270 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4194/8366] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:58 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:58.680666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:58.690937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dbe12-f65e-473a-9b8c-a7b31463c1dc admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:58.695553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:58.696149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.696424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.696714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.697352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:58.698968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:58.710031 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4173/8367] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:58.713912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:58.725181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa57f2-e60d-485d-bf76-2965cff3a8c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:58.729751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b15ae-22f8-4faf-b363-fd6361efe26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:58.730372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b15ae-22f8-4faf-b363-fd6361efe26c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.730652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b15ae-22f8-4faf-b363-fd6361efe26c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.730925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b15ae-22f8-4faf-b363-fd6361efe26c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.731555 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b15ae-22f8-4faf-b363-fd6361efe26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:58.733136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b15ae-22f8-4faf-b363-fd6361efe26c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:58.744357 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4195/8368] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:58.751651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:58.758490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbb8e4-023d-495f-bbb1-bc46435ee5e1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:58.763240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:58.763878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.764162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.764432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] PATH_INFO: `/v3/projects/3b98f70dd2574769a6d7534f6032aaec/users/89ac2a0f623b4d6795c69d0455dbeab8/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.779346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b98f70dd2574769a6d7534f6032aaec, user_id=89ac2a0f623b4d6795c69d0455dbeab8, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:58.781959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:58.890465 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4174/8369] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:58 2022] PUT /identity/v3/projects/3b98f70dd2574769a6d7534f6032aaec/users/89ac2a0f623b4d6795c69d0455dbeab8/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:58.901501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ed22-7bd9-4d7b-b189-0f1d787edac5 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:58.901784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ed22-7bd9-4d7b-b189-0f1d787edac5 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:58.902135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ed22-7bd9-4d7b-b189-0f1d787edac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:58.929939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c401ed22-7bd9-4d7b-b189-0f1d787edac5 None None] MFA Rules not processed for user `89ac2a0f623b4d6795c69d0455dbeab8`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:58.931170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c401ed22-7bd9-4d7b-b189-0f1d787edac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:58.995625 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4196/8370] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:58 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:59.000122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:59.061693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cffc30-bd1b-4198-8ebc-6466d3ef03e5 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:59.066556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:59.067159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.067442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.067717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.068346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:59.070259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:59.187878 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4175/8371] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:19:58 2022] POST /identity/v3/projects => generated 399 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:59.191910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401ed22-7bd9-4d7b-b189-0f1d787edac5 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:59.202589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401ed22-7bd9-4d7b-b189-0f1d787edac5 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:59.258856 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:59.259467 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.259894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.260174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.260795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:59.262732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:59.339696 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4197/8372] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:19:59 2022] POST /identity/v3/users => generated 306 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:19:59.341053 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:59.352299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988d03-3742-48c2-a73f-a92947b4293d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:59.357076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:59.357677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.357962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.358266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.358932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:59.360504 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:59.371343 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4176/8373] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:59.375554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:59.386335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d631397-0e26-485f-9356-ae72850b28cf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:59.390968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:59.391687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.392058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.392426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] PATH_INFO: `/v3/projects/5b8dd13545274a2aa2d7cd29787ec6b1/users/060cc1b90a614544a24fc44da9e5b4d6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.408071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8dd13545274a2aa2d7cd29787ec6b1, user_id=060cc1b90a614544a24fc44da9e5b4d6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:59.411509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:59.415960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:59.474089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4198/8374] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:59 2022] PUT /identity/v3/projects/5b8dd13545274a2aa2d7cd29787ec6b1/users/060cc1b90a614544a24fc44da9e5b4d6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:19:59.480707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:59.491003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f79137-4a52-492c-aa49-1948f9019cd9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:59.500770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:19:59.552166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb17ca-7d1e-4f2d-aa9c-05356b270bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:59.552817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb17ca-7d1e-4f2d-aa9c-05356b270bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.553191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb17ca-7d1e-4f2d-aa9c-05356b270bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.553573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb17ca-7d1e-4f2d-aa9c-05356b270bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.554284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb17ca-7d1e-4f2d-aa9c-05356b270bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:59.555877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb17ca-7d1e-4f2d-aa9c-05356b270bc5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:59.575565 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4177/8375] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:19:59.575747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:59.582940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add445d0-fc67-4e9a-93df-0f7eab5baa64 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:59.587906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:59.588584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.588866 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.589144 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] PATH_INFO: `/v3/projects/5b8dd13545274a2aa2d7cd29787ec6b1/users/060cc1b90a614544a24fc44da9e5b4d6/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.591115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8dd13545274a2aa2d7cd29787ec6b1, user_id=060cc1b90a614544a24fc44da9e5b4d6, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:59.593754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:59.604680 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4199/8376] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:19:59 2022] PUT /identity/v3/projects/5b8dd13545274a2aa2d7cd29787ec6b1/users/060cc1b90a614544a24fc44da9e5b4d6/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:19:59.616255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d013dd-8392-41c7-bfb2-e16c596743b1 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.616700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d013dd-8392-41c7-bfb2-e16c596743b1 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.617048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d013dd-8392-41c7-bfb2-e16c596743b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.646603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e6d013dd-8392-41c7-bfb2-e16c596743b1 None None] MFA Rules not processed for user `060cc1b90a614544a24fc44da9e5b4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:19:59.647806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e6d013dd-8392-41c7-bfb2-e16c596743b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:59.728456 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4178/8377] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:19:59.742092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:19:59.742092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:19:59.801268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1622e-cdc3-4386-b320-ce355eb62951 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:19:59.805056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:19:59.805604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:19:59.805884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:19:59.806193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:19:59.815221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:19:59.817265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:19:59.826807 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4200/8378] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:19:59 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:20:00.030980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d013dd-8392-41c7-bfb2-e16c596743b1 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:00.040935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d013dd-8392-41c7-bfb2-e16c596743b1 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:00.044591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3589f1-9894-4c47-8573-0eced25a75c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:00.045203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3589f1-9894-4c47-8573-0eced25a75c2 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:00.045489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3589f1-9894-4c47-8573-0eced25a75c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:00.045766 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3589f1-9894-4c47-8573-0eced25a75c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:00.104137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3589f1-9894-4c47-8573-0eced25a75c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:00.105505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3589f1-9894-4c47-8573-0eced25a75c2 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:00.115531 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4179/8379] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:08.258299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:08.325158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116823de-0b60-4c95-9336-2f90aa3f28bc service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:08.329847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:08.330545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:08.332723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:08.332723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] PATH_INFO: `/v3/users/89ac2a0f623b4d6795c69d0455dbeab8` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:08.332723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ac2a0f623b4d6795c69d0455dbeab8)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:08.334378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:08.530227 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ac2a0f623b4d6795c69d0455dbeab8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:08.537693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ac2a0f623b4d6795c69d0455dbeab8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:08.538389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ac2a0f623b4d6795c69d0455dbeab8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:08.550934 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ac2a0f623b4d6795c69d0455dbeab8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:08.641598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ac2a0f623b4d6795c69d0455dbeab8'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:08.648522 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4201/8380] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:20:08 2022] DELETE /identity/v3/users/89ac2a0f623b4d6795c69d0455dbeab8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:08.653103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:08.658155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:08.658155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:08.675403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:08.676590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:08.704765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:08.735661 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4180/8381] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:08.745254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:08.746689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:08.752063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:08.805206 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ac52c-20eb-4bfd-b65f-1595fd275ad8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:08.809067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:08.809899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:08.810585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:08.810919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:08.819960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:08.821399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:08.830824 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4202/8382] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:20:09.233693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:09.235165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:09.247136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f6c70-d7e7-48b8-be6c-3ad76363a631 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:09.251995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:09.252832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:09.253121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:09.253456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] PATH_INFO: `/v3/projects/3b98f70dd2574769a6d7534f6032aaec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:09.255121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b98f70dd2574769a6d7534f6032aaec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:09.257063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:09.387015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b98f70dd2574769a6d7534f6032aaec', 'request_id': 'req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.393060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b98f70dd2574769a6d7534f6032aaec', 'request_id': 'req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.449000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b98f70dd2574769a6d7534f6032aaec', 'request_id': 'req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.459731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] The token cache is being invalidate because project 3b98f70dd2574769a6d7534f6032aaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:20:09.460010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.460634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.462149 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4181/8383] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:20:09 2022] DELETE /identity/v3/projects/3b98f70dd2574769a6d7534f6032aaec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:09.466156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:09.475814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959ab54-593b-46f5-9c8c-3c45da7da604 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:09.533741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:09.533741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:09.533741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:09.533741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] PATH_INFO: `/v3/users/060cc1b90a614544a24fc44da9e5b4d6` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:09.534343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060cc1b90a614544a24fc44da9e5b4d6)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:09.536297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:09.737803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060cc1b90a614544a24fc44da9e5b4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.745661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060cc1b90a614544a24fc44da9e5b4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.746363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060cc1b90a614544a24fc44da9e5b4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.763078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060cc1b90a614544a24fc44da9e5b4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.837498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe92635f-6d3f-48f8-aed8-fe67de2882d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060cc1b90a614544a24fc44da9e5b4d6'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:09.843773 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4203/8384] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:20:09 2022] DELETE /identity/v3/users/060cc1b90a614544a24fc44da9e5b4d6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:10.232326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:10.233824 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:10.247499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c32df-19b9-43c7-bbdb-ae1f0b81bde2 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:10.305713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:10.306385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:10.306666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:10.306939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] PATH_INFO: `/v3/projects/5b8dd13545274a2aa2d7cd29787ec6b1` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:10.308070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8dd13545274a2aa2d7cd29787ec6b1)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:10.309969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:10.435743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8dd13545274a2aa2d7cd29787ec6b1', 'request_id': 'req-2c2e961e-7d44-4c72-8372-43befa6e731b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:10.442020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8dd13545274a2aa2d7cd29787ec6b1', 'request_id': 'req-2c2e961e-7d44-4c72-8372-43befa6e731b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:10.446321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:10.523309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8dd13545274a2aa2d7cd29787ec6b1', 'request_id': 'req-2c2e961e-7d44-4c72-8372-43befa6e731b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:10.534620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] The token cache is being invalidate because project 5b8dd13545274a2aa2d7cd29787ec6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:20:10.534910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:10.535551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2c2e961e-7d44-4c72-8372-43befa6e731b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:10.537537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4182/8385] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:20:10 2022] DELETE /identity/v3/projects/5b8dd13545274a2aa2d7cd29787ec6b1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:10.542616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694e5c-c674-4915-bf1b-633a36d0248e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:10.543065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694e5c-c674-4915-bf1b-633a36d0248e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:10.543193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694e5c-c674-4915-bf1b-633a36d0248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:10.563407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6c694e5c-c674-4915-bf1b-633a36d0248e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:10.564638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6c694e5c-c674-4915-bf1b-633a36d0248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:10.583102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:10.624370 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4204/8386] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:10.632496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea67e-bf10-4a7e-a398-d65e7e2d0f1d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:10.632785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea67e-bf10-4a7e-a398-d65e7e2d0f1d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:10.633063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea67e-bf10-4a7e-a398-d65e7e2d0f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:10.653069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-69eea67e-bf10-4a7e-a398-d65e7e2d0f1d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:10.654314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-69eea67e-bf10-4a7e-a398-d65e7e2d0f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:10.663201 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4183/8387] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:20:10.667461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694e5c-c674-4915-bf1b-633a36d0248e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:10.677655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694e5c-c674-4915-bf1b-633a36d0248e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:10.682242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:10.683659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:10.683659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:10.683659 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:10.684107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:20:10.684445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:10.686542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:10.698478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4205/8388] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:20:10.702822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea67e-bf10-4a7e-a398-d65e7e2d0f1d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:10.712262 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea67e-bf10-4a7e-a398-d65e7e2d0f1d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:10.717020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:10.717625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:10.717922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:10.718280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:10.718919 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:10.720805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:10.814542 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4184/8389] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:20:10 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:20:10.818728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:10.828658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a73c8d-5746-4259-8c06-6c0d0aefda1f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:10.884697 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:10.885566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:10.885851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:10.886154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:10.886787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:10.888695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:10.986325 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4206/8390] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:20:10 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:20:10.990508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.001008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d39b-2409-4fdf-8da9-d227a0b53cf0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.005595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.006230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.006510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.006781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.007432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.009070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.019466 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4185/8391] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:11.024046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.033976 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822d7e-58fa-4e72-97c0-8b665cb15358 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.039297 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d34835-6d34-4f7a-9ed6-0306bbc3912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.039892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d34835-6d34-4f7a-9ed6-0306bbc3912f admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.040174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d34835-6d34-4f7a-9ed6-0306bbc3912f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.040454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d34835-6d34-4f7a-9ed6-0306bbc3912f admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.041097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d34835-6d34-4f7a-9ed6-0306bbc3912f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.042751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d34835-6d34-4f7a-9ed6-0306bbc3912f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.053228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4207/8392] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:11.057242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.067137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3e283-5a18-4df0-9e2f-10bb697139c6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.071688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.072325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.072603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.072876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] PATH_INFO: `/v3/projects/af8559445e3e4f35a0fb6b957ba20055/users/a5568470e8c34ba49465462c1fe78578/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.087859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8559445e3e4f35a0fb6b957ba20055, user_id=a5568470e8c34ba49465462c1fe78578, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.090512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.210297 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4186/8393] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:20:11 2022] PUT /identity/v3/projects/af8559445e3e4f35a0fb6b957ba20055/users/a5568470e8c34ba49465462c1fe78578/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:11.220702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd22e-2229-4e58-a73d-f2031fe7d67f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.220992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd22e-2229-4e58-a73d-f2031fe7d67f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.221270 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd22e-2229-4e58-a73d-f2031fe7d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.249055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-43acd22e-2229-4e58-a73d-f2031fe7d67f None None] MFA Rules not processed for user `a5568470e8c34ba49465462c1fe78578`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:11.250209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-43acd22e-2229-4e58-a73d-f2031fe7d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:11.313029 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4208/8394] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:11.318207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.378997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e8825-a03f-4130-9965-01f72d313990 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.384288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.385157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.385443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.385721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.386397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.388303 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.458716 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4187/8395] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:20:11 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:20:11.460590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd22e-2229-4e58-a73d-f2031fe7d67f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.471525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd22e-2229-4e58-a73d-f2031fe7d67f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.488369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:11.529688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.530275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.530594 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.530873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.531518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.533503 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.597676 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4209/8396] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:20:11 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:20:11.601818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.612437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e6628-f513-49e1-898a-952dec2e359f admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.617733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.621953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.621953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.621953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.621953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.621953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.632964 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4188/8397] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:11.637485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.647910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215bf96-46d0-480e-9cb7-a5c7724726d4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.652610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.653266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.653595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.653874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] PATH_INFO: `/v3/projects/cad859154e3f42e391d79a614d4f7443/users/b62c62108bf6401b90fc8eb0de32a83f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.668865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad859154e3f42e391d79a614d4f7443, user_id=b62c62108bf6401b90fc8eb0de32a83f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.671573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.739075 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4210/8398] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:20:11 2022] PUT /identity/v3/projects/cad859154e3f42e391d79a614d4f7443/users/b62c62108bf6401b90fc8eb0de32a83f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:11.743281 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.753287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e41d58-62bc-4204-acb5-0c0285847052 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.808296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:11.814249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b4ad5-fdb0-4d3f-bd49-eb4c6a2ce411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.814870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4ad5-fdb0-4d3f-bd49-eb4c6a2ce411 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.815233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4ad5-fdb0-4d3f-bd49-eb4c6a2ce411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.815512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b4ad5-fdb0-4d3f-bd49-eb4c6a2ce411 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.816161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b4ad5-fdb0-4d3f-bd49-eb4c6a2ce411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.817905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b4ad5-fdb0-4d3f-bd49-eb4c6a2ce411 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.827682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4189/8399] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:11.831924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.842755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fe97d-cb31-419a-a3d6-7dae2797fd16 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:11.847513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:11.848115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.848397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.849323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] PATH_INFO: `/v3/projects/cad859154e3f42e391d79a614d4f7443/users/b62c62108bf6401b90fc8eb0de32a83f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.851288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad859154e3f42e391d79a614d4f7443, user_id=b62c62108bf6401b90fc8eb0de32a83f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:11.853929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:11.864016 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4211/8400] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:20:11 2022] PUT /identity/v3/projects/cad859154e3f42e391d79a614d4f7443/users/b62c62108bf6401b90fc8eb0de32a83f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:11.875327 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053b16-a683-49db-9915-73b820a537bf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:11.875616 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053b16-a683-49db-9915-73b820a537bf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:11.875895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75053b16-a683-49db-9915-73b820a537bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:11.904594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-75053b16-a683-49db-9915-73b820a537bf None None] MFA Rules not processed for user `b62c62108bf6401b90fc8eb0de32a83f`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:11.905801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-75053b16-a683-49db-9915-73b820a537bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:11.973772 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4190/8401] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:11.984656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:11.986356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:12.043532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c671-acda-4bc8-868b-3aea50de0331 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:12.047226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:12.047832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:12.048114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:12.048390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:12.104123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:12.105480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:12.114188 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4212/8402] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:20.430801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75053b16-a683-49db-9915-73b820a537bf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:20.440314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75053b16-a683-49db-9915-73b820a537bf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:20.444402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbf353-a0e6-4dfa-8397-8766d78f6e26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:20.445003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf353-a0e6-4dfa-8397-8766d78f6e26 service cinder] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:20.445283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf353-a0e6-4dfa-8397-8766d78f6e26 service cinder] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:20.445558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf353-a0e6-4dfa-8397-8766d78f6e26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:20.455102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbf353-a0e6-4dfa-8397-8766d78f6e26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:20.456316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbf353-a0e6-4dfa-8397-8766d78f6e26 service cinder] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:20.466617 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4191/8403] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:22.110289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:30.462240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=43 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:33.561754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:33.629601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845f258-b80e-4a92-aa84-6ed06542fe9c service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:33.635137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:33.635804 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:33.636093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:33.636369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] PATH_INFO: `/v3/users/a5568470e8c34ba49465462c1fe78578` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:33.637514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5568470e8c34ba49465462c1fe78578)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:33.639497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:33.818880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5568470e8c34ba49465462c1fe78578'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:33.826680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5568470e8c34ba49465462c1fe78578'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:33.827448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5568470e8c34ba49465462c1fe78578'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:33.841096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5568470e8c34ba49465462c1fe78578'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:33.928875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5568470e8c34ba49465462c1fe78578'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:33.936033 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4213/8404] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:20:33 2022] DELETE /identity/v3/users/a5568470e8c34ba49465462c1fe78578 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:33.940549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:33.941011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:33.941140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:33.960040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:33.961238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:34.026080 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4192/8405] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:34.036021 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:34.038007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:34.095003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb408416-d95c-42c1-ab72-4cc5273e6443 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:34.098937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:34.100198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:34.100486 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:34.100762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:34.109737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:34.111229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:34.120629 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4214/8406] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:34.539866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:34.541435 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:34.554291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c11a8f-d410-45aa-8491-626de91e14dd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:34.559016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:34.559725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:34.560013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:34.560292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] PATH_INFO: `/v3/projects/af8559445e3e4f35a0fb6b957ba20055` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:34.561532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8559445e3e4f35a0fb6b957ba20055)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:34.563496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:34.665782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8559445e3e4f35a0fb6b957ba20055', 'request_id': 'req-b6dadc97-ee7f-4cd2-86be-984e74fdc858'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:34.671847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8559445e3e4f35a0fb6b957ba20055', 'request_id': 'req-b6dadc97-ee7f-4cd2-86be-984e74fdc858'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:34.739655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8559445e3e4f35a0fb6b957ba20055', 'request_id': 'req-b6dadc97-ee7f-4cd2-86be-984e74fdc858'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:34.750555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] The token cache is being invalidate because project af8559445e3e4f35a0fb6b957ba20055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:20:34.750855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:34.751451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b6dadc97-ee7f-4cd2-86be-984e74fdc858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:34.752931 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4193/8407] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:20:34 2022] DELETE /identity/v3/projects/af8559445e3e4f35a0fb6b957ba20055 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:34.757583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:34.767355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8501dc-80a8-4f27-b4fe-dcb757f015f0 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:34.785421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:34.823666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:34.823901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:34.824182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:34.824452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] PATH_INFO: `/v3/users/b62c62108bf6401b90fc8eb0de32a83f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:34.825574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62c62108bf6401b90fc8eb0de32a83f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:34.827586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:35.022359 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62c62108bf6401b90fc8eb0de32a83f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.029417 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62c62108bf6401b90fc8eb0de32a83f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.030242 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62c62108bf6401b90fc8eb0de32a83f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.042246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62c62108bf6401b90fc8eb0de32a83f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.111363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0af25590-5a95-4250-9063-8e004dd12dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62c62108bf6401b90fc8eb0de32a83f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.117495 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4215/8408] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:20:34 2022] DELETE /identity/v3/users/b62c62108bf6401b90fc8eb0de32a83f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:35.260207 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5780011-3910-4664-a650-a9c420914ecd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:35.260751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5780011-3910-4664-a650-a9c420914ecd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:35.260861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5780011-3910-4664-a650-a9c420914ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:35.281636 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b5780011-3910-4664-a650-a9c420914ecd None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:35.282891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b5780011-3910-4664-a650-a9c420914ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:35.350471 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4194/8409] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 18 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:35.375424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:35.375721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:35.375991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:35.397062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:35.398295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:35.407036 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4216/8410] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:35.412949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5780011-3910-4664-a650-a9c420914ecd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:35.423601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5780011-3910-4664-a650-a9c420914ecd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:35.429195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea58c2-5e71-420a-80b6-358a6eee7f2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:35.429806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea58c2-5e71-420a-80b6-358a6eee7f2c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:35.430115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea58c2-5e71-420a-80b6-358a6eee7f2c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:35.430391 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea58c2-5e71-420a-80b6-358a6eee7f2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:35.439017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea58c2-5e71-420a-80b6-358a6eee7f2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:35.440595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea58c2-5e71-420a-80b6-358a6eee7f2c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:35.452295 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4195/8411] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:35.553774 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:35.556012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:35.627183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801037a8-3a4a-4dee-9bc6-6dd56cd64db8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:35.632781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:35.633416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:35.633723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:35.633997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] PATH_INFO: `/v3/projects/cad859154e3f42e391d79a614d4f7443` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:35.635419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad859154e3f42e391d79a614d4f7443)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:35.637439 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:35.741460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:35.750008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad859154e3f42e391d79a614d4f7443', 'request_id': 'req-f84132a2-3217-4026-8d74-a4d48ebd01e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.756103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad859154e3f42e391d79a614d4f7443', 'request_id': 'req-f84132a2-3217-4026-8d74-a4d48ebd01e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.824383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad859154e3f42e391d79a614d4f7443', 'request_id': 'req-f84132a2-3217-4026-8d74-a4d48ebd01e2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.836324 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] The token cache is being invalidate because project cad859154e3f42e391d79a614d4f7443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:20:35.836925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.838197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-f84132a2-3217-4026-8d74-a4d48ebd01e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:35.839841 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4217/8412] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:20:35 2022] DELETE /identity/v3/projects/cad859154e3f42e391d79a614d4f7443 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:35.845656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8876e4-08ae-4d2c-bcb8-609b4aee9871 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:35.845945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8876e4-08ae-4d2c-bcb8-609b4aee9871 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:35.846259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8876e4-08ae-4d2c-bcb8-609b4aee9871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:35.861894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:35.867825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fa8876e4-08ae-4d2c-bcb8-609b4aee9871 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:35.869061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fa8876e4-08ae-4d2c-bcb8-609b4aee9871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:35.927694 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4196/8413] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:35.936116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0971e2-0c3a-420f-916f-fae0e92db4ba None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:35.936400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0971e2-0c3a-420f-916f-fae0e92db4ba None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:35.936674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0971e2-0c3a-420f-916f-fae0e92db4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:35.956939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1b0971e2-0c3a-420f-916f-fae0e92db4ba None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:35.958251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1b0971e2-0c3a-420f-916f-fae0e92db4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:35.967107 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4218/8414] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:35.973038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8876e4-08ae-4d2c-bcb8-609b4aee9871 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:35.981748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8876e4-08ae-4d2c-bcb8-609b4aee9871 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:35.986426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:35.987088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:35.987376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:35.987647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:35.988291 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:20:35.988591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:35.990220 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.001865 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4197/8415] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:20:36.006596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0971e2-0c3a-420f-916f-fae0e92db4ba None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:36.016043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0971e2-0c3a-420f-916f-fae0e92db4ba None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:36.020720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:36.021940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.022248 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.022519 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.023151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:36.025046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.128639 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4219/8416] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:20:36 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:20:36.133481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:36.144011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abc2b3-f9b2-44fa-bbe3-7bb0694798b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:36.201049 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:36.201656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.201934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.202259 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.202895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:36.204795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.297978 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4198/8417] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:20:36 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:20:36.303014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:36.313441 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255d3e8-d383-4d2d-8086-e88bdcdf6a9a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:36.318850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:36.319451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.319754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.320032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.320675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:36.322306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.332107 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4220/8418] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:36.335856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:36.345695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3a51e-adf5-49d8-b720-6191924d791e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:36.350399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b58987-766e-4d99-bc53-6a40db3cd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:36.350993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58987-766e-4d99-bc53-6a40db3cd549 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.351271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58987-766e-4d99-bc53-6a40db3cd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.351545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58987-766e-4d99-bc53-6a40db3cd549 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.352179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b58987-766e-4d99-bc53-6a40db3cd549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:36.353742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b58987-766e-4d99-bc53-6a40db3cd549 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.364163 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4199/8419] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:36.368728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:36.378584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fecae-e5cf-482d-921e-f5329f5bf3c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:36.384041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:36.384620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.385157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.385437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] PATH_INFO: `/v3/projects/2463b6d8549b4ea58267d9248cb84675/users/7ddfd5f835e2427fbf3090c3f6bc725a/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.399737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2463b6d8549b4ea58267d9248cb84675, user_id=7ddfd5f835e2427fbf3090c3f6bc725a, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:36.402418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.475788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4221/8420] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:20:36 2022] PUT /identity/v3/projects/2463b6d8549b4ea58267d9248cb84675/users/7ddfd5f835e2427fbf3090c3f6bc725a/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:36.491170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dcad-1ed9-45f4-bf96-baec31c6dba9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.491459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dcad-1ed9-45f4-bf96-baec31c6dba9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.491738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dcad-1ed9-45f4-bf96-baec31c6dba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.520383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4ae7dcad-1ed9-45f4-bf96-baec31c6dba9 None None] MFA Rules not processed for user `7ddfd5f835e2427fbf3090c3f6bc725a`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:36.521646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ae7dcad-1ed9-45f4-bf96-baec31c6dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:36.585944 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4200/8421] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:36.597410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:36.599137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:36.655596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecfdfa-7735-4722-b311-20184c71d1f2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:36.659191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7ec3a-1c51-40fd-b766-aded0aa922cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:36.659791 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7ec3a-1c51-40fd-b766-aded0aa922cf service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.660071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7ec3a-1c51-40fd-b766-aded0aa922cf service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.660347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7ec3a-1c51-40fd-b766-aded0aa922cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.669091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7ec3a-1c51-40fd-b766-aded0aa922cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:36.670558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7ec3a-1c51-40fd-b766-aded0aa922cf service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.679909 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4222/8422] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:36.698418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7dcad-1ed9-45f4-bf96-baec31c6dba9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:36.702641 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:36.761197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7dcad-1ed9-45f4-bf96-baec31c6dba9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:36.766210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:36.766846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:36.767129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:36.767404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] PATH_INFO: `/v3/users/7ddfd5f835e2427fbf3090c3f6bc725a` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:36.768534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ddfd5f835e2427fbf3090c3f6bc725a)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:36.770488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:36.942714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ddfd5f835e2427fbf3090c3f6bc725a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:36.943437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ddfd5f835e2427fbf3090c3f6bc725a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.019580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ddfd5f835e2427fbf3090c3f6bc725a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.020209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ddfd5f835e2427fbf3090c3f6bc725a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.028030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ddfd5f835e2427fbf3090c3f6bc725a'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.045775 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4201/8423] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:20:36 2022] DELETE /identity/v3/users/7ddfd5f835e2427fbf3090c3f6bc725a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:37.050398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:37.050885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:37.050987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:37.070965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:37.072153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:37.130481 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4223/8424] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:37.140480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:37.141887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:37.198558 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9648c4-6129-4786-8281-27eeb99775c8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:37.202087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c646f30-4b8b-41a1-9164-b704cc0636d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:37.202679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c646f30-4b8b-41a1-9164-b704cc0636d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:37.202956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c646f30-4b8b-41a1-9164-b704cc0636d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:37.203224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c646f30-4b8b-41a1-9164-b704cc0636d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:37.212676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c646f30-4b8b-41a1-9164-b704cc0636d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:37.214111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c646f30-4b8b-41a1-9164-b704cc0636d2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:37.223884 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4202/8425] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:37.627228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:37.628633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:37.639932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:37.643904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f61ad-550a-4c74-b7f7-a6ef7ec1bec9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:37.649063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:37.649755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:37.650031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:37.650338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] PATH_INFO: `/v3/projects/2463b6d8549b4ea58267d9248cb84675` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:37.651454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2463b6d8549b4ea58267d9248cb84675)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:37.653369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:37.763768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2463b6d8549b4ea58267d9248cb84675', 'request_id': 'req-e642d6cd-010c-410b-a6f6-3dce265e813b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.769776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2463b6d8549b4ea58267d9248cb84675', 'request_id': 'req-e642d6cd-010c-410b-a6f6-3dce265e813b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.859755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2463b6d8549b4ea58267d9248cb84675', 'request_id': 'req-e642d6cd-010c-410b-a6f6-3dce265e813b'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.870990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] The token cache is being invalidate because project 2463b6d8549b4ea58267d9248cb84675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:20:37.871983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.871983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-e642d6cd-010c-410b-a6f6-3dce265e813b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:20:37.873464 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4224/8426] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:20:37 2022] DELETE /identity/v3/projects/2463b6d8549b4ea58267d9248cb84675 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:37.878632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22e62-fd77-4ca9-9849-1f85a8073904 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:37.879131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22e62-fd77-4ca9-9849-1f85a8073904 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:37.879246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22e62-fd77-4ca9-9849-1f85a8073904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:37.900700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6af22e62-fd77-4ca9-9849-1f85a8073904 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:37.901909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6af22e62-fd77-4ca9-9849-1f85a8073904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:37.922433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:37.962296 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4203/8427] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:37.970627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812796f-9462-48c4-9b87-665600d4ccc9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:37.970910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812796f-9462-48c4-9b87-665600d4ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:37.971209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812796f-9462-48c4-9b87-665600d4ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:37.991682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-8812796f-9462-48c4-9b87-665600d4ccc9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:37.992873 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8812796f-9462-48c4-9b87-665600d4ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:38.001386 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4225/8428] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:38.005561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af22e62-fd77-4ca9-9849-1f85a8073904 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:38.015621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af22e62-fd77-4ca9-9849-1f85a8073904 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:38.020161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:38.020763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.023965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.023965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.023965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:20:38.023965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:38.024401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:38.035926 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4204/8429] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:20:38.040863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812796f-9462-48c4-9b87-665600d4ccc9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:38.050011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812796f-9462-48c4-9b87-665600d4ccc9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:38.055246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:38.055872 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.056189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.056415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.057057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:38.059108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:38.147951 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4226/8430] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:20:38 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:20:38.152286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:38.163030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4d24c-0ca4-48f9-8173-92f7e0c5fc26 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:38.219431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:38.220040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.220318 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.220588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.221209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:38.223162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:38.345699 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4205/8431] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:20:38 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:20:38.349743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:38.360076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20139c-bc95-418b-a22a-06624b9c2b5f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:38.364768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:38.365368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.365650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.366082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.366740 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:38.368371 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:38.378236 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4227/8432] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:38.382588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:38.392976 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e969f-828c-417c-9c6c-eb64c92f5332 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:38.398337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a744-73a8-4e1d-b8d7-4de319638e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:38.398928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a744-73a8-4e1d-b8d7-4de319638e2a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.399210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a744-73a8-4e1d-b8d7-4de319638e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.399515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a744-73a8-4e1d-b8d7-4de319638e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.400147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a744-73a8-4e1d-b8d7-4de319638e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:38.401720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a744-73a8-4e1d-b8d7-4de319638e2a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:38.412568 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4206/8433] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:20:38.416482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:38.426768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7fb7a-3ca7-4b3d-b877-9d9278ea6be6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:38.431848 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:38.432494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.432802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.433073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] PATH_INFO: `/v3/projects/72bd5a46ec0c470c8479206e1707672c/users/58d59f2505e745e09ee9f00775987b7c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.447975 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bd5a46ec0c470c8479206e1707672c, user_id=58d59f2505e745e09ee9f00775987b7c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:38.450691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:38.512495 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4228/8434] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:20:38 2022] PUT /identity/v3/projects/72bd5a46ec0c470c8479206e1707672c/users/58d59f2505e745e09ee9f00775987b7c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:20:38.523460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e6fc-5dcf-4817-be95-a155876e3df7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.523777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e6fc-5dcf-4817-be95-a155876e3df7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.524057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760e6fc-5dcf-4817-be95-a155876e3df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.551802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5760e6fc-5dcf-4817-be95-a155876e3df7 None None] MFA Rules not processed for user `58d59f2505e745e09ee9f00775987b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:20:38.553529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5760e6fc-5dcf-4817-be95-a155876e3df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:38.618485 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4207/8435] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:20:38.630403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:20:38.632729 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:20:38.689433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca958e3-6d2f-45b1-a77b-43e6a43bc933 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:20:38.693691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d995217-dab1-45b0-ae5a-211faddfbdea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:20:38.694398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d995217-dab1-45b0-ae5a-211faddfbdea service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:20:38.694679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d995217-dab1-45b0-ae5a-211faddfbdea service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:20:38.694952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d995217-dab1-45b0-ae5a-211faddfbdea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:20:38.703188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d995217-dab1-45b0-ae5a-211faddfbdea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:20:38.704622 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d995217-dab1-45b0-ae5a-211faddfbdea service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:20:38.713533 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4229/8436] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:20:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:20:48.615076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:48.709478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:02.294258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e6fc-5dcf-4817-be95-a155876e3df7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:02.365667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760e6fc-5dcf-4817-be95-a155876e3df7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:02.370270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:02.370922 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:02.371198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:02.371468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] PATH_INFO: `/v3/users/58d59f2505e745e09ee9f00775987b7c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:02.372739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d59f2505e745e09ee9f00775987b7c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:02.374726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:02.548016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d59f2505e745e09ee9f00775987b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:02.548670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d59f2505e745e09ee9f00775987b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:02.636995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d59f2505e745e09ee9f00775987b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:02.637534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d59f2505e745e09ee9f00775987b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:02.645288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d59f2505e745e09ee9f00775987b7c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:02.663290 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4208/8437] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:21:02 2022] DELETE /identity/v3/users/58d59f2505e745e09ee9f00775987b7c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:21:02.667994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:02.668472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:02.668727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:02.688217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:02.689414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:02.749089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4230/8438] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:21:02.759609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:02.761258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:02.818761 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0376b3-d62d-433d-b91d-3427557dfbd3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:02.823102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c5a56-96d6-4873-971f-b0f25525a0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:02.823726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5a56-96d6-4873-971f-b0f25525a0ac service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:02.824005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5a56-96d6-4873-971f-b0f25525a0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:02.824280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c5a56-96d6-4873-971f-b0f25525a0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:02.834069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c5a56-96d6-4873-971f-b0f25525a0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:02.835554 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c5a56-96d6-4873-971f-b0f25525a0ac service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:02.845157 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4209/8439] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:21:03.231249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:03.232811 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:03.246162 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593717ea-09b7-436d-ad2d-71d369b6dd93 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:03.250877 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:03.256612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:03.256915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:03.257211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] PATH_INFO: `/v3/projects/72bd5a46ec0c470c8479206e1707672c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:03.259581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bd5a46ec0c470c8479206e1707672c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:03.261790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:03.380315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bd5a46ec0c470c8479206e1707672c', 'request_id': 'req-4f34e376-96e5-45a2-8ecd-e64f6db3e007'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:03.388004 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bd5a46ec0c470c8479206e1707672c', 'request_id': 'req-4f34e376-96e5-45a2-8ecd-e64f6db3e007'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:03.453301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bd5a46ec0c470c8479206e1707672c', 'request_id': 'req-4f34e376-96e5-45a2-8ecd-e64f6db3e007'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:03.464992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] The token cache is being invalidate because project 72bd5a46ec0c470c8479206e1707672c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:21:03.465296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:03.465956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4f34e376-96e5-45a2-8ecd-e64f6db3e007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:21:03.467466 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4231/8440] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:21:03 2022] DELETE /identity/v3/projects/72bd5a46ec0c470c8479206e1707672c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:21:03.474856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55c35-d445-40a4-ae71-e853f29ea8cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:03.475430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55c35-d445-40a4-ae71-e853f29ea8cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:03.475430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55c35-d445-40a4-ae71-e853f29ea8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:03.495287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6de55c35-d445-40a4-ae71-e853f29ea8cf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:03.496484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6de55c35-d445-40a4-ae71-e853f29ea8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:03.514286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:03.560241 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4210/8441] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:21:03.667685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b76007-2b68-4d7f-99f4-d1ca397c4b8d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:03.667974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b76007-2b68-4d7f-99f4-d1ca397c4b8d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:03.668252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b76007-2b68-4d7f-99f4-d1ca397c4b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:03.688946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-88b76007-2b68-4d7f-99f4-d1ca397c4b8d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:03.690196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88b76007-2b68-4d7f-99f4-d1ca397c4b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:03.698419 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4232/8442] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:21:03.702799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55c35-d445-40a4-ae71-e853f29ea8cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:03.712820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55c35-d445-40a4-ae71-e853f29ea8cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:03.717640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:03.718328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:03.718615 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:03.718896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:03.719551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:21:03.719860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:03.721492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:03.734870 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4211/8443] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:21:03.739209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b76007-2b68-4d7f-99f4-d1ca397c4b8d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:03.749277 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b76007-2b68-4d7f-99f4-d1ca397c4b8d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:03.754098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:03.754704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:03.754989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:03.755267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:03.755936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:03.757863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:03.849089 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4233/8444] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:21:03 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:21:03.853092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:03.863566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1dc9d-e992-4581-a7e0-fb2ea8e0a29c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:03.920943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:03.921555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:03.921839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:03.922148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:03.922789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:03.924713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:03.997090 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4212/8445] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:21:03 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:21:04.001332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:04.012611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f1a6-a064-44a5-bcfb-f3465ace39bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:04.017221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:04.017823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:04.018142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:04.018424 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:04.019066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:04.020665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:04.030499 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4234/8446] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:21:04.034402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:04.044607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c821041-2ea4-46be-bed3-3fd6da1e4e0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:04.049334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833107e-843a-45b7-9a9d-1244db596913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:04.049928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833107e-843a-45b7-9a9d-1244db596913 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:04.050248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833107e-843a-45b7-9a9d-1244db596913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:04.050528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833107e-843a-45b7-9a9d-1244db596913 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:04.051188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833107e-843a-45b7-9a9d-1244db596913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:04.052773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833107e-843a-45b7-9a9d-1244db596913 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:04.065109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4213/8447] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:21:04.069148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:04.079963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c0534-3075-415d-8293-f2cb24fbdffe admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:04.084624 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:04.085276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:04.085562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:04.085844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] PATH_INFO: `/v3/projects/f09061f81e9c4850a4ec04996daa2a57/users/6cbfc2c4bddf4f979ab328d336d074a2/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:04.101299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09061f81e9c4850a4ec04996daa2a57, user_id=6cbfc2c4bddf4f979ab328d336d074a2, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:04.104065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:04.161885 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4235/8448] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:21:04 2022] PUT /identity/v3/projects/f09061f81e9c4850a4ec04996daa2a57/users/6cbfc2c4bddf4f979ab328d336d074a2/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:21:04.167299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28c5d-136e-4598-bfe4-8dfa2ed98506 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:04.169326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28c5d-136e-4598-bfe4-8dfa2ed98506 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:04.169326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28c5d-136e-4598-bfe4-8dfa2ed98506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:04.187128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-23c28c5d-136e-4598-bfe4-8dfa2ed98506 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:04.188320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-23c28c5d-136e-4598-bfe4-8dfa2ed98506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:04.248100 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4214/8449] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:21:04.258717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:04.260752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:04.282766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:04.318360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebcee4-dfb7-4843-91e2-4c7b656d68f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:04.322745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:04.323351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:04.323633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:04.323913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:04.333348 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:04.338438 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:04.346363 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4236/8450] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:21:05.380513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e840dc-b3c8-40ec-9e18-1780a61ede6e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:05.381058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e840dc-b3c8-40ec-9e18-1780a61ede6e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:05.381058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e840dc-b3c8-40ec-9e18-1780a61ede6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:05.409712 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9e840dc-b3c8-40ec-9e18-1780a61ede6e None None] MFA Rules not processed for user `6cbfc2c4bddf4f979ab328d336d074a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:05.411008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9e840dc-b3c8-40ec-9e18-1780a61ede6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:05.428538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:05.482454 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4215/8451] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:21:05.493267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:05.495046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:05.552554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f5bf1-7143-47bf-9911-aa9ef73d2da4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:05.556208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:05.556810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:05.557085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:05.557355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:05.566245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:05.567672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:05.576561 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4237/8452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:21:08.295818 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:08.296321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:08.296321 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:08.315167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] MFA Rules not processed for user `6cbfc2c4bddf4f979ab328d336d074a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:08.316359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:08.323148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4216/8453] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:21:08.376859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:08.378466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:08.437478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5da24-48ed-45da-9ace-f9469389d5e6 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:08.441160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:08.441767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:08.442083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:08.442357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:08.444090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:08.522635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:08.524113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:08.543079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:08.548516 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4238/8454] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:21:09.125070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:09.127275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:09.153529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:09.163023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6be202-d74d-4d7c-8cec-ae641ae213e1 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:09.167724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:09.168356 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:09.168684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:09.168960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:09.170709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:09.187952 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:09.189459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:09.203613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6217d-8a33-4372-b02e-68df55836f37 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:09.203790 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4239/8455] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:21:09.208846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e5e55-c3f0-4188-8d0e-e5abd068e995 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:09.209471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5e55-c3f0-4188-8d0e-e5abd068e995 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:09.209752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5e55-c3f0-4188-8d0e-e5abd068e995 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:09.210026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5e55-c3f0-4188-8d0e-e5abd068e995 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:09.211756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cb9e5e55-c3f0-4188-8d0e-e5abd068e995 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:09.223606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5e55-c3f0-4188-8d0e-e5abd068e995 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:09.225188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5e55-c3f0-4188-8d0e-e5abd068e995 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:09.235896 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4217/8456] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:21:18.874409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:18.876042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:18.893558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3667ca3-ee87-4dcf-8a45-cee863605014 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:18.899192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:18.899801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:18.900086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:18.900364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:18.902097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:18.916766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:18.918932 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:18.933558 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4240/8457] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:21:19.231484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=54 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:25.468959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:25.469540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:25.469540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:25.488513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] MFA Rules not processed for user `6cbfc2c4bddf4f979ab328d336d074a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:25.489720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:25.497084 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4218/8458] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:21:26.092616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:26.094130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:26.112226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9814d5-b3f2-4daf-b8b2-7a7f0776c723 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:26.117493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:26.118135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:26.118425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:26.118704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:26.120456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:26.132761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:26.134385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:26.148459 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4241/8459] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:21:35.093561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:35.095032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:35.107010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc5d6e-d9e5-4c37-bb60-09591135e462 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:35.110537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56d183-091f-4609-a113-6d45503d0f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:35.111221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d183-091f-4609-a113-6d45503d0f3a service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:35.111526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d183-091f-4609-a113-6d45503d0f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:35.111806 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56d183-091f-4609-a113-6d45503d0f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:35.113549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-eb56d183-091f-4609-a113-6d45503d0f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:35.127121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56d183-091f-4609-a113-6d45503d0f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:35.128612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56d183-091f-4609-a113-6d45503d0f3a service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:35.140501 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4219/8460] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:21:36.144107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=19 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:39.804221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:39.805670 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:39.824577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25b4bb-da8f-4314-96a2-b4b36287a5f5 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:39.830596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:39.831197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:39.831482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:39.831755 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:39.833525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:39.848917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:39.850543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:39.863854 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4242/8461] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:21:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:21:43.155413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68410238-8985-4852-bbda-c85974115db4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:43.155880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68410238-8985-4852-bbda-c85974115db4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:43.155959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68410238-8985-4852-bbda-c85974115db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:43.176628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-68410238-8985-4852-bbda-c85974115db4 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:21:43.177856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-68410238-8985-4852-bbda-c85974115db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:43.233643 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4220/8462] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:21:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:21:43.376114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:21:43.377528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:21:43.445783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4939-5763-4275-ab55-3b84a04619fd service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:21:43.450871 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:21:43.451475 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:21:43.451859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:21:43.452141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:21:43.460549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:21:43.462254 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:21:43.471332 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4243/8463] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:21:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:21:53.226083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=34 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:53.468064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=38 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:01.110037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d5f66-be11-437c-9ca9-7f21730c66d7 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:01.110496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d5f66-be11-437c-9ca9-7f21730c66d7 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:01.110714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d5f66-be11-437c-9ca9-7f21730c66d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:01.140271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d6d5f66-be11-437c-9ca9-7f21730c66d7 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:01.141501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d6d5f66-be11-437c-9ca9-7f21730c66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:01.148713 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4221/8464] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:01.161390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:01.171797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d0b67-6618-4542-9ad1-a34dcd6f3dc9 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:01.176689 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:01.177273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:01.177550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:01.177833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:01.186208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:01.187781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:01.195833 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4244/8465] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:22:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:22:06.127651 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d5f66-be11-437c-9ca9-7f21730c66d7 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:06.139493 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d5f66-be11-437c-9ca9-7f21730c66d7 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:06.144145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:06.144783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:06.145063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:06.145340 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] PATH_INFO: `/v3/users/6cbfc2c4bddf4f979ab328d336d074a2` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:06.146482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbfc2c4bddf4f979ab328d336d074a2)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:06.148522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:06.317434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbfc2c4bddf4f979ab328d336d074a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:06.318146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbfc2c4bddf4f979ab328d336d074a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:06.411402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbfc2c4bddf4f979ab328d336d074a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:06.411989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbfc2c4bddf4f979ab328d336d074a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:06.419431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-2a79e301-2d43-40cd-b622-4ee245a98671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbfc2c4bddf4f979ab328d336d074a2'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:06.438324 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4222/8466] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:22:06 2022] DELETE /identity/v3/users/6cbfc2c4bddf4f979ab328d336d074a2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:06.688545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:06.700488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aaf3d-de0b-4b46-9e6f-e6b1e1d00918 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:06.771626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:06.772263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:06.772547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:06.772850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] PATH_INFO: `/v3/projects/f09061f81e9c4850a4ec04996daa2a57` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:06.773984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09061f81e9c4850a4ec04996daa2a57)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:06.775923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:06.921608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09061f81e9c4850a4ec04996daa2a57', 'request_id': 'req-2e07bde1-0572-4110-ad5f-062a50d80384'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:06.928296 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09061f81e9c4850a4ec04996daa2a57', 'request_id': 'req-2e07bde1-0572-4110-ad5f-062a50d80384'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:06.994835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09061f81e9c4850a4ec04996daa2a57', 'request_id': 'req-2e07bde1-0572-4110-ad5f-062a50d80384'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:07.008738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] The token cache is being invalidate because project f09061f81e9c4850a4ec04996daa2a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:22:07.009252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:07.010311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-2e07bde1-0572-4110-ad5f-062a50d80384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:07.013237 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4245/8467] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:22:06 2022] DELETE /identity/v3/projects/f09061f81e9c4850a4ec04996daa2a57 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:07.019844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746190b-ae2c-40b6-8a05-237343dd431e None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.020141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746190b-ae2c-40b6-8a05-237343dd431e None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.020421 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746190b-ae2c-40b6-8a05-237343dd431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.042165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3746190b-ae2c-40b6-8a05-237343dd431e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:07.043476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3746190b-ae2c-40b6-8a05-237343dd431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:07.112466 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4223/8468] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:07.120397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77967d59-e22b-4e66-aabe-a0d51ede7a28 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.120663 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77967d59-e22b-4e66-aabe-a0d51ede7a28 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.120944 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77967d59-e22b-4e66-aabe-a0d51ede7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.142231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-77967d59-e22b-4e66-aabe-a0d51ede7a28 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:07.143514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77967d59-e22b-4e66-aabe-a0d51ede7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:07.151726 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4246/8469] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:07.156587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746190b-ae2c-40b6-8a05-237343dd431e None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:07.167634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746190b-ae2c-40b6-8a05-237343dd431e None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:07.172361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:07.172971 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.173247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.173516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.174310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:22:07.174612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:07.176431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:07.188929 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4224/8470] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:22:07.193383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77967d59-e22b-4e66-aabe-a0d51ede7a28 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:07.203686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77967d59-e22b-4e66-aabe-a0d51ede7a28 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:07.208281 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:07.208876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.209156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.209429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.210047 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:07.212100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:07.311265 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4247/8471] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:22:07 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:07.315328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:07.325840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b39270-87b0-4a89-94ec-ed2a240cb820 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:07.370509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:07.386740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:07.387356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.387639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.387917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.388562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:07.391149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:07.468937 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4225/8472] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:22:07 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:07.472885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:07.483437 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd3d2d-8f60-4199-bdba-1e06a78d83c7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:07.488202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:07.488799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.489081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.489355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.489993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:07.491621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:07.502092 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4248/8473] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:07.505969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:07.516739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d367f-ed5a-4229-b310-73518c44ece8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:07.521592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52612c1b-bcfa-45b8-8ff2-4450ebbed327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:07.522228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52612c1b-bcfa-45b8-8ff2-4450ebbed327 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.522512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52612c1b-bcfa-45b8-8ff2-4450ebbed327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.522784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52612c1b-bcfa-45b8-8ff2-4450ebbed327 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.523433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52612c1b-bcfa-45b8-8ff2-4450ebbed327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:07.525072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52612c1b-bcfa-45b8-8ff2-4450ebbed327 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:07.535822 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4226/8474] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:07.539815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:07.550492 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a547f-1316-4352-9f33-4186388808bd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:07.555259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:07.555912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.556194 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.556472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] PATH_INFO: `/v3/projects/203acf6c38634e42becd2781a2f89430/users/dd0463e5aa8f403b904f47ae72dcf94b/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.571758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203acf6c38634e42becd2781a2f89430, user_id=dd0463e5aa8f403b904f47ae72dcf94b, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:07.574405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:07.651636 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4249/8475] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:07 2022] PUT /identity/v3/projects/203acf6c38634e42becd2781a2f89430/users/dd0463e5aa8f403b904f47ae72dcf94b/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:07.662880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd046ca-de49-4a35-85ad-540a834c091f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.669006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd046ca-de49-4a35-85ad-540a834c091f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.669006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd046ca-de49-4a35-85ad-540a834c091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.692189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8fd046ca-de49-4a35-85ad-540a834c091f None None] MFA Rules not processed for user `dd0463e5aa8f403b904f47ae72dcf94b`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:07.693402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8fd046ca-de49-4a35-85ad-540a834c091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:07.757076 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4227/8476] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:07.768770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:07.770491 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:07.785315 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:07.829330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1c671-7c1a-471a-8d4a-ebd79bcc5cf4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:07.833053 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32529e35-675d-424b-b13f-3e97f2417ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:07.833895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32529e35-675d-424b-b13f-3e97f2417ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:07.834251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32529e35-675d-424b-b13f-3e97f2417ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:07.834712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32529e35-675d-424b-b13f-3e97f2417ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:07.843705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32529e35-675d-424b-b13f-3e97f2417ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:07.846512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32529e35-675d-424b-b13f-3e97f2417ad8 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:07.854139 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4250/8477] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:17.748494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd046ca-de49-4a35-85ad-540a834c091f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:17.812256 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd046ca-de49-4a35-85ad-540a834c091f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:17.816866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:17.817578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:17.817893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:17.818203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] PATH_INFO: `/v3/users/dd0463e5aa8f403b904f47ae72dcf94b` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:17.819355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0463e5aa8f403b904f47ae72dcf94b)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:17.821337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:17.857563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=20 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:17.973749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0463e5aa8f403b904f47ae72dcf94b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:17.974484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0463e5aa8f403b904f47ae72dcf94b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.034530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0463e5aa8f403b904f47ae72dcf94b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.035176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0463e5aa8f403b904f47ae72dcf94b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.036683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:18.043603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0463e5aa8f403b904f47ae72dcf94b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.062125 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4228/8478] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:22:17 2022] DELETE /identity/v3/users/dd0463e5aa8f403b904f47ae72dcf94b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:18.066633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:18.066982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:18.067230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:18.087834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:18.089031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:18.149562 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4251/8479] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:22:18.159672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:18.161148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:18.219238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f533bc7-dbd6-4dbc-9ebf-8d1db6f8e727 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:18.222934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bcd42-61b1-40e8-a55d-f63a6f893626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:18.223541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bcd42-61b1-40e8-a55d-f63a6f893626 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:18.223826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bcd42-61b1-40e8-a55d-f63a6f893626 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:18.224097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bcd42-61b1-40e8-a55d-f63a6f893626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:18.233501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bcd42-61b1-40e8-a55d-f63a6f893626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:18.234970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bcd42-61b1-40e8-a55d-f63a6f893626 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:18.244385 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4229/8480] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:18.687176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:18.688795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:18.703404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f960-f205-40b3-b2fc-6c55b1838f7d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:18.708089 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:18.708884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:18.709179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:18.709463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] PATH_INFO: `/v3/projects/203acf6c38634e42becd2781a2f89430` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:18.711790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203acf6c38634e42becd2781a2f89430)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:18.713725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:18.824391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203acf6c38634e42becd2781a2f89430', 'request_id': 'req-403da7e4-4c19-461c-a971-249301b11018'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.831591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203acf6c38634e42becd2781a2f89430', 'request_id': 'req-403da7e4-4c19-461c-a971-249301b11018'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.919747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203acf6c38634e42becd2781a2f89430', 'request_id': 'req-403da7e4-4c19-461c-a971-249301b11018'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.930910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] The token cache is being invalidate because project 203acf6c38634e42becd2781a2f89430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:22:18.931131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.931762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-403da7e4-4c19-461c-a971-249301b11018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:18.933249 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4252/8481] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:22:18 2022] DELETE /identity/v3/projects/203acf6c38634e42becd2781a2f89430 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:18.938644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833220c-16d5-4fb9-b661-f15eac57a48b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:18.939072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833220c-16d5-4fb9-b661-f15eac57a48b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:18.939178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833220c-16d5-4fb9-b661-f15eac57a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:18.959217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5833220c-16d5-4fb9-b661-f15eac57a48b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:18.960411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5833220c-16d5-4fb9-b661-f15eac57a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:19.021276 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4230/8482] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:19.029384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebd7c-7d6d-4980-91fa-863ca528c331 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.030355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebd7c-7d6d-4980-91fa-863ca528c331 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.030621 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebd7c-7d6d-4980-91fa-863ca528c331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.052191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-88cebd7c-7d6d-4980-91fa-863ca528c331 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:19.053411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-88cebd7c-7d6d-4980-91fa-863ca528c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:19.061747 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4253/8483] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:19.066203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833220c-16d5-4fb9-b661-f15eac57a48b None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:19.080129 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833220c-16d5-4fb9-b661-f15eac57a48b None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:19.087531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:19.088209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.088499 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.088777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.089483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:22:19.089998 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:19.092026 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:19.107332 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4231/8484] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:22:19.111869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebd7c-7d6d-4980-91fa-863ca528c331 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:19.122957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebd7c-7d6d-4980-91fa-863ca528c331 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:19.129178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:19.130028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.130463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.130888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.131632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:19.133764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:19.281910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4254/8485] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:22:19 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:19.286001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:19.296179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b33477-d9e5-4fb3-bf57-9de7ebb1fce9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:19.354018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:19.354590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.354870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.355143 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.355764 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:19.357686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:19.366676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:19.480220 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4232/8486] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:22:19 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:19.484824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:19.495005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf30a2-1c7e-477d-b623-ac6aa9c3f80c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:19.500055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:19.500644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.500920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.501188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.501823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:19.503498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:19.513831 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4255/8487] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:19.518398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:19.528270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df2b8b-394b-4509-bb1d-90b3b8465900 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:19.535653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110e516-9a67-474b-b153-8e5ce2ca91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:19.535653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e516-9a67-474b-b153-8e5ce2ca91b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.535653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e516-9a67-474b-b153-8e5ce2ca91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.535653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e516-9a67-474b-b153-8e5ce2ca91b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.536153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e516-9a67-474b-b153-8e5ce2ca91b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:19.537369 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e516-9a67-474b-b153-8e5ce2ca91b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:19.550086 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4233/8488] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:19.554300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:19.564825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f853b-b1d9-4f07-a007-d78e48cfbd41 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:19.569412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:19.570085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.570399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.570677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] PATH_INFO: `/v3/projects/12b770cebde244e496501ea5c724f9f5/users/042da80d5aed4e4b8403a5a20f64b0e4/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.585046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b770cebde244e496501ea5c724f9f5, user_id=042da80d5aed4e4b8403a5a20f64b0e4, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:19.587743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:19.656907 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4256/8489] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:19 2022] PUT /identity/v3/projects/12b770cebde244e496501ea5c724f9f5/users/042da80d5aed4e4b8403a5a20f64b0e4/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:19.662097 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc145-dc0f-455c-b738-a55f69a54d69 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.672876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc145-dc0f-455c-b738-a55f69a54d69 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.672876 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc145-dc0f-455c-b738-a55f69a54d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.681896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-da6dc145-dc0f-455c-b738-a55f69a54d69 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:19.683136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-da6dc145-dc0f-455c-b738-a55f69a54d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:19.741454 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4234/8490] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:19.751685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:19.753354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:19.775150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:19.810344 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fe7b9-a9be-46b0-ba7b-939b8e1b9c67 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:19.814549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:19.818950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:19.818950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:19.818950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:19.826542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:19.828100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:19.837752 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4257/8491] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:25.048441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8685-d4cc-4cbb-89df-d4581d6568ec None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:25.049001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8685-d4cc-4cbb-89df-d4581d6568ec None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:25.049001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8685-d4cc-4cbb-89df-d4581d6568ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:25.080476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2d7a8685-d4cc-4cbb-89df-d4581d6568ec None None] MFA Rules not processed for user `042da80d5aed4e4b8403a5a20f64b0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:25.081718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2d7a8685-d4cc-4cbb-89df-d4581d6568ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:25.160767 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4235/8492] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:25.165302 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:25.175742 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d282fc4-c016-4212-b36c-59515e242ee8 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:25.180569 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:25.181255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:25.181535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:25.181805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:25.182494 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:25.184443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:25.273013 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4258/8493] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:22:25 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:25.274483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a8685-d4cc-4cbb-89df-d4581d6568ec None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:25.286382 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a8685-d4cc-4cbb-89df-d4581d6568ec None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:25.345162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:25.346137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:25.346434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:25.346716 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:25.347379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:25.349315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:25.424048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:25.429344 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4236/8494] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:22:25 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:25.433373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:25.444016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660491f-d127-46d6-849a-8bb1d475db94 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:25.448704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:25.449325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:25.449638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:25.449917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:25.450688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:25.452300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:25.463910 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4259/8495] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:25.469277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:25.480305 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68690c-75f5-433d-b82e-bcc50f53e17b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:25.485621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:25.486304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:25.486586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:25.486856 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] PATH_INFO: `/v3/projects/9b2a08f8065840cfbfe40d8ee50451f8/users/cc47ce354fb94a9b866b2282fabdf9dc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:25.501648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2a08f8065840cfbfe40d8ee50451f8, user_id=cc47ce354fb94a9b866b2282fabdf9dc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:25.504302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:25.583146 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4237/8496] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:25 2022] PUT /identity/v3/projects/9b2a08f8065840cfbfe40d8ee50451f8/users/cc47ce354fb94a9b866b2282fabdf9dc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:25.587257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:25.598387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20d444-902d-45b7-8bb4-463d35bdf495 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:25.655111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945ebb4-ad67-42ca-a8d8-b1cc5aa1255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:25.655783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945ebb4-ad67-42ca-a8d8-b1cc5aa1255c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:25.656060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945ebb4-ad67-42ca-a8d8-b1cc5aa1255c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:25.656333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945ebb4-ad67-42ca-a8d8-b1cc5aa1255c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:25.656965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945ebb4-ad67-42ca-a8d8-b1cc5aa1255c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:25.658581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945ebb4-ad67-42ca-a8d8-b1cc5aa1255c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:25.668219 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4260/8497] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:25.672416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:25.682606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb9286-4ea0-454e-8468-c8e52f0048d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:25.687353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92db619-1576-4a67-a0c5-327b667986b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:25.688010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92db619-1576-4a67-a0c5-327b667986b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:25.688288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92db619-1576-4a67-a0c5-327b667986b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:25.688561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92db619-1576-4a67-a0c5-327b667986b2 admin admin] PATH_INFO: `/v3/projects/9b2a08f8065840cfbfe40d8ee50451f8/users/cc47ce354fb94a9b866b2282fabdf9dc/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:25.690521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92db619-1576-4a67-a0c5-327b667986b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2a08f8065840cfbfe40d8ee50451f8, user_id=cc47ce354fb94a9b866b2282fabdf9dc, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:25.693137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92db619-1576-4a67-a0c5-327b667986b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:25.703604 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4238/8498] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:25 2022] PUT /identity/v3/projects/9b2a08f8065840cfbfe40d8ee50451f8/users/cc47ce354fb94a9b866b2282fabdf9dc/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:31.169101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d188c-0673-4c9f-a3ad-5705983fb1d9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:31.169652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d188c-0673-4c9f-a3ad-5705983fb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:31.169737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d188c-0673-4c9f-a3ad-5705983fb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:31.201093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c49d188c-0673-4c9f-a3ad-5705983fb1d9 None None] MFA Rules not processed for user `cc47ce354fb94a9b866b2282fabdf9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:31.202584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c49d188c-0673-4c9f-a3ad-5705983fb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:31.284946 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4261/8499] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:31.298450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305e53-4c3d-4de8-a4b2-269561f985f4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:31.298912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305e53-4c3d-4de8-a4b2-269561f985f4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:31.299006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305e53-4c3d-4de8-a4b2-269561f985f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:31.342317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-44305e53-4c3d-4de8-a4b2-269561f985f4 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:31.343563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-44305e53-4c3d-4de8-a4b2-269561f985f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:31.431026 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4239/8500] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:31.438347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d188c-0673-4c9f-a3ad-5705983fb1d9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:31.450744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d188c-0673-4c9f-a3ad-5705983fb1d9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:31.457146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:31.457766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:31.458097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:31.458373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:31.467135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:31.468725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:31.472679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:31.478842 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4262/8501] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:31.854521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de2c6-c389-41f6-a17f-de73d0e5a278 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:31.854839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de2c6-c389-41f6-a17f-de73d0e5a278 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:31.855116 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07de2c6-c389-41f6-a17f-de73d0e5a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:31.888680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a07de2c6-c389-41f6-a17f-de73d0e5a278 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:31.889890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a07de2c6-c389-41f6-a17f-de73d0e5a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:31.954522 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4240/8502] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:31.960665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:31.973237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26740809-e4fb-434e-8ee9-f81487a6b039 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:31.978658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:31.979265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:31.979540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:31.979950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:31.981803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:31.996950 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:31.998617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:32.011763 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4263/8503] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:32.471424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72618-d95c-4346-b828-ec61d956af7c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:32.471985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72618-d95c-4346-b828-ec61d956af7c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:32.472165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72618-d95c-4346-b828-ec61d956af7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:32.494395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-12a72618-d95c-4346-b828-ec61d956af7c None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:32.495646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-12a72618-d95c-4346-b828-ec61d956af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:32.505398 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4241/8504] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:22:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:32.517925 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:32.519485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:32.532715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f72293-3e0f-4759-bfed-1ff3d5b0517c service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:32.538084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:32.538819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:32.539131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:32.539406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:32.549012 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:32.550769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:32.561800 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4264/8505] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:36.691212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72618-d95c-4346-b828-ec61d956af7c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:36.698735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:36.704185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72618-d95c-4346-b828-ec61d956af7c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:36.708935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:36.709659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:36.710012 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:36.712981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:36.715010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:36.731469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:36.733739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:36.748720 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4242/8506] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:40.253530 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:40.317048 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda53a2-75f3-49ef-a980-135b381a4c6b service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:40.321652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:40.322317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:40.322600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:40.322880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] PATH_INFO: `/v3/users/042da80d5aed4e4b8403a5a20f64b0e4` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:40.324015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042da80d5aed4e4b8403a5a20f64b0e4)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:40.326498 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:40.487688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042da80d5aed4e4b8403a5a20f64b0e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:40.494673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042da80d5aed4e4b8403a5a20f64b0e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:40.495337 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042da80d5aed4e4b8403a5a20f64b0e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:40.507766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042da80d5aed4e4b8403a5a20f64b0e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:40.570039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042da80d5aed4e4b8403a5a20f64b0e4'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:40.576116 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4265/8507] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:22:40 2022] DELETE /identity/v3/users/042da80d5aed4e4b8403a5a20f64b0e4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:40.829693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:40.841604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d10e90-f524-4513-b782-93944c04d6e7 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:40.900683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:40.901362 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:40.901694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:40.901974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] PATH_INFO: `/v3/projects/12b770cebde244e496501ea5c724f9f5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:40.903229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b770cebde244e496501ea5c724f9f5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:40.905706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:41.000027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b770cebde244e496501ea5c724f9f5', 'request_id': 'req-c480271c-ce8e-47de-8fe1-355f474c0e73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.006257 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b770cebde244e496501ea5c724f9f5', 'request_id': 'req-c480271c-ce8e-47de-8fe1-355f474c0e73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.061959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b770cebde244e496501ea5c724f9f5', 'request_id': 'req-c480271c-ce8e-47de-8fe1-355f474c0e73'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.072661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] The token cache is being invalidate because project 12b770cebde244e496501ea5c724f9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:22:41.072977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.073603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.075200 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4243/8508] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:22:40 2022] DELETE /identity/v3/projects/12b770cebde244e496501ea5c724f9f5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:41.079340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:41.080727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:41.094143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37cba7-836f-430e-9662-78ed49cc18f1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:41.140758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:41.150583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:41.151243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:41.151523 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:41.151800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] PATH_INFO: `/v3/users/cc47ce354fb94a9b866b2282fabdf9dc` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:41.152930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc47ce354fb94a9b866b2282fabdf9dc)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:41.155406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:41.275891 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc47ce354fb94a9b866b2282fabdf9dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.282884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc47ce354fb94a9b866b2282fabdf9dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.283619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc47ce354fb94a9b866b2282fabdf9dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.296406 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc47ce354fb94a9b866b2282fabdf9dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.433273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1849e5a3-4ab2-4fc8-894e-8ac4193b4f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc47ce354fb94a9b866b2282fabdf9dc'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.439623 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4266/8509] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:22:41 2022] DELETE /identity/v3/users/cc47ce354fb94a9b866b2282fabdf9dc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:41.663903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:41.665349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:41.678867 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480271c-ce8e-47de-8fe1-355f474c0e73 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:41.735551 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:41.736189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:41.736467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:41.736737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] PATH_INFO: `/v3/projects/9b2a08f8065840cfbfe40d8ee50451f8` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:41.737836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2a08f8065840cfbfe40d8ee50451f8)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:41.739754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:41.764795 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:41.862661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2a08f8065840cfbfe40d8ee50451f8', 'request_id': 'req-facec4d2-9bbe-4b07-969d-864ed11e84cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.868767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2a08f8065840cfbfe40d8ee50451f8', 'request_id': 'req-facec4d2-9bbe-4b07-969d-864ed11e84cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.913560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2a08f8065840cfbfe40d8ee50451f8', 'request_id': 'req-facec4d2-9bbe-4b07-969d-864ed11e84cb'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.925722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] The token cache is being invalidate because project 9b2a08f8065840cfbfe40d8ee50451f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:22:41.929123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.929123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-facec4d2-9bbe-4b07-969d-864ed11e84cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:41.929274 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4244/8510] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:22:41 2022] DELETE /identity/v3/projects/9b2a08f8065840cfbfe40d8ee50451f8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:41.934389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51c94-a25b-4282-b5af-97fbe6d75c79 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:41.934681 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51c94-a25b-4282-b5af-97fbe6d75c79 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:41.934958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51c94-a25b-4282-b5af-97fbe6d75c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:41.973596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1fb51c94-a25b-4282-b5af-97fbe6d75c79 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:41.974899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1fb51c94-a25b-4282-b5af-97fbe6d75c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:42.033572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4267/8511] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:42.041590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acee00-fe73-4f1e-a9ff-cac717538fc0 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.041870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acee00-fe73-4f1e-a9ff-cac717538fc0 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.042179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acee00-fe73-4f1e-a9ff-cac717538fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.062951 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-59acee00-fe73-4f1e-a9ff-cac717538fc0 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:42.064170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-59acee00-fe73-4f1e-a9ff-cac717538fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:42.072148 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4245/8512] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:42.076422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb51c94-a25b-4282-b5af-97fbe6d75c79 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.086160 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb51c94-a25b-4282-b5af-97fbe6d75c79 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.090960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.091589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.091886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.092159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.092799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:22:42.093099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.094747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:42.106481 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4268/8513] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:22:42.111270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acee00-fe73-4f1e-a9ff-cac717538fc0 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.120372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acee00-fe73-4f1e-a9ff-cac717538fc0 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.125546 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.126170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.126449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.126717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.127348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.129217 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:42.217454 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4246/8514] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:22:42 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:42.221522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.231305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e120f9-06e2-43f7-8c21-7d2110efc551 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.271393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:42.287351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.287989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.288271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.288549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.289217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.291186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:42.382568 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4269/8515] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:22:42 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:22:42.386937 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.397339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2855e-f868-498e-a7e3-e172d15762ac admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.402001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.402625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.402905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.403173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.403810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.406040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:42.415899 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4247/8516] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:22:42.419745 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.430022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8e52-f80d-4b84-af5a-aa8ad91b4af4 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.434595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428bf0-1e5c-46ae-9a76-e61afbea26cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.435191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428bf0-1e5c-46ae-9a76-e61afbea26cd admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.435469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428bf0-1e5c-46ae-9a76-e61afbea26cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.435743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428bf0-1e5c-46ae-9a76-e61afbea26cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.436375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428bf0-1e5c-46ae-9a76-e61afbea26cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.438010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428bf0-1e5c-46ae-9a76-e61afbea26cd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:42.448463 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4270/8517] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:22:42.452541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.462460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d6bd-985c-4adc-bc15-7a271d473eb8 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.467591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.468322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.468601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.468874 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] PATH_INFO: `/v3/projects/e4699de0a0304aac922620eca021add5/users/1975edf9bdbe4dc3890192cadeea79e3/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.483995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4699de0a0304aac922620eca021add5, user_id=1975edf9bdbe4dc3890192cadeea79e3, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.486676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:42.553557 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4248/8518] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:42 2022] PUT /identity/v3/projects/e4699de0a0304aac922620eca021add5/users/1975edf9bdbe4dc3890192cadeea79e3/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:42.565353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39143ae8-0556-49ed-99d4-34049f9c204a None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.565635 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39143ae8-0556-49ed-99d4-34049f9c204a None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.565910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39143ae8-0556-49ed-99d4-34049f9c204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.594593 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-39143ae8-0556-49ed-99d4-34049f9c204a None None] MFA Rules not processed for user `1975edf9bdbe4dc3890192cadeea79e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:42.595923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-39143ae8-0556-49ed-99d4-34049f9c204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:42.659280 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4271/8519] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:42.663808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.725232 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402b719-4056-4484-9d50-f1e258467d63 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.730252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.730865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.731147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.731422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.732054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.733977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:42.858100 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4249/8520] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:22:42 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:42.862073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39143ae8-0556-49ed-99d4-34049f9c204a None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:42.872852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39143ae8-0556-49ed-99d4-34049f9c204a None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:42.929647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:42.930222 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:42.930506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:42.930784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:42.931419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:42.933452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:43.056962 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4272/8521] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:22:42 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:43.061602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:43.071961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc06b0e-a2b1-4bdd-ada9-865cd71935ba admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:43.077222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8c7a6-f69a-4f77-aa04-c827b01c277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:43.078231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c7a6-f69a-4f77-aa04-c827b01c277b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:43.078503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c7a6-f69a-4f77-aa04-c827b01c277b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:43.078909 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c7a6-f69a-4f77-aa04-c827b01c277b admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:43.079557 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8c7a6-f69a-4f77-aa04-c827b01c277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:43.081224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8c7a6-f69a-4f77-aa04-c827b01c277b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:43.092742 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4250/8522] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:43.097177 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:43.108118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6962de-3700-4532-889b-0f94e8966464 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:43.113199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:43.113935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:43.114307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:43.114591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] PATH_INFO: `/v3/projects/e94f7dd0fb544ab5a45ab3cd126d634a/users/4bcf597868b3484ea04c590e8344a79e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:43.130138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94f7dd0fb544ab5a45ab3cd126d634a, user_id=4bcf597868b3484ea04c590e8344a79e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:43.132781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:43.227585 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4273/8523] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:43 2022] PUT /identity/v3/projects/e94f7dd0fb544ab5a45ab3cd126d634a/users/4bcf597868b3484ea04c590e8344a79e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:43.238693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c549dc-2140-4304-b177-3300fa69f891 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:43.238981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c549dc-2140-4304-b177-3300fa69f891 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:43.239255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c549dc-2140-4304-b177-3300fa69f891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:43.267582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-00c549dc-2140-4304-b177-3300fa69f891 None None] MFA Rules not processed for user `4bcf597868b3484ea04c590e8344a79e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:43.268780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00c549dc-2140-4304-b177-3300fa69f891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:43.277756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:43.333594 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4251/8524] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:43 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:43.366688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:43.368466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:43.387291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:43.438478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5a4d-5d76-4f1c-8110-f12b2ac9f988 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:43.443709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d86aa4-8b19-4eea-85b1-153f625261d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:43.444540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d86aa4-8b19-4eea-85b1-153f625261d4 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:43.445005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d86aa4-8b19-4eea-85b1-153f625261d4 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:43.445636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d86aa4-8b19-4eea-85b1-153f625261d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:43.453421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d86aa4-8b19-4eea-85b1-153f625261d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:43.455199 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d86aa4-8b19-4eea-85b1-153f625261d4 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:43.463437 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4274/8525] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:22:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:22:45.986648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c549dc-2140-4304-b177-3300fa69f891 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:46.048356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c549dc-2140-4304-b177-3300fa69f891 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:46.052830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:46.053455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:46.053736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:46.054007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] PATH_INFO: `/v3/users/1975edf9bdbe4dc3890192cadeea79e3` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:46.055205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1975edf9bdbe4dc3890192cadeea79e3)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:46.057164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:46.230825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1975edf9bdbe4dc3890192cadeea79e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:46.231325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1975edf9bdbe4dc3890192cadeea79e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:46.284549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1975edf9bdbe4dc3890192cadeea79e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:46.285193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1975edf9bdbe4dc3890192cadeea79e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:46.292515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1975edf9bdbe4dc3890192cadeea79e3'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:46.310511 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4252/8526] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:22:45 2022] DELETE /identity/v3/users/1975edf9bdbe4dc3890192cadeea79e3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:46.315033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:46.315522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:46.315619 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:46.335924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:46.337117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:46.396353 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4275/8527] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:46.406869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:46.408287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:46.581933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:46.605023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2aba4-a68c-4dff-9ae0-e4ab8466fa6e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:46.608675 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:46.609280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:46.609556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:46.609828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:46.619048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:46.620448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:46.630200 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4253/8528] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:47.052126 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:47.059654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:47.066512 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f034ae-6700-472e-ad3f-e826d4aec7bb None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:47.071373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:47.072015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:47.072442 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:47.072723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] PATH_INFO: `/v3/projects/e4699de0a0304aac922620eca021add5` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:47.073879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4699de0a0304aac922620eca021add5)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:47.075810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:47.181606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4699de0a0304aac922620eca021add5', 'request_id': 'req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.188269 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4699de0a0304aac922620eca021add5', 'request_id': 'req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.261911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4699de0a0304aac922620eca021add5', 'request_id': 'req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.273390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] The token cache is being invalidate because project e4699de0a0304aac922620eca021add5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:22:47.273684 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.274346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.275841 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4276/8529] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:22:47 2022] DELETE /identity/v3/projects/e4699de0a0304aac922620eca021add5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:47.279858 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:47.289621 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405318-1fc1-4cae-9a9a-926bc3fe0807 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:47.345351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:47.345985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:47.346298 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:47.346576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] PATH_INFO: `/v3/users/4bcf597868b3484ea04c590e8344a79e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:47.347697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bcf597868b3484ea04c590e8344a79e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:47.349599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:47.556520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcf597868b3484ea04c590e8344a79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.557172 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcf597868b3484ea04c590e8344a79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.644906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcf597868b3484ea04c590e8344a79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.645596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcf597868b3484ea04c590e8344a79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.653306 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-005ce88f-fce2-4eac-9558-dce2034219ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcf597868b3484ea04c590e8344a79e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:47.671808 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4254/8530] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:22:47 2022] DELETE /identity/v3/users/4bcf597868b3484ea04c590e8344a79e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:48.092466 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:48.093930 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:48.107299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746739fd-bfde-47cb-bf0a-b5ae8561dfd5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:48.135942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:48.165916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:48.166586 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:48.166870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:48.167147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] PATH_INFO: `/v3/projects/e94f7dd0fb544ab5a45ab3cd126d634a` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:48.168253 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94f7dd0fb544ab5a45ab3cd126d634a)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:48.170202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:48.280275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94f7dd0fb544ab5a45ab3cd126d634a', 'request_id': 'req-79ec5120-2092-4cec-858f-8a5173b70a1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:48.287637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94f7dd0fb544ab5a45ab3cd126d634a', 'request_id': 'req-79ec5120-2092-4cec-858f-8a5173b70a1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:48.359369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94f7dd0fb544ab5a45ab3cd126d634a', 'request_id': 'req-79ec5120-2092-4cec-858f-8a5173b70a1e'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:48.376464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] The token cache is being invalidate because project e94f7dd0fb544ab5a45ab3cd126d634a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:22:48.376749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:48.377396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-79ec5120-2092-4cec-858f-8a5173b70a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:22:48.378972 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4277/8531] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:22:48 2022] DELETE /identity/v3/projects/e94f7dd0fb544ab5a45ab3cd126d634a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:57.667884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:58.224973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0527-5ce2-4226-a362-d2c80a07756a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.225255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0527-5ce2-4226-a362-d2c80a07756a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.225531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee0527-5ce2-4226-a362-d2c80a07756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.245276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-dbee0527-5ce2-4226-a362-d2c80a07756a None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:58.246537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-dbee0527-5ce2-4226-a362-d2c80a07756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:58.305147 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4255/8532] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:58.316501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b7093-7c54-46b4-b8de-53ce76126066 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.317067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b7093-7c54-46b4-b8de-53ce76126066 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.317067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b7093-7c54-46b4-b8de-53ce76126066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.337149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-220b7093-7c54-46b4-b8de-53ce76126066 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:58.338379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-220b7093-7c54-46b4-b8de-53ce76126066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:58.347645 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4278/8533] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:58.352542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0527-5ce2-4226-a362-d2c80a07756a None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:58.362606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee0527-5ce2-4226-a362-d2c80a07756a None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:58.367365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:58.367945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.368224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.368495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.369180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:22:58.369480 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:58.371094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:58.383853 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4256/8534] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:22:58.398115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b7093-7c54-46b4-b8de-53ce76126066 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:58.407230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b7093-7c54-46b4-b8de-53ce76126066 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:58.411827 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:58.412452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.412730 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.413000 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.413625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:58.415558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:58.493359 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4279/8535] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:22:58 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:22:58.497828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:58.508642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db4adf-8f9a-4779-92cc-e83c2a34549e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:58.563775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:58.564977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.565243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.565509 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.566161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:58.568045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:58.702353 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4257/8536] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:22:58 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:58.706443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:58.717063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e93f8-2e8d-4e0d-8755-696c80a68ed8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:58.721957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:58.722595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.722875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.723148 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.723788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:58.725705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:58.735793 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4280/8537] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:58.740420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:58.750418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46cdd-35f7-4c72-909f-712d1c8be98b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:58.755678 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b5ff0-0af8-4383-8827-26fd33898f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:58.760538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b5ff0-0af8-4383-8827-26fd33898f4c admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.760538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b5ff0-0af8-4383-8827-26fd33898f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.760538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b5ff0-0af8-4383-8827-26fd33898f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.760538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b5ff0-0af8-4383-8827-26fd33898f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:58.760538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b5ff0-0af8-4383-8827-26fd33898f4c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:58.769257 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4258/8538] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:58.773379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:58.783317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec2790-da65-4665-9755-a19bc13c047b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:58.787927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:58.788568 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.788847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.789121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] PATH_INFO: `/v3/projects/bbd3fe6e57dd48a1ae7001cd48714739/users/7c219aa3af75469396c9d7018a0bf062/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.803880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd3fe6e57dd48a1ae7001cd48714739, user_id=7c219aa3af75469396c9d7018a0bf062, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:58.806605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:58.868005 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4281/8539] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:58 2022] PUT /identity/v3/projects/bbd3fe6e57dd48a1ae7001cd48714739/users/7c219aa3af75469396c9d7018a0bf062/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:58.879317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a6bf-d05c-4041-b0e7-3f5d81f5cd12 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:58.879602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a6bf-d05c-4041-b0e7-3f5d81f5cd12 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:58.879872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a6bf-d05c-4041-b0e7-3f5d81f5cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:58.907202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d0b8a6bf-d05c-4041-b0e7-3f5d81f5cd12 None None] MFA Rules not processed for user `7c219aa3af75469396c9d7018a0bf062`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:58.909626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d0b8a6bf-d05c-4041-b0e7-3f5d81f5cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:58.963065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:58.972323 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4259/8540] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:58.976879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.034094 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:59.039091 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd488a4-2385-4ceb-9ec7-0f1194017646 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:59.043958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:59.047116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.047116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.047116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.047116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:59.047669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:59.120474 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4282/8541] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:22:58 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:59.124608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a6bf-d05c-4041-b0e7-3f5d81f5cd12 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.135353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a6bf-d05c-4041-b0e7-3f5d81f5cd12 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:59.191667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:59.192274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.192556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.192829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.193462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:59.195416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:59.264568 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4260/8542] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:22:59 2022] POST /identity/v3/users => generated 302 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:22:59.265855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.276250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224962a-00d0-4f36-b409-78d416da00f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:59.280947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:59.281549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.281834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.282141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.282787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:59.284384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:59.294584 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4283/8543] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:59.299807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.310230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698f03-b9b8-4a81-b73a-10b022556425 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:59.315904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:59.316619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.316903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.317181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] PATH_INFO: `/v3/projects/f4bb711cf2324436bc577ad89e58201f/users/86d1cd9202154823a87f177106ca1ee7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.333070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bb711cf2324436bc577ad89e58201f, user_id=86d1cd9202154823a87f177106ca1ee7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:59.335756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:59.393563 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4261/8544] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:59 2022] PUT /identity/v3/projects/f4bb711cf2324436bc577ad89e58201f/users/86d1cd9202154823a87f177106ca1ee7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:59.397548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.407936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ae9fc-6656-4fc2-834c-29ea87bb6ddb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:59.477033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7fbf7-a69a-4da6-836f-7216d67341fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:59.477705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fbf7-a69a-4da6-836f-7216d67341fe admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.478016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fbf7-a69a-4da6-836f-7216d67341fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.478321 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7fbf7-a69a-4da6-836f-7216d67341fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.478969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7fbf7-a69a-4da6-836f-7216d67341fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:59.480603 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7fbf7-a69a-4da6-836f-7216d67341fe admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:59.491240 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4284/8545] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:22:59.500751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.512427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e303d5f-a8e8-47f8-aa72-7b1d0e227c0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:59.517272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02c98-e157-4fa0-8741-56cfea80185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:59.517878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02c98-e157-4fa0-8741-56cfea80185b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.518189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02c98-e157-4fa0-8741-56cfea80185b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.518467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02c98-e157-4fa0-8741-56cfea80185b admin admin] PATH_INFO: `/v3/projects/f4bb711cf2324436bc577ad89e58201f/users/86d1cd9202154823a87f177106ca1ee7/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.523244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02c98-e157-4fa0-8741-56cfea80185b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bb711cf2324436bc577ad89e58201f, user_id=86d1cd9202154823a87f177106ca1ee7, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:59.525870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02c98-e157-4fa0-8741-56cfea80185b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:59.536452 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4262/8546] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:22:59 2022] PUT /identity/v3/projects/f4bb711cf2324436bc577ad89e58201f/users/86d1cd9202154823a87f177106ca1ee7/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:22:59.546683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037c147-5bea-4f14-b035-c4f79e5e9dbb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.546974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037c147-5bea-4f14-b035-c4f79e5e9dbb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.547255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037c147-5bea-4f14-b035-c4f79e5e9dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.576266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-e037c147-5bea-4f14-b035-c4f79e5e9dbb None None] MFA Rules not processed for user `86d1cd9202154823a87f177106ca1ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:59.577408 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e037c147-5bea-4f14-b035-c4f79e5e9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:59.648347 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4285/8547] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:59.662422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3d8a8-f7e2-404b-9bd7-5cdccebc49fc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.662760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3d8a8-f7e2-404b-9bd7-5cdccebc49fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.663035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3d8a8-f7e2-404b-9bd7-5cdccebc49fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.683747 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d4d3d8a8-f7e2-404b-9bd7-5cdccebc49fc None None] MFA Rules not processed for user `7c219aa3af75469396c9d7018a0bf062`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:59.684947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d4d3d8a8-f7e2-404b-9bd7-5cdccebc49fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:59.741960 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4263/8548] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:59.756751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372daa6-2b38-42c6-971c-c2d25f83b9cb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.757036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372daa6-2b38-42c6-971c-c2d25f83b9cb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.757316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372daa6-2b38-42c6-971c-c2d25f83b9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.777918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4372daa6-2b38-42c6-971c-c2d25f83b9cb None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:59.779063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4372daa6-2b38-42c6-971c-c2d25f83b9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:59.824392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:59.846176 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4286/8549] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Oct 18 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:59.852575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3d8a8-f7e2-404b-9bd7-5cdccebc49fc None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.865652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3d8a8-f7e2-404b-9bd7-5cdccebc49fc None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:22:59.871320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:22:59.871952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.872236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.872510 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.881575 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:22:59.883240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:22:59.893811 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4264/8550] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:22:59.921386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024f2a8-307f-461a-9b60-b07cde5be238 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:22:59.921654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024f2a8-307f-461a-9b60-b07cde5be238 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:22:59.921926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024f2a8-307f-461a-9b60-b07cde5be238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:22:59.943407 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c024f2a8-307f-461a-9b60-b07cde5be238 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:22:59.944709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c024f2a8-307f-461a-9b60-b07cde5be238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:22:59.954124 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4287/8551] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:22:59.966724 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:22:59.968240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:00.013210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:00.027146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58ca5-280b-4dfe-a929-7077b1a01c71 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:00.032472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:00.032472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:00.032472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:00.032472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:00.043608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:00.045032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:00.056428 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4265/8552] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:00.572587 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408857-9add-4c90-a76c-abd774e01a8c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:00.573102 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408857-9add-4c90-a76c-abd774e01a8c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:00.573688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9408857-9add-4c90-a76c-abd774e01a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:00.596024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d9408857-9add-4c90-a76c-abd774e01a8c None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:00.597228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d9408857-9add-4c90-a76c-abd774e01a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:00.607228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4288/8553] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:23:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:00.618230 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:00.619684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:00.684784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a679e-cd3c-4fc4-9d68-e65b25ddce88 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:00.688502 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:00.689181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:00.689979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:00.690264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:00.701270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:00.704017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:00.714619 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4266/8554] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:03.914041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d314-f9f8-4778-b3ae-f6c7d2cf787e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:03.919835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d314-f9f8-4778-b3ae-f6c7d2cf787e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:03.919835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d314-f9f8-4778-b3ae-f6c7d2cf787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:03.956974 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-6958d314-f9f8-4778-b3ae-f6c7d2cf787e None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:03.958478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6958d314-f9f8-4778-b3ae-f6c7d2cf787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:03.965843 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4289/8555] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 18 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:03.982987 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:03.983521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:03.995267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9f02-2eab-4a69-bed3-8fdf41738ccb service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:03.999080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:03.999681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:03.999963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:04.000263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:04.008330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:04.009754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:04.018180 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4267/8556] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:04.876481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a42bf-32f2-46e0-b71a-718bd87dc38d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:04.876802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a42bf-32f2-46e0-b71a-718bd87dc38d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:04.877092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a42bf-32f2-46e0-b71a-718bd87dc38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:04.898524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-263a42bf-32f2-46e0-b71a-718bd87dc38d None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:04.901274 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-263a42bf-32f2-46e0-b71a-718bd87dc38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:04.909296 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4290/8557] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:23:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:04.924663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:04.926387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:04.944228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3a43-6df2-4bba-9979-0c16e384ccc9 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:04.949847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:04.953042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:04.953042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:04.953042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:04.960900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:04.962576 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:04.973203 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4268/8558] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:11.374853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d85e-edb0-4e31-bcc1-6262be599408 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:11.375385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d85e-edb0-4e31-bcc1-6262be599408 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:11.375485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d85e-edb0-4e31-bcc1-6262be599408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:11.396342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5112d85e-edb0-4e31-bcc1-6262be599408 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:11.397600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5112d85e-edb0-4e31-bcc1-6262be599408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:11.406974 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4291/8559] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:11.421296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:11.433153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a7bc-fd11-4d5e-9e5e-eddc34ab8643 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:11.439308 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58f2dd-e150-4d33-9c53-d10bec1519ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:11.439918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f2dd-e150-4d33-9c53-d10bec1519ac service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:11.440196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f2dd-e150-4d33-9c53-d10bec1519ac service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:11.440473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f2dd-e150-4d33-9c53-d10bec1519ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:11.455030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58f2dd-e150-4d33-9c53-d10bec1519ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:11.456650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58f2dd-e150-4d33-9c53-d10bec1519ac service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:11.468346 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4269/8560] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:13.727354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d85e-edb0-4e31-bcc1-6262be599408 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:13.738965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d85e-edb0-4e31-bcc1-6262be599408 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:13.745392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:13.746041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:13.746376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:13.746654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:13.755639 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:13.757226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:13.766977 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4292/8561] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:13.782853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733570-07ed-411f-be65-f065a8dcbb46 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:13.783286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733570-07ed-411f-be65-f065a8dcbb46 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:13.783381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733570-07ed-411f-be65-f065a8dcbb46 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:13.784718 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4270/8562] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 14:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 14:23:13.789083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 14:23:13.800280 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:13.808490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d057-3a0b-4acd-a36c-c4f4b57e6f8a service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:13.813037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86d1cd9202154823a87f177106ca1ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4bb711cf2324436bc577ad89e58201f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:13.813651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:13.813936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:13.814249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] PATH_INFO: `/v3/projects/f4bb711cf2324436bc577ad89e58201f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:13.815376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4bb711cf2324436bc577ad89e58201f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:13.817688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:13.819330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4293/8563] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 14:23:13 2022] GET /identity/v3/projects/f4bb711cf2324436bc577ad89e58201f => generated 391 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 14:23:14.013240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120ed90-27be-4794-92c2-8e42580e119a None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:14.013463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120ed90-27be-4794-92c2-8e42580e119a None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:14.013696 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120ed90-27be-4794-92c2-8e42580e119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:14.033792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8120ed90-27be-4794-92c2-8e42580e119a None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:14.035077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8120ed90-27be-4794-92c2-8e42580e119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:14.041587 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4271/8564] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:14.053093 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:14.063266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33a2a2-23e4-4bd3-8d63-e7b6a2bba5ef tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:14.067350 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:14.067946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:14.068229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:14.068504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:14.075427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:14.076995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:14.085282 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4294/8565] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:14.315701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a99bf9-e0f4-4702-bbd3-f9e801509148 None None] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:14.316623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a99bf9-e0f4-4702-bbd3-f9e801509148 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:14.316903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a99bf9-e0f4-4702-bbd3-f9e801509148 None None] PATH_INFO: `/` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:14.318286 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4272/8566] 10.222.0.27 () {54 vars in 912 bytes} [Tue Oct 18 14:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 14:23:14.322918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] Authenticating service token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 14:23:14.336156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:14.345650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1832131-9cb2-4562-9ecc-2292d449ec6d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:14.350240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86d1cd9202154823a87f177106ca1ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4bb711cf2324436bc577ad89e58201f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:14.350865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:14.351145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:14.351418 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] PATH_INFO: `/v3/projects/f4bb711cf2324436bc577ad89e58201f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:14.352565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] RBAC: Authorizing `identity:get_project(project_id=f4bb711cf2324436bc577ad89e58201f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:14.354375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:14.356010 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4295/8567] 10.222.0.27 () {58 vars in 1443 bytes} [Tue Oct 18 14:23:14 2022] GET /identity/v3/projects/f4bb711cf2324436bc577ad89e58201f => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:23:14.557521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8e88-5219-47f0-b8fd-07181f10f060 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:14.557715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8e88-5219-47f0-b8fd-07181f10f060 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:14.557981 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8e88-5219-47f0-b8fd-07181f10f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:14.576941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a87d8e88-5219-47f0-b8fd-07181f10f060 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:14.578153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a87d8e88-5219-47f0-b8fd-07181f10f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:14.584886 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4273/8568] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:14.596778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:14.607403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af28f-3af3-4927-80b3-12a108ebbee2 tempest-ServersAdminNegativeTestJSON-269557122 tempest-ServersAdminNegativeTestJSON-269557122-project-admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:14.610995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb177475-8e38-4328-a6aa-d81a60cb605d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:14.611588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177475-8e38-4328-a6aa-d81a60cb605d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:14.611865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177475-8e38-4328-a6aa-d81a60cb605d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:14.612158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb177475-8e38-4328-a6aa-d81a60cb605d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:14.619709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb177475-8e38-4328-a6aa-d81a60cb605d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:14.621131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb177475-8e38-4328-a6aa-d81a60cb605d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:14.628901 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4296/8569] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:18.678132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d8e88-5219-47f0-b8fd-07181f10f060 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:18.740343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d8e88-5219-47f0-b8fd-07181f10f060 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:18.744840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:18.746635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:18.746635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:18.746635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] PATH_INFO: `/v3/users/7c219aa3af75469396c9d7018a0bf062` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:18.747239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c219aa3af75469396c9d7018a0bf062)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:18.749153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:18.877234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:18.887210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c219aa3af75469396c9d7018a0bf062'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:18.887866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c219aa3af75469396c9d7018a0bf062'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:18.929774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c219aa3af75469396c9d7018a0bf062'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:18.930414 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c219aa3af75469396c9d7018a0bf062'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:18.937374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c219aa3af75469396c9d7018a0bf062'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:18.955763 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4274/8570] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:23:18 2022] DELETE /identity/v3/users/7c219aa3af75469396c9d7018a0bf062 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:23:18.960598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:18.961063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:18.961193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:18.980122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:18.981308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:19.039718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4297/8571] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:19.050366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:19.052639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:19.110489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1a479-ae94-4570-9cf5-f95d4a09b308 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:19.114846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:19.115513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:19.118580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:19.118580 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:19.125301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:19.126762 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:19.136486 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4275/8572] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:19.377565 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:19.379456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:19.391376 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6f1ed-4e5f-46f3-b72d-a10008212b13 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:19.398421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:19.399101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:19.399392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:19.399676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] PATH_INFO: `/v3/projects/bbd3fe6e57dd48a1ae7001cd48714739` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:19.401193 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd3fe6e57dd48a1ae7001cd48714739)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:19.403205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:19.528019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:19.537923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd3fe6e57dd48a1ae7001cd48714739', 'request_id': 'req-ed11b303-1944-4984-9b46-afc38edc2c79'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.544301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd3fe6e57dd48a1ae7001cd48714739', 'request_id': 'req-ed11b303-1944-4984-9b46-afc38edc2c79'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.592850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd3fe6e57dd48a1ae7001cd48714739', 'request_id': 'req-ed11b303-1944-4984-9b46-afc38edc2c79'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.603888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] The token cache is being invalidate because project bbd3fe6e57dd48a1ae7001cd48714739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:23:19.604360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.605415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.606977 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4298/8573] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:23:19 2022] DELETE /identity/v3/projects/bbd3fe6e57dd48a1ae7001cd48714739 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:23:19.611241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:19.621699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea847a0-443f-47bb-b1d9-2b1eeb2b7289 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:19.678526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:19.679187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:19.679431 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:19.679706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] PATH_INFO: `/v3/users/86d1cd9202154823a87f177106ca1ee7` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:19.680823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d1cd9202154823a87f177106ca1ee7)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:19.682853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:19.840779 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d1cd9202154823a87f177106ca1ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.841411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d1cd9202154823a87f177106ca1ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.941190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d1cd9202154823a87f177106ca1ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.942138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d1cd9202154823a87f177106ca1ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.945090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:19.950492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-6c7e664d-edf4-4633-987e-a46fdedf2310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d1cd9202154823a87f177106ca1ee7'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:19.968461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4276/8574] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:23:19 2022] DELETE /identity/v3/users/86d1cd9202154823a87f177106ca1ee7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:23:20.371958 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:20.376917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:20.387665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11b303-1944-4984-9b46-afc38edc2c79 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:20.446592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:20.447233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:20.447549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:20.447824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] PATH_INFO: `/v3/projects/f4bb711cf2324436bc577ad89e58201f` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:20.448957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4bb711cf2324436bc577ad89e58201f)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:20.450938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:20.565113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bb711cf2324436bc577ad89e58201f', 'request_id': 'req-d6913202-1313-41e9-b440-973a78d348ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:20.571331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bb711cf2324436bc577ad89e58201f', 'request_id': 'req-d6913202-1313-41e9-b440-973a78d348ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:20.627207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bb711cf2324436bc577ad89e58201f', 'request_id': 'req-d6913202-1313-41e9-b440-973a78d348ef'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:20.638301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] The token cache is being invalidate because project f4bb711cf2324436bc577ad89e58201f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:23:20.638591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:20.639217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-d6913202-1313-41e9-b440-973a78d348ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:23:20.640697 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4299/8575] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:23:20 2022] DELETE /identity/v3/projects/f4bb711cf2324436bc577ad89e58201f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:23:20.646811 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3492e3-ad03-4706-bf0c-bedcd467ac88 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:20.647102 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3492e3-ad03-4706-bf0c-bedcd467ac88 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:20.647399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3492e3-ad03-4706-bf0c-bedcd467ac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:20.667703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-bf3492e3-ad03-4706-bf0c-bedcd467ac88 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:20.669002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf3492e3-ad03-4706-bf0c-bedcd467ac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:20.730307 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4277/8576] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:20.738788 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745084-577e-4ee2-a79b-619491eeb06f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:20.739071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745084-577e-4ee2-a79b-619491eeb06f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:20.740032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745084-577e-4ee2-a79b-619491eeb06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:20.759782 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-2b745084-577e-4ee2-a79b-619491eeb06f None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:20.761226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2b745084-577e-4ee2-a79b-619491eeb06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:20.769329 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4300/8577] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:20.773732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3492e3-ad03-4706-bf0c-bedcd467ac88 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:20.783771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3492e3-ad03-4706-bf0c-bedcd467ac88 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:20.789091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:20.789683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:20.789961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:20.790265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:20.790968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:23:20.791270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:20.792956 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:20.806714 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4278/8578] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:23:20.812087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b745084-577e-4ee2-a79b-619491eeb06f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:20.823071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b745084-577e-4ee2-a79b-619491eeb06f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:20.827838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:20.828443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:20.828720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:20.829108 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:20.829851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:20.831835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:20.942264 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4301/8579] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:23:20 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:23:20.947043 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:20.957061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73307c2-21a3-4ced-83cb-807d13e8a121 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:21.012728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:21.013329 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:21.013608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:21.013880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:21.014529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:21.016426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:21.095702 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4279/8580] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:23:20 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:23:21.099842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:21.110305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f8c66-2d73-4248-aedc-4c90a16d4e6e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:21.115509 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:21.116088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:21.116373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:21.116651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:21.117323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:21.119007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:21.128820 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4302/8581] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:23:21.133660 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:21.144154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653a201-b503-45c0-9b54-e01fe54ad6be admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:21.148822 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a2b94-6db6-4d31-b143-2f47c6a8e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:21.149407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2b94-6db6-4d31-b143-2f47c6a8e6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:21.149690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2b94-6db6-4d31-b143-2f47c6a8e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:21.149959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a2b94-6db6-4d31-b143-2f47c6a8e6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:21.150627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a2b94-6db6-4d31-b143-2f47c6a8e6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:21.152225 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a2b94-6db6-4d31-b143-2f47c6a8e6c1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:21.162769 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4280/8582] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:23:21.166776 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:21.177268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cface97-84a5-4344-82f6-9f87e3542525 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:21.182015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:21.182703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:21.182986 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:21.183263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] PATH_INFO: `/v3/projects/4a777d3dbab447a7931482286b7304fb/users/7d5ff5333e314722bd805995ff846b9e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:21.195453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:21.199463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a777d3dbab447a7931482286b7304fb, user_id=7d5ff5333e314722bd805995ff846b9e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:21.202201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:21.284382 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4303/8583] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:23:21 2022] PUT /identity/v3/projects/4a777d3dbab447a7931482286b7304fb/users/7d5ff5333e314722bd805995ff846b9e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:23:21.290130 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637655c-151c-4288-b191-3b4d8f8b9e87 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:21.290448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637655c-151c-4288-b191-3b4d8f8b9e87 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:21.290723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637655c-151c-4288-b191-3b4d8f8b9e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:21.310381 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e637655c-151c-4288-b191-3b4d8f8b9e87 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:21.311679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e637655c-151c-4288-b191-3b4d8f8b9e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:21.344865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:21.370751 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4281/8584] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:21.380590 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:21.384510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:21.440313 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5f4fc-677c-4db8-971d-bbdf19664206 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:21.444064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bba86-75f1-4c45-bd6d-7b34bee1f54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:21.444672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bba86-75f1-4c45-bd6d-7b34bee1f54d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:21.444982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bba86-75f1-4c45-bd6d-7b34bee1f54d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:21.445263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bba86-75f1-4c45-bd6d-7b34bee1f54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:21.454551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bba86-75f1-4c45-bd6d-7b34bee1f54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:21.456008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bba86-75f1-4c45-bd6d-7b34bee1f54d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:21.465837 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4304/8585] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:26.694593 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:26.695511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:26.695749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:26.731498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] MFA Rules not processed for user `7d5ff5333e314722bd805995ff846b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:26.732734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:26.803828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4282/8586] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:23:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:26.815513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a29cd-b0ef-4ea3-9f7e-2b98a74e2f49 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:26.816060 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a29cd-b0ef-4ea3-9f7e-2b98a74e2f49 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:26.816293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a29cd-b0ef-4ea3-9f7e-2b98a74e2f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:26.837124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-9a9a29cd-b0ef-4ea3-9f7e-2b98a74e2f49 None None] MFA Rules not processed for user `7d5ff5333e314722bd805995ff846b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:26.838500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9a9a29cd-b0ef-4ea3-9f7e-2b98a74e2f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:26.845701 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4305/8587] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:23:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:26.859626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:26.861059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:26.938336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ef944-fff7-42b7-bd1d-a7fbc41fe5fe None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:26.944694 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffca83-de1d-456f-b3c0-b3245c3624b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:26.945330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffca83-de1d-456f-b3c0-b3245c3624b3 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:26.945606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffca83-de1d-456f-b3c0-b3245c3624b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:26.945879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffca83-de1d-456f-b3c0-b3245c3624b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:26.954796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffca83-de1d-456f-b3c0-b3245c3624b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:26.956490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffca83-de1d-456f-b3c0-b3245c3624b3 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:26.966705 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4283/8588] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:36.830887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:36.962324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=75 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:39.783928 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a29cd-b0ef-4ea3-9f7e-2b98a74e2f49 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:39.794367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a29cd-b0ef-4ea3-9f7e-2b98a74e2f49 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:39.797920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:39.798560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:39.798859 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:39.799136 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:39.800832 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:39.813433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:39.814956 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:39.826099 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4306/8589] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:23:39.975208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c748-445b-43b6-8650-7eaea8a0d9c3 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:39.975807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c748-445b-43b6-8650-7eaea8a0d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:39.975807 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996c748-445b-43b6-8650-7eaea8a0d9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:40.013644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3996c748-445b-43b6-8650-7eaea8a0d9c3 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:23:40.014885 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3996c748-445b-43b6-8650-7eaea8a0d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:40.077263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4284/8590] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:23:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:23:40.088785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:40.090202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:40.104920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f2a19-039b-4ef9-b705-dec0e34145fa service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:40.109912 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6a165-b8ce-4974-9807-a9e7e72edfe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:40.110538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6a165-b8ce-4974-9807-a9e7e72edfe8 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:40.110818 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6a165-b8ce-4974-9807-a9e7e72edfe8 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:40.111090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6a165-b8ce-4974-9807-a9e7e72edfe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:40.120123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6a165-b8ce-4974-9807-a9e7e72edfe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:40.121726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6a165-b8ce-4974-9807-a9e7e72edfe8 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:40.131815 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4307/8591] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:40.458201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996c748-445b-43b6-8650-7eaea8a0d9c3 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:23:40.468511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996c748-445b-43b6-8650-7eaea8a0d9c3 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:23:40.472148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:23:40.477314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:23:40.477314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:23:40.477314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:23:40.477314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:23:40.492358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:23:40.493782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:23:40.507635 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4285/8592] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:23:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:23:50.127588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:50.500183 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:10.953895 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4d0c5-1726-4786-8aa6-06e6ba45ee43 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:10.954489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4d0c5-1726-4786-8aa6-06e6ba45ee43 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:10.954489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4d0c5-1726-4786-8aa6-06e6ba45ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:10.985725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-97c4d0c5-1726-4786-8aa6-06e6ba45ee43 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:10.986970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-97c4d0c5-1726-4786-8aa6-06e6ba45ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:10.993429 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4308/8593] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Oct 18 14:24:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:11.011809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:11.013218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:11.024055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c751-3fd5-45ec-8afe-1b13626273bc service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:11.027782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:11.028386 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:11.028669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:11.028946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:11.035985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:11.037398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:11.045124 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4286/8594] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:24:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:24:11.437800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:11.438100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:11.438386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:11.459576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:11.460789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:11.480390 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4309/8595] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:24:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:11.490063 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:11.503258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c20ac-80b8-4fff-9e07-9e2066b63b43 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:11.508829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:11.509425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:11.510245 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:11.510516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:11.519578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:11.521132 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:11.532176 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4287/8596] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:24:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:24:21.471184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=14 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:21.527732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:24.876962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:24.878674 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:24.892744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd03c5-912c-4f97-8998-73440c8b11a4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:24.897719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:24.898370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:24.898651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:24.898923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:24.900747 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:24.917751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:24.919402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:24.933237 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4310/8597] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:24:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:24:24.988501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:24.999212 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee560b4a-b0b0-4464-9a4d-465f74dcb79d service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:25.003828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:25.004455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:25.004731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:25.005265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] PATH_INFO: `/v3/users/7d5ff5333e314722bd805995ff846b9e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:25.006427 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5ff5333e314722bd805995ff846b9e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:25.008325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:25.182309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5ff5333e314722bd805995ff846b9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.183013 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5ff5333e314722bd805995ff846b9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.237244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5ff5333e314722bd805995ff846b9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.237860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5ff5333e314722bd805995ff846b9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.245077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b9159c1c-aae8-4a88-9e5c-3f8453ec0ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5ff5333e314722bd805995ff846b9e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.262330 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4288/8598] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:24:24 2022] DELETE /identity/v3/users/7d5ff5333e314722bd805995ff846b9e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:24:25.502842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:25.514180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e449f-fe74-4706-88dd-82afee4061e9 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:25.571131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:25.571762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:25.572036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:25.572305 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] PATH_INFO: `/v3/projects/4a777d3dbab447a7931482286b7304fb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:25.573957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a777d3dbab447a7931482286b7304fb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:25.575965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:25.666564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a777d3dbab447a7931482286b7304fb', 'request_id': 'req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.672962 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a777d3dbab447a7931482286b7304fb', 'request_id': 'req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.740087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a777d3dbab447a7931482286b7304fb', 'request_id': 'req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.750838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] The token cache is being invalidate because project 4a777d3dbab447a7931482286b7304fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:24:25.752166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.752166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-1b28d714-3d9a-49f2-8685-3f2d41fb5bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:24:25.753299 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4311/8599] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:24:25 2022] DELETE /identity/v3/projects/4a777d3dbab447a7931482286b7304fb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:24:25.758489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1b44-7717-4a73-8917-cde3e38152b4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:25.758773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1b44-7717-4a73-8917-cde3e38152b4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:25.759047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1b44-7717-4a73-8917-cde3e38152b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:25.779586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ad3f1b44-7717-4a73-8917-cde3e38152b4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:25.780776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ad3f1b44-7717-4a73-8917-cde3e38152b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:25.841355 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4289/8600] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:25.850212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd067-f89b-4e1a-800f-c97a46048952 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:25.850505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd067-f89b-4e1a-800f-c97a46048952 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:25.850815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd067-f89b-4e1a-800f-c97a46048952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:25.870386 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f8bcd067-f89b-4e1a-800f-c97a46048952 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:25.871627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f8bcd067-f89b-4e1a-800f-c97a46048952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:25.879478 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4312/8601] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:25.883594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f1b44-7717-4a73-8917-cde3e38152b4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:25.894243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f1b44-7717-4a73-8917-cde3e38152b4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:25.898793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:25.899396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:25.899672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:25.899941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:25.900579 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:24:25.900878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:25.903174 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:25.914563 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4290/8602] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:24:25.918784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd067-f89b-4e1a-800f-c97a46048952 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:25.927903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd067-f89b-4e1a-800f-c97a46048952 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:25.932990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:25.933582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:25.933865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:25.934184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:25.934799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:25.936705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:26.016887 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4313/8603] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:24:25 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:24:26.021161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:26.032095 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75198f-05ba-4ffa-a5aa-f73cf8fc0bb1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:26.090542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:26.091258 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:26.091607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:26.091945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:26.092655 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:26.095050 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:26.103462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:26.178432 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4291/8604] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:24:26 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:24:26.179671 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:26.192209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec336d-27af-449d-bb7c-ab4cb0dc5a2b admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:26.197101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:26.197727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:26.198083 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:26.200906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:26.200906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:26.201181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:26.212206 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4314/8605] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:24:26.215891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:26.226861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c6f32-37e0-4689-a635-07368a618c85 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:26.231768 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde83d36-764c-410c-b780-07b517ec58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:26.232400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83d36-764c-410c-b780-07b517ec58b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:26.232676 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83d36-764c-410c-b780-07b517ec58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:26.232947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde83d36-764c-410c-b780-07b517ec58b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:26.233587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde83d36-764c-410c-b780-07b517ec58b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:26.235255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde83d36-764c-410c-b780-07b517ec58b2 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:26.246601 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4292/8606] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:24:26.251040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:26.261907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1f79-9c6b-453f-b6c7-2117b54212a3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:26.266538 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:26.267405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:26.267633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:26.267909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] PATH_INFO: `/v3/projects/ee305e628b7a4f069272604cf496df83/users/e338ca8ecf9646e1b5f798d5ea65f5c9/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:26.283343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee305e628b7a4f069272604cf496df83, user_id=e338ca8ecf9646e1b5f798d5ea65f5c9, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:26.286046 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:26.362731 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4315/8607] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:24:26 2022] PUT /identity/v3/projects/ee305e628b7a4f069272604cf496df83/users/e338ca8ecf9646e1b5f798d5ea65f5c9/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:24:26.367837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214460-9d5c-41ec-8156-810cd80b654b None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:26.368123 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214460-9d5c-41ec-8156-810cd80b654b None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:26.368411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214460-9d5c-41ec-8156-810cd80b654b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:26.394889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ce214460-9d5c-41ec-8156-810cd80b654b None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:26.396090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce214460-9d5c-41ec-8156-810cd80b654b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:26.454662 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4293/8608] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:26.464372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:26.466103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:26.481268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:26.524192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00809cc1-7873-49d7-b58b-3679932685dd admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:26.527834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2088c-21c7-4bcd-9278-a140dd90feed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:26.528445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2088c-21c7-4bcd-9278-a140dd90feed service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:26.528722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2088c-21c7-4bcd-9278-a140dd90feed service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:26.528993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2088c-21c7-4bcd-9278-a140dd90feed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:26.537852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2088c-21c7-4bcd-9278-a140dd90feed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:26.539342 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2088c-21c7-4bcd-9278-a140dd90feed service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:26.549788 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4316/8609] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:24:31.775684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:31.776156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:31.776396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:31.809704 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] MFA Rules not processed for user `e338ca8ecf9646e1b5f798d5ea65f5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:31.811236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:31.886751 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4294/8610] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:24:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:31.897562 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:31.898173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:31.898173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:31.918803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] MFA Rules not processed for user `e338ca8ecf9646e1b5f798d5ea65f5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:31.920033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:31.927314 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4317/8611] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:24:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:31.940872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:31.942411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:32.020354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0afcd8-fc97-4031-a67c-110ed4eae768 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:32.026197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857a6bf-529f-46e4-827e-714a6c1a4516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:32.026825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a6bf-529f-46e4-827e-714a6c1a4516 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:32.027643 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a6bf-529f-46e4-827e-714a6c1a4516 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:32.027921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a6bf-529f-46e4-827e-714a6c1a4516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:32.033028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:32.036947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857a6bf-529f-46e4-827e-714a6c1a4516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:32.038573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857a6bf-529f-46e4-827e-714a6c1a4516 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:32.049067 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4295/8612] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:24:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:24:41.912298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=23 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:42.081360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:43.020051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:43.021472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:43.092434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8707-3b85-40a3-a02f-a6159ef23613 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:43.102001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:43.102657 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:43.102938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:43.103211 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:43.111573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:43.117395 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:43.119140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:43.129548 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4318/8613] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:24:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:24:47.315366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd86fb-046d-4f15-8d08-6ee5cc022fba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:47.316023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd86fb-046d-4f15-8d08-6ee5cc022fba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:47.316127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd86fb-046d-4f15-8d08-6ee5cc022fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:47.337828 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8cdd86fb-046d-4f15-8d08-6ee5cc022fba None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:24:47.340356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8cdd86fb-046d-4f15-8d08-6ee5cc022fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:47.345666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4296/8614] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:24:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:24:47.357260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:24:47.358727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:24:47.370031 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002280-0cc1-469f-8264-1e5b32966c55 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:24:47.374130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:24:47.374720 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:24:47.374999 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:24:47.375273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:24:47.382133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:24:47.383551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:24:47.391415 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4319/8615] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:24:57.331884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:57.388081 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=38 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:27.139829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c37e3-0da4-4e97-ab86-b868c7034dd9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:25:27.140428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c37e3-0da4-4e97-ab86-b868c7034dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:25:27.140428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c37e3-0da4-4e97-ab86-b868c7034dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:25:27.159628 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-342c37e3-0da4-4e97-ab86-b868c7034dd9 None None] MFA Rules not processed for user `e338ca8ecf9646e1b5f798d5ea65f5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:25:27.160890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-342c37e3-0da4-4e97-ab86-b868c7034dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:25:27.167729 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4297/8616] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:25:37.154326 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:39.404669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:25:39.419815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316f4db-8839-48b3-9874-8f9493ed5364 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:25:39.425267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:25:39.425901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:25:39.426225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:25:39.426504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:25:39.428314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:25:39.440231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:25:39.446090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:25:39.453318 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4320/8617] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:25:41.851111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1181-45e0-4545-a3cb-dfacb110402c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:25:41.851540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1181-45e0-4545-a3cb-dfacb110402c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:25:41.851661 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1181-45e0-4545-a3cb-dfacb110402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:25:41.883817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-962b1181-45e0-4545-a3cb-dfacb110402c None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:25:41.885202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-962b1181-45e0-4545-a3cb-dfacb110402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:25:41.895194 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4298/8618] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:25:41.906187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:25:41.915761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1522881-019e-436f-8857-83fbf221b40f service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:25:41.920085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:25:41.920687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:25:41.920970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:25:41.921244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:25:41.931444 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:25:41.932875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:25:41.943535 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4321/8619] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:25:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:25:51.878917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=8 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:51.938924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:28.741898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0d3e-609e-4694-b472-beb909a9a1cd None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:28.742494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0d3e-609e-4694-b472-beb909a9a1cd None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:28.742494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c0d3e-609e-4694-b472-beb909a9a1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:28.763957 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-193c0d3e-609e-4694-b472-beb909a9a1cd None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:26:28.765166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-193c0d3e-609e-4694-b472-beb909a9a1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:28.774537 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4299/8620] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:26:28.789954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:28.803497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf69c32-9152-460f-ac4c-c2578668edd7 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:28.809183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:28.809577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:28.809920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:28.810303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:28.819465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:28.821044 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:28.830668 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4322/8621] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:26:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:26:28.893160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0d3e-609e-4694-b472-beb909a9a1cd None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:28.903999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c0d3e-609e-4694-b472-beb909a9a1cd None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:28.910581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:28.911224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:28.911501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:28.911776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] PATH_INFO: `/v3/users/e338ca8ecf9646e1b5f798d5ea65f5c9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:28.912934 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e338ca8ecf9646e1b5f798d5ea65f5c9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:28.914896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:29.078420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e338ca8ecf9646e1b5f798d5ea65f5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.079008 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e338ca8ecf9646e1b5f798d5ea65f5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.132569 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e338ca8ecf9646e1b5f798d5ea65f5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.133204 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e338ca8ecf9646e1b5f798d5ea65f5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.140743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-15ff86fa-2551-4b50-b3a6-1944990501b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e338ca8ecf9646e1b5f798d5ea65f5c9'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.157962 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4300/8622] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:26:28 2022] DELETE /identity/v3/users/e338ca8ecf9646e1b5f798d5ea65f5c9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:26:29.391255 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:29.402366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daeba75-7b79-4cb3-826a-55e5178c30b0 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:29.465675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:29.466349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:29.466632 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:29.466905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] PATH_INFO: `/v3/projects/ee305e628b7a4f069272604cf496df83` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:29.468056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee305e628b7a4f069272604cf496df83)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:29.470301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:29.614374 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee305e628b7a4f069272604cf496df83', 'request_id': 'req-546d76bb-55e6-4d7c-8d50-7844e151167f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.620560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee305e628b7a4f069272604cf496df83', 'request_id': 'req-546d76bb-55e6-4d7c-8d50-7844e151167f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.692631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee305e628b7a4f069272604cf496df83', 'request_id': 'req-546d76bb-55e6-4d7c-8d50-7844e151167f'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.703506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] The token cache is being invalidate because project ee305e628b7a4f069272604cf496df83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:26:29.703798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.704436 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-546d76bb-55e6-4d7c-8d50-7844e151167f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:26:29.705933 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4323/8623] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:26:29 2022] DELETE /identity/v3/projects/ee305e628b7a4f069272604cf496df83 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:26:29.711134 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf41ed-020e-43f2-8142-1b8f4a3f8098 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:29.711422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf41ed-020e-43f2-8142-1b8f4a3f8098 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:29.711701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf41ed-020e-43f2-8142-1b8f4a3f8098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:29.731888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-05cf41ed-020e-43f2-8142-1b8f4a3f8098 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:26:29.736844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-05cf41ed-020e-43f2-8142-1b8f4a3f8098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:29.792233 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4301/8624] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:26:29.800783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5920-18e4-4678-b947-5de84e8fe38e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:29.801223 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5920-18e4-4678-b947-5de84e8fe38e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:29.801319 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5920-18e4-4678-b947-5de84e8fe38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:29.820678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-564e5920-18e4-4678-b947-5de84e8fe38e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:26:29.821855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-564e5920-18e4-4678-b947-5de84e8fe38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:29.829627 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4324/8625] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:26:29.833973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf41ed-020e-43f2-8142-1b8f4a3f8098 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:29.844332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf41ed-020e-43f2-8142-1b8f4a3f8098 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:29.848845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:29.849443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:29.849719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:29.850282 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:29.851301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:26:29.851623 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:29.853263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:29.865590 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4302/8626] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:26:29.869865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5920-18e4-4678-b947-5de84e8fe38e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:29.879154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5920-18e4-4678-b947-5de84e8fe38e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:29.883905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:29.884525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:29.884806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:29.885078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:29.885693 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:29.887913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:30.003470 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4325/8627] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:26:29 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:26:30.007474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:30.018927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc2a7-6761-478b-9532-2994def42b5a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:30.067635 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:30.076460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:30.079293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:30.079293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:30.079293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:30.079293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:30.080681 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:30.156114 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4303/8628] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:26:30 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:26:30.160271 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:30.170783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73926dd1-3962-43be-8c03-c03679218c01 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:30.175333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:30.175929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:30.176207 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:30.176482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:30.177377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:30.179026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:30.191831 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4326/8629] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:26:30.193020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:30.203820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8f801-2146-4ff1-bc52-1f97eed8424c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:30.208666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccb861-9a02-4c71-97e1-fae36f736a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:30.209271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb861-9a02-4c71-97e1-fae36f736a9e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:30.209553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb861-9a02-4c71-97e1-fae36f736a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:30.209866 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb861-9a02-4c71-97e1-fae36f736a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:30.210490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccb861-9a02-4c71-97e1-fae36f736a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:30.213167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccb861-9a02-4c71-97e1-fae36f736a9e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:30.224870 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4304/8630] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:26:30.229244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:30.239402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa5a9-b08b-41ed-ad9e-9a1a2ccd6339 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:30.244055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:30.244709 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:30.245710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:30.245710 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] PATH_INFO: `/v3/projects/727cc4f10b7f4910a0ff9f9910e7f0e9/users/89856fba9c264090baecbb3468b770ba/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:30.261157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727cc4f10b7f4910a0ff9f9910e7f0e9, user_id=89856fba9c264090baecbb3468b770ba, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:30.264706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:30.338399 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4327/8631] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:26:30 2022] PUT /identity/v3/projects/727cc4f10b7f4910a0ff9f9910e7f0e9/users/89856fba9c264090baecbb3468b770ba/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:26:30.343522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae4b2-bfff-4459-bcf0-c6b767d83cc8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:30.343900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae4b2-bfff-4459-bcf0-c6b767d83cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:30.344087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae4b2-bfff-4459-bcf0-c6b767d83cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:30.362995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9f7ae4b2-bfff-4459-bcf0-c6b767d83cc8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:26:30.365669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9f7ae4b2-bfff-4459-bcf0-c6b767d83cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:30.424461 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4305/8632] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:26:30.434485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:30.436723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:30.452620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:30.498111 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8401e20-8a5c-4e10-bf1e-61e44a16e8c5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:30.502323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:30.502926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:30.503202 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:30.503517 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:30.513034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:30.515079 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:30.525065 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4328/8633] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:26:35.745929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2375c-76db-4fcb-bd17-0079f8b0df71 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:35.746603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2375c-76db-4fcb-bd17-0079f8b0df71 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:35.746603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2375c-76db-4fcb-bd17-0079f8b0df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:35.777734 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ccb2375c-76db-4fcb-bd17-0079f8b0df71 None None] MFA Rules not processed for user `89856fba9c264090baecbb3468b770ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:26:35.779000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ccb2375c-76db-4fcb-bd17-0079f8b0df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:35.853726 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4306/8634] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:26:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:26:35.870778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:35.872266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:35.946525 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f29c22-8f07-497e-8094-9a4887bbc2e4 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:35.953331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:35.953942 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:35.954251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:35.954527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:35.962677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:35.964250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:35.973534 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4329/8635] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:26:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:26:38.362598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:38.362598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:38.362598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:38.391191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] MFA Rules not processed for user `89856fba9c264090baecbb3468b770ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:26:38.392420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:38.399628 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4307/8636] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:26:39.191989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:26:39.193628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:39.275680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce7782-0383-4411-b1bf-57400e5d310c service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:26:39.280988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:26:39.281718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:26:39.282073 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:26:39.282368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:26:39.284125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:26:39.296397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:26:39.297991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:26:39.308104 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4330/8637] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:26:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:26:48.377717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:49.303764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=86 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:30.620156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:27:30.621564 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:27:30.637819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde316d-fb14-4a8c-99f1-b1ddd5a96cb6 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:27:30.644607 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09739281-d3bd-4f02-b04d-7e3697eb5f43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:27:30.645240 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09739281-d3bd-4f02-b04d-7e3697eb5f43 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:27:30.645515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09739281-d3bd-4f02-b04d-7e3697eb5f43 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:27:30.645785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09739281-d3bd-4f02-b04d-7e3697eb5f43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:27:30.647591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-09739281-d3bd-4f02-b04d-7e3697eb5f43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:27:30.660253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09739281-d3bd-4f02-b04d-7e3697eb5f43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:27:30.661847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09739281-d3bd-4f02-b04d-7e3697eb5f43 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:27:30.672618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4308/8638] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:27:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:27:40.668081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:00.903336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:28:00.913989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc240442-7ecd-46c6-a235-a3490972909a service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:28:00.917849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:28:00.918783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:28:00.922549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:28:00.922549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:28:00.922549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:00.937204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:28:00.938784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:28:00.950452 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4331/8639] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:28:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:28:02.100441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa3dc-e3a3-4f44-a3a7-1d07d4dbf225 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:28:02.100939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa3dc-e3a3-4f44-a3a7-1d07d4dbf225 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:28:02.101051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa3dc-e3a3-4f44-a3a7-1d07d4dbf225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:28:02.119826 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c0afa3dc-e3a3-4f44-a3a7-1d07d4dbf225 None None] MFA Rules not processed for user `89856fba9c264090baecbb3468b770ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:28:02.121009 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c0afa3dc-e3a3-4f44-a3a7-1d07d4dbf225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:02.128697 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4309/8640] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:28:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:28:02.166462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:28:02.167857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:02.225753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0011d-f211-45ae-88a0-e7383685acb1 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:28:02.229686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:28:02.230320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:28:02.230599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:28:02.230869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:28:02.232583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:02.245453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:28:02.247018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:28:02.266796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4332/8641] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:28:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:28:05.899227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa3dc-e3a3-4f44-a3a7-1d07d4dbf225 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:28:05.909433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa3dc-e3a3-4f44-a3a7-1d07d4dbf225 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:28:05.913195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:28:05.918455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:28:05.918455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:28:05.918455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:28:05.918455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:05.926222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:28:05.927631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:28:05.935425 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4310/8642] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:28:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:28:06.704874 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:28:06.706433 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:06.721275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e01152-5166-4039-8485-5b95571fa272 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:28:06.727116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:28:06.729299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:28:06.729299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:28:06.729299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:28:06.730174 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:06.743680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:28:06.745328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:28:06.758188 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4333/8643] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:28:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:28:12.704908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:28:12.719542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00847223-67fa-40aa-afe2-91500c34d6d2 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:28:12.725448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:28:12.726176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:28:12.726547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:28:12.727011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:28:12.729039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:28:12.741689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:28:12.743483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:28:12.755568 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4311/8644] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:28:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:28:16.752448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=38 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:28:22.751162 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:14.100539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:29:14.144357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2cbb3-19e6-4090-a883-b7adfc365e4c service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:29:14.149290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:29:14.149880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:29:14.150187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:29:14.150460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:29:14.152141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:29:14.163496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:29:14.165049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:29:14.174452 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4334/8645] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:29:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:29:19.724983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:29:19.726659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:29:19.750677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad298a0-3140-42c9-ac22-bc9bc1acbf24 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:29:19.754328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80372e-595a-47f2-ab17-d9ea8696d034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:29:19.754935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80372e-595a-47f2-ab17-d9ea8696d034 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:29:19.755218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80372e-595a-47f2-ab17-d9ea8696d034 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:29:19.755578 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80372e-595a-47f2-ab17-d9ea8696d034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:29:19.757878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-bf80372e-595a-47f2-ab17-d9ea8696d034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:29:19.769693 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80372e-595a-47f2-ab17-d9ea8696d034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:29:19.771185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80372e-595a-47f2-ab17-d9ea8696d034 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:29:19.779036 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4312/8646] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:29:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:29:20.577243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:29:20.597272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e455c-139e-48a9-85d7-c64abd47da3f service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:29:20.603604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:29:20.607520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:29:20.607520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:29:20.607520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:29:20.607520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:29:20.618795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:29:20.620505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:29:20.631345 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4335/8647] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:29:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:29:29.775505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:30.626564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=27 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:33.765368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5299e0-289f-4a5c-80b5-10e6cabfc9c9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:29:33.770608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5299e0-289f-4a5c-80b5-10e6cabfc9c9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:29:33.770608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5299e0-289f-4a5c-80b5-10e6cabfc9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:29:33.785394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0a5299e0-289f-4a5c-80b5-10e6cabfc9c9 None None] MFA Rules not processed for user `89856fba9c264090baecbb3468b770ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:29:33.786611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0a5299e0-289f-4a5c-80b5-10e6cabfc9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:29:33.793655 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4313/8648] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:29:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:29:34.099692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:29:34.109483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d975b04-e8bb-42a1-ba8a-bc3656a110ba service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:29:34.113110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:29:34.113708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:29:34.113991 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:29:34.114298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:29:34.116028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:29:34.125801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:29:34.127264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:29:34.135006 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4336/8649] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:29:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:29:43.780278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:44.131572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:49.040830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5299e0-289f-4a5c-80b5-10e6cabfc9c9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:29:49.052944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5299e0-289f-4a5c-80b5-10e6cabfc9c9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:29:49.058457 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:29:49.059061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:29:49.059342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:29:49.060178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:29:49.062027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:29:49.073090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:29:49.074744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:29:49.084215 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4314/8650] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:29:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:29:59.080197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:27.785836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:30:27.794763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335bed6-bf4b-4fea-8734-c6e7bcecb9da service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:30:27.799387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8e69b-00c6-43fe-bc19-ab7723c2f136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:30:27.799993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e69b-00c6-43fe-bc19-ab7723c2f136 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:30:27.800268 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e69b-00c6-43fe-bc19-ab7723c2f136 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:30:27.800537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8e69b-00c6-43fe-bc19-ab7723c2f136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:30:27.806163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-35a8e69b-00c6-43fe-bc19-ab7723c2f136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:30:27.816026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8e69b-00c6-43fe-bc19-ab7723c2f136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:30:27.817554 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8e69b-00c6-43fe-bc19-ab7723c2f136 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:30:27.825358 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4337/8651] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:30:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:30:37.822115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:30:45.234548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:30:45.246033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0ddd4-273a-4969-8524-2e9127cee5a2 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:30:45.251505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:30:45.252843 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:30:45.253124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:30:45.253396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:30:45.255185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:30:45.267124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:30:45.268709 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:30:45.278844 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4315/8652] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:30:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:30:55.274425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:01.364863 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:31:01.365901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:31:01.366247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:31:01.386842 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] MFA Rules not processed for user `89856fba9c264090baecbb3468b770ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:31:01.388051 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:31:01.395767 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4338/8653] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:31:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:31:01.709352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:31:01.718882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3096191-f9a1-4fdc-8b9e-38bee2de6c69 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:31:01.722825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:31:01.723416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:31:01.723695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:31:01.723967 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:31:01.725669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:31:01.734966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:31:01.736400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:31:01.744773 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4316/8654] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:31:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:31:11.380609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:11.741418 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:49.834609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:31:49.836001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:31:49.913125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e538a-5a8b-4242-b256-ee448af6a4b4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:31:49.916682 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:31:49.917287 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:31:49.917573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:31:49.918427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:31:49.926880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:31:49.928309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:31:49.937874 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4339/8655] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:31:59.933003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=35 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:06.211000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:32:06.220485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5a36-7b06-477f-b847-8e0af5698862 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:32:06.224213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:32:06.224837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:32:06.225115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:32:06.225387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:32:06.227275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:32:06.251703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:32:06.253105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:32:06.273514 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4317/8656] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:32:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:32:16.270860 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=14 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:02.327801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:02.344828 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4a68-378f-4d74-a8dc-57ec6786ebce service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:02.349087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:02.349688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:02.349969 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:02.350273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:02.360249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:02.361707 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:02.372288 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4340/8657] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:03.555995 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:03.572682 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f53c5-c7c3-4da1-b64c-f1c78e587b2c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:03.576357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:03.576964 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:03.577242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:03.577517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:03.589467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:03.590939 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:03.613723 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4318/8658] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:12.367655 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:13.597118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:20.378201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:20.387425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba4b5-afe8-4e86-bd0e-0018cdd6b3fc service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:20.391312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:20.391909 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:20.392192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:20.392469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:20.401917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:20.403388 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:20.430685 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4341/8659] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:24.033782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:24.045571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebbca7-a225-4e04-984d-a0cf21b9f73c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:24.050677 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:24.051877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:24.052157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:24.052429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:24.054364 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:24.088211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:24.089793 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:24.100047 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4319/8660] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:24.154364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:24.166391 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be5c48-cf5d-48c2-8f92-2ae813a7e711 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:24.171036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:24.171609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:24.171886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:24.172157 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] PATH_INFO: `/v3/users/89856fba9c264090baecbb3468b770ba` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:24.173260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89856fba9c264090baecbb3468b770ba)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:24.175226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:24.363563 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89856fba9c264090baecbb3468b770ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:24.370685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89856fba9c264090baecbb3468b770ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:24.371393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89856fba9c264090baecbb3468b770ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:24.383712 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89856fba9c264090baecbb3468b770ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:24.440067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-4c420902-e83d-496c-9eb3-5198e4028819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89856fba9c264090baecbb3468b770ba'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:24.446808 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4342/8661] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:33:24 2022] DELETE /identity/v3/users/89856fba9c264090baecbb3468b770ba => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:33:24.714349 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:24.725140 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7334a1-eb12-4141-bc1d-1d41e943b111 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:24.782899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:24.783526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:24.783803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:24.784072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] PATH_INFO: `/v3/projects/727cc4f10b7f4910a0ff9f9910e7f0e9` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:24.785170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727cc4f10b7f4910a0ff9f9910e7f0e9)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:24.787173 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:24.903466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'request_id': 'req-634d0d52-434c-4e24-a80a-62775e0af511'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:24.909759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'request_id': 'req-634d0d52-434c-4e24-a80a-62775e0af511'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:24.982686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727cc4f10b7f4910a0ff9f9910e7f0e9', 'request_id': 'req-634d0d52-434c-4e24-a80a-62775e0af511'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:25.006328 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] The token cache is being invalidate because project 727cc4f10b7f4910a0ff9f9910e7f0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:33:25.006620 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:25.007247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-634d0d52-434c-4e24-a80a-62775e0af511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:33:25.008732 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4320/8662] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:33:24 2022] DELETE /identity/v3/projects/727cc4f10b7f4910a0ff9f9910e7f0e9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:33:25.025584 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1efd4e-c97c-4f2d-bd7b-666d1343a4d4 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.026008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1efd4e-c97c-4f2d-bd7b-666d1343a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.026415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1efd4e-c97c-4f2d-bd7b-666d1343a4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.084830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-ed1efd4e-c97c-4f2d-bd7b-666d1343a4d4 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:33:25.086033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed1efd4e-c97c-4f2d-bd7b-666d1343a4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:25.171269 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4343/8663] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:33:25.179810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76141d0-75e4-49bf-bc4e-b1b068412711 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.180275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76141d0-75e4-49bf-bc4e-b1b068412711 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.180372 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76141d0-75e4-49bf-bc4e-b1b068412711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.202360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-f76141d0-75e4-49bf-bc4e-b1b068412711 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:33:25.203563 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f76141d0-75e4-49bf-bc4e-b1b068412711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:25.211421 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4321/8664] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:33:25.215894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1efd4e-c97c-4f2d-bd7b-666d1343a4d4 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:25.225741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1efd4e-c97c-4f2d-bd7b-666d1343a4d4 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:25.230252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:25.230843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.231122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.231464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.232106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:33:25.232410 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:25.234095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:25.242982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:25.246166 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4344/8665] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:33:25.250611 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76141d0-75e4-49bf-bc4e-b1b068412711 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:25.260330 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76141d0-75e4-49bf-bc4e-b1b068412711 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:25.265197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:25.265800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.266104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.266384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.267018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:25.268905 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:25.365181 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4322/8666] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:33:25 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:33:25.369415 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:25.380228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4bb7d-d34a-447c-b32e-102fb83bac6c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:25.436654 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:25.437260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.437541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.437819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.438506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:25.440423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:25.524001 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4345/8667] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:33:25 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:33:25.528018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:25.542993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620f4f-65fe-473f-8e9c-94469c32bd0e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:25.548803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:25.549422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.549708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.549990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.550749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:25.553600 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:25.556344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:25.564748 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4323/8668] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:33:25.569323 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:25.579609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92ee03-350e-4246-84c2-08c883d1cbdf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:25.584529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933885c7-0c43-45f4-b74c-3a8c2548dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:25.585244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933885c7-0c43-45f4-b74c-3a8c2548dfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.585533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933885c7-0c43-45f4-b74c-3a8c2548dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.585826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933885c7-0c43-45f4-b74c-3a8c2548dfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.586507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933885c7-0c43-45f4-b74c-3a8c2548dfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:25.588101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933885c7-0c43-45f4-b74c-3a8c2548dfc2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:25.599304 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4346/8669] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:33:25.603498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:25.613484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b59e7-210f-413e-a050-89961df91379 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:25.619527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:25.620192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.620475 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.620753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] PATH_INFO: `/v3/projects/72e2ab854c824c68bfc6ca1f34621484/users/5211250033404c4698bbfd10470fc19e/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.635898 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e2ab854c824c68bfc6ca1f34621484, user_id=5211250033404c4698bbfd10470fc19e, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:25.638732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:25.706211 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4324/8670] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:33:25 2022] PUT /identity/v3/projects/72e2ab854c824c68bfc6ca1f34621484/users/5211250033404c4698bbfd10470fc19e/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:33:25.711746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac576-97e7-4a57-90d2-463d17c6d668 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.712100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac576-97e7-4a57-90d2-463d17c6d668 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.712443 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bac576-97e7-4a57-90d2-463d17c6d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.731213 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f7bac576-97e7-4a57-90d2-463d17c6d668 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:33:25.732416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f7bac576-97e7-4a57-90d2-463d17c6d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:25.791864 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4347/8671] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:33:25.802343 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:25.804007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:25.859960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094451b-18e8-41eb-af20-d4c5b45f4022 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:25.864118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0e1a0-98b9-4b1b-bccf-95de95e19058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:25.864720 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0e1a0-98b9-4b1b-bccf-95de95e19058 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:25.865000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0e1a0-98b9-4b1b-bccf-95de95e19058 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:25.865265 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0e1a0-98b9-4b1b-bccf-95de95e19058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:25.874144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0e1a0-98b9-4b1b-bccf-95de95e19058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:25.875550 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0e1a0-98b9-4b1b-bccf-95de95e19058 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:25.885320 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4325/8672] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:31.553834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:31.554336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:31.554336 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:31.584837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] MFA Rules not processed for user `5211250033404c4698bbfd10470fc19e`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:33:31.586228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:31.661923 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4348/8673] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:33:31.671940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:31.672407 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:31.672536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:31.693517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] MFA Rules not processed for user `5211250033404c4698bbfd10470fc19e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:33:31.698266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:31.703345 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4326/8674] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:33:31.722241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:31.724566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:31.742797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:31.816042 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf574aee-382d-43a8-a28a-3b88c946c086 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:31.823531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:31.824847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:31.825135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:31.825428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:31.834115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:31.835786 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:31.846361 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4349/8675] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:32.544570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:32.547778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:32.653339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4fcd7-3a8b-4095-88d6-893861084741 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:32.658527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:32.659157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:32.659491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:32.659755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:32.661700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:32.673698 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:32.676917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:32.687737 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4327/8676] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:35.972361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:35.974500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:35.986614 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b615d-640b-4008-8aed-a726a44e484c service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:35.990940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:35.991558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:35.991841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:35.992118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:35.993910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:36.003987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:36.005423 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:36.017040 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4350/8677] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:33:36.864638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:36.864638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:36.877426 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7dfa5-8d37-4d2e-b334-49c81d6eabcf service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:36.883473 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8933-6ccf-4e8c-bca4-aaaeecbf46d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:36.884083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8933-6ccf-4e8c-bca4-aaaeecbf46d9 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:36.884408 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8933-6ccf-4e8c-bca4-aaaeecbf46d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:36.884688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8933-6ccf-4e8c-bca4-aaaeecbf46d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:36.886442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1ec8933-6ccf-4e8c-bca4-aaaeecbf46d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:36.899938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8933-6ccf-4e8c-bca4-aaaeecbf46d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:36.901524 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8933-6ccf-4e8c-bca4-aaaeecbf46d9 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:36.912684 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4328/8678] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:44.176375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:44.190602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ce67-255d-4492-a263-58c8c19d550f service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:44.196129 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:44.200851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:44.200851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:44.200851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:44.200851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:44.211215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:44.212785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:44.224362 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4351/8679] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:46.705853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f417-fbd4-4164-82a8-a9d4b5b0a046 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:46.706383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f417-fbd4-4164-82a8-a9d4b5b0a046 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:46.706383 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f417-fbd4-4164-82a8-a9d4b5b0a046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:46.726324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-3009f417-fbd4-4164-82a8-a9d4b5b0a046 None None] MFA Rules not processed for user `5211250033404c4698bbfd10470fc19e`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:33:46.727515 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-3009f417-fbd4-4164-82a8-a9d4b5b0a046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:46.734560 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4329/8680] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:33:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:33:47.357987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:33:47.369650 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a6567-4108-42c7-89c5-fe95ab84dca8 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:33:47.375037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:33:47.375646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:33:47.375924 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:33:47.376196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:33:47.377943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:33:47.391483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:33:47.393062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:33:47.406919 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4352/8681] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:33:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:33:56.720717 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:57.402419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=48 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:12.646352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3279d-6327-4f3b-912e-071d2d439475 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:12.648042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3279d-6327-4f3b-912e-071d2d439475 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:12.648562 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3279d-6327-4f3b-912e-071d2d439475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:12.704320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d9a3279d-6327-4f3b-912e-071d2d439475 None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:12.706014 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d9a3279d-6327-4f3b-912e-071d2d439475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:12.716676 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4330/8682] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:34:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:12.728812 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:12.739759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed587c54-964a-4d09-9e83-4108978aa0e3 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:12.745284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:12.746005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:12.746320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:12.746734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:12.755343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:12.757780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:12.771623 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4353/8683] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:34:12.789727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3279d-6327-4f3b-912e-071d2d439475 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:12.801210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3279d-6327-4f3b-912e-071d2d439475 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:12.806534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:12.807176 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:12.807484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:12.807756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] PATH_INFO: `/v3/users/5211250033404c4698bbfd10470fc19e` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:12.808904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5211250033404c4698bbfd10470fc19e)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:12.810848 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:12.993718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5211250033404c4698bbfd10470fc19e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:12.994338 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5211250033404c4698bbfd10470fc19e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.088234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5211250033404c4698bbfd10470fc19e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.088895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5211250033404c4698bbfd10470fc19e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.096608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-5f2deed9-1c7f-4f36-a9e8-025ee695bc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5211250033404c4698bbfd10470fc19e'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.114045 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4331/8684] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:34:12 2022] DELETE /identity/v3/users/5211250033404c4698bbfd10470fc19e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:13.344275 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:13.356121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf6388-35b5-4fc6-bf1e-b34bbfe897ad service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:13.415781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:13.416422 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:13.416704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:13.416979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] PATH_INFO: `/v3/projects/72e2ab854c824c68bfc6ca1f34621484` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:13.418132 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e2ab854c824c68bfc6ca1f34621484)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:13.420057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:13.536816 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e2ab854c824c68bfc6ca1f34621484', 'request_id': 'req-fe2755bf-5108-4e97-8bbe-72acd17ba969'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.543579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e2ab854c824c68bfc6ca1f34621484', 'request_id': 'req-fe2755bf-5108-4e97-8bbe-72acd17ba969'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.602381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e2ab854c824c68bfc6ca1f34621484', 'request_id': 'req-fe2755bf-5108-4e97-8bbe-72acd17ba969'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.613018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] The token cache is being invalidate because project 72e2ab854c824c68bfc6ca1f34621484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:34:13.613306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.613929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-fe2755bf-5108-4e97-8bbe-72acd17ba969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:13.615427 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4354/8685] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:34:13 2022] DELETE /identity/v3/projects/72e2ab854c824c68bfc6ca1f34621484 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:34:13.621335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662588-0ee0-4f88-b920-fc6fdd450722 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:13.621649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662588-0ee0-4f88-b920-fc6fdd450722 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:13.621927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662588-0ee0-4f88-b920-fc6fdd450722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:13.642039 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-26662588-0ee0-4f88-b920-fc6fdd450722 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:13.643613 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-26662588-0ee0-4f88-b920-fc6fdd450722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:13.704766 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4332/8686] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:13.713493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe1382-925d-4888-bd6e-c64e0f2068c1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:13.713800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe1382-925d-4888-bd6e-c64e0f2068c1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:13.714113 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe1382-925d-4888-bd6e-c64e0f2068c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:13.734711 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-7afe1382-925d-4888-bd6e-c64e0f2068c1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:13.735896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7afe1382-925d-4888-bd6e-c64e0f2068c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:13.743719 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4355/8687] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:13.748055 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662588-0ee0-4f88-b920-fc6fdd450722 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:13.757897 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26662588-0ee0-4f88-b920-fc6fdd450722 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:13.762517 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:13.763106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:13.763387 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:13.763658 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:13.764304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:34:13.764871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:13.766492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:13.778666 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4333/8688] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:34:13.783276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe1382-925d-4888-bd6e-c64e0f2068c1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:13.793151 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe1382-925d-4888-bd6e-c64e0f2068c1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:13.797837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:13.798531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:13.798815 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:13.799090 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:13.799725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:13.801630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:13.885588 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4356/8689] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:34:13 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:34:13.889845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:13.900710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34fbda-ec99-4ca7-8b7a-994d6e6f499b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:13.929691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:13.956895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:13.957500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:13.957840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:13.958142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:13.958776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:13.961224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:14.068199 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4334/8690] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:34:13 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:34:14.072865 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:14.083923 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994582-1118-4104-84e9-aa9e6f4f7506 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:14.089263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:14.089906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:14.090368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:14.090642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:14.091284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:14.092870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:14.103025 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4357/8691] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:34:14.107366 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:14.117670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b52d-78d8-4fd6-b550-229d331553b0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:14.122646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca0f5e-fa40-4f6f-b9ac-ef3ac5ed22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:14.123288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca0f5e-fa40-4f6f-b9ac-ef3ac5ed22e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:14.123574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca0f5e-fa40-4f6f-b9ac-ef3ac5ed22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:14.123850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca0f5e-fa40-4f6f-b9ac-ef3ac5ed22e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:14.124490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca0f5e-fa40-4f6f-b9ac-ef3ac5ed22e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:14.126100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca0f5e-fa40-4f6f-b9ac-ef3ac5ed22e7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:14.136618 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4335/8692] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:34:14.140854 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:14.151496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d2fcf-72ba-480f-9e01-cfd098bffb55 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:14.156106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:14.156783 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:14.157067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:14.157345 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] PATH_INFO: `/v3/projects/861c91efc9304674976b7e2b2d0dc4d2/users/c03c99fabe05430d9b0a6807366ae59c/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:14.172057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=861c91efc9304674976b7e2b2d0dc4d2, user_id=c03c99fabe05430d9b0a6807366ae59c, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:14.174737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:14.244315 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4358/8693] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:34:14 2022] PUT /identity/v3/projects/861c91efc9304674976b7e2b2d0dc4d2/users/c03c99fabe05430d9b0a6807366ae59c/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:14.254397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828877b7-a8c0-4eb9-9bd2-d13c301aeb25 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:14.254688 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828877b7-a8c0-4eb9-9bd2-d13c301aeb25 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:14.255041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828877b7-a8c0-4eb9-9bd2-d13c301aeb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:14.284518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-828877b7-a8c0-4eb9-9bd2-d13c301aeb25 None None] MFA Rules not processed for user `c03c99fabe05430d9b0a6807366ae59c`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:14.285770 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-828877b7-a8c0-4eb9-9bd2-d13c301aeb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:14.350127 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4336/8694] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:14.360596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:14.362328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:14.380318 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:14.432103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72342707-20db-4653-affa-86562ff3d3de admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:14.436198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097c81-d1d8-425b-8f37-3537a4b98f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:14.439427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097c81-d1d8-425b-8f37-3537a4b98f16 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:14.439427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097c81-d1d8-425b-8f37-3537a4b98f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:14.439427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097c81-d1d8-425b-8f37-3537a4b98f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:14.447011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097c81-d1d8-425b-8f37-3537a4b98f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:14.447772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097c81-d1d8-425b-8f37-3537a4b98f16 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:14.458965 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4359/8695] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:34:24.347056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:24.454082 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=25 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:32.032896 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828877b7-a8c0-4eb9-9bd2-d13c301aeb25 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:32.096644 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828877b7-a8c0-4eb9-9bd2-d13c301aeb25 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:32.101175 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:32.102342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:32.102626 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:32.102903 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] PATH_INFO: `/v3/users/c03c99fabe05430d9b0a6807366ae59c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:32.104027 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03c99fabe05430d9b0a6807366ae59c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:32.105920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:32.308491 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03c99fabe05430d9b0a6807366ae59c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.309571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03c99fabe05430d9b0a6807366ae59c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.370368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03c99fabe05430d9b0a6807366ae59c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.370983 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03c99fabe05430d9b0a6807366ae59c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.378719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03c99fabe05430d9b0a6807366ae59c'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.396993 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4337/8696] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:34:32 2022] DELETE /identity/v3/users/c03c99fabe05430d9b0a6807366ae59c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:32.401520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:32.401990 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:32.402115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:32.421005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:32.422247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:32.482549 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4360/8697] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:32.493434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:32.495068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:32.559103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fe9c-536d-4ce4-8e9e-d4664e3c0b65 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:32.562864 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62232f7-33bc-454b-8d5e-983944b65c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:32.563476 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62232f7-33bc-454b-8d5e-983944b65c04 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:32.563757 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62232f7-33bc-454b-8d5e-983944b65c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:32.564031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62232f7-33bc-454b-8d5e-983944b65c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:32.574120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62232f7-33bc-454b-8d5e-983944b65c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:32.575549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62232f7-33bc-454b-8d5e-983944b65c04 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:32.585623 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4338/8698] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:34:32.814902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:32.816402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:32.829636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caed93-947e-40be-89ec-bb3e16ecdfb9 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:32.834625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:32.835260 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:32.838739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:32.838739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] PATH_INFO: `/v3/projects/861c91efc9304674976b7e2b2d0dc4d2` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:32.838739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=861c91efc9304674976b7e2b2d0dc4d2)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:32.839097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:32.925022 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861c91efc9304674976b7e2b2d0dc4d2', 'request_id': 'req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.931878 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861c91efc9304674976b7e2b2d0dc4d2', 'request_id': 'req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.987411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861c91efc9304674976b7e2b2d0dc4d2', 'request_id': 'req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:32.999390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] The token cache is being invalidate because project 861c91efc9304674976b7e2b2d0dc4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:34:32.999726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:33.000377 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-94a72e3e-3ed7-436b-9a66-7bea8343a4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:33.001878 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4361/8699] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:34:32 2022] DELETE /identity/v3/projects/861c91efc9304674976b7e2b2d0dc4d2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:33.007082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2d7f-fe5e-44bf-8b95-0b98f3a037c8 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.007374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2d7f-fe5e-44bf-8b95-0b98f3a037c8 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.007654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2d7f-fe5e-44bf-8b95-0b98f3a037c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.027474 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-730a2d7f-fe5e-44bf-8b95-0b98f3a037c8 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:33.028731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-730a2d7f-fe5e-44bf-8b95-0b98f3a037c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:33.045943 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:33.089526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4339/8700] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:33.097330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa06305-8d25-46e7-b42e-426e325f2429 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.097623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa06305-8d25-46e7-b42e-426e325f2429 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.097904 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa06305-8d25-46e7-b42e-426e325f2429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.118869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-daa06305-8d25-46e7-b42e-426e325f2429 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:33.120074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-daa06305-8d25-46e7-b42e-426e325f2429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:33.128016 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4362/8701] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:33.132274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a2d7f-fe5e-44bf-8b95-0b98f3a037c8 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:33.142437 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a2d7f-fe5e-44bf-8b95-0b98f3a037c8 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:33.147592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:33.148190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.148469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.149242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.149884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:34:33.150213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:33.151784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:33.163804 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4340/8702] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:34:33.168840 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa06305-8d25-46e7-b42e-426e325f2429 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:33.178411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa06305-8d25-46e7-b42e-426e325f2429 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:33.183095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:33.183685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.183960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.184228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.184852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:33.186798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:33.265988 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4363/8703] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:34:33 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:34:33.270154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:33.280792 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d5acc-b213-45f9-8ce2-47a74ddf29f0 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:33.337927 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:33.338572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.338855 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.339133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.339829 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:33.341691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:33.436546 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4341/8704] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:34:33 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:34:33.440690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:33.451396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09df71b-3d21-488e-96cf-7d85d5919085 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:33.456125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:33.456748 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.457032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.457307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.457980 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:33.459616 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:33.470776 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4364/8705] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:34:33.474918 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:33.485619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb5607-0013-4b81-b86c-98e7d20ea36a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:33.490276 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ac98-e61a-45fa-9247-590a4166e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:33.490877 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ac98-e61a-45fa-9247-590a4166e4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.491156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ac98-e61a-45fa-9247-590a4166e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.491434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ac98-e61a-45fa-9247-590a4166e4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.492068 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720ac98-e61a-45fa-9247-590a4166e4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:33.493667 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720ac98-e61a-45fa-9247-590a4166e4f9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:33.504182 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4342/8706] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:34:33.508798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:33.518933 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635900-0749-447e-bf13-8bc66b4fbfcf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:33.524088 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:33.524717 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.524995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.525267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] PATH_INFO: `/v3/projects/c47ada8a4f0c4b6aa91fcc817bb0e45c/users/15cfc147d84b49fb8b734a9a4c0d2101/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.539542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47ada8a4f0c4b6aa91fcc817bb0e45c, user_id=15cfc147d84b49fb8b734a9a4c0d2101, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:33.542259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:33.607972 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4365/8707] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:34:33 2022] PUT /identity/v3/projects/c47ada8a4f0c4b6aa91fcc817bb0e45c/users/15cfc147d84b49fb8b734a9a4c0d2101/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:33.618701 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76324-37e0-4959-be51-df3cb463924c None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.618985 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76324-37e0-4959-be51-df3cb463924c None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.619260 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76324-37e0-4959-be51-df3cb463924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.647750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-78e76324-37e0-4959-be51-df3cb463924c None None] MFA Rules not processed for user `15cfc147d84b49fb8b734a9a4c0d2101`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:33.649606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-78e76324-37e0-4959-be51-df3cb463924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:33.714997 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4343/8708] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:33.725034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:33.726725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:33.748628 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:33.784683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38f053-bf97-43ce-a42f-fe010f1478b1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:33.788360 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab953f-fb5f-402d-9c27-4765ea3db38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:33.788966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab953f-fb5f-402d-9c27-4765ea3db38a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:33.803775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab953f-fb5f-402d-9c27-4765ea3db38a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:33.803775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab953f-fb5f-402d-9c27-4765ea3db38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:33.803775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab953f-fb5f-402d-9c27-4765ea3db38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:33.803775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab953f-fb5f-402d-9c27-4765ea3db38a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:33.808339 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4366/8709] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:34:40.083882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76324-37e0-4959-be51-df3cb463924c None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:40.099040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:40.142722 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76324-37e0-4959-be51-df3cb463924c None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:40.147251 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:40.147881 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:40.148160 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:40.148432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] PATH_INFO: `/v3/users/15cfc147d84b49fb8b734a9a4c0d2101` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:40.150100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cfc147d84b49fb8b734a9a4c0d2101)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:40.152005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:40.300170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cfc147d84b49fb8b734a9a4c0d2101'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:40.300823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cfc147d84b49fb8b734a9a4c0d2101'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:40.372608 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cfc147d84b49fb8b734a9a4c0d2101'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:40.373224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cfc147d84b49fb8b734a9a4c0d2101'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:40.380526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cfc147d84b49fb8b734a9a4c0d2101'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:40.402735 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4344/8710] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:34:40 2022] DELETE /identity/v3/users/15cfc147d84b49fb8b734a9a4c0d2101 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:40.407488 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:40.407989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:40.408092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:40.426959 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:40.428164 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:40.487257 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4367/8711] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:40.497800 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:40.499316 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:40.562192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d830174-5c50-45c7-9660-a04523a01599 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:40.565834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052b85c-5b0d-49f2-95d5-70dd36870534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:40.566610 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052b85c-5b0d-49f2-95d5-70dd36870534 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:40.566754 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052b85c-5b0d-49f2-95d5-70dd36870534 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:40.567277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052b85c-5b0d-49f2-95d5-70dd36870534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:40.577166 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052b85c-5b0d-49f2-95d5-70dd36870534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:40.578657 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052b85c-5b0d-49f2-95d5-70dd36870534 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:40.588678 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4345/8712] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:34:40.882947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:40.884352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:40.899941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8464277-3c14-4c49-923f-e5ba20aa4fd3 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:40.907725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:40.907725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:40.907725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:40.907725 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] PATH_INFO: `/v3/projects/c47ada8a4f0c4b6aa91fcc817bb0e45c` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:40.910472 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47ada8a4f0c4b6aa91fcc817bb0e45c)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:40.912643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.025326 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47ada8a4f0c4b6aa91fcc817bb0e45c', 'request_id': 'req-87084d2b-2e96-4822-8e4a-8598d1e23b1a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:41.031738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47ada8a4f0c4b6aa91fcc817bb0e45c', 'request_id': 'req-87084d2b-2e96-4822-8e4a-8598d1e23b1a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:41.103835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47ada8a4f0c4b6aa91fcc817bb0e45c', 'request_id': 'req-87084d2b-2e96-4822-8e4a-8598d1e23b1a'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:41.114690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] The token cache is being invalidate because project c47ada8a4f0c4b6aa91fcc817bb0e45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:34:41.119702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:41.119702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-87084d2b-2e96-4822-8e4a-8598d1e23b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:34:41.119702 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4368/8713] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:34:40 2022] DELETE /identity/v3/projects/c47ada8a4f0c4b6aa91fcc817bb0e45c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:41.122928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270252a-b3d6-4c66-a452-a828d70e4cae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.123397 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270252a-b3d6-4c66-a452-a828d70e4cae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.123507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270252a-b3d6-4c66-a452-a828d70e4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.143404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-6270252a-b3d6-4c66-a452-a828d70e4cae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:41.144538 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-6270252a-b3d6-4c66-a452-a828d70e4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:41.177739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:41.203360 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4346/8714] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:34:41.211331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ff5e6-731b-495d-b110-80242f98f0d1 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.211687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ff5e6-731b-495d-b110-80242f98f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.212030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ff5e6-731b-495d-b110-80242f98f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.232429 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a32ff5e6-731b-495d-b110-80242f98f0d1 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:41.233615 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a32ff5e6-731b-495d-b110-80242f98f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:41.241493 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4369/8715] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:41.246547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270252a-b3d6-4c66-a452-a828d70e4cae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:41.256118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270252a-b3d6-4c66-a452-a828d70e4cae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:41.260706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:41.264959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.264959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.264959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.264959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:34:41.264959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:41.264959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.276314 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4347/8716] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:34:41.280677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ff5e6-731b-495d-b110-80242f98f0d1 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:41.290449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ff5e6-731b-495d-b110-80242f98f0d1 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:41.295239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:41.295837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.296115 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.296834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.297470 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:41.299448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.374485 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4370/8717] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:34:41 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:34:41.378774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:41.389254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67027-9957-4f51-ae70-8585570ebe86 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:41.446104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:41.446638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.446915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.447188 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.447815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:41.449723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.536412 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4348/8718] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:34:41 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:34:41.541224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:41.551588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717260e9-d394-4f1f-b389-50f37f723561 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:41.556461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:41.557187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.557460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.557767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.558482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:41.560099 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.570524 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4371/8719] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:34:41.574672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:41.584884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928ea0a-26e9-421c-8828-578bb5bec10d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:41.590030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc965-8614-4b47-b066-0fdf584f99a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:41.590662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc965-8614-4b47-b066-0fdf584f99a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.590947 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc965-8614-4b47-b066-0fdf584f99a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.591227 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc965-8614-4b47-b066-0fdf584f99a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.591880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc965-8614-4b47-b066-0fdf584f99a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:41.593464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc965-8614-4b47-b066-0fdf584f99a3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.604770 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4349/8720] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:34:41.608845 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:41.619121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085afd4-91a5-4b6e-a917-b21319e92d8c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:41.623765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:41.624430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.624700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.624978 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] PATH_INFO: `/v3/projects/d76dfb43e63b4caa88f8c8d0cc669927/users/a599af629ce6421499d5b545acad45d0/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.627200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:41.640245 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76dfb43e63b4caa88f8c8d0cc669927, user_id=a599af629ce6421499d5b545acad45d0, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:41.643018 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.706969 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4372/8721] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:34:41 2022] PUT /identity/v3/projects/d76dfb43e63b4caa88f8c8d0cc669927/users/a599af629ce6421499d5b545acad45d0/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:41.712485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fa78-ae75-46fb-8de9-c1f05ff6c2fc None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.712879 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fa78-ae75-46fb-8de9-c1f05ff6c2fc None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.713163 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fa78-ae75-46fb-8de9-c1f05ff6c2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.734181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-ecd1fa78-ae75-46fb-8de9-c1f05ff6c2fc None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:41.735400 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ecd1fa78-ae75-46fb-8de9-c1f05ff6c2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:41.795657 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4350/8722] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:41.806107 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:41.807838 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:41.865331 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a4c3-15ce-44b4-945d-be01a83eccff admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:41.869612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:41.870266 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:41.870548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:41.870843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:41.880325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:41.881768 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:41.891681 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4373/8723] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:34:46.954739 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b67df-077f-4442-b037-98ba4658e5c5 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:46.955285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b67df-077f-4442-b037-98ba4658e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:46.955285 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b67df-077f-4442-b037-98ba4658e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:46.984058 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-e10b67df-077f-4442-b037-98ba4658e5c5 None None] MFA Rules not processed for user `a599af629ce6421499d5b545acad45d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:46.985268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e10b67df-077f-4442-b037-98ba4658e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:47.022033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:47.060508 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4351/8724] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:47.065316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:47.075817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2ece5-5d06-4824-85fe-a76e333cafbf service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:47.080556 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:47.081192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:47.081478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:47.081762 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:47.082505 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:47.084445 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:47.194822 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4374/8725] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:34:47 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:34:47.199662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b67df-077f-4442-b037-98ba4658e5c5 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:47.211710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b67df-077f-4442-b037-98ba4658e5c5 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:47.272154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:47.273544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:47.274429 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:47.274708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:47.275354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:47.277304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:47.355952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4352/8726] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:34:47 2022] POST /identity/v3/users => generated 301 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:34:47.360025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:47.370997 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254812-2352-4402-829b-363c0994ed51 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:47.375528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:47.376125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:47.376403 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:47.376676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:47.377311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:47.378947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:47.391317 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4375/8727] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:34:47.395542 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:47.405659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bee64-2baf-4c9c-b9dc-b9c237e6cf04 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:47.410442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:47.411025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:47.411315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:47.411591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] PATH_INFO: `/v3/projects/f33a3b1414584cec91f71d09ba2df951/users/c0ef60227ec0422981c5dd88f8841e42/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:47.426442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33a3b1414584cec91f71d09ba2df951, user_id=c0ef60227ec0422981c5dd88f8841e42, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:47.429088 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:47.487464 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4353/8728] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:34:47 2022] PUT /identity/v3/projects/f33a3b1414584cec91f71d09ba2df951/users/c0ef60227ec0422981c5dd88f8841e42/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:47.491504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:47.503166 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c35d3-2da2-4742-b072-fcf33ba39d73 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:47.562316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116c1b9-0503-490e-b375-0cf9265c047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:47.562929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116c1b9-0503-490e-b375-0cf9265c047d admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:47.563209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116c1b9-0503-490e-b375-0cf9265c047d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:47.563497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116c1b9-0503-490e-b375-0cf9265c047d admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:47.564128 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116c1b9-0503-490e-b375-0cf9265c047d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:47.565722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116c1b9-0503-490e-b375-0cf9265c047d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:47.576249 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4376/8729] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:34:47.580394 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:47.591045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7682d-30db-4d7a-9101-86b65b80e5bf admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:47.595894 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:47.596573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:47.596850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:47.597124 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] PATH_INFO: `/v3/projects/f33a3b1414584cec91f71d09ba2df951/users/c0ef60227ec0422981c5dd88f8841e42/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:47.599087 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33a3b1414584cec91f71d09ba2df951, user_id=c0ef60227ec0422981c5dd88f8841e42, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:47.601705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:47.612373 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4354/8730] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:34:47 2022] PUT /identity/v3/projects/f33a3b1414584cec91f71d09ba2df951/users/c0ef60227ec0422981c5dd88f8841e42/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:34:53.602880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c64500-6507-48a9-bde3-bdcbd7f66c05 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:53.603390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c64500-6507-48a9-bde3-bdcbd7f66c05 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:53.603540 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c64500-6507-48a9-bde3-bdcbd7f66c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:53.638215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-34c64500-6507-48a9-bde3-bdcbd7f66c05 None None] MFA Rules not processed for user `c0ef60227ec0422981c5dd88f8841e42`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:53.639464 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34c64500-6507-48a9-bde3-bdcbd7f66c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:53.680154 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:53.713266 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4377/8731] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:53.732882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:53.732882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:53.814388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9d691-0450-4c58-a7c5-3901080350aa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:53.820036 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:53.820674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:53.820959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:53.821239 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:53.838348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:53.878869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:53.880469 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:53.889406 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4355/8732] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:34:54.028095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:54.028095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:54.028095 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:54.048508 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] MFA Rules not processed for user `a599af629ce6421499d5b545acad45d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:34:54.049449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:54.061197 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4378/8733] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:34:55.061365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:34:55.071310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:55.139639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e137f51-2123-4fa0-b3ed-40e8f0a20465 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:34:55.145588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c38ae-e668-4a1e-b3b4-488b7488d55a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:34:55.146419 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c38ae-e668-4a1e-b3b4-488b7488d55a service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:34:55.146703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c38ae-e668-4a1e-b3b4-488b7488d55a service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:34:55.146973 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c38ae-e668-4a1e-b3b4-488b7488d55a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:34:55.148946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-e15c38ae-e668-4a1e-b3b4-488b7488d55a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:34:55.167632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c38ae-e668-4a1e-b3b4-488b7488d55a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:34:55.169309 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c38ae-e668-4a1e-b3b4-488b7488d55a service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:34:55.181696 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4356/8734] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:34:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:35:04.042857 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=15 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:05.176992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=51 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:06.700833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:35:06.702273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:35:06.763462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851cf1f-7eaf-4637-9c1c-40dc072a3add None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:35:06.767384 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6c94378d347410c944afe6fe9a55584', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:35:06.767987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:35:06.768267 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:35:06.768574 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:35:06.778146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:35:06.779582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:35:06.788837 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4379/8735] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:35:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:35:16.784738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=26 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:35.724925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093cf70-4037-4858-99f0-ce0d906c24a4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:35:35.725461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093cf70-4037-4858-99f0-ce0d906c24a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:35:35.725461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093cf70-4037-4858-99f0-ce0d906c24a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:35:35.745958 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1093cf70-4037-4858-99f0-ce0d906c24a4 None None] MFA Rules not processed for user `a599af629ce6421499d5b545acad45d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:35:35.747224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1093cf70-4037-4858-99f0-ce0d906c24a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:35:35.754153 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4357/8736] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:35:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:35:45.739624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:53.203218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:35:53.204604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:35:53.220558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164c5ce-7e1b-4810-96f6-52179e5b41d5 service cinder] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:35:53.226453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:35:53.227070 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:35:53.227381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:35:53.227675 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:35:53.229463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:35:53.242201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:35:53.243790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:35:53.253641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4380/8737] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:36:03.249551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:18.317273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781dc26-ef16-4f7f-b250-5c72917aa21d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:36:18.317837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781dc26-ef16-4f7f-b250-5c72917aa21d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:36:18.317837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781dc26-ef16-4f7f-b250-5c72917aa21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:36:18.336908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1781dc26-ef16-4f7f-b250-5c72917aa21d None None] MFA Rules not processed for user `a599af629ce6421499d5b545acad45d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:36:18.338126 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1781dc26-ef16-4f7f-b250-5c72917aa21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:36:18.345526 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4358/8738] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:36:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:36:18.602411 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:36:18.603968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:36:18.660846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099e69f-6898-4a30-972b-18c7f9de93d6 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:36:18.664497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:36:18.665101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:36:18.665373 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:36:18.665676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:36:18.667363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:36:18.676739 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:36:18.678263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:36:18.685927 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4381/8739] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:36:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:36:28.331494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:28.682526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=26 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:06.969989 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781dc26-ef16-4f7f-b250-5c72917aa21d None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:07.035101 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781dc26-ef16-4f7f-b250-5c72917aa21d None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:07.039648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:07.040286 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:07.040566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:07.040839 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] PATH_INFO: `/v3/users/a599af629ce6421499d5b545acad45d0` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:07.042020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a599af629ce6421499d5b545acad45d0)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:07.043970 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:07.182445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a599af629ce6421499d5b545acad45d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.183135 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a599af629ce6421499d5b545acad45d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.242501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a599af629ce6421499d5b545acad45d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.243121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a599af629ce6421499d5b545acad45d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.250415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a599af629ce6421499d5b545acad45d0'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.268625 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4359/8740] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:37:06 2022] DELETE /identity/v3/users/a599af629ce6421499d5b545acad45d0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:37:07.486960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:07.499265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbce9c-de79-4d63-aca8-d09fded7cd76 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:07.556122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:07.556759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:07.557043 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:07.557320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] PATH_INFO: `/v3/projects/d76dfb43e63b4caa88f8c8d0cc669927` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:07.558481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76dfb43e63b4caa88f8c8d0cc669927)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:07.560430 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:07.666799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76dfb43e63b4caa88f8c8d0cc669927', 'request_id': 'req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.673821 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76dfb43e63b4caa88f8c8d0cc669927', 'request_id': 'req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.717200 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76dfb43e63b4caa88f8c8d0cc669927', 'request_id': 'req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.727988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] The token cache is being invalidate because project d76dfb43e63b4caa88f8c8d0cc669927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:37:07.729064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.729064 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.730489 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4382/8741] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:37:07 2022] DELETE /identity/v3/projects/d76dfb43e63b4caa88f8c8d0cc669927 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:37:07.735304 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:07.736773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:07.749889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccff18-a881-45f0-a386-bedd92e3fc01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:07.807353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:07.807990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:07.808279 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:07.808549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] PATH_INFO: `/v3/users/c0ef60227ec0422981c5dd88f8841e42` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:07.809686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ef60227ec0422981c5dd88f8841e42)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:07.811632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:07.833201 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:07.965745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ef60227ec0422981c5dd88f8841e42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:07.966417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ef60227ec0422981c5dd88f8841e42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.014439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ef60227ec0422981c5dd88f8841e42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.015051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ef60227ec0422981c5dd88f8841e42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.023221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-714ec653-8929-4aee-a817-8855f0cd12f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ef60227ec0422981c5dd88f8841e42'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.041410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4360/8742] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:37:07 2022] DELETE /identity/v3/users/c0ef60227ec0422981c5dd88f8841e42 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:37:08.278690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:08.280192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:08.295979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac459-b0a6-4ac8-9c3a-68bae33ba69d admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:08.354295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:08.354940 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.355225 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.355504 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] PATH_INFO: `/v3/projects/f33a3b1414584cec91f71d09ba2df951` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.356620 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33a3b1414584cec91f71d09ba2df951)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:08.358575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:08.425463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:08.437032 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33a3b1414584cec91f71d09ba2df951', 'request_id': 'req-153ea061-ff3f-4587-ba6f-4f44da153341'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.443617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33a3b1414584cec91f71d09ba2df951', 'request_id': 'req-153ea061-ff3f-4587-ba6f-4f44da153341'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.506672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33a3b1414584cec91f71d09ba2df951', 'request_id': 'req-153ea061-ff3f-4587-ba6f-4f44da153341'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.518067 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] The token cache is being invalidate because project f33a3b1414584cec91f71d09ba2df951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:37:08.518387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.519392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-153ea061-ff3f-4587-ba6f-4f44da153341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:37:08.520868 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4383/8743] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:37:08 2022] DELETE /identity/v3/projects/f33a3b1414584cec91f71d09ba2df951 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:37:08.526031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2d89-e613-40d1-bda9-09da203cd4cf None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.526287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2d89-e613-40d1-bda9-09da203cd4cf None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.526560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc2d89-e613-40d1-bda9-09da203cd4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.545979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-53cc2d89-e613-40d1-bda9-09da203cd4cf None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:08.557767 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53cc2d89-e613-40d1-bda9-09da203cd4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:08.606499 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4361/8744] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:37:08.614900 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822750-4065-49c7-89d6-dc8b846e3d09 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.615186 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822750-4065-49c7-89d6-dc8b846e3d09 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.615460 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40822750-4065-49c7-89d6-dc8b846e3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.635775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-40822750-4065-49c7-89d6-dc8b846e3d09 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:08.636988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-40822750-4065-49c7-89d6-dc8b846e3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:08.645285 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4384/8745] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:37:08.649598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2d89-e613-40d1-bda9-09da203cd4cf None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:08.659450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc2d89-e613-40d1-bda9-09da203cd4cf None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:08.663994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:08.664598 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.664880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.665159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.665813 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:37:08.666157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:08.667753 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:08.679856 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4362/8746] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:37:08.684168 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822750-4065-49c7-89d6-dc8b846e3d09 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:08.694669 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40822750-4065-49c7-89d6-dc8b846e3d09 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:08.699317 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:08.699914 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.700197 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.700473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.701098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:08.703086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:08.786743 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4385/8747] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:37:08 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:37:08.790940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:08.801583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e97e21-92ce-4ff6-b905-b8df76b72349 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:08.856612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:08.857218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.857498 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.857773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.858436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:08.860844 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:08.940312 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4363/8748] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:37:08 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:37:08.944476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:08.955030 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a8633-bf94-4627-838b-6adeb293ee97 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:08.959580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:08.960178 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.960480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.960752 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.961390 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:08.962993 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:08.973757 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4386/8749] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:37:08.977335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:08.988022 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661bd87-597a-48ad-80c5-a8e87c4b57fa admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:08.992812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9fb7d-1456-4cd5-b557-648b83ff0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:08.993412 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9fb7d-1456-4cd5-b557-648b83ff0562 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:08.993733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9fb7d-1456-4cd5-b557-648b83ff0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:08.994041 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9fb7d-1456-4cd5-b557-648b83ff0562 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:08.994714 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9fb7d-1456-4cd5-b557-648b83ff0562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:08.996296 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9fb7d-1456-4cd5-b557-648b83ff0562 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:09.007076 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4364/8750] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:37:09.011125 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:09.021282 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e928bad-75f7-4180-9329-909f86fbdc20 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:09.025927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:09.026602 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:09.026881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:09.028210 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] PATH_INFO: `/v3/projects/2df5b6291a724accb3ca9bf1baa7cf29/users/57bf494036c8499e9ef5f4452ef23f85/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:09.041967 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df5b6291a724accb3ca9bf1baa7cf29, user_id=57bf494036c8499e9ef5f4452ef23f85, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:09.044573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:09.133487 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4387/8751] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:37:09 2022] PUT /identity/v3/projects/2df5b6291a724accb3ca9bf1baa7cf29/users/57bf494036c8499e9ef5f4452ef23f85/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:37:09.138814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ec26c-55c2-48ce-936e-f3559fb20f85 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:09.139334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ec26c-55c2-48ce-936e-f3559fb20f85 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:09.139439 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ec26c-55c2-48ce-936e-f3559fb20f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:09.147952 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:09.159226 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-624ec26c-55c2-48ce-936e-f3559fb20f85 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:09.160425 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-624ec26c-55c2-48ce-936e-f3559fb20f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:09.219056 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4365/8752] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:37:09.228759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:09.230513 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:09.290819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc687bb1-3609-4063-acc8-da3f17b79ea2 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:09.294601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:09.295149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:09.295428 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:09.295702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:09.304640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:09.306084 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:09.315467 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4388/8753] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:37:14.813746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413ed8-0471-4356-bc70-24bf12973d82 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:14.814350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413ed8-0471-4356-bc70-24bf12973d82 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:14.814350 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413ed8-0471-4356-bc70-24bf12973d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:14.848581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8e413ed8-0471-4356-bc70-24bf12973d82 None None] MFA Rules not processed for user `57bf494036c8499e9ef5f4452ef23f85`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:14.850572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8e413ed8-0471-4356-bc70-24bf12973d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:14.992663 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4366/8754] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:37:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:37:14.998803 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:15.010746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41dc39-3a91-4a38-8711-0374bfbe4b79 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:15.017250 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:15.017528 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:15.017795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:15.018098 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:15.018893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:15.020779 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:15.166293 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4389/8755] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:37:14 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:37:15.170325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413ed8-0471-4356-bc70-24bf12973d82 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:15.184799 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413ed8-0471-4356-bc70-24bf12973d82 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:15.264322 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:15.264904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:15.265211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:15.266065 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:15.266740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:15.268741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:15.356890 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4367/8756] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:37:15 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 14:37:15.358714 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:15.369780 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e0fa7-58eb-439e-a98e-207e488c6cf5 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:15.375881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:15.376495 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:15.376773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:15.377040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:15.377686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:15.379357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:15.391475 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4390/8757] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:37:15.395781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:15.406653 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583fc4c-8717-450c-b737-7fed2aaffc01 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:15.411299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:15.411946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:15.412367 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:15.412548 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] PATH_INFO: `/v3/projects/57296b8d0fbe44558710b322d773a02c/users/9a94ad4bb2eb4284b044195913c31d09/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:15.428629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57296b8d0fbe44558710b322d773a02c, user_id=9a94ad4bb2eb4284b044195913c31d09, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:15.431416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:15.496464 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:15.501371 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4368/8758] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:37:15 2022] PUT /identity/v3/projects/57296b8d0fbe44558710b322d773a02c/users/9a94ad4bb2eb4284b044195913c31d09/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:37:15.505599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:15.516886 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf77fb-cb68-4726-ae47-5bdef4506ed3 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:15.542902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:15.575340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae23b-a14f-41f2-85cf-d7edf6824fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:15.575960 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae23b-a14f-41f2-85cf-d7edf6824fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:15.576244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae23b-a14f-41f2-85cf-d7edf6824fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:15.576545 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae23b-a14f-41f2-85cf-d7edf6824fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:15.577188 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae23b-a14f-41f2-85cf-d7edf6824fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:15.579414 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae23b-a14f-41f2-85cf-d7edf6824fd4 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:15.589796 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4391/8759] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:37:15.594808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:15.605420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ef579-58b8-4a8d-a3ff-1f3f5483bb0b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:15.610413 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:15.611074 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:15.611352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:15.611625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] PATH_INFO: `/v3/projects/57296b8d0fbe44558710b322d773a02c/users/9a94ad4bb2eb4284b044195913c31d09/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:15.613553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57296b8d0fbe44558710b322d773a02c, user_id=9a94ad4bb2eb4284b044195913c31d09, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:15.616336 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:15.627098 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4369/8760] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:37:15 2022] PUT /identity/v3/projects/57296b8d0fbe44558710b322d773a02c/users/9a94ad4bb2eb4284b044195913c31d09/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:37:21.114476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be77f4-2f60-43fe-806b-47d541741c2e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:21.114936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be77f4-2f60-43fe-806b-47d541741c2e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:21.115049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be77f4-2f60-43fe-806b-47d541741c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:21.145728 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-71be77f4-2f60-43fe-806b-47d541741c2e None None] MFA Rules not processed for user `9a94ad4bb2eb4284b044195913c31d09`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:21.147050 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71be77f4-2f60-43fe-806b-47d541741c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:21.220338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4392/8761] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:37:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:37:21.244878 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:21.246873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:21.328834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbb84-4aa8-4af0-bfcf-8706882b8e62 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:21.332738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:21.333358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:21.333633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:21.333904 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:21.395705 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:21.397571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:21.407072 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4370/8762] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:37:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:37:21.710662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7bcb-d374-4c50-acc9-cb4bf228f262 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:21.710898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7bcb-d374-4c50-acc9-cb4bf228f262 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:21.711180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7bcb-d374-4c50-acc9-cb4bf228f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:21.761756 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-edbc7bcb-d374-4c50-acc9-cb4bf228f262 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:21.763005 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-edbc7bcb-d374-4c50-acc9-cb4bf228f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:21.830869 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4393/8763] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:37:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:37:21.961359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:21.962820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:22.053301 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:22.055993 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d8ee-c400-449f-a015-8b1769f1558c service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:22.061477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:22.062711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:22.063020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:22.063299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:22.072249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:22.073886 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:22.087263 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4371/8764] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:37:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:37:31.826917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:32.191242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:32.194679 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77917c9-0c18-418a-b08c-773bf5a857c3 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:32.195135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77917c9-0c18-418a-b08c-773bf5a857c3 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:32.195379 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77917c9-0c18-418a-b08c-773bf5a857c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:32.215351 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f77917c9-0c18-418a-b08c-773bf5a857c3 None None] MFA Rules not processed for user `57bf494036c8499e9ef5f4452ef23f85`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:32.216575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f77917c9-0c18-418a-b08c-773bf5a857c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:32.224741 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4394/8765] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:37:32.487845 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:32.489274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:32.546984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4df9f-8d55-448d-ae9b-d6d106f40e9b service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:32.550606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:32.551211 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:32.551496 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:32.551771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:32.553606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:32.563313 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:32.564731 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:32.572718 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4372/8766] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:37:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:37:35.542290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28a910-60c6-42d8-9727-203464e94871 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:35.542801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28a910-60c6-42d8-9727-203464e94871 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:35.543056 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28a910-60c6-42d8-9727-203464e94871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:35.562905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-5f28a910-60c6-42d8-9727-203464e94871 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:37:35.564264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5f28a910-60c6-42d8-9727-203464e94871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:37:35.571572 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4395/8767] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:37:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:37:35.584461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:37:35.597482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ebcea-7239-48f2-b853-dade3d93e742 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:37:35.602618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:37:35.603223 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:37:35.603506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:37:35.603789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:37:35.612213 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:37:35.613798 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:37:35.622315 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4373/8768] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:37:45.557316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:45.618814 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=32 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:11.513076 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28a910-60c6-42d8-9727-203464e94871 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:38:11.523731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28a910-60c6-42d8-9727-203464e94871 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:38:11.527673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:38:11.528300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:38:11.528575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:38:11.528844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:38:11.530580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:38:11.617303 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:38:11.618802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:38:11.630233 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4396/8769] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:38:11.762385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:38:11.772247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e981f-64f9-48fc-ab15-b939208b80c1 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:38:11.775794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:38:11.776447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:38:11.776703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:38:11.776974 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:38:11.785962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:38:11.787396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:38:11.796818 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4374/8770] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:38:21.625023 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=39 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:21.792803 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:54.916758 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:38:54.925966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d792-9a5a-44ba-b91d-4224b34a29cd service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:38:54.929627 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:38:54.930341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:38:54.930626 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:38:54.930902 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:38:54.932601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:38:54.942880 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:38:54.944358 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:38:54.953003 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4397/8771] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:38:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:39:04.948922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:55.914148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:39:55.936849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa9a7-97cd-45df-998a-864cc96f6453 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:39:55.940534 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:39:55.941264 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:39:55.941541 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:39:55.941685 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:39:55.943456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:39:55.978586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:39:55.980010 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:39:55.992075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4375/8772] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:39:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:39:57.991195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:39:57.992727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:39:58.072204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb783-1bf2-42dd-b68e-189725290093 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:39:58.077204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:39:58.077801 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:39:58.078118 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:39:58.078393 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:39:58.080075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:39:58.091847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:39:58.093440 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:39:58.103679 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4398/8773] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:39:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:40:05.988099 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=21 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:40:08.099235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=38 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:01.203614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:01.204980 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:01.219119 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909763a1-5236-4bb0-a98e-7e7ecbf07bba service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:01.224128 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:01.224726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:01.225007 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:01.225275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:01.226921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:01.237820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:01.239420 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:01.249418 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4376/8774] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:41:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:41:11.245189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:12.501462 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:12.503103 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:12.519691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c40b8-2e03-485e-8349-c7ad9f2d00f5 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:12.527477 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071df0-bdd0-46c2-9f90-f8e73a288e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:12.527808 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071df0-bdd0-46c2-9f90-f8e73a288e71 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:12.528473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071df0-bdd0-46c2-9f90-f8e73a288e71 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:12.528473 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071df0-bdd0-46c2-9f90-f8e73a288e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:12.530469 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-68071df0-bdd0-46c2-9f90-f8e73a288e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:12.546851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68071df0-bdd0-46c2-9f90-f8e73a288e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:12.548589 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68071df0-bdd0-46c2-9f90-f8e73a288e71 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:12.562550 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4399/8775] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:41:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:41:22.555217 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:25.471017 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:25.472662 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:25.488344 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a15e6-ceb8-4097-8960-d21cef2b14f6 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:25.493859 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:25.494520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:25.494805 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:25.495082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:25.496752 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:25.508553 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:25.510148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:25.520797 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4377/8776] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:41:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:41:26.809485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59738ec0-4c4d-479a-843e-0c7b7f8e5930 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:26.809949 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59738ec0-4c4d-479a-843e-0c7b7f8e5930 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:26.810078 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59738ec0-4c4d-479a-843e-0c7b7f8e5930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:26.830198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-59738ec0-4c4d-479a-843e-0c7b7f8e5930 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:41:26.831401 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-59738ec0-4c4d-479a-843e-0c7b7f8e5930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:26.838729 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4400/8777] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:41:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:41:26.880713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:26.892436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acc814-0c77-4ffd-ae9a-25e248772ce7 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:26.897432 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:26.898077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:26.898361 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:26.898637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:26.907196 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:26.908769 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:26.916878 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4378/8778] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:41:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:41:28.065205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c76fb5-82cd-4011-9f05-dd626c4fc2b8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:28.065656 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c76fb5-82cd-4011-9f05-dd626c4fc2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:28.065757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c76fb5-82cd-4011-9f05-dd626c4fc2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:28.084807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-34c76fb5-82cd-4011-9f05-dd626c4fc2b8 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:41:28.085973 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-34c76fb5-82cd-4011-9f05-dd626c4fc2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:28.093412 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4401/8779] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:41:28.106187 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:28.117949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc43cce-c202-4142-aa3e-4e71192ce99a service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:28.123153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:28.124461 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:28.124760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:28.125091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:28.135404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:28.141673 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:28.145380 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4379/8780] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:41:38.079526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:38.141797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=18 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:38.336131 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf07e-1087-4f62-892f-e3458244308f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:38.336420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf07e-1087-4f62-892f-e3458244308f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:38.336726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf07e-1087-4f62-892f-e3458244308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:38.356096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fbbbf07e-1087-4f62-892f-e3458244308f None None] MFA Rules not processed for user `57bf494036c8499e9ef5f4452ef23f85`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:41:38.357354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fbbbf07e-1087-4f62-892f-e3458244308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:38.364919 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4402/8781] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:41:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:41:38.633198 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:38.643530 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212917a-18af-48ac-b3fa-05e4633ce501 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:38.647363 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ba8ca-a7e7-4b95-b392-31a593b28ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:38.647965 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba8ca-a7e7-4b95-b392-31a593b28ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:38.648248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba8ca-a7e7-4b95-b392-31a593b28ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:38.648521 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba8ca-a7e7-4b95-b392-31a593b28ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:38.650271 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-de8ba8ca-a7e7-4b95-b392-31a593b28ac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:38.660622 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ba8ca-a7e7-4b95-b392-31a593b28ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:38.662090 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ba8ca-a7e7-4b95-b392-31a593b28ac2 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:38.669872 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4380/8782] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:41:39.059850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf07e-1087-4f62-892f-e3458244308f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:39.072550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf07e-1087-4f62-892f-e3458244308f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:39.078346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:39.078963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:39.079243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:39.079520 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:39.081357 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:39.093726 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:39.095354 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:39.105892 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4403/8783] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:41:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:41:41.607516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e516f5d-da8c-4ef0-ab2c-807e3f0f5b6f None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:41.607994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e516f5d-da8c-4ef0-ab2c-807e3f0f5b6f None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:41.607994 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e516f5d-da8c-4ef0-ab2c-807e3f0f5b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:41.627808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7e516f5d-da8c-4ef0-ab2c-807e3f0f5b6f None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:41:41.629023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7e516f5d-da8c-4ef0-ab2c-807e3f0f5b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:41.636339 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4381/8784] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:41:41.650529 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:41.662546 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c0938-135c-478c-b6f1-2d84a861f380 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:41.668007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:41.668617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:41.668896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:41.669169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:41.677716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:41.692007 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:41.692007 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4404/8785] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:41:49.233399 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e516f5d-da8c-4ef0-ab2c-807e3f0f5b6f None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:49.243337 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e516f5d-da8c-4ef0-ab2c-807e3f0f5b6f None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:49.246862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:49.247503 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:49.248462 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:49.248778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:49.250596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:49.260765 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:49.262255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:49.270375 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4382/8786] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:41:51.684183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=15 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:58.035017 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:41:58.048984 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02506f49-720f-4b26-b026-dceefbf7cd94 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:41:58.056353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:41:58.057263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:41:58.057550 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:41:58.057830 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:41:58.059869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:41:58.073623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:41:58.075014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:41:58.086425 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4405/8787] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:41:59.266450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:08.082581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:21.162347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:42:21.192142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7c83-b628-436c-af38-dd9b840b737c service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:42:21.197944 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36a6c3-0c1c-4258-99e9-36b6eb01686e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:42:21.198585 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a6c3-0c1c-4258-99e9-36b6eb01686e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:42:21.198869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a6c3-0c1c-4258-99e9-36b6eb01686e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:42:21.199147 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a6c3-0c1c-4258-99e9-36b6eb01686e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:42:21.208533 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36a6c3-0c1c-4258-99e9-36b6eb01686e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:42:21.210459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36a6c3-0c1c-4258-99e9-36b6eb01686e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:42:21.219843 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4383/8788] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:42:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:42:31.215411 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=10 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:21.281465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:21.298764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bb563-d525-411c-b55e-1bce6b7c541f service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:21.302370 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:21.302968 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:21.305284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:21.305596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:21.316100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:21.317541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:21.328672 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4406/8789] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:43:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:43:31.323708 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:37.443392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b90fd-6422-429a-b90e-b0e341444cf9 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:37.443887 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b90fd-6422-429a-b90e-b0e341444cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:37.443992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b90fd-6422-429a-b90e-b0e341444cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:37.475106 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-2b0b90fd-6422-429a-b90e-b0e341444cf9 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:43:37.477018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-2b0b90fd-6422-429a-b90e-b0e341444cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:37.493355 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4384/8790] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:43:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:43:37.533600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:37.544892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb01504-7b74-4061-b2b1-e351b475dcaa service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:37.549861 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:37.550522 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:37.550799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:37.551071 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:37.559647 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:37.561290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:37.570498 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4407/8791] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:43:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:43:38.744376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b90fd-6422-429a-b90e-b0e341444cf9 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:38.753853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b90fd-6422-429a-b90e-b0e341444cf9 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:38.757445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:38.758045 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:38.758931 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:38.759120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:38.828297 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:38.829737 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:38.848829 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4385/8792] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:43:42.724535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:42.735907 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b8688-ed5e-41e9-bdb8-2b17820928ee service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:42.741034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:42.741637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:42.741917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:42.742241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:42.744551 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:42.774286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:42.774286 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:42.782963 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4408/8793] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:43:46.256935 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:46.268910 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce7a6a-8cd7-4479-b967-14859d8f77f6 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:46.276834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:46.277446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:46.279868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:46.279868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:46.279868 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:46.291672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:46.293355 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:46.303552 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4386/8794] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:43:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:43:46.403450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:46.415938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed1e9-ccc8-4777-bb78-3eca84266979 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:46.420737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:46.421369 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:46.421643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:46.421913 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] PATH_INFO: `/v3/users/57bf494036c8499e9ef5f4452ef23f85` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:46.423062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bf494036c8499e9ef5f4452ef23f85)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:46.424994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:46.685074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bf494036c8499e9ef5f4452ef23f85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:46.691921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bf494036c8499e9ef5f4452ef23f85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:46.692592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bf494036c8499e9ef5f4452ef23f85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:46.704927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bf494036c8499e9ef5f4452ef23f85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:46.792233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bf494036c8499e9ef5f4452ef23f85'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:46.798691 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4409/8795] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:43:46 2022] DELETE /identity/v3/users/57bf494036c8499e9ef5f4452ef23f85 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:43:47.066142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:47.077555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845092c-3ac4-4f2a-a249-53f2f7f26d88 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:47.143083 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:47.143773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:47.144054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:47.144365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] PATH_INFO: `/v3/projects/2df5b6291a724accb3ca9bf1baa7cf29` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:47.145566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df5b6291a724accb3ca9bf1baa7cf29)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:47.147523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:47.264853 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:47.271093 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df5b6291a724accb3ca9bf1baa7cf29', 'request_id': 'req-1426310a-d85f-4a21-a7aa-7020dcede46b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.277317 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df5b6291a724accb3ca9bf1baa7cf29', 'request_id': 'req-1426310a-d85f-4a21-a7aa-7020dcede46b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.402772 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df5b6291a724accb3ca9bf1baa7cf29', 'request_id': 'req-1426310a-d85f-4a21-a7aa-7020dcede46b'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.426771 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] The token cache is being invalidate because project 2df5b6291a724accb3ca9bf1baa7cf29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:43:47.427059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.427679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.429185 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4387/8796] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:43:47 2022] DELETE /identity/v3/projects/2df5b6291a724accb3ca9bf1baa7cf29 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:43:47.433741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:47.435195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:47.448691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474fc1-e361-40f3-b03c-d6f78cba305f admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:47.506189 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:47.511382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:47.511382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:47.511382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] PATH_INFO: `/v3/users/9a94ad4bb2eb4284b044195913c31d09` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:47.511382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a94ad4bb2eb4284b044195913c31d09)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:47.511382 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:47.757130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:47.765633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a94ad4bb2eb4284b044195913c31d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.772636 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a94ad4bb2eb4284b044195913c31d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.773291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a94ad4bb2eb4284b044195913c31d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.785826 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a94ad4bb2eb4284b044195913c31d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.864212 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-691f97df-0262-48c3-9330-c767a45af4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a94ad4bb2eb4284b044195913c31d09'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:47.870204 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4410/8797] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:43:47 2022] DELETE /identity/v3/users/9a94ad4bb2eb4284b044195913c31d09 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:43:48.159455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:48.160938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:48.176725 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426310a-d85f-4a21-a7aa-7020dcede46b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:48.234742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:48.235384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:48.235666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:48.235942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] PATH_INFO: `/v3/projects/57296b8d0fbe44558710b322d773a02c` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:48.237072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] RBAC: Authorizing `identity:delete_project(project_id=57296b8d0fbe44558710b322d773a02c)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:48.239047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:48.369284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57296b8d0fbe44558710b322d773a02c', 'request_id': 'req-82994323-0cfa-4e76-bd6e-33af097edeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:48.375490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57296b8d0fbe44558710b322d773a02c', 'request_id': 'req-82994323-0cfa-4e76-bd6e-33af097edeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:48.448567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57296b8d0fbe44558710b322d773a02c', 'request_id': 'req-82994323-0cfa-4e76-bd6e-33af097edeef'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:48.461669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] The token cache is being invalidate because project 57296b8d0fbe44558710b322d773a02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:43:48.461961 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:48.462640 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-82994323-0cfa-4e76-bd6e-33af097edeef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:43:48.464406 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4388/8798] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:43:48 2022] DELETE /identity/v3/projects/57296b8d0fbe44558710b322d773a02c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:43:48.469456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3249-d717-43e0-938b-3782d9fdd6b6 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:48.469916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3249-d717-43e0-938b-3782d9fdd6b6 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:48.470035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f3249-d717-43e0-938b-3782d9fdd6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:48.529292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-177f3249-d717-43e0-938b-3782d9fdd6b6 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:43:48.530541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-177f3249-d717-43e0-938b-3782d9fdd6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:48.591759 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4411/8799] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:43:48.599979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f4e3-a96b-48fb-8d63-dc4a6b2e89ed None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:48.600346 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f4e3-a96b-48fb-8d63-dc4a6b2e89ed None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:48.600690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f4e3-a96b-48fb-8d63-dc4a6b2e89ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:48.621788 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c6f6f4e3-a96b-48fb-8d63-dc4a6b2e89ed None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:43:48.623021 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c6f6f4e3-a96b-48fb-8d63-dc4a6b2e89ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:48.631015 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4389/8800] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:43:48.635372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f3249-d717-43e0-938b-3782d9fdd6b6 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:48.645706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f3249-d717-43e0-938b-3782d9fdd6b6 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:48.650389 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:48.650989 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:48.651265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:48.651534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:48.652173 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:43:48.652468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:48.654106 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:48.666338 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4412/8801] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:43:48.670773 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6f4e3-a96b-48fb-8d63-dc4a6b2e89ed None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:48.680287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6f4e3-a96b-48fb-8d63-dc4a6b2e89ed None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:48.685723 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:48.686360 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:48.686642 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:48.686915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:48.687649 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:48.689537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:48.819757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4390/8802] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:43:48 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:43:48.824219 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:48.834511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4ab50-3d6f-4967-8814-393cbd7541f6 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:48.890608 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:48.891201 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:48.891482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:48.891759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:48.892394 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:48.894599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:48.985137 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:48.990229 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4413/8803] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:43:48 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:43:49.006048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.006048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e40b6-9740-42a5-9fd4-ea1fb8e5fe4e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:49.010332 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:49.010950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.011266 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.011573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.012224 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:49.013812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:49.019632 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:49.025102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4391/8804] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:43:49.029155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.039214 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f60500-b74c-4711-aeb8-d3ce9f0d777e admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:49.044531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d0656-7945-44de-975c-dc90ceaa6620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:49.045130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0656-7945-44de-975c-dc90ceaa6620 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.045412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0656-7945-44de-975c-dc90ceaa6620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.045688 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0656-7945-44de-975c-dc90ceaa6620 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.046366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d0656-7945-44de-975c-dc90ceaa6620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:49.047966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d0656-7945-44de-975c-dc90ceaa6620 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:49.058541 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4414/8805] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:43:49.062529 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.072631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42417a0f-c286-43ec-891b-57d3a8905aad admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:49.077992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:49.078763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.079051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.079331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] PATH_INFO: `/v3/projects/381041942f024a3fb56e35c99475ff61/users/1b02196b7d35453b8a710ef6f4835dec/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.095139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=381041942f024a3fb56e35c99475ff61, user_id=1b02196b7d35453b8a710ef6f4835dec, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:49.097838 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:49.258755 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4392/8806] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:43:49 2022] PUT /identity/v3/projects/381041942f024a3fb56e35c99475ff61/users/1b02196b7d35453b8a710ef6f4835dec/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:43:49.270667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf725a-cea2-4c24-82e3-58e04e1ff47b None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.270951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf725a-cea2-4c24-82e3-58e04e1ff47b None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.271224 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf725a-cea2-4c24-82e3-58e04e1ff47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.299510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-4cbf725a-cea2-4c24-82e3-58e04e1ff47b None None] MFA Rules not processed for user `1b02196b7d35453b8a710ef6f4835dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:43:49.300724 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cbf725a-cea2-4c24-82e3-58e04e1ff47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:49.370238 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4415/8807] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:43:49.375781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.442354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1ee7b-a0c6-4a82-bec4-f5d40563c60b admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:49.448233 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:49.448870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.449154 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.449450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.450117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:49.452059 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:49.587510 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4393/8808] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:43:49 2022] POST /identity/v3/projects => generated 393 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:43:49.591461 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf725a-cea2-4c24-82e3-58e04e1ff47b None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.602251 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf725a-cea2-4c24-82e3-58e04e1ff47b None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:49.657935 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:49.658597 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.658875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.659145 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] PATH_INFO: `/v3/users` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.659765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:49.661699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:49.795689 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4416/8809] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:43:49 2022] POST /identity/v3/users => generated 303 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:43:49.799571 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.810484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc3087-9ee6-4c1e-ba18-236a1033d3a6 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:49.815182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:49.815783 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.816070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.816345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.816984 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:49.818604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:49.829819 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4394/8810] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:43:49.833946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.844163 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e8dd7-9cd2-4bf8-9517-85d0eb38efaf admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:49.848766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:49.849420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:49.849704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:49.849983 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] PATH_INFO: `/v3/projects/694c8a4b6af140579e7b79e9e390ba68/users/956a8ab7a7a44c47a8c04955856380f5/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:49.865247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=694c8a4b6af140579e7b79e9e390ba68, user_id=956a8ab7a7a44c47a8c04955856380f5, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:49.867998 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:49.967403 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4417/8811] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:43:49 2022] PUT /identity/v3/projects/694c8a4b6af140579e7b79e9e390ba68/users/956a8ab7a7a44c47a8c04955856380f5/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:43:49.971460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:49.981945 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f231d-eadd-4d07-a8cd-498fa1d599e9 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:50.039933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac8fc3-d869-4ac5-a1d4-1ed96951fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:50.041044 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8fc3-d869-4ac5-a1d4-1ed96951fb7f admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:50.041324 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8fc3-d869-4ac5-a1d4-1ed96951fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:50.041590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac8fc3-d869-4ac5-a1d4-1ed96951fb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:50.042252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac8fc3-d869-4ac5-a1d4-1ed96951fb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:50.043830 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac8fc3-d869-4ac5-a1d4-1ed96951fb7f admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:50.053435 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4395/8812] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:43:50.058531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:50.068918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7254e3-72b1-46ed-8fa9-ffe5f44a2f6c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:50.074149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:50.074841 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:50.075122 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:50.075397 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] PATH_INFO: `/v3/projects/694c8a4b6af140579e7b79e9e390ba68/users/956a8ab7a7a44c47a8c04955856380f5/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:50.077383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=694c8a4b6af140579e7b79e9e390ba68, user_id=956a8ab7a7a44c47a8c04955856380f5, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:50.080066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:50.090330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4418/8813] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:43:50 2022] PUT /identity/v3/projects/694c8a4b6af140579e7b79e9e390ba68/users/956a8ab7a7a44c47a8c04955856380f5/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 14:43:50.100433 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:50.100703 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:50.100925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:50.129596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] MFA Rules not processed for user `956a8ab7a7a44c47a8c04955856380f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:43:50.130840 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:50.164842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:50.212129 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4396/8814] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:43:50.228381 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:50.230637 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:50.264917 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:50.306215 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e0f70-e013-44b9-b8f9-f2447c1407ae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:50.311765 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05653618-9f10-409a-8847-4fbda112560b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:50.312363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653618-9f10-409a-8847-4fbda112560b service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:50.312640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653618-9f10-409a-8847-4fbda112560b service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:50.312910 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653618-9f10-409a-8847-4fbda112560b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:50.368939 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05653618-9f10-409a-8847-4fbda112560b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:50.370560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05653618-9f10-409a-8847-4fbda112560b service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:50.379569 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4419/8815] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:43:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:43:55.968755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:43:55.976695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:56.028727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638cc72-893c-4052-bd8b-79f5ac8808b4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:43:56.032668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:43:56.033254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:56.033532 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:56.033850 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:56.043422 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:43:56.044917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:43:56.055037 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4397/8816] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:43:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:43:59.707835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610d18-c8be-4eb3-bbe2-96a5db2835c8 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:43:59.708335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610d18-c8be-4eb3-bbe2-96a5db2835c8 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:43:59.708452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be610d18-c8be-4eb3-bbe2-96a5db2835c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:43:59.738191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-be610d18-c8be-4eb3-bbe2-96a5db2835c8 None None] MFA Rules not processed for user `1b02196b7d35453b8a710ef6f4835dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:43:59.739518 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-be610d18-c8be-4eb3-bbe2-96a5db2835c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:43:59.754888 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4420/8817] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:44:01.615139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:44:01.617646 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:44:01.713691 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff85abe-0ad1-44b0-939e-6801e567e9c8 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:44:01.719619 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:44:01.720248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:44:01.720537 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:44:01.720812 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:44:01.722637 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:44:01.736144 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:44:01.945609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:44:01.945609 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4398/8818] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:44:05.546672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be610d18-c8be-4eb3-bbe2-96a5db2835c8 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:44:05.559668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be610d18-c8be-4eb3-bbe2-96a5db2835c8 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:44:05.564191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:44:05.564982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:44:05.565314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:44:05.565664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:44:05.567692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:44:05.579744 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:44:05.581228 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:44:05.590191 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4421/8819] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:44:11.746707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=71 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:15.586770 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=51 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:57.001625 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:44:57.003168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:44:57.027809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f6bf1-1de2-4a48-b2f0-595554dc3c98 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:44:57.031442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fefc9-3618-4a57-bdc8-749692124125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:44:57.032544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fefc9-3618-4a57-bdc8-749692124125 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:44:57.032832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fefc9-3618-4a57-bdc8-749692124125 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:44:57.033105 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fefc9-3618-4a57-bdc8-749692124125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:44:57.034861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ba3fefc9-3618-4a57-bdc8-749692124125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:44:57.055401 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fefc9-3618-4a57-bdc8-749692124125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:44:57.056746 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fefc9-3618-4a57-bdc8-749692124125 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:44:57.067668 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4399/8820] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:44:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:45:01.020825 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:45:01.034763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbeced-35dd-4706-a249-d2d043d624da service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:45:01.040141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:45:01.041062 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:45:01.041340 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:45:01.041617 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:45:01.043668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:45:01.057221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:45:01.059039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:45:01.070179 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4422/8821] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:45:07.062891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=14 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:11.066010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:14.257320 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:45:14.257778 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:45:14.257899 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:45:14.278915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] MFA Rules not processed for user `1b02196b7d35453b8a710ef6f4835dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:45:14.280441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:45:14.288424 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4400/8822] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:45:14.644899 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:45:14.655705 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cedb6-d53d-463c-9597-7ce35c324ea6 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:45:14.660450 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:45:14.661285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:45:14.661566 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:45:14.661835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:45:14.663911 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:45:14.674478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:45:14.675922 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:45:14.687075 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4423/8823] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:45:24.273938 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:24.682265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:04.203736 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:46:04.205203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:46:04.220796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f868-dec6-44c9-ac8a-68a51ca59066 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:46:04.225955 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32235e-c82c-4c3d-87c4-bba3dcfcdce9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:46:04.226581 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32235e-c82c-4c3d-87c4-bba3dcfcdce9 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:46:04.226861 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32235e-c82c-4c3d-87c4-bba3dcfcdce9 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:46:04.227161 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32235e-c82c-4c3d-87c4-bba3dcfcdce9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:46:04.229042 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4a32235e-c82c-4c3d-87c4-bba3dcfcdce9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:46:04.241531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32235e-c82c-4c3d-87c4-bba3dcfcdce9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:46:04.243246 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32235e-c82c-4c3d-87c4-bba3dcfcdce9 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:46:04.253935 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4401/8824] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:46:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:46:14.248915 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:46:50.879700 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:46:50.895276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6d4ad-09c8-4ed2-8f56-df736ca46e58 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:46:50.901692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:46:50.902420 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:46:50.903226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:46:50.903226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:46:50.904833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:46:50.925396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:46:50.929673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:46:50.940487 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4424/8825] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:46:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:47:00.935142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:06.877238 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725d753-457e-4205-a1b9-7941e1b2ddc2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:47:06.878700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725d753-457e-4205-a1b9-7941e1b2ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:47:06.879342 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725d753-457e-4205-a1b9-7941e1b2ddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:47:06.904243 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-d725d753-457e-4205-a1b9-7941e1b2ddc2 None None] MFA Rules not processed for user `1b02196b7d35453b8a710ef6f4835dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:47:06.905577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d725d753-457e-4205-a1b9-7941e1b2ddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:47:06.917802 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4402/8826] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:47:07.290638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:47:07.301304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60678c8-7e05-48b2-9b80-a0942ab4fb9d service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:47:07.305383 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c519767-9319-4165-8ed5-f4ca69b4ba3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:47:07.306028 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519767-9319-4165-8ed5-f4ca69b4ba3c service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:47:07.306352 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519767-9319-4165-8ed5-f4ca69b4ba3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:47:07.306658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519767-9319-4165-8ed5-f4ca69b4ba3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:47:07.308500 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4c519767-9319-4165-8ed5-f4ca69b4ba3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:47:07.318483 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c519767-9319-4165-8ed5-f4ca69b4ba3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:47:07.319921 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c519767-9319-4165-8ed5-f4ca69b4ba3c service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:47:07.328549 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4425/8827] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:47:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:47:16.896441 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:17.324447 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:21.880511 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725d753-457e-4205-a1b9-7941e1b2ddc2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:47:21.893802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725d753-457e-4205-a1b9-7941e1b2ddc2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:47:21.899544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:47:21.900146 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:47:21.900428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:47:21.900702 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:47:21.902470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:47:21.915182 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:47:21.916820 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:47:21.928390 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4403/8828] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:47:31.924274 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:02.222849 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90625b7-9801-4ea0-a562-a3a55c5ae036 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:02.223478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90625b7-9801-4ea0-a562-a3a55c5ae036 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:02.223478 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90625b7-9801-4ea0-a562-a3a55c5ae036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:02.274110 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-f90625b7-9801-4ea0-a562-a3a55c5ae036 None None] MFA Rules not processed for user `7d7fa3a95a66463c94e757c58ccec244`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:48:02.275941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f90625b7-9801-4ea0-a562-a3a55c5ae036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:48:02.284850 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4426/8829] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:48:02.295202 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:48:02.304605 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f9314-bf1e-4f76-9a08-f8fe0df09022 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:48:02.308244 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:48:02.308837 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:02.309117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:02.309390 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:02.316424 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:48:02.317842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:48:02.326109 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4404/8830] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:48:02.453581 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b387d2-5ad6-434c-bd6d-d9c6b80f78ef None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:02.453868 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b387d2-5ad6-434c-bd6d-d9c6b80f78ef None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:02.454179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b387d2-5ad6-434c-bd6d-d9c6b80f78ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:02.492121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d0b387d2-5ad6-434c-bd6d-d9c6b80f78ef None None] MFA Rules not processed for user `211feea67b824d5b8f77e491cc96a022`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:48:02.493311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d0b387d2-5ad6-434c-bd6d-d9c6b80f78ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:48:02.501906 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4427/8831] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:48:02.513933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:48:02.526865 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c944836-6054-42b8-bf0a-a8b2fbac1d18 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:48:02.532038 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:48:02.532668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:02.532946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:02.533218 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:02.541742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:48:02.543314 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:48:02.553048 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4405/8832] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:48:02.859938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8babc-c0ea-4ef0-a0fc-87e6cc9cc10d None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:02.860328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8babc-c0ea-4ef0-a0fc-87e6cc9cc10d None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:02.860737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8babc-c0ea-4ef0-a0fc-87e6cc9cc10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:02.902534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-49c8babc-c0ea-4ef0-a0fc-87e6cc9cc10d None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:48:02.903732 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-49c8babc-c0ea-4ef0-a0fc-87e6cc9cc10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:48:02.912962 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4428/8833] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 14:48:02.924164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:48:02.937005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fdf0e-cd86-47ab-91db-24f8773b51f4 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:48:02.941003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:48:02.941638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:02.941941 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:02.942277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:02.953573 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:48:02.955030 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:48:02.966208 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4406/8834] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:48:03.029764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8babc-c0ea-4ef0-a0fc-87e6cc9cc10d None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:48:03.041480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8babc-c0ea-4ef0-a0fc-87e6cc9cc10d None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:48:03.046552 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:48:03.047158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:03.047459 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:03.047718 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:03.049434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:48:03.061493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:48:03.063120 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:48:03.073287 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4429/8835] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:48:12.961120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=18 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:13.068824 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=37 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:23.333652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:48:23.342572 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19f5fa-9e9b-4732-b797-73df66a44735 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:48:23.346428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:48:23.347023 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:23.347331 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:23.347604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:23.349872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:48:23.376263 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:48:23.377684 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:48:23.388852 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4407/8836] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:48:23.745419 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:48:23.754806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4357e-1fc2-4097-b378-1a1348988250 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:48:23.758448 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:48:23.759490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:23.759490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:23.759749 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:23.761304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:48:23.771334 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:48:23.772847 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:48:23.780628 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4430/8837] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:48:33.383871 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=11 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:33.777232 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:53.488743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:48:53.500513 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b88cb2-5e89-427a-8c5b-b79eaa6fe11f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:48:53.505950 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:48:53.506583 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:48:53.506863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:48:53.507138 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:48:53.514733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:48:53.516292 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:48:53.525335 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4408/8838] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:49:00.879931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:49:00.893611 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefec3a0-03dc-45e9-bd53-486a4e697e8d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:49:00.900926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:49:00.900926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:49:00.900926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:49:00.900926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:49:00.903138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:49:00.916468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:49:00.918549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:49:00.936181 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4431/8839] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:49:03.521365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:07.868522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:49:07.880520 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e606-8ef4-42a3-8e54-b5804fe4362f service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:49:07.885652 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dacc77-92d4-4422-8c8a-7afe2dee6158 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:49:07.886299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dacc77-92d4-4422-8c8a-7afe2dee6158 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:49:07.886784 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dacc77-92d4-4422-8c8a-7afe2dee6158 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:49:07.887062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dacc77-92d4-4422-8c8a-7afe2dee6158 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:49:07.889347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d8dacc77-92d4-4422-8c8a-7afe2dee6158 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:49:07.901452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dacc77-92d4-4422-8c8a-7afe2dee6158 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:49:07.903120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dacc77-92d4-4422-8c8a-7afe2dee6158 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:49:07.913154 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4409/8840] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:49:10.929343 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:13.403192 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:49:13.412901 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ce80c-2b82-48b5-992b-2c5faf685a5c service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:49:13.416633 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:49:13.417329 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:49:13.418220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:49:13.418573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:49:13.427734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:49:13.429237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:49:13.439512 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4432/8841] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:49:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:49:16.866614 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350348-53c9-438b-9012-ccd86c159821 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:49:16.867455 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350348-53c9-438b-9012-ccd86c159821 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:49:16.867917 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3350348-53c9-438b-9012-ccd86c159821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:49:16.889237 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-a3350348-53c9-438b-9012-ccd86c159821 None None] MFA Rules not processed for user `1b02196b7d35453b8a710ef6f4835dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:49:16.890596 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a3350348-53c9-438b-9012-ccd86c159821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:49:16.902697 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4410/8842] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:49:17.762946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:49:17.796723 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2a6c1-f38d-4d02-a66d-0749a8c1deec service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:49:17.812002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:49:17.812734 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:49:17.813288 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:49:17.813802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:49:17.829955 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:49:17.831795 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:49:17.848757 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4433/8843] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:49:20.839680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350348-53c9-438b-9012-ccd86c159821 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:49:20.850168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3350348-53c9-438b-9012-ccd86c159821 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:49:20.853890 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:49:20.854540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:49:20.855460 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:49:20.855962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:49:20.864385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:49:20.865875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:49:20.874144 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4411/8844] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:49:27.840203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:49:30.870568 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:03.962592 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:50:04.005652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf066c4-3e41-495b-a8a4-10d787dfe815 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:50:04.011314 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:50:04.011908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:50:04.012196 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:50:04.012457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:50:04.020695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:50:04.022289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:50:04.032472 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4434/8845] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:50:05.583781 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:50:05.604832 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc499-aebd-4430-9d46-56ccde55bf92 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:50:05.608592 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c47abd-9972-4083-bec2-7acf9f885882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:50:05.609185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c47abd-9972-4083-bec2-7acf9f885882 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:50:05.609466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c47abd-9972-4083-bec2-7acf9f885882 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:50:05.609740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c47abd-9972-4083-bec2-7acf9f885882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:50:05.621069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c47abd-9972-4083-bec2-7acf9f885882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:50:05.622584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c47abd-9972-4083-bec2-7acf9f885882 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:50:05.633785 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4412/8846] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:50:14.028291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=21 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:15.628842 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=12 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:59.102003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:50:59.115731 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec3252-6f1f-46ee-bbfa-f339ac05e55d service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:50:59.121449 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:50:59.123011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:50:59.123662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:50:59.124096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:50:59.126623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:50:59.142278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:50:59.144204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:50:59.162281 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4435/8847] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:51:08.006018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a34ed3-aa0c-4c2b-82e0-709345329895 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:51:08.008430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a34ed3-aa0c-4c2b-82e0-709345329895 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:51:08.008430 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a34ed3-aa0c-4c2b-82e0-709345329895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:51:08.029977 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-83a34ed3-aa0c-4c2b-82e0-709345329895 None None] MFA Rules not processed for user `1b02196b7d35453b8a710ef6f4835dec`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:51:08.031656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-83a34ed3-aa0c-4c2b-82e0-709345329895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:51:08.039102 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4413/8848] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:51:08.403238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:51:08.414817 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e2054-5009-47df-9683-a3ddedd04f1d service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:51:08.419301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:51:08.420147 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:51:08.420496 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:51:08.420843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:51:08.430135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:51:08.433035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:51:08.446380 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4436/8849] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:51:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:51:09.156940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a34ed3-aa0c-4c2b-82e0-709345329895 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:51:09.169672 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a34ed3-aa0c-4c2b-82e0-709345329895 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:51:09.174802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:51:09.175443 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:51:09.175821 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:51:09.176052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:51:09.186817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:51:09.188193 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:51:09.198828 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4414/8850] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:51:18.437761 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:51:19.194205 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=9 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:04.350187 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:04.351685 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:04.369463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdaf74-75b0-43d6-86a6-eef941523ab2 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:04.378020 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e4aee-9b8e-4a79-856c-6a7bcd746d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:04.378701 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e4aee-9b8e-4a79-856c-6a7bcd746d49 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:04.379421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e4aee-9b8e-4a79-856c-6a7bcd746d49 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:04.379421 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e4aee-9b8e-4a79-856c-6a7bcd746d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:04.389180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e4aee-9b8e-4a79-856c-6a7bcd746d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:04.390875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e4aee-9b8e-4a79-856c-6a7bcd746d49 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:04.402698 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4437/8851] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:52:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:52:13.615057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:13.674666 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c5ef-00e4-4c08-97cd-0879f0aa64c7 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:13.679377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:13.680006 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:13.680283 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:13.680556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] PATH_INFO: `/v3/users/1b02196b7d35453b8a710ef6f4835dec` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:13.681670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b02196b7d35453b8a710ef6f4835dec)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:13.683659 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:13.949528 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b02196b7d35453b8a710ef6f4835dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:13.950253 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b02196b7d35453b8a710ef6f4835dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.006152 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b02196b7d35453b8a710ef6f4835dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.006774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b02196b7d35453b8a710ef6f4835dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.015191 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b02196b7d35453b8a710ef6f4835dec'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.034191 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4415/8852] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:52:13 2022] DELETE /identity/v3/users/1b02196b7d35453b8a710ef6f4835dec => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:52:14.039049 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:14.039542 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:14.039678 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:14.058497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:52:14.059696 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:14.122023 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4438/8853] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:52:14.132584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:14.134015 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:14.191488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b73b2-1e80-40b5-964f-24b517c8b09d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:14.195645 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:14.196252 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:14.196536 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:14.196809 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:14.205979 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:14.207376 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:14.217370 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4416/8854] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:52:14.505061 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:14.506676 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:14.520468 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578352-95da-4fa0-88f9-1e94298ffd0e None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:14.525247 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:14.526100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:14.526375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:14.526938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] PATH_INFO: `/v3/projects/381041942f024a3fb56e35c99475ff61` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:14.528205 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] RBAC: Authorizing `identity:delete_project(project_id=381041942f024a3fb56e35c99475ff61)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:14.530284 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:14.645252 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381041942f024a3fb56e35c99475ff61', 'request_id': 'req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.652853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381041942f024a3fb56e35c99475ff61', 'request_id': 'req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.719598 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381041942f024a3fb56e35c99475ff61', 'request_id': 'req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.730646 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] The token cache is being invalidate because project 381041942f024a3fb56e35c99475ff61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:52:14.730937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.731595 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.733054 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4439/8855] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:52:14 2022] DELETE /identity/v3/projects/381041942f024a3fb56e35c99475ff61 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:52:14.737294 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:14.747732 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596ab0-d466-45ab-83ee-d9c21df32a34 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:14.766219 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:14.805884 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:14.806545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:14.806825 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:14.807096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] PATH_INFO: `/v3/users/956a8ab7a7a44c47a8c04955856380f5` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:14.808235 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956a8ab7a7a44c47a8c04955856380f5)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:14.810181 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:14.996841 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956a8ab7a7a44c47a8c04955856380f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:14.997507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956a8ab7a7a44c47a8c04955856380f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.062518 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956a8ab7a7a44c47a8c04955856380f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.063150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956a8ab7a7a44c47a8c04955856380f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.070728 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-955d6a32-ba21-4c3c-b3f4-2ef9b69ccfb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956a8ab7a7a44c47a8c04955856380f5'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.089255 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4417/8856] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 14:52:14 2022] DELETE /identity/v3/users/956a8ab7a7a44c47a8c04955856380f5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:52:15.498773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:15.500229 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:15.521580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c75e-8b64-4f50-bb9e-dfc7065ad4da admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:15.585994 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:15.586577 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:15.586855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:15.587124 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] PATH_INFO: `/v3/projects/694c8a4b6af140579e7b79e9e390ba68` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:15.588241 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694c8a4b6af140579e7b79e9e390ba68)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:15.590179 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:15.608772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:15.709778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694c8a4b6af140579e7b79e9e390ba68', 'request_id': 'req-565d1863-5b3b-4d18-87d3-cfe4f4228757'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.716686 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694c8a4b6af140579e7b79e9e390ba68', 'request_id': 'req-565d1863-5b3b-4d18-87d3-cfe4f4228757'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.805531 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694c8a4b6af140579e7b79e9e390ba68', 'request_id': 'req-565d1863-5b3b-4d18-87d3-cfe4f4228757'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.816425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] The token cache is being invalidate because project 694c8a4b6af140579e7b79e9e390ba68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 14:52:15.816715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.817963 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-565d1863-5b3b-4d18-87d3-cfe4f4228757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 14:52:15.819486 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4440/8857] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 14:52:15 2022] DELETE /identity/v3/projects/694c8a4b6af140579e7b79e9e390ba68 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:52:15.824901 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633461-2853-48f5-95bf-35e194d10b58 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:15.825378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633461-2853-48f5-95bf-35e194d10b58 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:15.825508 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a633461-2853-48f5-95bf-35e194d10b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:15.845302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8a633461-2853-48f5-95bf-35e194d10b58 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:52:15.846470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8a633461-2853-48f5-95bf-35e194d10b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:15.906390 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4418/8858] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:52:15.916150 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81924fc-928d-4851-8bd4-075cb480fc7c None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:15.916446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81924fc-928d-4851-8bd4-075cb480fc7c None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:15.916722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81924fc-928d-4851-8bd4-075cb480fc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:15.937463 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b81924fc-928d-4851-8bd4-075cb480fc7c None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:52:15.938715 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b81924fc-928d-4851-8bd4-075cb480fc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:15.947413 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4441/8859] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:52:15.951744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a633461-2853-48f5-95bf-35e194d10b58 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:15.961450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a633461-2853-48f5-95bf-35e194d10b58 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:15.966115 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:15.966721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:15.967003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:15.967280 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:15.967929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 14:52:15.968234 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:15.969823 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:15.981671 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4419/8860] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 14:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 14:52:15.985981 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81924fc-928d-4851-8bd4-075cb480fc7c None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:15.995800 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81924fc-928d-4851-8bd4-075cb480fc7c None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:16.000773 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:16.001372 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:16.001651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:16.001926 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:16.002588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:16.005198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:16.104228 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4442/8861] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:52:15 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:52:16.108545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:16.119157 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2754e-af9d-4c91-96a3-d50808a49f43 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:16.145449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:16.177452 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:16.178076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:16.178352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:16.178624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:16.179242 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:16.181139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:16.246410 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4420/8862] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:52:16 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:52:16.250612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:16.261257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c201b2-62be-4d3f-954c-07882453eaeb admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:16.266019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:16.266652 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:16.266938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:16.267218 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:16.267881 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:16.269487 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:16.280139 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4443/8863] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:52:16.286990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:16.299066 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d531d-9109-4560-9c76-51504b63348c admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:16.304454 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11f58d-ca71-43c9-8f09-623f1eca4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:16.308052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11f58d-ca71-43c9-8f09-623f1eca4fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:16.308052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11f58d-ca71-43c9-8f09-623f1eca4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:16.308052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11f58d-ca71-43c9-8f09-623f1eca4fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:16.308052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11f58d-ca71-43c9-8f09-623f1eca4fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:16.308052 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11f58d-ca71-43c9-8f09-623f1eca4fc3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:16.318722 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4421/8864] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:52:16.322690 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:16.333156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fae8de-ceb6-454d-932d-b90ed1870f57 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:16.342604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:16.342604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:16.342604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:16.342604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] PATH_INFO: `/v3/projects/163bbf1c864a47e08e6060545462a3a9/users/199f47687c2c44b0a97d4bf529bc9957/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:16.354221 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163bbf1c864a47e08e6060545462a3a9, user_id=199f47687c2c44b0a97d4bf529bc9957, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:16.357058 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:16.429322 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4444/8865] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:52:16 2022] PUT /identity/v3/projects/163bbf1c864a47e08e6060545462a3a9/users/199f47687c2c44b0a97d4bf529bc9957/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:52:16.434472 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c2e5-9525-4e01-af0a-fc2ba2d5dfef None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:16.434759 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c2e5-9525-4e01-af0a-fc2ba2d5dfef None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:16.435035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494c2e5-9525-4e01-af0a-fc2ba2d5dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:16.455103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b494c2e5-9525-4e01-af0a-fc2ba2d5dfef None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:52:16.456020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b494c2e5-9525-4e01-af0a-fc2ba2d5dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:16.514809 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4422/8866] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:52:16.525258 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:16.527279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:16.584514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e26fd2-4a90-4ece-a8cc-5882e67362c0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:16.588184 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:16.588787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:16.589065 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:16.589338 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:16.598977 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:16.600405 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:16.609862 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4445/8867] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:52:21.828033 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb36e4-e4b7-4d0d-bfc4-980d13b50cee None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:21.828574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb36e4-e4b7-4d0d-bfc4-980d13b50cee None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:21.828574 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb36e4-e4b7-4d0d-bfc4-980d13b50cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:21.866255 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-c8eb36e4-e4b7-4d0d-bfc4-980d13b50cee None None] MFA Rules not processed for user `199f47687c2c44b0a97d4bf529bc9957`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:52:21.868005 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-c8eb36e4-e4b7-4d0d-bfc4-980d13b50cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:21.946223 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4423/8868] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:52:21.947557 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:21.958167 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3c954-58f9-496b-978f-159bbca0ee19 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:21.963100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:21.963982 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:21.964263 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:21.964535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:21.965230 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:21.967400 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:22.059209 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4446/8869] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 14:52:21 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:52:22.063434 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb36e4-e4b7-4d0d-bfc4-980d13b50cee None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:22.075591 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb36e4-e4b7-4d0d-bfc4-980d13b50cee None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:22.111339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:22.135402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:22.136076 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:22.136354 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:22.136629 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:22.137268 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:22.139284 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:22.250515 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4424/8870] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 14:52:22 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 14:52:22.254634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:22.265471 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f44d7d-74f3-4359-9d18-d30e02e40256 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:22.278896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:22.278896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:22.278896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:22.278896 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:22.279295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:22.279295 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:22.284718 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4447/8871] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 14:52:22.288990 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:22.299241 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976893dc-524e-44b2-91e4-60256629575a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:22.303954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:22.304604 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:22.304888 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:22.305164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] PATH_INFO: `/v3/projects/9686a1db604245c694cd75a4acfb5fdb/users/d0ad9add49ed4657bc7c002e5e80267f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:22.320347 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9686a1db604245c694cd75a4acfb5fdb, user_id=d0ad9add49ed4657bc7c002e5e80267f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:22.323048 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:22.394472 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4425/8872] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:52:22 2022] PUT /identity/v3/projects/9686a1db604245c694cd75a4acfb5fdb/users/d0ad9add49ed4657bc7c002e5e80267f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:52:22.399140 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:22.409501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d6932-8c73-4aa6-bdb2-cba34e0f1e31 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:22.413203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:22.468454 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d843e50-e2bb-4bc0-815c-b77793c58cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:22.469075 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843e50-e2bb-4bc0-815c-b77793c58cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:22.469490 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843e50-e2bb-4bc0-815c-b77793c58cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:22.469777 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843e50-e2bb-4bc0-815c-b77793c58cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:22.470453 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d843e50-e2bb-4bc0-815c-b77793c58cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:22.472041 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d843e50-e2bb-4bc0-815c-b77793c58cb1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:22.482599 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4448/8873] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 14:52:22.487019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:22.498442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ce86f-b144-4be4-8f4d-3ac575ca0f25 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:22.503248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:22.503908 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:22.504190 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:22.504466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] PATH_INFO: `/v3/projects/9686a1db604245c694cd75a4acfb5fdb/users/d0ad9add49ed4657bc7c002e5e80267f/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:22.507051 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9686a1db604245c694cd75a4acfb5fdb, user_id=d0ad9add49ed4657bc7c002e5e80267f, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:22.509740 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:22.519923 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4426/8874] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 14:52:22 2022] PUT /identity/v3/projects/9686a1db604245c694cd75a4acfb5fdb/users/d0ad9add49ed4657bc7c002e5e80267f/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 14:52:28.089402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b457c-da5c-452d-8d22-5278ecc512fb None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:28.089919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b457c-da5c-452d-8d22-5278ecc512fb None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:28.090045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b457c-da5c-452d-8d22-5278ecc512fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:28.132823 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-c41b457c-da5c-452d-8d22-5278ecc512fb None None] MFA Rules not processed for user `d0ad9add49ed4657bc7c002e5e80267f`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:52:28.134191 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-c41b457c-da5c-452d-8d22-5278ecc512fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:28.212580 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4449/8875] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:52:28.229683 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:28.231875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:28.327127 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4c9c2-aa2b-44b2-9289-7bab69de3e43 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:28.333148 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:28.333776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:28.334086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:28.334514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:28.395721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:28.397359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:28.407328 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4427/8876] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:52:30.820301 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d9659-db5e-4455-a029-f70ee894ca51 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:30.820846 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d9659-db5e-4455-a029-f70ee894ca51 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:30.820951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d9659-db5e-4455-a029-f70ee894ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:30.842169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-d69d9659-db5e-4455-a029-f70ee894ca51 None None] MFA Rules not processed for user `199f47687c2c44b0a97d4bf529bc9957`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:52:30.843399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-d69d9659-db5e-4455-a029-f70ee894ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:30.850853 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4450/8877] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:52:31.192208 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:31.215763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:31.268679 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44424cb-65f0-4e68-9258-2119217a776c service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:31.272487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:31.273098 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:31.273379 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:31.273650 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:31.275527 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:31.286742 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:31.288192 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:31.296753 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4428/8878] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:52:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:52:40.835346 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=63 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:41.292873 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=18 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:43.615045 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d9659-db5e-4455-a029-f70ee894ca51 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:43.628814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d9659-db5e-4455-a029-f70ee894ca51 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:43.635037 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:43.635691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:43.635988 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:43.636285 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:43.638537 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:52:43.651640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:43.653658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:43.665393 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4451/8879] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:52:45.967371 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:52:45.976668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b19a8-ec3a-4c6a-b24a-5d092de07842 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:52:45.980315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea7755-2451-4af3-a159-4d88ff10bd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:52:45.980912 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea7755-2451-4af3-a159-4d88ff10bd4c service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:52:45.981194 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea7755-2451-4af3-a159-4d88ff10bd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:52:45.981467 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea7755-2451-4af3-a159-4d88ff10bd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:52:45.990315 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea7755-2451-4af3-a159-4d88ff10bd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:52:45.992335 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea7755-2451-4af3-a159-4d88ff10bd4c service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:52:46.001650 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4429/8880] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:52:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:52:53.660101 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:55.997560 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:46.187180 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:54:46.188558 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:54:46.291182 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad788e8-98ae-4bf7-bbfb-69ecd99c1ed1 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:54:46.294987 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:54:46.299810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:54:46.299810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:54:46.299810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:54:46.299810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:54:46.312591 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:54:46.314008 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:54:46.324841 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4452/8881] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:54:56.320001 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=46 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:59.798540 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:54:59.799077 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:54:59.799216 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:54:59.852229 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:54:59.853448 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:54:59.930270 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4430/8882] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:54:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:55:00.080335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:00.081797 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:00.183548 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78563bba-21b9-4898-bd53-b64855621ce8 service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:00.189875 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:00.190642 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:00.190810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:00.191096 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:00.200035 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:00.202409 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:00.213842 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4453/8883] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:55:06.790155 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:06.791633 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:06.819450 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb04b4d-7d71-4b9a-98d2-3e0f9ea92def None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:06.823559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:06.824466 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:06.825011 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:06.825290 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:06.827648 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:06.842706 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:06.844153 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:06.856931 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4431/8884] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:55:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:55:08.903869 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:08.915264 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d0c3-6615-43b2-9a8e-1b9b56382265 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:08.919363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094a778-06cb-427c-9227-dc7ec0dd09d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:08.920105 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a778-06cb-427c-9227-dc7ec0dd09d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:08.920456 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a778-06cb-427c-9227-dc7ec0dd09d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:08.920806 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094a778-06cb-427c-9227-dc7ec0dd09d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:08.922736 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0094a778-06cb-427c-9227-dc7ec0dd09d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:08.934003 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094a778-06cb-427c-9227-dc7ec0dd09d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:08.935767 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094a778-06cb-427c-9227-dc7ec0dd09d4 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:08.945871 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4454/8885] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:55:10.029505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:10.031078 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:10.122222 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7c06-3a5f-4d2d-b497-f153bf9b61ae service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:10.127946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:10.128566 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:10.128968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:10.129247 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:10.131686 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:10.144862 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:10.146488 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:10.157133 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4432/8886] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:55:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:55:15.875378 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b932e2-736a-4be5-a501-3cdee0098540 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:15.875995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b932e2-736a-4be5-a501-3cdee0098540 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:15.875995 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b932e2-736a-4be5-a501-3cdee0098540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:15.907936 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-79b932e2-736a-4be5-a501-3cdee0098540 None None] MFA Rules not processed for user `793ee1b363f8415f817fe5a8c3c200fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:55:15.909149 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-79b932e2-736a-4be5-a501-3cdee0098540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:15.918902 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4455/8887] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Oct 18 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:55:15.930624 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:15.941168 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deffb0-1136-4c9c-8e7c-367de7b220ba service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:15.945567 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:15.946468 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:15.946751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:15.947028 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:15.962267 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:15.963707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:15.975252 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4433/8888] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:55:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:55:16.171802 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b932e2-736a-4be5-a501-3cdee0098540 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:16.182226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b932e2-736a-4be5-a501-3cdee0098540 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:16.186239 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:16.186860 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:16.187141 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:16.187416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:16.189310 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:16.199116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:16.200596 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:16.209446 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4456/8889] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:55:16.283214 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:16.292902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e6ab-542a-42c4-9cb9-d581bd4d16c8 service glance] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:16.297118 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819cbc5-1c87-48fd-b01f-ccd3000d3bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:16.297718 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819cbc5-1c87-48fd-b01f-ccd3000d3bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:16.298001 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819cbc5-1c87-48fd-b01f-ccd3000d3bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:16.298310 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819cbc5-1c87-48fd-b01f-ccd3000d3bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:16.300035 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9819cbc5-1c87-48fd-b01f-ccd3000d3bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:16.309926 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=100 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:16.314062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819cbc5-1c87-48fd-b01f-ccd3000d3bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:16.315577 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819cbc5-1c87-48fd-b01f-ccd3000d3bb3 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:16.326673 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4434/8890] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 14:55:16.395328 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:16.407890 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7efaee-28fb-46eb-82aa-869c6ef02f6a service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:16.412835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:16.413427 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:16.413704 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:16.413971 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:16.415672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:16.427903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:16.429769 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:16.440610 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4457/8891] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:55:18.954549 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4660e-d2ad-46f3-a1f3-1dbfe90845ba None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:18.955064 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4660e-d2ad-46f3-a1f3-1dbfe90845ba None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:18.955177 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4660e-d2ad-46f3-a1f3-1dbfe90845ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:18.977302 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-7cd4660e-d2ad-46f3-a1f3-1dbfe90845ba None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:55:18.978545 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7cd4660e-d2ad-46f3-a1f3-1dbfe90845ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:18.986532 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4435/8892] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:55:18.998741 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:19.010349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8cbd-f8fb-48b7-82df-f086ac327cd0 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:19.016308 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:19.022570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:19.022570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:19.022570 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:19.026870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:19.028943 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:19.042076 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4458/8893] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:55:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:55:28.970663 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:29.034474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=72 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:33.593962 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb65a-2eff-457c-ae96-61f28dbc9970 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:33.594490 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb65a-2eff-457c-ae96-61f28dbc9970 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:33.594601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adb65a-2eff-457c-ae96-61f28dbc9970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:33.616627 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-13adb65a-2eff-457c-ae96-61f28dbc9970 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:55:33.617847 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-13adb65a-2eff-457c-ae96-61f28dbc9970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:55:33.625187 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4436/8894] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 14:55:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:55:33.638623 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:55:33.649778 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bedf4-28bc-4316-a0eb-bbd85a2c8b63 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:55:33.655142 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:55:33.656368 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:55:33.656644 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:55:33.656919 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:55:33.665320 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:55:33.666941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:55:33.675761 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4459/8895] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 14:55:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 14:55:43.610777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:43.671855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:56:13.134700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adb65a-2eff-457c-ae96-61f28dbc9970 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:56:13.148197 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adb65a-2eff-457c-ae96-61f28dbc9970 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:56:13.153774 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ebd17-ea51-4396-b1e0-837bc7e06d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:56:13.154634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ebd17-ea51-4396-b1e0-837bc7e06d1c service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:56:13.154756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ebd17-ea51-4396-b1e0-837bc7e06d1c service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:56:13.154954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ebd17-ea51-4396-b1e0-837bc7e06d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:56:13.156745 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-fe2ebd17-ea51-4396-b1e0-837bc7e06d1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:56:13.168595 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ebd17-ea51-4396-b1e0-837bc7e06d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:56:13.170339 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ebd17-ea51-4396-b1e0-837bc7e06d1c service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:56:13.180682 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4437/8896] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:56:23.176402 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:56:49.457322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:56:49.459025 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:56:49.480425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7d3a9-d1f5-42e0-afc0-be76a71f20aa service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:56:49.486402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:56:49.487015 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:56:49.487293 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:56:49.487606 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:56:49.489579 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:56:49.502209 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:56:49.503789 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:56:49.515315 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4460/8897] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:56:56.496741 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597051e6-5689-4ff5-984a-6a1c960d2206 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:56:56.503440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597051e6-5689-4ff5-984a-6a1c960d2206 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:56:56.503440 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597051e6-5689-4ff5-984a-6a1c960d2206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:56:56.516656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-597051e6-5689-4ff5-984a-6a1c960d2206 None None] MFA Rules not processed for user `199f47687c2c44b0a97d4bf529bc9957`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 14:56:56.517846 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-597051e6-5689-4ff5-984a-6a1c960d2206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:56:56.525492 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4438/8898] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 14:56:59.510204 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:06.511891 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:17.747181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:57:17.757507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0dac1-7c0b-4bd9-9ddc-cbb538478902 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:57:17.761355 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:57:17.761951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:57:17.762259 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:57:17.762532 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:57:17.764246 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:57:17.774019 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:57:17.775534 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:57:17.783511 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4461/8899] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:57:18.520895 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597051e6-5689-4ff5-984a-6a1c960d2206 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:57:18.533417 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597051e6-5689-4ff5-984a-6a1c960d2206 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:57:18.539293 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:57:18.541405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:57:18.541405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:57:18.541405 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:57:18.542463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:57:18.555992 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:57:18.557586 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:57:18.568793 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4439/8900] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:57:22.363482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:57:22.380039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcc88a-7e55-43cf-b7be-10667efa35e3 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:57:22.386751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:57:22.387547 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:57:22.388034 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:57:22.388485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:57:22.390335 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 14:57:22.404524 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:57:22.406203 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:57:22.419124 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4462/8901] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:57:28.563713 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:28.988248 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 14:57:29.001150 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef8c63-9739-483c-8f11-a9710bff52a3 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 14:57:29.006601 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 14:57:29.007228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 14:57:29.007514 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 14:57:29.007789 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 14:57:29.015523 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 14:57:29.017136 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 14:57:29.025898 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4440/8902] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 14:57:32.413114 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=12 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:39.021942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:07.937549 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:07.959465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1f938-f4c4-4f26-847c-4af73fd18770 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:07.964560 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:07.965235 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:07.966290 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:07.966631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:07.999516 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:08.000954 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:08.012330 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4463/8903] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:00:09.204695 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:09.216831 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b909949-74dc-456b-9159-7f4142836f2e service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:09.220519 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:09.221107 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:09.221384 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:09.221654 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:09.231561 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:09.232963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:09.243667 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4441/8904] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:11.942195 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:11.951146 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7957a12-7b36-4176-a765-721a24ff491d service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:11.954798 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:11.955398 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:11.955680 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:11.955957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:11.963074 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:11.964501 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:11.972705 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4464/8905] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:15.022630 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:15.043802 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c5f3d-f561-4fcd-be73-f8962442a86d service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:15.048797 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:15.049392 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:15.049670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:15.049942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:15.058273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:15.060451 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:15.070089 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4442/8906] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:21.969143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=27 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:23.639665 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:23.652651 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202ccd-0f1e-42eb-ab09-0437d624eb86 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:23.658402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:23.659010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:23.659294 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:23.659572 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:23.668306 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:23.669884 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:23.680509 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4465/8907] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:23.976708 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:23.987751 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142995d-6a08-436e-85e1-09e8166a8198 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:23.991334 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:23.991928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:23.992210 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:23.992483 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:24.000836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:24.002492 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:24.010901 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4443/8908] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:25.121273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:25.131304 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f1ecf-99b2-4ded-8545-bd6f767caca1 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:25.135156 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:25.135757 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:25.136033 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:25.136903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:25.147208 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:25.148721 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:25.160641 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4466/8909] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:25.225000 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:25.226570 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:00:25.242137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b52f-7e90-4c87-8e86-d5a0f9e65196 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:25.247942 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:25.248588 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:25.248906 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:25.249178 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:25.258406 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:25.259969 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:25.270075 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4444/8910] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:34.910851 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:00:34.920123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768443be-fb00-4b46-9048-e3aef4b3479e service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:00:34.923737 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:00:34.924332 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:00:34.924612 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:00:34.924888 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:00:34.926640 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:00:34.936510 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:00:34.937957 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:00:34.945772 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4467/8911] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:00:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:00:35.266003 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=30 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:00:44.942396 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=18 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:01:15.119707 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:01:15.131516 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4576-0d03-4f96-b4bd-f19588e428c9 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:01:15.136785 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:01:15.137398 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:01:15.137711 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:01:15.138032 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:01:15.146385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:01:15.148018 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:01:15.158464 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4445/8912] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:01:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:01:25.153817 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:27.121870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:27.137790 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be185a-5d19-416c-82af-d11bbdc67cc6 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:27.144576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:27.144576 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:27.144867 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:27.145117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:27.155333 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:27.156916 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:27.168740 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4468/8913] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:02:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:02:29.261403 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:29.270940 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7294e6-fa96-4750-9a2c-b82fd58f8669 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:29.275069 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:29.275668 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:29.275954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:29.276231 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:29.278025 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:29.359254 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:29.360699 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:29.379024 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4446/8914] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:02:35.775938 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:35.837915 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478079a-27e9-4f9d-b456-ed9a2a254903 service nova] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:35.841543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:35.842198 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:35.842480 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:35.842844 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:35.844631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:35.934722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:35.936183 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:35.955932 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4469/8915] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:02:39.376526 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=41 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:39.729117 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:39.742609 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f142d-945d-44f3-851c-6621dcc3e27f service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:39.747603 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:39.748215 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:39.748500 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:39.748776 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:39.750544 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:39.769428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:39.771072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:39.781962 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4447/8916] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:02:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:02:43.535766 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:43.547365 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a833b-b539-4699-abd9-5cb9f9dc0aeb service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:43.552476 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:43.553086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:43.553625 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:43.553903 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:43.556226 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:43.567996 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:43.569609 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:43.580525 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4470/8917] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:02:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:02:43.681209 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:43.682900 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:43.697590 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a9b41-5e1d-4102-956a-280f0969b811 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:43.702449 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:43.703110 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:43.703415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:43.703689 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] PATH_INFO: `/v3/users/199f47687c2c44b0a97d4bf529bc9957` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:43.704808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199f47687c2c44b0a97d4bf529bc9957)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:43.706816 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:43.917071 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199f47687c2c44b0a97d4bf529bc9957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:43.917749 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199f47687c2c44b0a97d4bf529bc9957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.004968 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199f47687c2c44b0a97d4bf529bc9957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.005618 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199f47687c2c44b0a97d4bf529bc9957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.013137 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199f47687c2c44b0a97d4bf529bc9957'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.031379 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4448/8918] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 15:02:43 2022] DELETE /identity/v3/users/199f47687c2c44b0a97d4bf529bc9957 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:02:44.276138 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:44.287787 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d844-7ab5-40c1-ad89-6b6077863646 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:44.340722 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:44.347607 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:44.348244 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:44.348527 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:44.348805 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] PATH_INFO: `/v3/projects/163bbf1c864a47e08e6060545462a3a9` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:44.349927 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] RBAC: Authorizing `identity:delete_project(project_id=163bbf1c864a47e08e6060545462a3a9)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:44.352582 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:44.481278 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163bbf1c864a47e08e6060545462a3a9', 'request_id': 'req-77c1dfc1-d344-4440-bcf3-19d05939714c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.487613 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163bbf1c864a47e08e6060545462a3a9', 'request_id': 'req-77c1dfc1-d344-4440-bcf3-19d05939714c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.576631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163bbf1c864a47e08e6060545462a3a9', 'request_id': 'req-77c1dfc1-d344-4440-bcf3-19d05939714c'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.588457 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] The token cache is being invalidate because project 163bbf1c864a47e08e6060545462a3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 15:02:44.588753 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.589387 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.590922 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4471/8919] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 15:02:44 2022] DELETE /identity/v3/projects/163bbf1c864a47e08e6060545462a3a9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:02:44.595061 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:44.596456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:44.609535 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac06196-347a-4ce1-b4a8-7bbcf522bd93 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:44.666808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:44.667445 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:44.667726 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:44.668002 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] PATH_INFO: `/v3/users/d0ad9add49ed4657bc7c002e5e80267f` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:44.681438 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ad9add49ed4657bc7c002e5e80267f)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:44.683512 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:44.864353 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ad9add49ed4657bc7c002e5e80267f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.865019 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ad9add49ed4657bc7c002e5e80267f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.868062 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:44.947875 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ad9add49ed4657bc7c002e5e80267f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.948507 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ad9add49ed4657bc7c002e5e80267f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.955763 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-b4981aa1-5531-4af8-97a5-3efeaf65f23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ad9add49ed4657bc7c002e5e80267f'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:44.973952 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4449/8920] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 15:02:44 2022] DELETE /identity/v3/users/d0ad9add49ed4657bc7c002e5e80267f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:02:45.223658 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:45.225097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:45.240695 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1dfc1-d344-4440-bcf3-19d05939714c admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:45.301311 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:45.301951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:45.302265 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:45.302541 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] PATH_INFO: `/v3/projects/9686a1db604245c694cd75a4acfb5fdb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:45.313465 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9686a1db604245c694cd75a4acfb5fdb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:45.315435 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:45.411599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9686a1db604245c694cd75a4acfb5fdb', 'request_id': 'req-5801c7d7-f65b-4741-8def-253236f4d765'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:45.418937 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9686a1db604245c694cd75a4acfb5fdb', 'request_id': 'req-5801c7d7-f65b-4741-8def-253236f4d765'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:45.468312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9686a1db604245c694cd75a4acfb5fdb', 'request_id': 'req-5801c7d7-f65b-4741-8def-253236f4d765'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:45.480006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] The token cache is being invalidate because project 9686a1db604245c694cd75a4acfb5fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 15:02:45.480292 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:45.480931 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-5801c7d7-f65b-4741-8def-253236f4d765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:02:45.482473 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4472/8921] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 15:02:45 2022] DELETE /identity/v3/projects/9686a1db604245c694cd75a4acfb5fdb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:02:45.487582 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa856c6-8499-4cd1-b0e8-dd47d6b142ae None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:45.487870 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa856c6-8499-4cd1-b0e8-dd47d6b142ae None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:45.488141 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa856c6-8499-4cd1-b0e8-dd47d6b142ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:45.536872 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4aa856c6-8499-4cd1-b0e8-dd47d6b142ae None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:02:45.538103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4aa856c6-8499-4cd1-b0e8-dd47d6b142ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:45.596243 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4450/8922] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 15:02:45.604837 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f83d7-4e79-4c38-8535-846f33d82e55 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:45.605367 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f83d7-4e79-4c38-8535-846f33d82e55 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:45.605493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f83d7-4e79-4c38-8535-846f33d82e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:45.619526 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:45.625833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-fb1f83d7-4e79-4c38-8535-846f33d82e55 None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:02:45.627121 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-fb1f83d7-4e79-4c38-8535-846f33d82e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:45.635111 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4473/8923] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:02:45.639465 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa856c6-8499-4cd1-b0e8-dd47d6b142ae None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:45.651016 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa856c6-8499-4cd1-b0e8-dd47d6b142ae None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:45.655959 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:45.656599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:45.656880 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:45.657158 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] PATH_INFO: `/v3/domains` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:45.657808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82161) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:02:45.658145 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:45.659743 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:45.672170 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4451/8924] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Oct 18 15:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:02:45.676485 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f83d7-4e79-4c38-8535-846f33d82e55 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:45.686416 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f83d7-4e79-4c38-8535-846f33d82e55 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:45.691092 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:45.693347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:45.693347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:45.693347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:45.693347 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:45.694784 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:45.818317 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4474/8925] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 15:02:45 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:02:45.822288 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:45.832584 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea71c1b-fd82-4e3e-a197-40fbbf66ee3a admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:45.889261 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:45.889863 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:45.890179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:45.890482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:45.891170 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:45.893104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:45.970604 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4452/8926] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 15:02:45 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:02:45.974692 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:45.985155 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6378bf-212b-4b23-a1de-a470029d0ff7 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:45.989850 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:45.990493 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:45.990781 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:45.991059 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:45.991703 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:45.993307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:46.003363 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4475/8927] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 15:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:02:46.007801 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:46.017755 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09284ad4-4c7b-4f08-a58d-bb66347585d1 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:46.022446 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab3055-e180-4188-aaa6-92745729410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:46.023086 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab3055-e180-4188-aaa6-92745729410e admin admin] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:46.023365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab3055-e180-4188-aaa6-92745729410e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:46.023638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab3055-e180-4188-aaa6-92745729410e admin admin] PATH_INFO: `/v3/roles` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:46.024273 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab3055-e180-4188-aaa6-92745729410e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:46.026697 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab3055-e180-4188-aaa6-92745729410e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:46.037513 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4453/8928] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 15:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:02:46.041507 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:46.051309 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4848a1-cd2a-4602-8df3-884fbb0c52e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:46.055898 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:46.056535 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] REQUEST_METHOD: `PUT` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:46.056814 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:46.057087 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] PATH_INFO: `/v3/projects/a10902613e0b4f14afc5a1792bec8efd/users/7283c557c7bd45fab6b08b3dc3bbc9eb/roles/a2471da680c44d5ea10d4af71215fd3d` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:46.072036 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10902613e0b4f14afc5a1792bec8efd, user_id=7283c557c7bd45fab6b08b3dc3bbc9eb, role_id=a2471da680c44d5ea10d4af71215fd3d)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:46.074667 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:46.148729 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4476/8929] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 15:02:46 2022] PUT /identity/v3/projects/a10902613e0b4f14afc5a1792bec8efd/users/7283c557c7bd45fab6b08b3dc3bbc9eb/roles/a2471da680c44d5ea10d4af71215fd3d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 15:02:46.153782 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270c5c5-79d2-42d5-b8db-2a6b24bed13d None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:46.154092 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270c5c5-79d2-42d5-b8db-2a6b24bed13d None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:46.154375 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270c5c5-79d2-42d5-b8db-2a6b24bed13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:46.173690 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-4270c5c5-79d2-42d5-b8db-2a6b24bed13d None None] MFA Rules not processed for user `046cf75832784d19837da245ab0a0009`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:02:46.175103 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4270c5c5-79d2-42d5-b8db-2a6b24bed13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:46.180351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:46.233757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4454/8930] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:02:46.243426 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:46.245117 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:46.305086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d656889-a793-4993-bc0f-b3857352cfae admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:46.309024 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:46.309645 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:46.309918 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:46.310231 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:46.319661 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:46.321746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:46.331207 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4477/8931] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:02:51.583559 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c712ba-4077-46b8-b26f-f5d83f614130 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:51.584164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c712ba-4077-46b8-b26f-f5d83f614130 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:51.584164 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c712ba-4077-46b8-b26f-f5d83f614130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:51.618849 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-b1c712ba-4077-46b8-b26f-f5d83f614130 None None] MFA Rules not processed for user `7283c557c7bd45fab6b08b3dc3bbc9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:02:51.620185 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-b1c712ba-4077-46b8-b26f-f5d83f614130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:51.699855 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4455/8932] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:02:51.707979 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:51.715158 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510de13-7f60-4dae-8919-97650ff706cf service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:51.719992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:51.720610 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:51.720894 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:51.721171 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:51.721819 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:51.723785 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:51.824204 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4478/8933] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Oct 18 15:02:51 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:02:51.828447 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c712ba-4077-46b8-b26f-f5d83f614130 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:51.842966 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c712ba-4077-46b8-b26f-f5d83f614130 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:51.908808 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:51.912081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:51.912081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:51.912081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] PATH_INFO: `/v3/users` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:51.912081 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:51.913149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:52.006757 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4456/8934] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Oct 18 15:02:51 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:02:52.011289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:52.022238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f442e-2e37-40a3-a017-216e870cd0e1 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:52.027672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:52.028307 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:52.028599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:52.028885 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:52.029687 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:52.031702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:52.044705 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4479/8935] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:02:52.049167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:52.062506 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270768af-85e4-40a2-8056-e5fb6d729578 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:52.067489 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:52.075100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:52.075100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:52.075100 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] PATH_INFO: `/v3/projects/5a6975b0a67a4667bf6cb790e5e40a37/users/3ef3eb7b69e84973934d17bf00983beb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:52.086345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6975b0a67a4667bf6cb790e5e40a37, user_id=3ef3eb7b69e84973934d17bf00983beb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:52.089080 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:52.158577 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4457/8936] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 15:02:52 2022] PUT /identity/v3/projects/5a6975b0a67a4667bf6cb790e5e40a37/users/3ef3eb7b69e84973934d17bf00983beb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:02:52.160063 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:52.171638 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45c3a7-3e31-4df6-9b11-aadaf9cefcd8 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:52.230497 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24161cc-fad3-44e4-9d78-0acd3e05edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:52.231116 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24161cc-fad3-44e4-9d78-0acd3e05edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:52.231402 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24161cc-fad3-44e4-9d78-0acd3e05edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:52.231677 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24161cc-fad3-44e4-9d78-0acd3e05edf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:52.232325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24161cc-fad3-44e4-9d78-0acd3e05edf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:52.233920 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24161cc-fad3-44e4-9d78-0acd3e05edf8 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:52.239965 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:52.248364 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4480/8937] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Oct 18 15:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:02:52.249060 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:52.260395 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557774-db82-415b-945d-a2a1440de3d3 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:52.265351 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:52.266133 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] REQUEST_METHOD: `PUT` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:52.266481 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:52.266893 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] PATH_INFO: `/v3/projects/5a6975b0a67a4667bf6cb790e5e40a37/users/3ef3eb7b69e84973934d17bf00983beb/roles/6896c84ae1cb498793bc04c2699d3e70` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:52.268907 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6975b0a67a4667bf6cb790e5e40a37, user_id=3ef3eb7b69e84973934d17bf00983beb, role_id=6896c84ae1cb498793bc04c2699d3e70)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:52.271710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:52.274852 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:02:52.284707 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4458/8938] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Oct 18 15:02:52 2022] PUT /identity/v3/projects/5a6975b0a67a4667bf6cb790e5e40a37/users/3ef3eb7b69e84973934d17bf00983beb/roles/6896c84ae1cb498793bc04c2699d3e70 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 15:02:57.588474 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0152f-4f25-464c-acbe-4086933d5513 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:57.589002 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0152f-4f25-464c-acbe-4086933d5513 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:57.589086 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0152f-4f25-464c-acbe-4086933d5513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:57.619068 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-bfc0152f-4f25-464c-acbe-4086933d5513 None None] MFA Rules not processed for user `3ef3eb7b69e84973934d17bf00983beb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:02:57.620446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-bfc0152f-4f25-464c-acbe-4086933d5513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:57.699382 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4481/8939] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:02:57.709067 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:02:57.710928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:02:57.816167 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b449f-3918-4945-a195-a490d4e5884e admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:02:57.822735 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:02:57.823385 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:02:57.823680 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:02:57.823960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:02:57.886156 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:02:57.887777 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:02:57.897403 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4459/8940] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:03:00.772834 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:03:00.773312 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:03:00.773392 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:03:00.793257 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] MFA Rules not processed for user `7283c557c7bd45fab6b08b3dc3bbc9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:03:00.794514 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:03:00.801712 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4482/8941] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 15:03:01.111594 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:03:01.113054 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:03:01.169612 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292ee0-c8ba-4cbc-b328-ed21f1022fdb service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:03:01.173272 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:03:01.173869 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:03:01.174179 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:03:01.174456 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:03:01.176159 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:03:01.185920 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:03:01.187365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:03:01.195204 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4460/8942] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:03:01.604764 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:03:01.606412 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:03:01.689941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcb9d8-e91f-4773-a3cb-a3559c459245 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:03:01.695810 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:03:01.696564 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:03:01.697181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:03:01.697489 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:03:01.699291 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:03:01.712506 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:03:01.714133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:03:01.724850 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4483/8943] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:03:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:03:11.191744 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:INSERT=1,keystone:SELECT=93 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:03:11.720057 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=69 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:03:14.870359 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:03:14.881165 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e555-338d-4839-a4ff-1897057f6807 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:03:14.885470 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:03:14.886096 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:03:14.886388 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:03:14.886665 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:03:14.895656 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:03:14.897070 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:03:14.907092 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4461/8944] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:03:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:03:24.902501 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:14.568691 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:14.570100 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:14.675006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc0de-07ad-4cb4-a8ad-1fe9d2c34826 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:14.678746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '562e50f34bb54c68b428d077efeaca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:14.679353 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:14.679630 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:14.679905 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:14.681631 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:14.702892 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:14.704341 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:14.715508 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4484/8945] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:14.846180 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:14.861738 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fd1af-fdd7-4fcb-9f85-18f08afd9448 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:14.865378 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f80371-7740-42e4-a40f-a0af28db7885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:14.866365 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80371-7740-42e4-a40f-a0af28db7885 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:14.866669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80371-7740-42e4-a40f-a0af28db7885 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:14.866949 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80371-7740-42e4-a40f-a0af28db7885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:14.868670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-53f80371-7740-42e4-a40f-a0af28db7885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:14.893700 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80371-7740-42e4-a40f-a0af28db7885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:14.895221 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80371-7740-42e4-a40f-a0af28db7885 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:14.903480 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4462/8946] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:18.939539 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:18.951853 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a74e-0f49-47e1-b52b-196a3cfaae6f service glance] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:18.963634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:18.963634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:18.963634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:18.963634 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:18.964040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:18.989807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:18.992843 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:19.005073 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4485/8947] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:19.181602 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a2cc-9f63-4d55-abc2-826e4001b754 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:19.182104 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a2cc-9f63-4d55-abc2-826e4001b754 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:19.182203 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a2cc-9f63-4d55-abc2-826e4001b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:19.243819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-9a99a2cc-9f63-4d55-abc2-826e4001b754 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:05:19.245047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-9a99a2cc-9f63-4d55-abc2-826e4001b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:19.314359 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4463/8948] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 15:05:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:05:19.501543 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:19.503097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:19.591746 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c77b7-0aef-44f2-adf6-c1c6ef16f7c4 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:19.597399 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:19.598010 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:19.598322 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:19.598601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:19.606947 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:19.608533 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:19.612011 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=100 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:19.616956 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4486/8949] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 15:05:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 15:05:29.311494 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=58 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:29.641330 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:30.674236 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3d61-f5d3-4c6f-a4fd-bc7a510425e2 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:30.674748 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3d61-f5d3-4c6f-a4fd-bc7a510425e2 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:30.674851 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3d61-f5d3-4c6f-a4fd-bc7a510425e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:30.694587 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-85dd3d61-f5d3-4c6f-a4fd-bc7a510425e2 None None] MFA Rules not processed for user `7283c557c7bd45fab6b08b3dc3bbc9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:05:30.695733 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-85dd3d61-f5d3-4c6f-a4fd-bc7a510425e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:30.703088 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4464/8950] 10.222.0.27 () {58 vars in 958 bytes} [Tue Oct 18 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:05:31.023097 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:31.033181 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411178-12d4-4764-b8c3-800cc3a17555 service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:31.036775 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:31.037380 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:31.038375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:31.038706 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:31.041038 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:31.050796 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:31.052220 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:31.059997 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4487/8951] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:31.510925 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3d61-f5d3-4c6f-a4fd-bc7a510425e2 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:31.517669 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3d61-f5d3-4c6f-a4fd-bc7a510425e2 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:31.521377 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:31.521929 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:31.522278 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:31.522556 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:31.524368 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:31.537727 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:31.539189 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:31.550490 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4465/8952] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:32.493946 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:32.495482 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:32.510662 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b320e4-ea81-446f-8efc-df2d4db8d26b service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:32.516279 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b747ce-278a-414c-8581-39e419a8232b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:32.516870 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b747ce-278a-414c-8581-39e419a8232b service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:32.517153 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b747ce-278a-414c-8581-39e419a8232b service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:32.517425 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b747ce-278a-414c-8581-39e419a8232b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:32.519135 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b1b747ce-278a-414c-8581-39e419a8232b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:32.530349 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b747ce-278a-414c-8581-39e419a8232b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:32.532159 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b747ce-278a-414c-8581-39e419a8232b service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:32.542326 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4488/8953] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:35.009287 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:35.011139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:35.025122 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7852-aee2-4401-b0bd-cc3fa0e76f34 service neutron] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:35.031997 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:35.035484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:35.035484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:35.035484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:35.035484 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:35.048358 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:35.049932 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:35.060647 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4466/8954] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:38.004583 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3501e-de18-4b15-8e74-6987e531783f None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:38.005836 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3501e-de18-4b15-8e74-6987e531783f None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:38.010237 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3501e-de18-4b15-8e74-6987e531783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:38.026855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-b2e3501e-de18-4b15-8e74-6987e531783f None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:05:38.028123 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-b2e3501e-de18-4b15-8e74-6987e531783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:38.036362 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4489/8955] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:05:38.049459 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:38.061436 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1846-ed4c-453e-a4b6-694f4738a018 service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:38.066638 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:38.067345 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:38.067710 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:38.067902 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:38.076348 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:38.078933 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:38.086599 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4467/8956] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 15:05:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 15:05:47.319055 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3501e-de18-4b15-8e74-6987e531783f None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:47.329807 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3501e-de18-4b15-8e74-6987e531783f None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:47.333743 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:47.334385 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:47.334664 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:47.334929 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:47.336772 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:47.346599 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:47.348066 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:47.356028 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4490/8957] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:05:48.083072 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=21 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:57.352511 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=21 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:05:58.159228 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:05:58.172930 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afa02d-3219-49ad-8a10-12a01453ca86 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:05:58.178396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58235818-ea7b-4ea0-8b67-3031d828e4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:05:58.178999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58235818-ea7b-4ea0-8b67-3031d828e4b5 service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:05:58.179277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58235818-ea7b-4ea0-8b67-3031d828e4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:05:58.179547 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58235818-ea7b-4ea0-8b67-3031d828e4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:05:58.181487 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-58235818-ea7b-4ea0-8b67-3031d828e4b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:05:58.194415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58235818-ea7b-4ea0-8b67-3031d828e4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:05:58.195986 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58235818-ea7b-4ea0-8b67-3031d828e4b5 service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:05:58.206796 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4468/8958] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:05:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:06:08.202270 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=6 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:06:22.144702 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:06:22.157026 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9922dcb-58c8-40bb-892c-1a8de13ed130 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:06:22.162006 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:06:22.162668 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:06:22.162966 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:06:22.163238 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:06:22.164970 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:06:22.176240 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:06:22.177829 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:06:22.190043 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4491/8959] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:06:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:06:32.183585 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:29.736091 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d6e0a-21c6-4f18-9398-e4abaac0ac19 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:29.738531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d6e0a-21c6-4f18-9398-e4abaac0ac19 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:29.738531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d6e0a-21c6-4f18-9398-e4abaac0ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:29.757020 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-8d1d6e0a-21c6-4f18-9398-e4abaac0ac19 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:07:29.758249 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-8d1d6e0a-21c6-4f18-9398-e4abaac0ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:07:29.765335 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4469/8960] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Oct 18 15:07:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:07:29.806879 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:07:29.818289 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447671c-6171-4777-b167-a60f2138e33d service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:07:29.823375 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:07:29.830727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:29.830727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:29.830727 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:29.833272 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:07:29.834906 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:07:29.842976 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4492/8961] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 15:07:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 15:07:39.751914 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=3 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:39.839641 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=6 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:40.381810 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4b2c-b076-4ea2-b5c1-d667b1e285a4 None None] REQUEST_METHOD: `POST` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:40.382131 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4b2c-b076-4ea2-b5c1-d667b1e285a4 None None] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:40.382416 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4b2c-b076-4ea2-b5c1-d667b1e285a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:40.401889 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.auth.core [None req-1c4c4b2c-b076-4ea2-b5c1-d667b1e285a4 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82161) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:07:40.403139 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1c4c4b2c-b076-4ea2-b5c1-d667b1e285a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:07:40.411254 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4470/8962] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 15:07:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:07:40.423276 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:07:40.433862 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed622c-aa49-4e50-9332-ff205486a42b service swift] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:07:40.439143 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8610e-deed-4975-829b-139ff0e989dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:07:40.439754 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8610e-deed-4975-829b-139ff0e989dd service swift] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:40.440039 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8610e-deed-4975-829b-139ff0e989dd service swift] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:40.440316 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8610e-deed-4975-829b-139ff0e989dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:40.448588 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8610e-deed-4975-829b-139ff0e989dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:07:40.450249 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8610e-deed-4975-829b-139ff0e989dd service swift] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:07:40.459094 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4493/8963] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 15:07:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 15:07:45.040960 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c4b2c-b076-4ea2-b5c1-d667b1e285a4 None None] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:07:45.054121 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c4b2c-b076-4ea2-b5c1-d667b1e285a4 None None] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:07:45.059522 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '793ee1b363f8415f817fe5a8c3c200fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:07:45.060120 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:45.060415 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:45.060670 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:45.062410 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:07:45.074750 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:07:45.076299 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:07:45.086627 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4471/8964] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:07:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:07:46.326941 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d82e73-d34b-4d24-9f14-991c50c84f27 None None] REQUEST_METHOD: `POST` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:46.334759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d82e73-d34b-4d24-9f14-991c50c84f27 None None] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:46.334759 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d82e73-d34b-4d24-9f14-991c50c84f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:46.347683 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.auth.core [None req-56d82e73-d34b-4d24-9f14-991c50c84f27 None None] MFA Rules not processed for user `386db40d108b4e93996394790debbfef`. Rule list: `[]` (Enabled: `True`). {{(pid=82160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:07:46.348887 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-56d82e73-d34b-4d24-9f14-991c50c84f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:07:46.356078 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4494/8965] 10.222.0.27 () {58 vars in 967 bytes} [Tue Oct 18 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:07:46.368289 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:07:46.379647 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164357-2194-4721-a6f3-48a7ec86734b service nova] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:07:46.384599 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025cbd75396f4aa09e2fc5c6c77be077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:07:46.385195 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:46.385505 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:46.385780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:46.394428 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:07:46.395999 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:07:46.403990 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4472/8966] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Oct 18 15:07:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 15:07:52.932130 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d82e73-d34b-4d24-9f14-991c50c84f27 None None] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:07:52.941876 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d82e73-d34b-4d24-9f14-991c50c84f27 None None] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:07:52.945446 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d7fa3a95a66463c94e757c58ccec244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:07:52.946040 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:52.946366 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:52.946673 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:53.008133 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:07:53.009573 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:07:53.019617 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4495/8967] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:07:56.400794 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=15 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:07:56.606485 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:07:56.618639 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c3c86-ab27-4344-a383-ed1981f62b78 service swift] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:07:56.623715 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:07:56.624325 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:07:56.624606 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:07:56.624882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:07:56.627149 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:07:56.638780 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:07:56.640352 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:07:56.652070 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4473/8968] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:07:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:08:00.219273 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:08:00.230363 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042f5f5-453e-4a65-affd-9bb2ad2ebb55 service neutron] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:08:00.235561 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:08:00.236893 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:08:00.237176 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:08:00.237452 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] PATH_INFO: `/v3/users/7283c557c7bd45fab6b08b3dc3bbc9eb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:08:00.238672 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7283c557c7bd45fab6b08b3dc3bbc9eb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:08:00.240604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:08:00.611605 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7283c557c7bd45fab6b08b3dc3bbc9eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:00.619451 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7283c557c7bd45fab6b08b3dc3bbc9eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:00.620233 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7283c557c7bd45fab6b08b3dc3bbc9eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:00.633481 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7283c557c7bd45fab6b08b3dc3bbc9eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:00.708951 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7283c557c7bd45fab6b08b3dc3bbc9eb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:00.715352 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4496/8969] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 15:08:00 2022] DELETE /identity/v3/users/7283c557c7bd45fab6b08b3dc3bbc9eb => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:08:01.003634 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:08:01.014815 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e3bfa-311e-41cb-8760-a1f010652692 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:08:01.073834 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:08:01.074495 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:08:01.074775 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:08:01.075046 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] PATH_INFO: `/v3/projects/a10902613e0b4f14afc5a1792bec8efd` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:08:01.076169 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10902613e0b4f14afc5a1792bec8efd)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:08:01.078047 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:08:01.173963 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10902613e0b4f14afc5a1792bec8efd', 'request_id': 'req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.180463 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10902613e0b4f14afc5a1792bec8efd', 'request_id': 'req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.253040 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10902613e0b4f14afc5a1792bec8efd', 'request_id': 'req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.263442 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] The token cache is being invalidate because project a10902613e0b4f14afc5a1792bec8efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 15:08:01.264057 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.264374 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.265950 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4474/8970] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 15:08:01 2022] DELETE /identity/v3/projects/a10902613e0b4f14afc5a1792bec8efd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:08:01.270170 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:08:01.271600 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:08:01.284908 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d334-3645-4e4b-94a4-cf26c007f4a0 admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:08:01.328855 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:08:01.341361 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:08:01.342016 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:08:01.342327 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:08:01.342601 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] PATH_INFO: `/v3/users/3ef3eb7b69e84973934d17bf00983beb` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:08:01.343751 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef3eb7b69e84973934d17bf00983beb)` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:08:01.345719 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:08:01.454299 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef3eb7b69e84973934d17bf00983beb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.461835 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef3eb7b69e84973934d17bf00983beb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.462643 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef3eb7b69e84973934d17bf00983beb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.475699 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef3eb7b69e84973934d17bf00983beb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.527085 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.notifications [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef3eb7b69e84973934d17bf00983beb'} {{(pid=82160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:01.533472 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4497/8971] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Oct 18 15:08:01 2022] DELETE /identity/v3/users/3ef3eb7b69e84973934d17bf00983beb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:08:01.917721 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:08:01.921389 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:08:01.934275 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f08ec-f8c2-48c4-97b0-684c24e2eb31 admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:08:02.002471 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046cf75832784d19837da245ab0a0009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5197f824fa2b4aa1886cdd12c796a5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:08:02.003114 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:08:02.003396 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:08:02.003674 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] PATH_INFO: `/v3/projects/5a6975b0a67a4667bf6cb790e5e40a37` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:08:02.004796 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6975b0a67a4667bf6cb790e5e40a37)` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:08:02.006756 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:08:02.028404 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:08:02.104921 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6975b0a67a4667bf6cb790e5e40a37', 'request_id': 'req-1438080c-b256-4959-846c-4970bcf1af0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:02.111031 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6975b0a67a4667bf6cb790e5e40a37', 'request_id': 'req-1438080c-b256-4959-846c-4970bcf1af0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:02.178356 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6975b0a67a4667bf6cb790e5e40a37', 'request_id': 'req-1438080c-b256-4959-846c-4970bcf1af0d'} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:02.189094 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] The token cache is being invalidate because project 5a6975b0a67a4667bf6cb790e5e40a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82161) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 15:08:02.189946 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:02.190631 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.notifications [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82161) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:08:02.192175 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4475/8972] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Oct 18 15:08:01 2022] DELETE /identity/v3/projects/5a6975b0a67a4667bf6cb790e5e40a37 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:08:11.529604 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:08:12.185953 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:10:23.941364 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:10:23.942833 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:10:24.042300 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c531b-5ca4-4a74-b388-72cc32cb043a admin admin] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:10:24.100404 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:10:24.101014 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:10:24.101298 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:10:24.101575 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:10:24.103325 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.fernet_utils [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:10:24.114666 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:10:24.116243 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:10:24.126580 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4498/8973] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:10:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:10:34.121852 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=73 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:11:26.134037 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:11:26.135477 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:11:26.173819 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438080c-b256-4959-846c-4970bcf1af0d admin admin] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:11:26.178954 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:11:26.179555 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:11:26.179836 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:11:26.180111 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:11:26.182082 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.fernet_utils [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82161) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:11:26.194719 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:11:26.196277 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:11:26.206733 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4476/8974] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:11:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:11:36.201928 n-d-858383-13 devstack@keystone.service[82161]: DEBUG dbcounter [-] [82161] Writing DB stats keystone:SELECT=17 {{(pid=82161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:15:26.965763 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] Authenticating user token {{(pid=82160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:15:26.985580 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e78a1-12a2-4b08-a740-6ba5f15a86c7 service placement] Validating token access rules against request {{(pid=82160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:15:26.990799 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6d86-3c15-409f-9069-e8854583c206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:15:26.991434 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6d86-3c15-409f-9069-e8854583c206 service placement] REQUEST_METHOD: `GET` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:15:26.991716 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6d86-3c15-409f-9069-e8854583c206 service placement] SCRIPT_NAME: `/identity` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:15:26.991992 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6d86-3c15-409f-9069-e8854583c206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:15:27.000553 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6d86-3c15-409f-9069-e8854583c206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:15:27.002169 n-d-858383-13 devstack@keystone.service[82160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6d86-3c15-409f-9069-e8854583c206 service placement] RBAC: Authorization granted {{(pid=82160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:15:27.011938 n-d-858383-13 devstack@keystone.service[82160]: [pid: 82160|app: 0|req: 4499/8975] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:15:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:15:37.007738 n-d-858383-13 devstack@keystone.service[82160]: DEBUG dbcounter [-] [82160] Writing DB stats keystone:SELECT=9 {{(pid=82160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:16:30.185357 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] Authenticating user token {{(pid=82161) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:16:30.205531 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441525fa-2094-4738-a51d-efb3dc4b30c2 service placement] Validating token access rules against request {{(pid=82161) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:16:30.210882 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ce783-de04-4de5-8d4d-fc6277556ffe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211feea67b824d5b8f77e491cc96a022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ddba45e6d543cb82195059710ea7d4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82161) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:16:30.211482 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce783-de04-4de5-8d4d-fc6277556ffe service placement] REQUEST_METHOD: `GET` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:16:30.211760 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce783-de04-4de5-8d4d-fc6277556ffe service placement] SCRIPT_NAME: `/identity` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:16:30.212056 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce783-de04-4de5-8d4d-fc6277556ffe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82161) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:16:30.220552 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ce783-de04-4de5-8d4d-fc6277556ffe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:16:30.222142 n-d-858383-13 devstack@keystone.service[82161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ce783-de04-4de5-8d4d-fc6277556ffe service placement] RBAC: Authorization granted {{(pid=82161) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:16:30.232517 n-d-858383-13 devstack@keystone.service[82161]: [pid: 82161|app: 0|req: 4477/8976] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Oct 18 15:16:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)